It is shown here that when extrapolation of a sequence of data with unknown statistics is performed under two optimization constraints, viz. maximizing the entropy and maximizing the a posteriori (MAP) probability density function (PDF) of the unknown sample, the resulting estimate is the same as that of an Autoregressive (AR) model. This leads to the conclusion that the estimate from an AR model is optimum in the sense that it is the MAP estimate which maximizes entropy.
ASJC Scopus subject areas
- Electrical and Electronic Engineering