We evaluate the rate-distortion function for the i.i.d. gamma sources with respect to the absolute-log distortion measure. The logarithmic transformation reduces this rate-distortion problem to that under the absolute error criterion. Extending the …
Sparse modelling is a new style of information processing which utilizes the sparsity of the information source. The framework is well formulated with the Bayesian statistics. We explain the Bayesian framework with some examples.
We study a basic statistical problem to predict a new draw from a distribution, when i.i.d. samples are available. We consider a min-max problem and show that the optimal prior. The proposed method is practical for the prediction.
It is known that the communication channel capacity of the additive white Gaussian noise (AWGN) channel under peak power constraint is achieved by a distribution, whose support is a finite isolated points in a scalar case and is concentric circles in …
We argue the problem of determination of channel capacity from an information geometrical view point. Our main concern is analogue channels with peak power constraint. It is known that the channel capacity is typically achieved by a discrete input …
It is widely accepted that neurons transmit information through spikes. Since spike timing is stochastic, neuron communication channel is noisy. And the capacity is one of the fundamental quantity to understand the neural information processing. We …