When the information source is a continuous distribution and the rate-distortion function is strictly larger than the Shannon lower bound, the explicit evaluation of the rate-distortion function is not straightforward. We evaluate the rate-distortion …
The channel conditions vary over time in wireless communications. In order to transmit information efficiently, digital wireless communication systems choose the modulation scheme and coding adaptively. This framework is called the adaptive …
Since Shannon's seminal work, channel capacity has been a fundamental quantity in information thoery. The general definition is formulated as an optimization problem of a probability measure under some moment constraints. Similarly, the definition of …
We evaluate the rate-distortion function for the i.i.d. gamma sources with respect to the absolute-log distortion measure. The logarithmic transformation reduces this rate-distortion problem to that under the absolute distortion measure. Extending …
We discuss a nonparametric estimation method of the mixing distribution in mixture models. We propose an objective function with one parameter, where its minimization becomes the maximum likelihood estimation or the kernel vector quantization in …
This article introduces several fundamental concepts in information theory from the perspective of their origins in engineering. Understanding such concepts is important in neuroscience for two reasons. Simply applying formulae from information …
Information transfer through a single neuron is a fundamental component of information processing in the brain, and computing the information channel capacity is important to understand this information processing. The problem is difficult since the …
It is widely believed the neurons transmit information in the form of spikes. Since the spike patterns are known to be noisy, the neuron information channel is noisy. We have investigated the channel capacity of this "Spiking neuron …
The information transfer through a single neuron is a fundamental information processing in the brain and computing the information channel capacity is important to understand the information processing in the brain. In this work, we discuss the …
The information transfer through a single neuron is a fundamental information processing in the brain and computing the information channel capacity is important to understand the information processing in the brain. The problem is difficult since …