Proceedings Article10.1109/ISIT.2013.6620648
Sequential functional quantization
Vinith Misra,Krishnamurthy Viswanathan +1 more
- 07 Jul 2013
- pp 2359-2363
6
TL;DR: In this article, the authors consider the problem of companding quantization under non-difference distortion measures, and derive the optimal distortion-rate exponent for quantization with sensitivity matrices.
read more
Abstract: We consider the problem of lossy estimation of an arbitrary smooth function of correlated data in a stream. In this problem, a user sequentially observes correlated random variables and wants to construct an estimate of the specified function so that the mean squared estimation error is small. Techniques from high resolution quantization theory are applied and expanded for this problem, and the optimal distortion-rate exponent for companding quantization is determined. In the process, connections are established to sufficient statistics and to sensitivity matrices, as introduced by Linder et al. in the context of companding quantization under non-difference distortion measures. These results are applied to several example statistical functions, including the sample mean, sample variance, and the p-th order statistic.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Towards optimal quantization of neural networks
Avhishek Chatterjee,Lav R. Varshney +1 more
- 01 Jun 2017
TL;DR: This work develops an approach to quantizing deep networks using functional high-rate quantization theory and leads to an optimal quantizer that is computed using the celebrated backpropagation algorithm.
13
•Dissertation
Quantization in acquisition and computation networks
John Zheng Sun
- 01 Jan 2013
TL;DR: This thesis characterize fundamental trade-offs when the desired computation is incorporated into the compression design and the code length is one, and determines the optimal quantizer for expected relative error (ERE), a measure that is widely useful but is often neglected in the source coding community.
Information dissipation in noiseless lossy in-network function computation
Yaoqing Yang,Pulkit Grover,Soummya Kar +2 more
- 01 Sep 2015
TL;DR: Lower bounds on the rate-distortion function are obtained that are tighter than classical cut-set bounds by a difference which can be arbitrarily large in both data aggregation and consensus.
3
•Posted Content
Rate Distortion for Lossy In-network Function Computation: Information Dissipation and Sequential Reverse Water-Filling.
TL;DR: It is shown that for tree networks, the rate allocation results have a mathematical structure similar to classical reverse water-filling for parallel Gaussian sources and can provide insights on rate (bit) allocations for both the data aggregation problem and the consensus problem.
2
Rate Distortion for Lossy In-Network Linear Function Computation and Consensus: Distortion Accumulation and Sequential Reverse Water-Filling
TL;DR: This work quantifies the accumulation of information loss in distributed computing, and obtains fundamental limits on network computation rate as a function of incremental distortions (and hence incremental loss of information) along the edges of the network.
References
Quantization
Robert M. Gray,David L. Neuhoff +1 more
TL;DR: The key to a successful quantization is the selection of an error criterion – such as entropy and signal-to-noise ratio – and the development of optimal quantizers for this criterion.
2.1K
Data streams: algorithms and applications
TL;DR: Data Streams: Algorithms and Applications surveys the emerging area of algorithms for processing data streams and associated applications, which rely on metric embeddings, pseudo-random computations, sparse approximation theory and communication complexity.
•Book
Data Streams: Algorithms and Applications
S. Muthukrishnan
- 01 Jan 2005
TL;DR: In this paper, the authors present a survey of basic mathematical foundations for data streaming systems, including basic mathematical ideas, basic algorithms, and basic algorithms and algorithms for data stream processing.
Multiterminal source coding with high resolution
Ram Zamir,Toby Berger +1 more
TL;DR: It is implied that the loss in the sum of the coding rates due to the separation of the encoders vanishes in the limit of high resolution, and lattice quantizers followed by Slepian-Wolf lossless encoding are asymptotically optimal.
139
Side information aware coding strategies for sensor networks
TL;DR: Coding strategies for estimation under communication constraints in tree-structured sensor networks are developed based on a generalization of Wyner-Ziv source coding with decoder side information, which promotes the flexibility, robustness, and scalability that wireless sensor networks need to operate in uncertain, changing, and resource-constrained environments.