Journal Article10.1109/tifs.2023.3262149
FastSecNet: An Efficient Cryptographic Framework for Private Neural Network Inference
4
TL;DR: FastSecNet as discussed by the authors proposes an efficient two-party cryptographic framework for private inference in the dealer-based pre-processing setting, which is built up on a recent advanced cryptographic primitive, function secret sharing (FSS).
read more
Abstract: Private neural network inference has demonstrated great importance in various privacy-critical scenarios. However, the primary challenge remaining in prior works is that the evaluation on encrypted data levies prohibitively high run-time and communication overhead. In this work, we present FastSecNet, an efficient two-party cryptographic framework for private inference in the dealer-based pre-processing setting. Specifically, (1) FastSecNet provides an efficient ReLU protocol for the evalution of non-linear layers, which is built up on a recent advanced cryptographic primitive, function secret sharing (FSS). The core of this construction are an optimized ReLU representation and a customized FSS-based ReLU protocol. (2) For linear layer evaluation, we first propose an efficient PRG-based preprocessing protocol based on the fact that one of the inputs is uniformly random in the offline phase. Then, the online phase only communicates one element and consists of lightweight secret-sharing operations in a ring. Extensive evaluations conducted on 4 real-world datasets and 9 neural network models demonstrate that during the online phase, FastSecNet achieves 14× less runtime and 18× less communication cost compared to the state-of-the-art.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Multi-party privacy-preserving decision tree training with a privileged party
Yiwen Tong
TL;DR: Experimental results indicate that SecureCART is significantly faster than similar schemes proposed in past studies, and that the loss of accuracy while using SecureCART remains within an acceptable range.
3
SiGBDT: Large-Scale Gradient Boosting Decision Tree Training via Function Secret Sharing
Yufan Jiang,Fei Mei,Tser-Ya Dai,Y. Li +3 more
- 01 Jul 2024
3
Compact Key Function Secret Sharing with Non-linear Decoder
NULL AUTHOR_ID,NULL AUTHOR_ID,NULL AUTHOR_ID +2 more
TL;DR: This paper aims to achieve the most compact p -party FSS key size to date, and extends the approach to distributed comparison and interval functions, achieving the most efficient key size to date.
SecureTLM: Private Inference For Transformer-based Large Model With MPC
Yuntian Chen,Xianjia Meng,Zhiying Shi,Zhiyuan Ning,Jingzhi Lin +4 more
TL;DR: SecureTLM, a private inference method for transformer-based large models, utilizes secure multi-party computation (MPC) to protect data privacy without modifying the model structure, ensuring correctness and efficiency in private inference tasks.
References
Deep Residual Learning for Image Recognition
Kaiming He,Xiangyu Zhang,Shaoqing Ren,Jian Sun +3 more
- 27 Jun 2016
TL;DR: In this article, the authors proposed a residual learning framework to ease the training of networks that are substantially deeper than those used previously, which won the 1st place on the ILSVRC 2015 classification task.
•Proceedings Article
Very Deep Convolutional Networks for Large-Scale Image Recognition
Karen Simonyan,Andrew Zisserman +1 more
- 04 Sep 2014
TL;DR: This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers.
102.6K
Gradient-based learning applied to document recognition
Yann LeCun,Léon Bottou,Léon Bottou,Yoshua Bengio,Yoshua Bengio,Yoshua Bengio,Patrick Haffner +6 more
- 01 Jan 1998
TL;DR: In this article, a graph transformer network (GTN) is proposed for handwritten character recognition, which can be used to synthesize a complex decision surface that can classify high-dimensional patterns, such as handwritten characters.
53.5K
Densely Connected Convolutional Networks
Gao Huang,Zhuang Liu,Laurens van der Maaten,Kilian Q. Weinberger +3 more
- 21 Jul 2017
TL;DR: DenseNet as mentioned in this paper proposes to connect each layer to every other layer in a feed-forward fashion, which can alleviate the vanishing gradient problem, strengthen feature propagation, encourage feature reuse, and substantially reduce the number of parameters.
•Posted Content
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size
TL;DR: This work proposes a small DNN architecture called SqueezeNet, which achieves AlexNet-level accuracy on ImageNet with 50x fewer parameters and is able to compress to less than 0.5MB (510x smaller than AlexNet).
Related Papers (5)
K. Kelber,Wolfgang Schwarz +1 more
- 01 Jan 2005
Ingrid Biehl,Bernd Meyer,Susanne Wetzel +2 more
- 01 Jan 1998