Jiatao Gu
92 Papers
657 Citations
Jiatao Gu is an academic researcher from Facebook. The author has contributed to research in topics: Machine translation & Computer science. The author has an hindex of 34, co-authored 92 publications. Previous affiliations of Jiatao Gu include Max Planck Society & University of Hong Kong.
Chat about Author
Papers
Multilingual Denoising Pre-training for Neural Machine Translation
Yinhan Liu,Jiatao Gu,Naman Goyal,Xian Li,Sergey Edunov,Marjan Ghazvininejad,Michael Lewis,Luke Zettlemoyer +7 more
TL;DR: This article proposed mBART, a sequence-to-sequence denoising auto-encoder pre-trained on large-scale monolingual corpora in many languages using the BART objective.
Incorporating Copying Mechanism in Sequence-to-Sequence Learning
Jiatao Gu,Zhengdong Lu,Hang Li,Victor O. K. Li +3 more
- 21 Mar 2016
TL;DR: CopyNet as discussed by the authors incorporates copying into neural network-based Seq2Seq learning and proposes a new model called CopyNet with encoder-decoder structure, which can nicely integrate the regular way of word generation in the decoder with the new copying mechanism which can choose sub-sequences in the input sequence and put them at proper places in the output sequence.
1.5K
•Posted Content
Incorporating Copying Mechanism in Sequence-to-Sequence Learning
TL;DR: This paper incorporates copying into neural network-based Seq2Seq learning and proposes a new model called CopyNet with encoder-decoder structure which can nicely integrate the regular way of word generation in the decoder with the new copying mechanism which can choose sub-sequences in the input sequence and put them at proper places in the output sequence.
1K
•Posted Content
Non-Autoregressive Neural Machine Translation
TL;DR: The authors use knowledge distillation, the use of input token fertilities as a latent variable, and policy gradient fine-tuning to avoid the autoregressive property and produce its outputs in parallel, allowing an order of magnitude lower latency during inference.
834
•Posted Content
Neural Sparse Voxel Fields
TL;DR: This work introduces Neural Sparse Voxel Fields (NSVF), a new neural scene representation for fast and high-quality free-viewpoint rendering that is over 10 times faster than the state-of-the-art (namely, NeRF) at inference time while achieving higher quality results.
825