Journal Article10.1109/TASLP.2020.3040507
A Knowledge Graph Embedding Approach for Metaphor Processing
18
TL;DR: Wang et al. as mentioned in this paper presented a method for metaphor processing based on knowledge graph (KG) embedding, where each specific metaphor can be represented as a metaphor triple $(target, attribute, source)$.
read more
Abstract: Metaphor is a figure of speech that describes one thing (a target) by mentioning another thing (a source) in a way that is not literally true. Metaphor understanding is an interesting but challenging problem in natural language processing. This paper presents a novel method for metaphor processing based on knowledge graph (KG) embedding. Conceptually, we abstract the structure of a metaphor as an attribute-dependent relation between the target and the source. Each specific metaphor can be represented as a metaphor triple $(target, attribute, source)$ . Therefore, we can model metaphor triples just like modeling fact triples in a KG and exploit KG embedding techniques to learn better representations of concepts, attributes and concept relations. In this way, metaphor interpretation and generation could be seen as KG completion, while metaphor detection could be viewed as a representation learning enhanced concept pair classification problem. Technically, we build a Chinese metaphor KG in the form of metaphor triples based on simile recognition, and also extract concept-attribute collocations to help describe concepts and measure concept relations. We extend the translation-based and the rotation-based KG embedding models to jointly optimize metaphor KG embedding and concept-attribute collocation embedding. Experimental results demonstrate the effectiveness of our method. Simile recognition is feasible for building the metaphor triple resource. The proposed models improve the performance on metaphor interpretation and generation, and the learned representations also benefit nominal metaphor detection compared with strong baselines.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Verb Metaphor Detection via Contextual Relation Learning
Wei Song,Shuhui Zhou,Fu Ruiji,Ting Liu,Lizhen Liu +4 more
- 01 Aug 2021
TL;DR: This article proposed the Metaphor-relation BERT (Mr-BERT) model, which explicitly models the relation between a verb and its grammatical, sentential and semantic contexts.
A survey on computational metaphor processing techniques: from identification, interpretation, generation to application
Mengshi Ge,Rui Mao,Erik Cambria +2 more
TL;DR: This article aims to comprehensively summarize and categorize previous computational metaphor processing approaches regarding metaphor identification, interpretation, generation, and application, and identify future directions for prospective researchers based on comparing the strengths and weaknesses of the previous works.
16
Multiview feature augmented neural network for knowledge graph embedding
TL;DR: Wang et al. as mentioned in this paper proposed a multiview feature augmented neural network (MFAE), which consists of three components (multiview spatial transform, feature fusion convolution and feature information augmentation).
12
Probing Simile Knowledge from Pre-trained Language Models
Weijie Chen,Yongzhu Chang,Rongsheng Zhang,Jiashu Pu,Guandan Chen,Yadong Xi,Yijiang Chen,Chang Su +7 more
- 27 Apr 2022
TL;DR: This paper probes simile knowledge from PLMs to solve the SI and SG tasks in the unified framework of simile triple completion for the first time and adopts a secondary training process with the masked language model (MLM) loss to enhance the prediction diversity of candidate words in the masked position.
10
Probing Simile Knowledge from Pre-trained Language Models
01 Jan 2022
TL;DR: Weijie Chen, Yongzhu Chang, Rongsheng Zhang, Jiashu Pu, Guandan Chen, Le Zhang, Yadong Xi, Yijiang Chen, Chang Su as discussed by the authors .
9
References
•Proceedings Article
Adam: A Method for Stochastic Optimization
Diederik P. Kingma,Jimmy Ba +1 more
- 01 Jan 2015
TL;DR: This work introduces Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments, and provides a regret bound on the convergence rate that is comparable to the best known results under the online convex optimization framework.
138.5K
•Posted Content
Adam: A Method for Stochastic Optimization
Diederik P. Kingma,Jimmy Ba +1 more
TL;DR: In this article, the adaptive estimates of lower-order moments are used for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimate of lowerorder moments.
82.5K
•Posted Content
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
TL;DR: A new language representation model, BERT, designed to pre-train deep bidirectional representations from unlabeled text by jointly conditioning on both left and right context in all layers, which can be fine-tuned with just one additional output layer to create state-of-the-art models for a wide range of tasks.
81.7K
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Jacob Devlin,Ming-Wei Chang,Kenton Lee,Kristina Toutanova +3 more
- 11 Oct 2018
TL;DR: BERT as mentioned in this paper pre-trains deep bidirectional representations from unlabeled text by jointly conditioning on both left and right context in all layers, which can be fine-tuned with just one additional output layer to create state-of-the-art models for a wide range of tasks.
24.6K
•Proceedings Article
Distributed Representations of Words and Phrases and their Compositionality
Tomas Mikolov,Ilya Sutskever,Kai Chen,Greg S. Corrado,Jeffrey Dean +4 more
- 05 Dec 2013
TL;DR: This paper presents a simple method for finding phrases in text, and shows that learning good vector representations for millions of phrases is possible and describes a simple alternative to the hierarchical softmax called negative sampling.