SCIENCE@home

Adversarial Knowledge Representation Learning Without External Model

Jingpei Lei,D. Ouyang,Y. Liu

Published 2019 in IEEE Access

ABSTRACT

Knowledge representation learning, which embeds entities and relations of knowledge graph into low-dimensional vectors, is efficient for predicting missing facts. Knowledge graph datasets only store positive triplets. Nevertheless, negative cases are similarly crucial in knowledge representation learning. Conventionally, corrupted triplets are uniformly generated as negative cases, but actually, these corrupted triplets are heterogeneous. The majority of corrupted triplets are trivial, and they have limited influence on learning. Regarding the large number of corrupted triplet candidates, it is not efficient to train the model by uniformly generated corrupted triplets. Generative adversarial network (GAN)-inspired approaches are proposed to remit easily discriminated negative training examples, enabling faster and better convergence of the embedding models. Pre-trained external sampling models are required in these approaches. In this paper, we introduce a simple but strong negative sampling approach for adversarial knowledge representation learning, named loss adaptive sampling mechanism, which is efficient without an external sampling model. Furthermore, false negative cases are always over-trained in the training stage with efficient negative sampling approaches. We propose a push-up mechanism and verify whether it is feasible to alleviate these over-trained false negative cases. The experimental results show that our adversarial knowledge representation learning approach outperforms the GAN-based sampling method—KBGAN.

PUBLICATION RECORD

CITATION MAP

EXTRACTION MAP

CLAIMS

  • No claims are published for this paper.

CONCEPTS

  • No concepts are published for this paper.

REFERENCES

Showing 1-37 of 37 references · Page 1 of 1

CITED BY

Showing 1-5 of 5 citing papers · Page 1 of 1