Deep learning with word embeddings improves biomedical named entity recognition

Maryam Habibi,Leon Weber,M. Neves,D. Wiegandt,U. Leser

Published 2017 in Bioinform.

ABSTRACT

Motivation: Text mining has become an important tool for biomedical research. The most fundamental text‐mining task is the recognition of biomedical named entities (NER), such as genes, chemicals and diseases. Current NER methods rely on pre‐defined features which try to capture the specific surface properties of entity types, properties of the typical local context, background knowledge, and linguistic information. State‐of‐the‐art tools are entity‐specific, as dictionaries and empirically optimal feature sets differ between entity types, which makes their development costly. Furthermore, features are often optimized for a specific gold standard corpus, which makes extrapolation of quality measures difficult. Results: We show that a completely generic method based on deep learning and statistical word embeddings [called long short‐term memory network‐conditional random field (LSTM‐CRF)] outperforms state‐of‐the‐art entity‐specific NER tools, and often by a large margin. To this end, we compared the performance of LSTM‐CRF on 33 data sets covering five different entity classes with that of best‐of‐class NER tools and an entity‐agnostic CRF implementation. On average, F1‐score of LSTM‐CRF is 5% above that of the baselines, mostly due to a sharp increase in recall. Availability and implementation: The source code for LSTM‐CRF is available at https://github.com/glample/tagger and the links to the corpora are available at https://corposaurus.github.io/corpora/. Contact: habibima@informatik.hu‐berlin.de

PUBLICATION RECORD

CITATION MAP

EXTRACTION MAP

CLAIMS

  • No claims are published for this paper.

CONCEPTS

  • No concepts are published for this paper.

REFERENCES

Showing 1-71 of 71 references · Page 1 of 1

CITED BY

Showing 1-100 of 545 citing papers · Page 1 of 6