SCIENCE@home

Contextual Stroke Classification in Online Handwritten Documents with Graph Attention Networks

Jun Ye,Yanming Zhang,Qing Yang,Cheng-Lin Liu

Published 2019 in IEEE International Conference on Document Analysis and Recognition

ABSTRACT

Classifying strokes into different categories is an essential preprocessing step in the automatic document understanding process. To tackle this task, it is crucial to integrate different types of contextual information. Previous methods which are based on conditional random fields or recurrent neural networks have some limitations in model capacity or computational cost. In this paper, we propose a novel framework based on graph attention networks to solve this problem, which casts the stroke classification problem into the node classification problem in a document graph. In the graph, each node represents a stroke and the edges are built from temporal and spatial interactions between strokes. Combined graph convolution with attention mechanisms to dynamically aggregate features from the neighborhood, our model is very flexible to control the message passing routine between different nodes and therefore has strong capability learning context-aware features. We perform comparison experiments on the IAMonDo dataset and experimental results demonstrate the superiority of our approach.

PUBLICATION RECORD

  • Publication year

    2019

  • Venue

    IEEE International Conference on Document Analysis and Recognition

  • Publication date

    2019-09-01

  • Fields of study

    Computer Science

  • Identifiers
    DOI 10.1109/ICDAR.2019.00163
  • External record

    Open on Semantic Scholar

  • Source metadata

    Semantic Scholar

CITATION MAP

EXTRACTION MAP

CLAIMS

  • No claims are published for this paper.

CONCEPTS

  • No concepts are published for this paper.

REFERENCES

Showing 1-18 of 18 references · Page 1 of 1

CITED BY

Showing 1-11 of 11 citing papers · Page 1 of 1