Issues in Arabic Orthography and Morphology Analysis

This paper discusses several issues in Arabic orthography that were encountered in the process of performing morphology analysis and POS tagging of 542,543 Arabic words in three newswire corpora at the LDC during 2002--2004, by means of the Buckwalter Arabic Morphological Analyzer. The most important issues involved variation in the orthography of Modern Standard Arabic that called for specific changes to the Analyzer algorithm, and also a more rigorous definition of typographic errors. Some orthographic anomalies had a direct impact on word tokenization, which in turn affected the morphology analysis and assignment of POS tags.

• Publication year

  2004

• Venue

  Unknown venue

• Publication date

  2004-08-28

• Fields of study

  Art, Linguistics, Computer Science

• Identifiers
  DOI 10.3115/1621804.1621813
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Modern Written Arabic: A Comprehensive Grammar

  2003cited by this paper

• A Literature Review of Machine Learning Techniques for Cyberbullying Detection in Arabic Social Media Text

  2025cites this paper
• A Survey on Arabic Named Entity Recognition: Past, Recent Advances, and Future Trends

  2023cites this paper
• Ibn-Ginni: An Improved Morphological Analyzer for Arabic

  2023cites this paper
• Advancements in Arabic Grammatical Error Detection and Correction: An Empirical Investigation

  2023cites this paper
• Multi-Lang Question Answering Framework for Decision Support in Educational Institutes

  2023cites this paper
• Towards a Question/Answering System in Moroccan Legal Domain: data preparation and question classification phase using ML approaches

  2023cites this paper
• Machine Learning for Arabic Text Classification: A Comparative Study

  2022cites this paper
• SemG-TS: Abstractive Arabic Text Summarization Using Semantic Graph Embedding

  2022cites this paper
• Combining a Novel Scoring Approach with Arabic Stemming Techniques for Arabic Chatbots Conversation Engine

  2022cites this paper
• ARALD: Arabic Annotation Using Linked Data

  2021cites this paper
• Stemming Algorithm optimization using big data analytics tools

  2021cites this paper
• A fully inflected Arabic verb resource constructed from a lexicon of lemmas by using finite-state transducers

  2021cites this paper
• Exploration of Approaches to Arabic Named Entity Recognition

  2020cites this paper
• Graph-Based Extractive Arabic Text Summarization Using Multiple Morphological Analyzers

  2020cites this paper
• Annotating Arabic Texts with Linked Data

  2020cites this paper
• Computational locality in nonlinear morphophonology

  2020cites this paper
• Romanized Tunisian dialect transliteration using sequence labelling techniques

  2020cites this paper
• On Arabic Stop-Words: A Comprehensive List and a Dedicated Morphological Analyzer

  2019cites this paper
• A Proposed Natural Language Processing Preprocessing Procedures for Enhancing Arabic Text Summarization

  2019cites this paper
• Improving Arabic Lemmatization Through a Lemmas Database and a Machine-Learning Technique

  2019cites this paper
• Reading text with and without diacritics alters brain activation: The case of Arabic

  2019cites this paper
• Transliteration of Arabizi into Arabic Script for Tunisian Dialect

  2019cites this paper
• Arabic Tag Sets: Review

  2018cites this paper
• Un état de l’art du traitement automatique du dialecte tunisien [Natural language processing of the Tunisian dialect: a state of the art]

  2018cites this paper
• Machine Learning Implementations in Arabic Text Classification

  2018cites this paper
• Multi-level skills-based student modeling in an Arabic grammar tutor

  2017cites this paper
• IDENTIFICATION OF GRAMMATICAL FUNCTIONS IN THREE LANGUAGES

  2017cites this paper
• Two Stages Neuro-Fuzzy System for Isolated Arabic Handwritten Character Recognition

  2017cites this paper
• A Comparative Survey on Arabic Stemming: Approaches and Challenges

  2017cites this paper
• LexBank: A Multilingual Lexical Resource for Low-Resource Languages

  2016influential citation
• A new Quranic Corpus rich in morphosyntactical information

  2016cites this paper
• Concatenation Technique for Extracted Arabic Characters for Efficient Content-based Indexing and Searching

  2016cites this paper
• Linking Arabic social media based on similarity and sentiment

  2016cites this paper
• Introducing a probabilistic–structural method for grapheme-to-phoneme conversion in Persian

  2016cites this paper
• Conversational Arabic Automatic Speech Recognition

  2015cites this paper
• Arabic spelling error detection and correction†

  2015cites this paper
• Detecting Plagiarism in Arabic E-Learning Using Text Mining

  2015cites this paper
• Enhanced Tf-Idf Weighting Scheme For Plagiarism Detection Model For Arabic Language

  2015cites this paper
• N-scheme model: An approach towards reducing Arabic language sparseness

  2015cites this paper
• Une métagrammaire de l’interface morpho-sémantique dans les verbes en arabe

  2015cites this paper
• Toward the Resolution of Arabic Lexical Ambiguities with Transduction on Text Automaton

  2015cites this paper
• A complete KALDI recipe for building Arabic speech recognition systems

  2014cites this paper
• Anaphora resolution for Arabic machine translation : a case study of nafs

  2014cites this paper
• GWU-HASP: Hybrid Arabic Spelling and Punctuation Corrector

  2014cites this paper
• Quotations, Relevance and Time Depth: Medieval Arabic Literature in Grids and Networks

  2014cites this paper
• Word sense disambiguation using evolutionary algorithms - Application to Arabic language

  2014cites this paper
• Improving Stemming Algorithm for Arabic Text Search

  2014cites this paper
• Morphological Processing of Semitic Languages

  2014cites this paper
• Developing Attitudes toward Learning Arabic as a Foreign Language among American University and College Students

  2014cites this paper
• Arabic Morphosyntactic Raw Text Part of Speech Tagging System

  2013cites this paper
• Arabic vs. English: Comparative Statistical Study

  2013cites this paper
• Book Reviews: Linguistic Fundamentals for Natural Language Processing: 100 Essentials from Morphology and Syntax by Emily M. Bender

  2013cites this paper
• A New Developed Model for Arabic Information Retrieval System based on Knowledge Base System

  2013cites this paper
• Using Natural Language Processing to Mine Multiple Perspectives from Social Media and Scientific Literature.

  2013cites this paper
• A Hybrid Approach for Arabic Diacritization

  2013cites this paper
• Mixed-Language Arabic- English Information Retrieval

  2013influential citation
• Neural network language models to select the best translation

  2013cites this paper
• Arabic Person Names Recognition by using a Rule based Approach

  2013cites this paper
• A fully inflected Arabic verb resource constructed constructed from a lexicon of lemmas by using finite-state transducers*

  2013cites this paper
• Identifying Opinion Subgroups in Arabic Online Discussions

  2013cites this paper
• Statistical-based System for Morphological Annotation of Arabic Texts

  2013cites this paper
• New approaches to automatic headline generation for Arabic documents

  2012cites this paper
• Approche hybride pour le résumé automatique de textes. Application à la langue arabe. (Hybrid approach for the automatic abstract of texts. Application with the Arab language)

  2012cites this paper
• Arabic Language Analyzer with Lemma Extraction and Rich Tagset

  2012cites this paper
• On morphological relatedness

  2012cites this paper
• Offline printed Arabic character recognition

  2012cites this paper
• Arabic Named Entity Recognition: A Corpus-Based Study

  2012cites this paper
• Arabic morphological analyzer with text to voice

  2012cites this paper
• Detection of Plagiarism in Arabic Documents

  2012cites this paper
• Automatic Headline Generation using Character Cross-Correlation

  2011cites this paper
• Arabic and computer-aided translation: an integrated approach

  2011cites this paper
• The Enhancement of Arabic Stemming by Using Light Stemming and Dictionary-Based Stemming

  2011cites this paper
• Lessons from building a Persian written corpus: Peykare

  2011cites this paper
• Arabic Text to Arabic Sign Language Translation System for the Deaf and Hearing-Impaired Community

  2011cites this paper
• Development of shahmukhi to gurmukhi transliteration system

  2011cites this paper
• First International Workshop on Lexical Resources

  2011cites this paper
• A lexicon of Arabic verbs constructed on the basis of Semitic taxonomy and using finite-state transducers

  2011cites this paper
• The MORPH2 new version: A robust morphological analyzer for Arabic texts

  2010cites this paper
• Building a multi-modal Arabic corpus (MMAC)

  2010cites this paper
• Consistent and Flexible Integration of Morphological Annotation in the Arabic Treebank

  2010cites this paper
• Arabic language modeling with stem-derived morphemes for automatic speech recognition

  2010influential citation
• Rule-based Approach in Arabic Natural Language Processing

  2010cites this paper
• New Statistical And Syntactic Models For Machine Translation

  2010cites this paper
• Analysis of Primary School Arabic Language Textbooks

  2010cites this paper
• The 2010 CMU GALE speech-to-text system

  2010influential citation
• Clitics in Arabic Language: A Statistical Study

  2010cites this paper
• An evaluated semantic query expansion and structure-based approach for enhancing Arabic question/answering

  2010cites this paper
• An evaluated semantic QE and structure-based approach for enhancing Arabic Q/A

  2009cites this paper
• On beyond TM: When the Translator Leads the Design of a Translation Support Framework

  2009cites this paper
• Corpus-based Analysis for Multi-token Units in Persian

  2009cites this paper
• Assessing Word-form based Search for Information in Arabic: Towards a New Type of Lexical Resource

  2009cites this paper
• Arabic Natural Language Processing: Challenges and Solutions

  2009cites this paper
• On Clustering and Evaluation of Narrow Domain Short-Text Corpora

  2009cites this paper
• On Clustering and Evaluation of Narrow Domain Short-Text Corpora

  2008cites this paper
• Arabic Computational Linguistics: Current Implementations

  2008cites this paper
• Architecture and modeling for n-gram-based statistical machine translation

  2008cites this paper
• A Web-Based Approach for Arabic PP Attachment

  2008cites this paper
• Author Profiling for English and Arabic Emails

  2008cites this paper
• Extraction automatique de fréquences lexicales en arabe et analyse d'un corpus journalistique avec le logiciel AraConc et la base de connaissances DIINAR.1

  2008cites this paper
• Dissymétrie entre l’indexation des documents et le traitement des requêtes pour la recherche d’information en langue arabe

  2008cites this paper