Automatic correction of standard Arabic text: Resource and system development

CMU-Q Point of Contact: Kemal Oflazer

AI Summary :

The project "Automatic Correction of Standard Arabic Text: Resource and System Development" aims to create a large corpus of human-corrected Arabic text (QALB) and build a general system (ACLE) for automatically detecting and correcting spelling, lexical choice, and grammar errors in Modern Standard Arabic.

Modern Standard Arabic is a morphologically and syntactically complex language, the understanding of which challenges both humans and machines. We propose to study problems encountered in correcting Arabic text automatically, which addresses errors in spelling, lexical choice, and grammar (morphology and syntax). Our approach is twofold. First, we will build a large corpus (~2M words) of human-corrected Arabic text produced by native speakers, non-native speakers, and machines. The QALB corpus (Qatar Arabic Language Bank) will provide a resource for training and testing automatic-correction systems. QALB's annotations will also support several other Arabic NLP efforts. Secondly, we will build a general system (ACLE) for automatically correcting Arabic-language errors. In developing ACLE, we will investigate and compare various methods for detecting and correcting errors, methods that rely on differing degrees of training-data availability. To compensate for sparsity of error-correction data, our methods will incorporate models that reflect Arabic's complex morphology and orthography. This project will be the first to study automatic Arabic error-correction using large-scale, manually annotated data and will form the basis for a shared-task workshop on Arabic automatic correction.

Project:

NPRP 4 - 1058 - 1 - 168

Start year:

2012

Sponsor:

QNRF

Status:

Closed

Team
image

Kemal Oflazer

Carnegie Mellon University in Qatar
image

Nizar Habash

New York University Abu Dhabi
image

Majd Sakr

Carnegie Mellon University in Qatar
image

Behrang Mohit

Carnegie Mellon University in Qatar