This repository contains data used in our paper "Evaluating performance of different grammar checking tools." for evaluation of grammar checking tools available online. Till now we have evlaluated following tools:-
- Grammarly (https://www.grammarly.com/)
- Ginger (https://www.gingersoftware.com/grammarcheck)
- ProWrittingAid (https://prowritingaid.com/)
- LanguageTool (https://languagetool.org/)
- AftertheDeadline (https://www.afterthedeadline.com/)
Note : If you are using any data from from this repo, then do cite our paper as mentioned below.
Subham Sahu, Yogesh Kumar Vishwakarma, Jeevanlal kori, Jitendra Singh Thakur . Evaluating performance of different grammar checking tools, International Journal of Advanced Trends in Computer Science and Engineering, Vol. 9 No. 2 pp. 2227 – 2233, April 2020.
We have created a dataset of 500 erroneous sentences anotated with the grammar error types and subtypes. Dataset is equally divided among 5 main grammar error types. Which means 100 sentences for each error type:-
- Sentence Structure error
- Punctuation error
- Spelling error
- Syntax error
- Semantic error.
The erroneous sentences in dataset were used to evaluate the error detection abilities of the five popular grammar checking application.
| Rank | Application | Accuracy(%) |
|---|---|---|
| 1 | Grammarly | 44.40 |
| 2 | ProWrittingAid | 38.60 |
| 3 | LanguageTool | 36.00 |
| 4 | Ginger | 34.60 |
| 5 | After the deadline | 28.74 |