2019 was a banner year for AI. This was also true for NLP (Natural Language Processing) one of most challenging areas in AI.
NLP grades (scores) for high school level reading comprehension went from C (60%) to A (almost 90%). NLP’s ability to provide short answers started exceeding human levels.
Reading Comprehension
RACE measures english reading comprehension at middle and high school. The SOTA (State Of The Art) now achieves grade A (approx. 90%). Additional data relating to RACE can be found at – https://www.cs.cmu.edu/~glai1/data/race/
High School Level Reading Comprehension

Middle School Level Reading Comprehension

RACE Results
For detailed RACE results (or leaderboard), please refer to – http://www.qizhexie.com/data/RACE_leaderboard.html

Short Answers
In 2019, AI also demonstrated its ability to provide short answers better than humans. Detail can be found at – https://rajpurkar.github.io/SQuAD-explorer/
