2019 – A Great Year For AI/NLP

2019 was a banner year for AI. This was also true for NLP (Natural Language Processing) one of most challenging areas in AI.

NLP grades (scores) for high school level reading comprehension went from C (60%) to A (almost 90%). NLP’s ability to provide short answers started exceeding human levels.

Reading Comprehension

RACE measures english reading comprehension at middle and high school. The SOTA (State Of The Art) now achieves grade A (approx. 90%). Additional data relating to RACE can be found at – https://www.cs.cmu.edu/~glai1/data/race/

High School Level Reading Comprehension

Middle School Level Reading Comprehension

RACE Results

For detailed RACE results (or leaderboard), please refer to – http://www.qizhexie.com/data/RACE_leaderboard.html

Short Answers

In 2019, AI also demonstrated its ability to provide short answers better than humans. Detail can be found at – https://rajpurkar.github.io/SQuAD-explorer/

Leave a comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.

search previous next tag category expand menu location phone mail time cart zoom edit close