AI Outperforms Humans in Language Understanding

Baidu Research has proposed a unified framework, coined as ERNIE 3.0, for pre-training large-scale knowledge enhanced models. Based on this framework, we have trained a 10-billion-parameter model on a massive unsupervised corpus for both natural language understanding (NLU) and generation (NLG) purposes. ERNIE 3.0 achieved new state-of-the-art results across 54 Chinese NLP tasks. Its English model secured first place by yielding a better-than-human performance on SuperGLUE, an authoritative language understanding benchmark. In addition to its language understanding capabilities, ERNIE 3.0 also demonstrated impressive creative writing aptitude through its ability to compose novels, lyrics, poems, and couplets. Find the paper ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation on arXiv: Read the blog for more: #Baidu #AI #NLP #technology #ERNIE #GPT3 #BERT