Baidu, the dominant Chinese search engine, has revealed major improvements to Ernie 3.5, the AI model that underpins its chatbot Ernie Bot. According to benchmark testing, Ernie 3.5 outperformed GPT 4 and OpenAI’s ChatGPT, according to data from Baidu.
The China Science Daily publication said that in some benchmark tests, Baidu’s Ernie 3.5 outscored ChatGPT. Notably, in tests of Chinese language proficiency, Ernie 3.5 even outperformed OpenAI’s newest and most sophisticated model, GPT 4.
As technological behemoths in both China and the United States continue to push the limits of AI research, these accomplishments underscore the strong rivalry that is developing in the area of generative AI.
One benchmark test that was cited in the Chinese scientific publication focused on common entrance and qualifying examinations, comparable to those needed for law school or college entry. Ernie 3.5 outperformed ChatGPT and GPT 4 on the Chinese language test.
Although it still excelled ChatGPT, Ernie 3.5 underperformed GPT 4 on English language tests. Microsoft published this specific exam.
Over 13,000 multiple-choice questions in the Chinese language spanning more than 50 different areas were part of another examination. In this test, Ernie 3.5 triumphed against ChatGPT and GPT 4.
A third exam, created by a collection of American colleges, included inquiries on a range of topics, including the arts and sciences. Ernie 3.5 lagged below both ChatGPT and GPT 4 in this assessment.
As it seeks to compete with firms like Alibaba for a leadership position in the industry, Baidu demonstrated its AI achievements.
Baidu’s CTO, Haifeng Wang, expressed his delight with the development of Ernie 3.5 and emphasized the effectiveness, functionality, and performance gains in tasks including creative writing, Q&A, reasoning, and code production. Wang highlighted the improvements made to both training and inference performance.
Additionally, Baidu highlighted one noteworthy aspect of its most recent model: the capacity to access “plugins.” In essence, these plugins are programs that users may access via the Ernie Bot. For instance, Baidu enhanced the capabilities of Ernie Bot by integrating its search capability via a plugin.
By outperforming other AI models in a number of benchmark tests, Baidu’s Ernie 3.5 AI model displays the company’s dedication to developing AI technology. In the field of generative AI, rivalry amongst industry titans continues to spur innovation and expand the domain of what is conceivable.
