When one of China’s biggest celebrities, Simon Gong—also known as Gong Jun—released a new music video in June 2022, it quickly attracted 15 million views on the country’s Twitter-like microblogging site Weibo. But the event also stood out for a different reason—one that only eagle-eyed fans might have noticed. The singer in the video was not Gong himself, but a digital replica created by Baidu, a “digital human” powered by artificial intelligence (AI). Likewise, the lyrics and melody were generated by AI, marking the recording as China’s first AI-generated content music video.

Deloitte defines digital humans as AI-powered virtual beings that can produce a whole range of human body language. In recent years, businesses focused on providing round-the-clock services, as well as the media and entertainment industry, are increasingly adopting this nascent technology, aiming to capture a growing market. And as digital humans increasingly populate other sectors like retail, health care, and finance, Emergen Research forecasts that the global market for digital humans will jump to about $530 billion in 2030, from $10 billion in 2020. 

Digital human created by Baidu AI Cloud and modeled after Chinese celebrity, Simon Gong.

“Rising demand is driving the boom of digital humans,” says Shiyan Li, head of the digital human and robotics business at Baidu, which created the digital model-actor, Gong. “In China alone, there are over 400 million ACGN (animation, comics, games, and novel) fans, and an enterprise market worth hundreds of billions of dollars centered on digital humans.” And according to a company that tracks business registrations, Qichacha, China now has more than 280,000 enterprises that engage in digital human-related activities.

different kind of digital

The debut of Baidu’s digital celebrity may not seem like much at first, as the concept of “virtual idols” has been around for years. For example, US virtual influencer Lil Miquela has been appearing alongside real human celebrities in online advertisements and TV commercials since 2016, gaining over three million Instagram followers. However, there is something different about the virtual Chinese star: a digital human with the ability to listen, speak, and interact with real humans at a level never seen before. And Gong’s digital duties are not limited to singing. On the latest update of Baidu App, China’s leading search-plus-feed app, Gong appears on users’ phones, helping with searches and queries using the model-actor’s real voice. Since this interactive search experience was launched in 2021, it has boosted the number of voice search queries on Baidu App by 18.2%.

Baidu AI Cloud first began developing a digital employee in 2019 in collaboration with Shanghai Pudong Development (SPD) Bank. Subsequently, they focused their efforts on building a digital financial advisor to provide a service equivalent to that of a human bank representative when real-life employees were unavailable. Today, SPD Bank says more than 460,000 customers rely on digital humans for banking services and portfolio management each month. “Access to digital humans outside of regular business hours allows SPD Bank to offer 24/7 customer service at low cost and high efficiency,” says a bank representative.

More recently, a Baidu-created virtual anchor provided live commentary in sign language at the 2022 Beijing Winter Games for hearing-impaired viewers. In addition to looking like a real person, the avatar was empowered with speech recognition and sign-language interpretation abilities to ensure rapid and highly accurate input and output. With approximately 430 million people around the world experiencing “disabling” hearing loss, according to the World Health Organization, there is strong potential for this technology to be used to increase their ability to access a wide range of content.

A sign-language interpreter created by Baidu AI

Read More


By: Baidu
Title: A digital human could be your next favorite celebrity—or financial advisor
Sourced From: www.technologyreview.com/2022/07/21/1056335/a-digital-human-could-be-your-next-favorite-celebrity-or-financial-advisor/
Published Date: Thu, 21 Jul 2022 10:16:49 +0000