SenseTime, a Chinese language AI firm greatest identified for its facial recognition know-how, launched a brand new open supply mannequin on Tuesday that it claims can each generate and interpret photographs far sooner than high fashions developed by US opponents. SenseNova U1 may assist the corporate reclaim misplaced floor after it slipped from its place among the many main gamers in China’s AI growth race.
The mannequin’s secret sauce is its capacity to “learn” photographs with out translating them to textual content first, dashing up the method and decreasing the quantity of computing energy required. “The mannequin’s complete reasoning course of is not restricted to textual content. It will possibly cause with photographs as properly,” Dahua Lin, cofounder and chief scientist at SenseTime, mentioned in an interview with WIRED.
Lin, who can also be a professor of knowledge engineering on the Chinese language College of Hong Kong, says that fashions able to processing photographs immediately will allow robots to raised perceive the bodily world sooner or later.
Like DeepSeek’s newest flagship mannequin, SenseTime says U1 could be powered by Chinese language-made chips. “A number of Chinese language home chipmakers have completed optimizing compatibility with our new mannequin,” Lin says. On launch day, 10 Chinese language chip designers, together with Cambricon and Biren Expertise, introduced their {hardware} helps U1.
That flexibility issues as a result of US export controls limit Chinese language corporations from accessing the world’s most superior AI chips, significantly these used for coaching, which at this level are primarily developed by Western corporations like Nvidia. “We are going to proceed to push for coaching on extra completely different chips,” Lin says. However he additionally acknowledges that SenseTime “should want to make use of one of the best chips to make sure the pace of our iteration.”
SenseTime launched U1 free of charge on Hugging Face and GitHub, one other signal of how Chinese language corporations have gotten a number of the most energetic contributors to open supply AI.
SenseTime was based in 2014 and have become a world chief in laptop imaginative and prescient, which is utilized in functions like facial recognition and autonomous driving. However when ChatGPT and different AI techniques powered by pure language processing turned the most popular factor within the tech trade, SenseTime started struggling to show a revenue and fell behind newer Chinese language startups like DeepSeek and MiniMax.
SenseTime says it hopes that releasing SenseNova-U1 publicly for anybody to make use of will assist it meet up with each home and Western AI gamers. Lin says the corporate lastly made the choice final yr to deal with open supply due to the useful suggestions it will get from researchers, which allows the corporate to iterate sooner. “At the present time, being open supply or closed supply shouldn’t be the successful issue; the pace of iteration is,” Lin explains.
Going open supply additionally helps SenseTime proceed collaborating with worldwide researchers with out the interference of geopolitics. The corporate has been sanctioned repeatedly by the US authorities in recent times over allegations that its facial recognition know-how helped energy surveillance techniques used to observe and detain Uyghurs and different minority teams in China’s Xinjiang area. In consequence, US corporations are restricted from investing in SenseTime and promoting sure applied sciences to it with no license. (SenseTime has denied the allegations.)
Seeing Clearly
In an accompanying technical report, SenseTime claims that SenseNova-U1 generates higher-quality photographs than all different open supply fashions at the moment available on the market. Its efficiency is akin to main Chinese language closed supply fashions like Alibaba’s Qwen and ByteDance’s Seedream, however it nonetheless lags behind trade leaders like GPT-Picture-2.0, which got here out only a week in the past.
However the mannequin’s fundamental promoting level is its capacity to generate photographs a lot sooner than all of these fashions. It depends on an revolutionary technical construction known as NEO-Unify that SenseTime previewed earlier this yr.
