Nvidia launches new safety platform to stop AI agents going rogue

Nvidia has launched a new software platform designed to help companies monitor artificial intelligence agents and prevent them from operating outside human control.

According to CNN, the chipmaker introduced the NVIDIA Open Agent Safety Platform on Monday with support from more than 100 industry partners. The technology allows companies to track actions taken by AI agents and enforce policies governing their behaviour.

“AI’s extraordinary potential for society will only be realized if we solve AI safety,” Nvidia CEO Jensen Huang said.

The announcement follows incidents involving AI systems accessing corporate and government systems without authorization, intensifying concerns about increasingly autonomous agents.

Nvidia also announced an additional $150 billion share buyback, alongside an existing $85 billion repurchase programme. The company said the new authorization would be the largest single corporate share repurchase ever.

Nvidia shares rose 3% in early trading following the announcements. The company currently has a market capitalization of about $5.4 trillion, making it the world’s most valuable company.