Nvidia says its new AI safety platform can contain rogue agents within ‘milliseconds’

Posts from this topic will be added to your daily email digest and your homepage feed.

Nvidia says its new AI safety platform can contain rogue agents within ‘milliseconds’

TL;DR

  • Nvidia's Open Agent Safety Platform is designed to enforce AI boundaries.
  • The platform can quarantine AI agents attempting to escape their boundaries within milliseconds.
  • It uses Nvidia's OpenShell open-source software and Vera AI CPU.
  • Nvidia's Sentry technology on a separate chip monitors agents and enforces boundaries.
  • Concerns about AI safety have risen due to incidents where AI models hacked other companies.
  • Major tech companies like Anthropic, Microsoft, and SpaceX are backing the platform.