
Nvidia doesn’t mess around: A week after open AI industry group formed, it’s already showing progress
Quick Answer
Nvidia's Open Secure AI Alliance (OSAA) has rapidly formed the SAFE working group, proposing guidelines for AI cybersecurity incidents.
Quick Take
With over 120 companies, including Adobe and Microsoft, the group aims to enhance open-source security measures amidst rising concerns over AI threats, particularly from Chinese labs.
Key Points
- OSAA has over 120 member companies, including Adobe, BlackRock, and Microsoft.
- The SAFE group is developing proposals for confidential AI cybersecurity incident reporting.
- Nvidia offers open models and a vulnerability scanner named Garak.
- OpenAI and Google, initial supporters, have yet to join the OSAA.
- The group aims to enhance the U.S. open AI ecosystem amid rising global AI threats.
DeepSignal Analysis
What happened
Nvidia's Open Secure AI Alliance (OSAA) has quickly formed the SAFE working group, which focuses on AI cybersecurity guidelines. The group, comprising over 120 companies, is currently soliciting feedback on its proposals, which include reporting AI cybersecurity incidents and conducting blame-free analyses.
Key evidence
- The OSAA, formed just a week ago, has grown to include over 120 companies, indicating rapid industry interest.
- The SAFE working group is developing proposals for reporting AI cybersecurity incidents and alerting affected parties, managed by The Linux Foundation.
- Notable members of the OSAA include Adobe, Microsoft, and Cisco, while Anthropic, OpenAI, and Google are currently absent despite signing an initial open letter supporting the group's formation.
Why it matters
The swift formation of the SAFE working group reflects a proactive approach to addressing AI cybersecurity concerns, particularly in light of potential threats from Chinese labs. The collaboration among major tech companies could lead to enhanced security measures in the open-source AI ecosystem, which is increasingly vital as AI technologies evolve.
📖 Reader Mode
~3 min readThe week-old Open Secure AI Alliance (OSAA), an industry group spearheaded by Nvidia that has already grown to over 120 companies, has developed a cutely named working group, the Shared AI Findings Exchange, or SAFE. The group is already presenting proposals for open comment, and The Linux Foundation, a member of the group, is managing the proposals.
The group developed them while members gathered at the nexus of the cybersecurity world, the Black Hat conference, taking place this week in Las Vegas.
The guidelines are nothing terribly earth shattering for now. The proposals cover areas like how to confidentially report AI cybersecurity incidents, alert those affected, and then do blame-free analysis so all can learn from them.
At the same time, members of the OSAA are also contributing and cataloging bits and pieces of their open source technology that might be useful. This may, as these types of industry organizations go, eventually coalesce into an open source means for an enterprise to secure their AI agents, or defend against rogue AI attackers, such as the OpenAI model that infiltrated Hugging Face. (Hugging Face is also a member of this group.)
For instance, Nvidia has noted that it offers an entire family of open models, as well as an open source LLM vulnerability scanner called Garak; Okta is working on agent identity tech; Red Hat is working on agent governance; Amazon has contributed both an open agent building tool, Strands Agents, and an authorization language Cedar. And there are many more examples.
The group now includes a host of big names including Adobe, BlackRock, Cisco, Intel, Microsoft, and Visa, but there are some notable absences, like Anthropic, OpenAI and Google.
Interestingly, both OpenAI and Google signed the original open letter that spawned this group. The letter, published last week, urged the White House to support open source AI efforts, not squash them. It was championed by Nvidia and signed by over 200 tech companies.
While Anthropic’s cold shoulder to the letter and the industry group to date is not a surprise, both OpenAI and Google have released open weight models of their own. Google is generally known as a big supporter of open source, too. We’ll see if they join as this group builds momentum.
Meanwhile, the group is operating at AI speeds. It’s only been a couple of weeks since news broke that the Trump Administration was considering banning Chinese open weight models, causing the industry consternation that resulted in the open letter.
Whatever ultimately happens with Chinese open weight models in the U.S., the fast-action by this heavyweight group appears to be a good thing for the U.S. open AI ecosystem Some in the ecosystem, like the co-founder and chief technology officer of U.S. open weight AI lab Arcee, say that’s ultimately the way to best any threat — real or imagined — that Chinese AI labs pose to the United States.
“Openness may be one of the most important paths to AI safety and security,” this industry group wrote in their letter. Looks like they are ready to immediately put their effort — and their tech — where their mouths are.
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.
— Originally published at techcrunch.com
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from TechCrunch
See more →
AI chip startup Etched defies skeptics, hits $10.3B valuation from big-name investors
AI chip startup Etched has achieved a $10.3 billion valuation after a $300 million Series C funding round, led by Sequoia and supported by notable investors like Andreessen Horowitz. The company claims to have developed innovative low-voltage chips for AI inference, significantly enhancing performance and reducing costs, with $1 billion in orders already booked.

