Anthropic claims its new model is so awesome that they can't release it to the public.
Instead, Anthropic said on Tuesday, it will make the new model — known as Claude Mythos Preview — available to a consortium of more than 40 technology companies, including Apple, Amazon and Microsoft, which will use the model to find and patch security vulnerabilities in critical software programs.
It is curious that most of the big AI companies rely so heavily on the apocalypse narrative. It's almost like they're trying to build a myth around their product.
The coalition, known as Project Glasswing, will include some of Anthropic’s competitors in A.I., such as Google, as well as hardware providers like Cisco and Broadcom, and organizations that maintain critical open-source software, such as the Linux Foundation. Anthropic is committing up to $100 million in Claude usage credits to the effort.
It does sounds plausible that Anthropic or some AI company could produce a new model that is really good at finding and exploiting bugs, but it's also a pretty good way to build hype about a new product -- especially in an industry that is full of constant hyping.
Anthropic said it had no plans to release its new technology more widely, but was announcing the new model’s capabilities in one area in particular — identifying security vulnerabilities in software — in an effort to sound the alarm over what the company believes will be a new, scarier era of A.I. threats.
Dunno. This guy Nicholas Carlini is apparently a super legit security researcher and he's saying the models are much better than him at finding these sorts of vulnerabilities. Seems legit.
Kinda makes sense. Finding vulnerabilities seems like a task well suited for the AI, since they're not being asked to make any judgment calls, just scan through a massive amount of code and identify patterns that give rise to a vulnerability.
Was considering studying for the CEH certification, wonder if these new AI models will come for all cybersecurity jobs next. :| Oh well, it's fun to learn things.
Idk... I'm getting 100s of security list vulns - most of them still suck, but there are definite hits. Also things that are hard to fix.
So honestly, I don't mind the breather so that some of these things actually can go through review before the next crisis.
Here is Anthropic's post about Glasswing: https://www.anthropic.com/glasswing