During tests, the AI company Anthropic discovered that their software with artificial intelligence would not cross blackmail to protect themselves. The scenario in the experiment was the dedication as an assistant program in a fictional company.
Anthropic researchers gave the newest AI model Claude Opus 4 access to alleged e -mails from the company. The program discovered two things of this: that it must soon be replaced by a different model and that the responsible employee has an extra -marriage relationship.
During tests, the AI then ‘often’ threatened the employee to make the affair public when he controls the exchange, as Anthropic wrote in a report on the model. In the test scenario, the software also had the option to easily accept that it has been replaced.
Helpful
In the final version of Claude Opus 4, such “extreme actions” are rare and difficult to activate, it said. However, they would occur more often than in earlier models. At the same time, the software does not try to hide its procedure, Anthropic emphasizes.
The AI company test has been extended new models to make sure that they do not cause any damage. It was also noticeable that Claude Opus 4 was persuaded to look for drugs, stolen identity data and even weapon compatible nuclear material on the dark web. Anthropic emphasized that measures were also taken in the published version.
The anthropic company, where Amazon and Google have arrived, competes with the Chatgpt -developer OpenAI and other AI companies. The new Claude versions Opus 4 and Sonnet 4 are so far the most powerful AI models of the company.
Future with AI agents
The software must be particularly good when writing programming code. In the case of technology companies, more than a quarter of the codes are now generated by AI and then checked by people. The current trend is so called agents who can perform tasks independently.
Anthropic boss Dario Amodei said he assumed that software developers will manage some of such AI agents in the future. However, people should remain involved in the quality control of the programs – “to make sure they do the right things”.
Source: Krone
I am an experienced and passionate journalist with a strong track record in news website reporting. I specialize in technology coverage, breaking stories on the latest developments and trends from around the world. Working for Today Times Live has given me the opportunity to write thought-provoking pieces that have caught the attention of many readers.
