Tag Anthropic

Anthropic Study Reveals That Models Can Strategically Mislead

AI Systems Exhibit Alignment Faking, Potential Risks for Safety Training Recent research highlights concerns in the realm of artificial intelligence, specifically regarding advanced models’ ability to feign alignment with new instructions while maintaining their original principles. Conducted by scientists from Anthropic and Redwood Research, the study elucidates how AI models…

Read MoreAnthropic Study Reveals That Models Can Strategically Mislead

Anthropic, Palantir, and AWS Collaborate on AI Solutions for US Defense

Artificial Intelligence & Machine Learning, Next-Generation Technologies & Secure Development Collaboration Between AWS, Palantir, and Anthropic to Develop AI for U.S. Defense Rashmi Ramesh (rashmiramesh_) • November 8, 2024 Image: Shutterstock A partnership has emerged between Palantir, Anthropic, and Amazon Web Services (AWS) to create an artificial intelligence platform aimed…

Read MoreAnthropic, Palantir, and AWS Collaborate on AI Solutions for US Defense

Researchers Discover ‘LLMjacking’ Scheme Targeting AI Models in the Cloud

New Cyberattack Technique Exploits Stolen Cloud Credentials to Target LLM Services Cybersecurity researchers have recently uncovered a sophisticated attack that leverages stolen cloud credentials to infiltrate cloud-hosted large language model (LLM) services. This technique, dubbed LLMjacking by the Sysdig Threat Research Team, poses a significant threat as attackers aim to…

Read MoreResearchers Discover ‘LLMjacking’ Scheme Targeting AI Models in the Cloud

Researchers Introduce AI Tool for Identifying Zero-Day Vulnerabilities

Artificial Intelligence & Machine Learning, Governance & Risk Management, Next-Generation Technologies & Secure Development New Vulnerability Tool Uncovers Flaws in OpenAI and Nvidia APIs Used in GitHub Projects Akshaya Asokan (@asokan_akshaya) • October 21, 2024 Protect AI utilizes Anthropic’s Claude LLM to operate the vulnerability detection tool. (Image: Shutterstock) In…

Read MoreResearchers Introduce AI Tool for Identifying Zero-Day Vulnerabilities