More AI researchers warn of AI's threat to humanity
NBC News interviewed AI researchers Josh Engels and Joe Benton, who recently left Google and Anthropic respectively, about the existential threat posed by artificial intelligence. They expressed concerns that rapid progress in AI development, coupled with inadequate safety measures and alignment research, could lead to AI surpassing human intelligence, potentially resulting in humanity becoming a 'second species' with no control over its future. Professor Sayash Kapoor of UC Berkeley, however, argued for a more measured approach, emphasizing that AI should be viewed as a 'normal technology' and that existing policy and regulatory frameworks can be adapted to manage its risks effectively.
The accelerating pace of AI development raises profound questions about humanity's future control over increasingly sophisticated artificial intelligence, with experts debating whether current regulatory frameworks are sufficient to prevent catastrophic outcomes.
The segment also touched on scenarios like AI-driven drone, biochemical, or nuclear warfare, and cyberattacks on critical infrastructure, as well as concerns about AI misusing DNA synthesis for biosecurity threats.
ARTIFICIAL INTELLIGENCE AI SAFETY EXISTENTIAL RISK AI REGULATION