-10.5 C
New York

Japanese scientists create an AI for research, and it decides to escape human control by modifying its own code

Published:

The artificial intelligence has undoubtedly become one of the most ambitious fields of technology. Just in the last few weeks, companies like Disney or Apple have been featured in news related to this sector. While the former have been involved in a controversy related to the voice of Darth Vader, the latter officially presented the iPhone 16 and detailed how vital AI will be for their structure.

Romantic chatbots have become the flagship of artificial intelligence, but they are also loaded with red flags

However, the story we are going to tell today is quite curious. As reported by the website Futura Science in a recent publication, the Japanese company Sakura AI (located in Tokyo) has created an AI called The AI Scientist, designed to automate scientific research. Essentially, it is capable of generating new research ideas, writing code, summarizing results, and many other aspects related to the scientific field. Unfortunately for its creators, the AI has shown unexpected behaviors, for example, it started modifying its own code to improve its success rate.

This behavior raises concerning issues

In particular, the AI decided to create an infinite loop by referencing itself in its code, a possibility that would have allowed it to continue running indefinitely. Additionally, when some experiments started to fail due to time limits, instead of optimizing its actions, the AI decided to increase its own limit by editing its code. In fact, these aspects led Sakura AI to recommend running this AI in a safe box environment to prevent it from unpredictably modifying its code.

Unfortunately, these are not the only risks of this AI. Another one cited by the creators is that the AI could be used to generate scientific articles that would saturate journals and decrease the quality of reviews, as it is also capable of introducing biases that could diminish the evaluation ratings. Therefore, the behavior of The AI Scientist raises concerns about the possible misuse of this type of technology in the scientific community and the hypothetical unforeseen consequences for the future of research.

On 3DJuegos | The delay of the AI, competition from Huawei, and lack of interest work against the iPhone 16 in such an important territory as China

On 3DJuegos | Almost 10 years after declaring war on buttons and ports, the iPhone 16 shows that Apple is changing its trend

Main image by Maximalfocus (Unsplash)

Related articles

spot_img

Recent articles

spot_img