AI Import 461: 'Alignment Not on Right Track'; FrontierCode; and Synthetic Science Interns
Researchers from UK AISI and Timaeus founded the non-profit organization Sequent to develop alignment methods ensuring the safety of superintelligent systems. Cognition released the FrontierCode benchmark for evaluating code quality, where the best model, Claude Opus 4.8, scored only 13.4% on the hardest level. Also presented are the ChinaHeritaQA dataset for evaluating VLM cultural knowledge about Chinese UNESCO sites and the Xiaomi MiMo-V2.5-Pro-UltraSpeed model with a generation speed of 1000 tokens per second.
Cognition
Alibaba/Qwen
Anthropic
OpenAI
Import AI27.07 · 21:04