Safety Research Scholar - Human Frontier Labs

Job description preview

From Scale AI’s original posting

About the Program The Human Frontier Collective (HFC) brings researchers and scientists together to tackle consequential problems in AI. In partnership with Scale Labs, we are building a small cohort of researchers to work on the empirical foundations of AI safety. That work includes finding where models fail, checking whether safety controls hold up under pressure in realistic settings, and studying how AI agents (mis-)behave over long-horizon tasks. Scholars take open research questions like these and turn them into work that improves how frontier AI systems are evaluated and safeguarded. Each scholar owns a substantial part of a safety research project. You'll work alongside a mentor from the research question through the experiments to deciding what to test next. Research Areas Mentors will guide Research Scholars on projects in selected AI safety research areas in select AI safety research areas, such as: • AI control and chain-of-thought monitoring: Developing techniques to oversee and constrain AIs, including detecting harmful intent or deception. • Alignment auditing and evaluations: Building scalable methods to test whether models have hidden goals, misaligned behaviors or…