AI Safety Grant Program
The call seeks proposals for innovative research or development projects aimed at reducing existential risks from artificial intelligence. The goal is to enhance AI safety through novel approaches in automated research, neurotechnology, AI system security, and multi-agent cooperation, ensuring alignment with the future of AGI development.

Type of projects to be funded
Funding is available for projects that develop high-impact approaches in AI, with a focus on:
Automating AI research and forecasting (e.g., AI-enabled research scaling, advanced forecasting for safe AGI).
Neurotechnology for human-AI collaboration (e.g., Brain-Computer Interfaces, Whole Brain Emulation, lo-fi behavioral modeling).
Security technologies for AI systems (e.g., cryptographic trust frameworks, automated red-teaming, secure AI architectures).
Safe multi-agent AI interactions (e.g., game theory for AI-human cooperation, avoiding collusion, deception, and competitive risks).

Sectors / domain
Artificial intelligence, machine learning, computational neuroscience, cybersecurity, and AI governance.

Call open to individuals, teams, and organizations.
Start-ups, research groups, and academic teams can apply.

Eligible applicants must be:
Established in any country.
Engaged in AI related research and development.
Capable of conducting high-risk, high-reward projects with real-world impact.
Non-profit organizations are eligible.
Applicants must align with AI safety priorities and demonstrate feasibility for near-term AGI timelines.
Specific topics or challenges

Applicants must address at least one of the following challenges:
CH 1: AI-driven forecasting and automation for safe AGI development.
CH 2: Brain-Computer Interfaces or other neurotech solutions for enhancing human-AI interactions.
CH 3: Secure AI system architectures, cryptographic safety, and adversarial resilience.
CH 4: Multi-agent coordination strategies to mitigate risks in AI-human interactions.

Project duration
Flexible, typically ranging from 6 months to 2 years.

Budget limit:
Previous grants ranged from $10,000 to $300,000+.
No strict cap, but applicants must justify requested amounts.

Payments:
Funds may be provided in lump sums or tranches based on milestones.
Multi-year projects will receive funding in stages, contingent upon successful progress.