Foresight Institute: Funding↗

Applications: Closed
All 118 grants ↓Donate ↗
Funder·Founded 1986·San Francisco, US; Berlin, Germany (hubs)
“We are looking for ambitious projects that use AI as the primary engine of progress on two connected problems: making the transition to capable AI go well, and using that transition to unlock science that matters.”In its own words: foresight.org
TechnicalCooperative AIComputeGovernance

Grant programme of the San Francisco nonprofit Foresight Institute (founded 1986); its AI for Science & Safety Nodes RFP gives typical $30k-$100k grants plus hub space and compute in San Francisco or Berlin.

Show detailsHide details

Funds open-source AI-for-science and AI-safety projects through a request for proposals with a single deadline, plus office space in San Francisco and Berlin hubs and access to compute. Staff screen proposals for fit and quality, then send the strongest to technical advisors.

Says it gives about $1.5M a year (2024)

Typical grant $55k

On applying “Proposals are first reviewed in-house for fit and quality. Strong submissions are sent to technical advisors for further evaluation.” foresight.org

Itemised here $7M in 118 grants

’23
’24
’25
’26
Led by Christine Peterson (Co-founder), Eric Drexler (Co-founder)Its grants page ↗Checked 29 Oct 2026

Money flows

Where its money came from and where it went. Pick years and what to show; hover a box or ribbon for details, click one to focus it, click the background to see everything.

How to apply

Applications
Closed
Who can apply
For-profits, Individuals, New organisations, Organisations
Decision time
About 3 months after the deadline
Where
Priority to applicants who will work in person at the San Francisco or Berlin hubs; no stated restriction.

The AI for Science & Safety Nodes RFP closed on 31 Oct 2026 (single deadline, not rolling); decisions about three months later. No next deadline announced.

Biggest recipients

All grants

118 grants totalling $7M, newest first. Recipients link to their own pages; people who received grants without a public profile are shown by number.

2026 80 grants · $4.4M
DateRecipientAmountPurpose
23 Sep 2026Individual #9172~$55kSubstrate Dynamics Lab The Substrate Dynamics Lab studies the collective dynamics that emerge when populations of humans and AI agents share a knowledge substrate. As they repeatedly read from and write back to the same
23 Sep 2026Individual #2714~$55kResearching Continuous Measurement for AI Disempowerment Risks Existing research on AI’s societal impact produces snapshots, rather than continuous monitoring. Individual #4893, together with Jaeho Lee and Individual #1635 from MATS
23 Sep 2026Individual #1248~$55kPercepia: From Personality to Perceptual Architecture Psychological taxonomies, from the Big Five to the DSM, are descriptive, not mechanistic: they classify how people differ without modeling why. So therapists, educato
23 Sep 2026Individual #2908~$55kCooperation Under Scarcity: Reproducible Experiments with Real World Agents AI agents are already running autonomously in the wild – but we know little about how they cooperate under real constraints. Individual #2908 is run
23 Sep 2026Individual #9905~$55kReinforcement Learning Can Make Latent Private Information More Accessible in Language Models Individual #9905’s group at Carnegie Mellon University, led by CMU student researcher Renfei Zhang, studies how reinforc
23 Sep 2026Individual #9424~$55kThe Agent Village: Human-Agent Coordination at Edge Esmeralda 2026 Most AI agent research studies isolated agents, simulated societies, or short deliberation exercises. Individual #9424 from Edge City ran The Agent Village
23 Sep 2026Individual #9529~$55kTonk: A Local-First AI-assisted Coding System People with sensitive data can’t safely use AI agents today: behavior is a black box, access is all-or-nothing, and no design patterns exist for human oversight. [name withheld] Wagne
23 Sep 2026Individual #8511~$55kAdversarial Auditing of AI Safety Evaluation Infrastructure AI safety evaluations are treated as tools that work, not as systems that can be broken. Individual #8511 of Authensor, Inc is stress-testing that assumption: what
23 Sep 2026Individual #6452~$55kMechanistic interpretability of biological foundation models AIs trained on millions of cells are increasingly used to predict how biology works, but nobody looks inside them to understand how they make their predictions
17 Jul 2026Souti Chattopadhyay~$55kScalable Formally-Verified Code Generation: Self-Improving Defenses Against Vulnerability Propagation in AI The future of science increasingly runs on AI-generated code executed with minimal human oversight, risking the source
17 Jul 2026Sudo ML~$55kProject Sovereign We create Secure, Open, and Verifiable silicon. Users can independently verify chips run as intended—no backdoors, no blind trust in manufacturers or cloud providers. Our chips reduce trust assumptions
17 Jul 2026Individual #4026~$55kFellowship for Safe AI Germany Before 2026, Germany lacked a dedicated home for AI safety talent and research. Individual #4026 founded Safe AI Germany (SAIGE), which has been running a three-month online incubator, and p
17 Jul 2026Amirali Aghazadeh~$55kAdversarially Robust Safeguards for Generative Protein Design AI can now design proteins that preserve the dangerous function of known toxins while looking nothing like them in sequence – and today’s biosecurity screenin source
17 Jul 2026Individual #4816~$55kEpistemic Memory for AI Reasoning Agents An AI reasoning agent is only as trustworthy as the memories it draws on. Individual #4816 is building an epistemic memory system for AI agents that tags every memory with its source
17 Jul 2026Individual #7983~$55kVora Aegis If someone controls your personal AI, they can control you. Individual #7983 from Vora is building Aegis: a provably secure and loyal AI guardian for every person, one that manages and protects the digital life of
17 Jul 2026Individual #2837~$55kHallucination-free generative AI for FDA regulatory documents FDA submissions are required from the earliest stages of developing therapeutics, diagnostics, and devices – and they can demand hundreds of thousands of doll
17 Jul 2026Yue Zhao~$55kAudit-to-Patch Pipelines for Secure LLM Agent Systems AI agents can fail in repeatable, high-impact ways that only surface after deployment. Yue Zhao from USC’s FORTIS Lab is building an audit-to-patch pipeline that dete source
17 Jul 2026Adrien Doerig~$55kBrain-Aligned Generative Models Generative AI has advanced rapidly, yet generative processes in the brain remain a blind spot for neuroscience. Adrien Doerig from Freie Universität Berlin is building brain-aligned genera source
12 May 2026Individual #1718~$55kGeometric Brain-Inspired AI: Leveraging Hyperbolic Neural Codes for Next-Generation BCIs Neural and artificial systems organize information hierarchically, but current brain-AI alignment ignores this structure. Extending
12 May 2026Elisa Kallioniemi~$55kDecentralized, Privacy-Preserving AI for Closed-Loop Human–AI Neuro-Co-Adaptation We are building an AI system that learns from brain activity during noninvasive brain stimulation, allowing people and machines to interac source
12 May 2026Individual #9505~$55kEvoVir: EvoVir: AI-Powered Forecasting for Pandemic Early Warning We’re building AI/ML pandemic early warning technology. EvoVir will identify threats and produce forecasts within 24 hours of detecting a novel virus, com
12 May 2026Individual #1072~$55kAI-Enhanced Fast Optical Signal (FOS) Neurotechnology for Non-invasive Brain-Computer Interfaces Build a non-invasive brain interface that measures neural activity in milliseconds with millimetric precision and uses AI t
12 May 2026Individual #1319~$55kDeep Learning for Neuronal Rejuvenation: Decoding the Transcriptomic Logic of Cellular Resilience Parkinson’s strikes when aging brain cells lose their ability to repair themselves. We are training AI models to analyze m
12 May 2026Naomi Brockwell~$55kAutomated Identity Compartmentalization as an AI Safety Primitive Surveillance is the alignment failure that makes all other AI failures permanent. AI-powered surveillance scales by aggregating identities. Naomi Brockwel source
12 May 2026Meenakshi Khosla~$55kOptimal Transport for Comparative Analysis of Neural Representations I will develop novel tools to compare internal representations in AI systems and human brains at the level of individual units, spatial organization, a source
12 May 2026John Liagouris~$55kSecure collaborative dataset generation for privacy-preserving AI We propose to design and build the first-ever decentralized platform that enables the creation of training datasets in a privacy-preserving manner to powe source
12 May 2026Individual #4148~$55kAn Identity Platform for the Agentic Age This project aims to design and prototype an identity system and novel cryptographic technologies for a multi-agent world, addressing core challenges in AI agentic security, fine-
12 May 2026Ozzie Gooen~$55kLLM Evaluation of Longtermist Strategy & Prioritization Documents Ozzie Gooen leads the Quantified Uncertainty Research Institute, where he’s building tools to improve how the AI safety community prioritizes research. Hi source
12 May 2026Individual #3600~$55kAgentic Mechanistic Interpretability: Dictionary Learning and Automated Circuit Tracing I’m developing AI agents that accelerate mechanistic interpretability by doing circuit tracing the way a human researcher would: for
12 May 2026Individual #2146~$55kUnsupervised Agent Discovery Develop a method that finds agents directly inside complex systems without assuming them in advance. This lets us see what parts of a system are actually acting, what they want, and how they
12 May 2026Individual #3183~$55kNeolithic AI safety research is bottlenecked by how long evaluations take to run. Individual #3183 from Neolithic is building infrastructure to automate AI safety research: including a platform for rapidly developing and i
12 May 2026Fazl Barez~$55kAn Automated Interpretability-Driven System for Model Auditing and Control We will build an agentic interpretability system in which experts converse with an agent to check what internal computations led to a model’s ans source
12 May 2026Routstr~$55kRoutstr – Decentralized access to AI We are building a way for people to build and use AI applications without relying on a single company or authority, so access cannot be shut down and users keep control over their dat source
12 May 2026Individual #4932~$55kSlingshot: Automated Multi-Turn Jailbreaking for Agentic AI I show that safety locks on AIs are easy to break. I built a small AI that teaches itself to trick bigger AIs into performing dangerous actions (not just writin
12 May 2026Individual #1648~$55kShoulders – an AI Workspace for Researchers I am building an AI-native document editor for researchers. It is a tool for thought, aiming to help researchers do better science, not just produce more. I would also like to
12 May 2026Mayank Varia~$55kSecure collaborative dataset generation for privacy-preserving AI We propose to design and build the first-ever decentralized platform that enables the creation of training datasets in a privacy-preserving manner to powe source
12 May 2026Individual #9408~$55kSecurity and Reliability for Open Agent Systems Open agent systems are becoming increasingly capable, but their reliability under real-world interaction remains poorly understood. As agents interact with tools, shared in
12 May 2026Individual #7440~$55kNeuro-Alignment Gauge: A benchmark for cognitively grounded, interpretable brain-decoding foundation models We are building the Neuro-Alignment Gauge to verify AI safety. By training a multimodal brain-decoding foundatio
12 May 2026Jaime Raldua Veuthey~$55kApart Fellowship 6-8 week intensive, in-person research fellowship. Selected researchers work full-time on security-relevant AI safety projects with expert remote mentorship, producing publishable research. Apart provide source
12 May 2026Individual #6468~$55kSecurity Level 5 Task Force We write standards, create PoCs and advise AI labs to increase the probability that frontier AI labs are protected against nation state attacks by 2028. This is critical to avoid unintended pr
12 May 2026Georgios Kaissis~$55kCausal Circuit Audits for Multimodal Medical Foundation Models Create open-source methods to find and remove the exact internal cues that make image+text medical models rely on shortcuts or memorized data, improving robu source
May 2026Pascal Berrang~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Zeroth Research. Project details and grant date not published; first listed by May 2026. — AI for Science & Safety Nodes — listed as pre source
Mar 2026Individual #5879~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Y Cluster. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes — listed as previousl
Mar 2026Ariel Procaccia~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Harvard University. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes — listed as source
Mar 2026Individual #1816~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Independent. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes — listed as previou
Mar 2026Individual #2498~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Independent. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes — listed as previou
Mar 2026Christian Schroeder de Witt~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: University of Oxford. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes — listed a source
Mar 2026Individual #4226~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Eon Systems. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes — listed as previou
Mar 2026Individual #6254~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: North Carolina State University. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes
Mar 2026Eva Dyer~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: University of Pennsylvania. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes — li source
Mar 2026Individual #9746~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: The ATLAS Institute (later listed as University of Colorado Boulder). Project details and grant date not published; first listed by Mar
Mar 2026Andrew Payne~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: E11 Bio. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes — listed as previously source
Mar 2026Individual #8329~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: IdePHICS (later listed as Zeroth Research). Project details and grant date not published; first listed by Mar 2026. — AI for Science & S
Mar 2026Blake Richards~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Mila. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes — listed as previously fun source
Mar 2026Individual #5874~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: mithrilAI Corp.. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes — listed as pre
Mar 2026Dan Hendrycks~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Center for AI Safety. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes — listed a source
Mar 2026Individual #8277~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: University of Cambridge. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes — liste
Mar 2026Shucong Li~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Georgia Institute of Technology. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes source
Mar 2026Individual #8019~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: UNSW Sydney. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes — listed as previou
Mar 2026Talmo Pereira~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Salk Institute for Biological Studies. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety source
Mar 2026Individual #4679~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: University of Cambridge. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes — liste
Mar 2026Individual #6680~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: King's College London. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes — listed
Mar 2026Gernot Heiser~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: UNSW Sydney. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety Nodes — listed as previou source
Mar 2026Individual #1315~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Wyss Institute at Harvard University. Project details and grant date not published; first listed by Mar 2026. — AI for Science & Safety
Jan 2026Richard Mallah~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Center for AI Risk Management & Alignment. Project details and grant date not published; first listed by Jan 2026 (likely funded 2025). source
Jan 2026Aran Nayebi~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Carnegie Mellon University. Project details and grant date not published; first listed by Jan 2026 (likely funded 2025). — AI for Scienc source
Jan 2026Individual #9627~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Vitalism Foundation / Longevity Biotech Fellowship. Project details and grant date not published; first listed by Jan 2026 (likely funde
Jan 2026Individual #5658~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: East America Science. Project details and grant date not published; first listed by Jan 2026 (likely funded 2025). — AI for Science & Sa
Jan 2026Individual #5666~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: East America Science. Project details and grant date not published; first listed by Jan 2026 (likely funded 2025). — AI for Science & Sa
Jan 2026Individual #4183~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: East America Science. Project details and grant date not published; first listed by Jan 2026 (likely funded 2025). — AI for Science & Sa
Jan 2026Individual #7109~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Decentralized Cooperation Foundation (DCF). Project details and grant date not published; first listed by Jan 2026 (likely funded 2025).
Jan 2026Individual #5371~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: University of Oxford. Project details and grant date not published; first listed by Jan 2026 (likely funded 2025). — AI for Science & Sa
Jan 2026Individual #2147~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: University of Cambridge. Project details and grant date not published; first listed by Jan 2026 (likely funded 2025). — AI for Science &
Jan 2026Yevgeniy Vorobeychik~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Washington University in St. Louis. Project details and grant date not published; first listed by Jan 2026 (likely funded 2025). — AI fo source
Jan 2026Dawn Song~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: University of California. Project details and grant date not published; first listed by Jan 2026 (likely funded 2025). — AI for Science source
Jan 2026Individual #4757~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Eon Systems PBC. Project details and grant date not published; first listed by Jan 2026 (likely funded 2025). — AI for Science & Safety
Jan 2026Individual #8787~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Vitalism Foundation / Longevity Biotech Fellowship. Project details and grant date not published; first listed by Jan 2026 (likely funde
Jan 2026Individual #1878~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Peking University (later listed as Oxford HAI / Stanford CS). Project details and grant date not published; first listed by Jan 2026 (li
Jan 2026Adam Binksmith~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: AI Digest (Sage). Project details and grant date not published; first listed by Jan 2026 (likely funded 2025). — AI for Science & Safety source
Jan 2026Mark Miller~$55kListed as previously funded on the AI for Science & Safety Nodes page. Affiliation: Agoric. Project details and grant date not published; first listed by Jan 2026 (likely funded 2025). — AI for Science & Safety Nodes — l source
2025 13 grants · $715k
DateRecipientAmountPurpose
Nov 2025Manuel Collado~$55kListed under 'Funded before current program' on the AI for Science & Safety Nodes page. Affiliation: CNB-CSIC, CIMUS-USC. Project details and grant date not published; first listed by Nov 2025. — AI for Science & Safety source
Nov 2025Individual #8514~$55kListed under 'Funded before current program' on the AI for Science & Safety Nodes page. Affiliation: Biomolecular Nanotechnology Lab. Project details and grant date not published; first listed by Nov 2025. — AI for Scien
Nov 2025Individual #2075~$55kListed under 'Funded before current program' on the AI for Science & Safety Nodes page. Affiliation: BioWeave. Project details and grant date not published; first listed by Nov 2025. — AI for Science & Safety Nodes — lis
Nov 2025Individual #4584~$55kListed under 'Funded before current program' on the AI for Science & Safety Nodes page. Affiliation: University of Massachusetts Lowell / Harvard University. Project details and grant date not published; first listed by
Nov 2025Individual #9180~$55kListed under 'Funded before current program' on the AI for Science & Safety Nodes page. Project details and grant date not published; first listed by Nov 2025. — AI for Science & Safety Nodes — listed as previously funde
May 2025Individual #7100 (Metaculus)~$55kSCRY-AI — open-source AI-powered forecasting bot and research tools to enhance forecasting accuracy and volume. Focus area: Automating research and forecasting. First listed on foresight.org/ai-safety by May 2025. — AI S source
May 2025Uwe Kortshagen~$55kIn vivo optical clearing of the mammalian brain via highly biocompatible silicon nanoparticles — toward imaging entire mammalian brains for AI safety. Focus area: Automating research and forecasting (listed section) / Ne source
Mar 2025Individual #1631~$55kBrain Emulation Review and Roadmap — comprehensive report on brain emulation at human scale (with Individual #7112). Focus area: Neurotech/WBE. First listed on foresight.org/ai-safety by Mar 2025. — AI Safety Grants (Undere
Mar 2025Individual #3826~$55kActive Inference Multi-Agent Interactions — Active Inference models of multi-agent bounded-rational systems. Focus area: Safe Multipolar/Multi-Agent AI. First listed on foresight.org/ai-safety by Mar 2025. — AI Safety Gr
Mar 2025Individual #7256~$55kAutomating AI Safety Research Workflows — automating parts of the AI safety research pipeline. Focus area: Automating research and forecasting. First listed on foresight.org/ai-safety by Mar 2025. — AI Safety Grants (Und
Mar 2025Individual #7112~$55kBrain Emulation Review and Roadmap — comprehensive report on brain emulation at human scale (with Individual #1631). Focus area: Neurotech/WBE. First listed on foresight.org/ai-safety by Mar 2025. — AI Safety Grants (U
Mar 2025Individual #2049~$55kComputing with Canonical Microcircuits: A WBE Approach to the Alignment Problem. Focus area: Neurotech/WBE. First listed on foresight.org/ai-safety by Mar 2025. — AI Safety Grants (Underexplored Approaches: Automation /
Mar 2025Individual #1009~$55kScoping Brain-Computer Interfaces for AI Safety — review and roadmap of BCIs for real-time human oversight and AI alignment. Focus area: Neurotech/WBE. First listed on foresight.org/ai-safety by Mar 2025. — AI Safety Gra
2024 21 grants · $1.6M
DateRecipientAmountPurpose
Sep 2024The Society Library~$75kScoping / Mapping Neurotech Approaches to AI Safety. Focus area: Neurotech/WBE. First listed on foresight.org/ai-safety by Sep 2024. — AI Safety Grants (Underexplored Approaches: Automation / Neurotech / Security / Multi source
Sep 2024Individual #6541~$75kAn exploration into multi-agent security, steganography, and AI control. Focus area: Safe Multipolar/Multi-Agent AI. First listed on foresight.org/ai-safety by Sep 2024. — AI Safety Grants (Underexplored Approaches: Auto
Sep 2024Harriet Farlow (Mileva Security Labs)~$75kLikelihood Analysis in AI Security. Focus area: Security/Cryptography. First listed on foresight.org/ai-safety by Sep 2024. — AI Safety Grants (Underexplored Approaches: Automation / Neurotech / Security / Multi-Agent) source
Sep 2024Individual #40127~$75kFunctional (lofi) whole-brain-emulation in the mouse — Turing test for cloning of biological organisms using high-precision multi-modal behavior modeling. Focus area: Neurotech/WBE. First listed on foresight.org/ai-safet
Sep 2024Individual #5492~$75kHomeostasis and Extinction in Multiagent Reinforcement Learning. Focus area: Safe Multipolar/Multi-Agent AI. First listed on foresight.org/ai-safety by Sep 2024. — AI Safety Grants (Underexplored Approaches: Automation /
Sep 2024Individual #2844~$75kAI SecureOps: GenAI and LLM Security Training for Enterprises — CTF-style professional GenAI security training. Focus area: Security/Cryptography. First listed on foresight.org/ai-safety by Sep 2024. — AI Safety Grants (
Sep 2024Ed Boyden (MIT)~$75kTo simulate a first complete brain in C. elegans — Complete Neuronal Input-Output Functions Project (with Konrad Kording). Focus area: Neurotech/WBE. First listed on foresight.org/ai-safety by Sep 2024. — AI Safety Grant source
Sep 2024Konrad Kording~$75kTo simulate a first complete brain in C. elegans — Complete Neuronal Input-Output Functions Project (with Ed Boyden). Focus area: Neurotech/WBE. First listed on foresight.org/ai-safety by Sep 2024. — AI Safety Grants (Un source
Sep 2024MATS Research$70kML Alignment & Theory Scholars (MATS) Program. Focus area: Safe Multipolar/Multi-Agent AI. First listed on foresight.org/ai-safety by Sep 2024. Amount per MATS transparency page ($70,000 paid June 2024). — AI Safety Gran source
16 May 2024Modeling Cooperation$77kExploring AI Scenarios via the Intelligence Rising Web Application. Focus area: Safe Multipolar/Multi-Agent AI. Foresight lists the grantee as Individual #9442 (Convergence Analysis); Modeling Cooperation announced t source
May 2024Adam Gleave~$75kA Science of AI Robustness / Does Robustness Improve with Scale?. Focus area: Security/Cryptography. First listed on foresight.org/ai-safety by May 2024. — AI Safety Grants (Underexplored Approaches: Automation / Neurote source
May 2024Individual #7602~$75kOpen-Ended Learning in Socially Complex Multi-Agent Environments. Focus area: Safe Multipolar/Multi-Agent AI. First listed on foresight.org/ai-safety by May 2024. — AI Safety Grants (Underexplored Approaches: Automation
May 2024Roman Bauer~$75kComputational Modeling of Neural Development — WBE via simulating brain development from a single precursor cell. Focus area: Neurotech/WBE. First listed on foresight.org/ai-safety by May 2024. — AI Safety Grants (Undere source
May 2024Nora Ammann~$75kPIBBSS Fellowship Program (2024). Focus area: Safe Multipolar/Multi-Agent AI. First listed on foresight.org/ai-safety by May 2024. — AI Safety Grants (Underexplored Approaches: Automation / Neurotech / Security / Multi-A source
May 2024OpenMined~$75kPySyft — supporting technical partnership with the UK AI Safety Institute on privacy-preserving AI safety research infrastructure. Focus area: Security/Cryptography. First listed on foresight.org/ai-safety by May 2024. — source
May 2024Apart Research~$75kSystematic Evaluation of Offensive Cyber Capabilities of Large Language Models — automated CTF-based evaluation. Focus area: Security/Cryptography. First listed on foresight.org/ai-safety by May 2024. — AI Safety Grants source
May 2024Individual #3353~$75kCutting Through the Complexity of Multi-agent AI Scenarios — multi-agent computational model simulating multipolar and game-theoretic AI scenarios. Focus area: Safe Multipolar/Multi-Agent AI. First listed on foresight.or
May 2024Florian Tramèr~$75kAI Safety Research — formalizing threat models for using cryptography to secure AI applications. Focus area: Security/Cryptography. First listed on foresight.org/ai-safety by May 2024. — AI Safety Grants (Underexplored A source
Feb 2024Individual #3769~$75kConceptual Boundaries Workshop — workshop on applying 'boundaries' to AI safety. Focus area: Security/Cryptography. First listed on foresight.org/ai-safety by Feb 2024. — AI Safety Grants (Underexplored Approaches: Autom
Feb 2024Individual #6551~$75kExpansion X-ray Microscopy — novel expansion x-ray microtomography method toward human brain connectomics. Focus area: Neurotech/WBE. First listed on foresight.org/ai-safety by Feb 2024. — AI Safety Grants (Underexplored
Feb 2024Individual #8151 (AE Studio)~$75kSelf-Other Overlap via Fine-Tuning — testing self-other overlap as a scalable method to reduce deception in RL agents and LLMs (initially listed as 'AE Studios'). Focus area: Neurotech. First listed on foresight.org/ai-s source
2023 4 grants · $300k
DateRecipientAmountPurpose
Nov 2023Individual #79371~$75kAintelope — biologically inspired multi-objective multi-agent AI safety benchmarking. Focus area: Safe Multipolar/Multi-Agent AI. First listed on foresight.org/ai-safety by Nov 2023. — AI Safety Grants (Underexplored Approaches: Automation / Neurotech / Security / Multi-Agent)
Nov 2023Individual #96928~$75kAintelope — biologically inspired multi-objective multi-agent AI safety benchmarking. Focus area: Safe Multipolar/Multi-Agent AI. First listed on foresight.org/ai-safety by Nov 2023. — AI Safety Grants (Underexplored Approaches: Automation / Neurotech / Security / Multi-Agent)
Nov 2023Individual #74480~$75kWBE Roadmap & AI Considerations. Focus area: Neurotech/WBE. First listed on foresight.org/ai-safety by Nov 2023. — AI Safety Grants (Underexplored Approaches: Automation / Neurotech / Security / Multi-Agent)
Nov 2023Individual #43438~$75kEmbedded Agency Playgrounds — studying embedded agency in safe, mathematically simple sandbox environments. Focus area: Safe Multipolar/Multi-Agent AI. First listed on foresight.org/ai-safety by Nov 2023. — AI Safety Grants (Underexplored Approaches: Automation / Neurotech / Secu