“EA Funds has chosen to close down the Long-Term Future Fund and launch the Transformative AI Fund in its stead.”In its own words: funds.effectivealtruism.org
A former EA Funds fund that made grants to reduce existential risk, especially from AI. EA Funds has closed it and launched the Transformative AI Fund in its place.
Show detailsHide details
EA Funds' fund for reducing existential risk, mostly from AI. A team of fund managers voted on applications from individuals and small projects. It has now closed and been replaced by the Transformative AI Fund.
Says it gives about $5.4M a year (2024)
Typical grant $36k ($6k–$90k)
Itemised here $25M in 514 grants
’21
’22
’23
’24
’25
’26
Its grants page ↗Checked 29 Oct 2026
Money flows
Where its money came from and where it went. Pick years and what to show; hover a box or ribbon for details, click one to focus it, click the background to see everything.
How to apply
- Applications
- Closed
No longer takes applications or donations; the page points to the Transformative AI Fund (https://funds.effectivealtruism.org/funds/transformative-ai).
Biggest recipients
- Robert Miles$508k
- Individual #3307$495k
- Transformative Futures Institute (TFI)$495k
- Machine Intelligence Research Institute (MIRI)$489k
- Berkeley Existential Risk Initiative$415k
- Alexander Turner$413k
Money from
- Coefficient Giving 2022$4.8M
- FTX Future Fund 2022$3.9M
- Coefficient Giving 2023$3.5M
- Coefficient Giving 2021$2.6M
- Jaan Tallinn 2021$2.4M
- Jaan Tallinn 2023$692k
- Giving What We Can 2025$644k
- Giving What We Can 2026$221k
Gifts and pooled money between funders, as recorded on the site.
All grants
514 grants totalling $25M, newest first. Recipients link to their own pages; people who received grants without a public profile are shown by number.
2026 13 grants · $688k
| Date | Recipient | Amount | Purpose |
|---|---|---|---|
| Jun 2026 | George Mason University | $157k | EA Funds grants database (2026 Q2): Research on AI safety source |
| Jun 2026 | WOMEN WHO DO DATA | $49k | EA Funds grants database (2026 Q2): Research on talent and mentorship in AI safety source |
| Jun 2026 | AI Safety UAE | $14k | EA Funds grants database (2026 Q2): Education and training in AI safety source |
| Jun 2026 | Individual #4351 | $6k | EA Funds grants database (2026 Q2): Direct work in AI safety |
| Jun 2026 | Individual #3882 | $1k | EA Funds grants database (2026 Q2): Research on AI safety |
| Apr 2026 | Individual #40124 | $10k | PhD tutition funding |
| Mar 2026 | Epistea, z.s | $128k | EA Funds grants database (2026 Q1): Educational program and research on AI safety source |
| Mar 2026 | Individual #83924 | $45k | EA Funds grants database (2026 Q1): Community building and research on AI safety |
| Jan 2026 | Lida Safety Research | $121k | A wargame simulation to analyze AI policies intended to prevent catastrophes, for education and statistical research source |
| Jan 2026 | DNAIS | $95k | Funding for Dutch AI Safety Network source |
| Jan 2026 | Individual #1271 | $30k | Stipend to support career exploration (10 weeks+) and a writing project on AI & Germany/Europe |
| Jan 2026 | Individual #2716 | $24k | 6 months of research assistance & miscellaneous admin help provided to Sean O hEigeartaigh, of between 20 - 32 h/week |
| Jan 2026 | Lise du Buisson | $8k | 6th (last) month of active grant with ID: a3rRl000000yduXIAQ (from my grantee portal) source |
2025 16 grants · $889k
| Date | Recipient | Amount | Purpose |
|---|---|---|---|
| Oct 2025 | Iliad | $56k | "Agent Foundations 2026 at CMU" will be a small, 5-day conference on agent foundations research source |
| Oct 2025 | Horizon Omega | $30k | 12 months of Montréal AI safety fieldbuilding and EA meetups source |
| Oct 2025 | Individual #4468 | $20k | 1-year stipend for leading the AI Safety Initiative at Georgia Tech (15-20 hours/week) |
| Oct 2025 | Individual #1943 | $6k | Top-up funding for making a short fiction film on AI x-risk |
| Jul 2025 | Robert Miles | $150k | 1-year funding to produce monthly videos on AI safety and alignment, hiring regular contractors to help expedite thing source |
| Apr 2025 | Individual #9051 | $150k | Stipend and expenses for independent AI alignment research on scaling laws and interpretability |
| Apr 2025 | Epistea, z.s | $115k | Organizing the fifth Human-Aligned AI Summer School (HAAISS), a 4-day conference in Prague for 120 participants source |
| Apr 2025 | Individual #7127 | $45k | 3-month stipend to do independent AI governance research |
| Apr 2025 | Lise du Buisson | $39k | 5-month stipend for career transition, independent research, and public outreach in AI safety and its impact on us source |
| Apr 2025 | Hebrew Universty | $5k | 6-month research extending the landmark Betley et al. emergent misalignment paper through fine-tuning experiments on bas source |
| Apr 2025 | Individual #2796 | $1k | Top-up: Travel funding to attend the workshop on biosecurity and AI safety in the UK |
| Jan 2025 | Individual #8748 | $100k | 1.5 year stipend for thorough investigation and analysis of AI lab scaling policies |
| Jan 2025 | Nicky Case | $80k | 1-year stipend to make accessible-yet-rigorous explainers on AI Alignment/Security, in the form of games/videos/articles source |
| Jan 2025 | Individual #5159 | $50k | 6-months of part-time stipend to launch a new science journalism outlet focused on AI Safety |
| Jan 2025 | Individual #1943 | $25k | Develop a short fiction film at a top film school, to spread accurate and emotive understanding of AI x-risk |
| Jan 2025 | For Collaborative Work with AI:FAR | $17k | 5-months funding for RA work with Sean Ó hÉigeartaigh on AI Governance research assistance / AI:FAR admin assistance source |
2024 109 grants · $4.7M
| Date | Recipient | Amount | Purpose |
|---|---|---|---|
| Oct 2024 | Individual #8761 | $21k | A 4-5 day workshop for agent foundations researchers at Carnegie Mellon University in March, 2025 |
| Oct 2024 | Individual #1340 | $5k | Create an animated video essay explaining how AI could accelerate AI R&D and its implications for AI governance |
| Jul 2024 | Individual #1545 | $160k | 6-month stipends to develop and apply a novel method for localizing information and computation in neural networks |
| Jul 2024 | The AI Governance Archive (TAIGA) | $125k | A private online platform for research-sharing amongst the AI governance community source |
| Jul 2024 | Individual #5722 | $85k | 6-month career transition and independent research in AI safety and risk mitigation |
| Jul 2024 | Individual #2870, Alice Riggs, Individual #2614 | $80k | Developing weight-based decomposition methods for interpretability - MATS extension, 6 months stipend for 2 people source |
| Jul 2024 | Individual #9350 | $80k | Stipend and expenses to run the second Athena mentorship program for gender-minority researchers in technical AI alignment |
| Jul 2024 | Individual #5499 | $80k | 3-month stipend for MATS extension establishing a benchmark for LLMs’ tendency to influence human preferences |
| Jul 2024 | Individual #2055 | $73k | 11 months stipend for 1.5 FTEs and funding for other costs for an AI Safety field-building organization TUTKE in Finland |
| Jul 2024 | Individual #1522 | $70k | 4-month stipend: Research on agent scaling laws—relationships between training compute and agent capabilities of LLMs |
| Jul 2024 | Rauno Arike, Individual #5251 | $60k | 4-month stipend and expenses to create a benchmark for evaluating goal-directedness in language models source |
| Jul 2024 | Individual #2005 | $60k | 4-months stipend to apply mechanistic interpretability to a real-world application, hallucinations |
| Jul 2024 | Individual #5903 | $50k | Mentored independent research and upskilling to transition from theoretical physics PhD to AI safety |
| Jul 2024 | Individual #5073 | $49k | 8 months stipend during job transition, to finish current projects (AI Goodharting, coop. AI) and find suitable next topic |
| Jul 2024 | Individual #3172 | $40k | Develop proposals for off-switch designs for AI, including policy games, that have been rigorously evaluated for their effectiveness, technical feasibility and political viability |
| Jul 2024 | Individual #3096 | $40k | 6 month stipend for SAE-circuits |
| Jul 2024 | Individual #4957 | $40k | 4-month salary for finding and characterising provably hard cases for mechanistic anomaly detection |
| Jul 2024 | Individual #3744 | $40k | Developing noise-injection methods to reveal and reduce deceptive behaviors in language models prior to deployment |
| Jul 2024 | Individual #6097 | $40k | 6-month stipend to remove conditional bad behaviors from LLMs via a learned latent space intervention |
| Jul 2024 | Individual #4854 | $37k | 6-month salary and compute budget for continuing work on mechanistic interpretability for attention layers |
| Jul 2024 | Individual #1587 | $30k | 4-month salary to continue work on AI Control as a MATS extension |
| Jul 2024 | Individual #3751 | $30k | 4-month stipend to continue work on AI Control as a MATS extension |
| Jul 2024 | Individual #4663 | $30k | 4-month stipend to continue work on AI Control as a MATS extension |
| Jul 2024 | Individual #9543 | $27k | 9 months support for an in-depth YouTube channel about AI safety and how AI will impact us all |
| Jul 2024 | Individual #4211 | $27k | 4-month grant to conduct deceptive alignment evaluation research and explore control and mitigation strategies |
| Jul 2024 | Stanford University | $22k | 4-month stipend to bring to completion a mechanistic interpretability research project on how neural networks perform co source |
| Jul 2024 | Individual #3672 | $20k | Researching neural net generalization on algorithmic tasks, upskilling in math relevant to singular learning theory |
| Jul 2024 | Individual #3736 | $16k | 7-month stipend for organising AI Alignment Irvine (AIAI) |
| Jul 2024 | Individual #4058 | $10k | 4-month part-time salary to work on interpretability projects with David Bau and Individual #3096 |
| Jul 2024 | Individual #7773 | $7k | 9-week stipend for two part-time researchers to write and publish a policy proposal: Mandatory AI Safety ‘Red Bonds’ |
| Jul 2024 | Individual #9386 | $6k | Two workshops on strategic communications around AI safety, focused on the AI safety community |
| Jul 2024 | Individual #5572 | $5k | 9-month programme to help language and cognition scientists repurpose their existing skills for long-termist research |
| Jul 2024 | Individual #4053 | $5k | 2 month funding to get into mechanistic interpretability and to do 2-3 projects, than learn briefly related fields |
| Jul 2024 | Individual #2796 | $2k | Travel Funding Request for Early-Career Researcher to Attend Workshop on Biosecurity and AI Safety |
| Apr 2024 | Geneva Centre for Security Policy | $120k | A fellowship for 3 fellows in synthetic biology, artificial intelligence and neurotechnology to bridge policy and tech source |
| Apr 2024 | Individual #4775 | $90k | Year-long stipend to work as the primary maintainer of TransformerLens, and implement large changes to the code base. |
| Apr 2024 | Individual #6108 | $86k | ~4 FTE for 9 months to fund WhiteBox Research, mainly for the 2nd cohort of our AI Interpretability Fellowship in Manila |
| Apr 2024 | Individual #8959 | $80k | 12 month stipend and expenses to research in AI Safety (Unlearning; Modularity; Probing Long-term behaviour) |
| Apr 2024 | Individual #6068 | $78k | 6-month stipend to work on a research project on AI Liability Insurance as an additional lever for AI Safety |
| Apr 2024 | Individual #5099 | $70k | 1-year stipend for independent research primarily on high-level interpretability |
| Apr 2024 | Individual #1420 | $60k | 6-month stipend to continue research on benchmarks for interpretability and on characterizing Goodhart's Law |
| Apr 2024 | University of Texas at Austin | $50k | 3–6 months stipend for first full year as a research professor of CS at UT Austin, researching technical AI alignment source |
| Apr 2024 | Individual #9051 | $45k | 12-month support for independent AI alignment research |
| Apr 2024 | Daniel Filan | $45k | This grant will support Daniel Filan in producing 18 episodes of AXRP, the AI X-risk Research Podcast. The podcast aims to increase in-depth understanding of potential risks from artificial intelligence. source |
| Apr 2024 | Individual #8484 | $40k | 6-months stipend for transitioning to independent research on AI Safety |
| Apr 2024 | Individual #8209 | $36k | 6-month stipend on evaluating robustness of AI agents safety guardrails and for running an AI spear-phishing study |
| Apr 2024 | Individual #5908 | $34k | 6-month salary to finish writing a book on international AI governance and three other smaller AI governance projects |
| Apr 2024 | Individual #2716 | $32k | Funding for 6-Month AI strategy/policy research stay at CSER with Seán Ó hÉigeartaigh & Individual #1686 |
| Apr 2024 | Individual #6203 | $30k | 6-month stipend to work on AI alignment research (automated redteaming, interpretability) |
| Apr 2024 | Individual #4272 | $30k | Development of mathematical language for highly adaptive entities (having stable commitments, not stable mechanisms) |
| Apr 2024 | Individual #1131 | $30k | 6-month stipend to work on safe and robust reasoning via mechanistically interpreting representations |
| Apr 2024 | Individual #3253 | $23k | 5-month salary to continue work on evaluating agent self-improvement capabilities |
| Apr 2024 | Individual #5806 | $20k | 3-month stipend to continue working on goal misgeneralisation project for ICLR deadline, plus travel funding |
| Apr 2024 | Individual #1676 | $13k | 4 weeks expenses for FAR Labs Residency for research group focusing on goal-directedness in transformer models |
| Apr 2024 | Individual #4834 | $13k | 3-month stipend and cloud credits to research AI collusion mitigation strategies and develop secure steganography |
| Apr 2024 | Individual #7398 | $12k | 3-month stipend to support research on the state of AI safety in China and implications for AI existential risk |
| Apr 2024 | Individual #8123 | $11k | 12 week 0.6FT upskilling stipend for technical governance research management |
| Apr 2024 | Individual #5500 | $10k | 4-month stipend for a career transition period to explore roles in AI safety communications |
| Apr 2024 | Individual #6108 | $10k | $10,120 for most of the ops expenses of the research phase (June-Sep 2024) of WhiteBox’s AI Interpretability Fellowship |
| Apr 2024 | Individual #6297 | $10k | 6 month AI alignment internship stipend top-up |
| Apr 2024 | Dioptra (informal research group working on evals) | $9k | Retroactive funding for GameBench paper source |
| Apr 2024 | Individual #1320 | $6k | 8-week stipend for a research project supervised by Individual #2063, PhD, on US regulatory decision-making and Frontier AI |
| Apr 2024 | Horizon Events | $6k | Monthly seminar series on Guaranteed Safe AI, from July to December 2024 source |
| Apr 2024 | Individual #6129 | $6k | 12-week part-time stipend to research specialized AI hardware requirements for large AI training, with IAPS mentor Individual #9660 |
| Apr 2024 | Individual #7718 | $5k | Spend 3 months (part time) assessing plausible pathways to slowing AI |
| Apr 2024 | Individual #8274 | $3k | Seeking funds to present “Benchmark Inflation” at ICML 2024, my paper on making AI progress measures more accurate |
| Apr 2024 | Individual #5386 | $2k | Grant to attend ICLR 2024 for an accepted alignment related paper as an undergraduate student |
| Jan 2024 | Decode Research | $275k | 1 year of stipend + compute + contracts for an AI interpretability research platform for LLMs source |
| Jan 2024 | Epistea, z.s | $160k | Organizing the fourth Human-Aligned AI Summer School (HAAISS), a 4-day conference in Prague/Vienna for 130 participants source |
| Jan 2024 | Thomas Costello | $115k | Experimentally testing generative AI's ability to persuade humans about hazardous topics source |
| Jan 2024 | Timaeus | $100k | Salary Top-Up for Timaeus' Employees & Contractors source |
| Jan 2024 | Lewis Hammond | $87k | Compute costs for experiments to evaluate different scalable oversight protocols source |
| Jan 2024 | AI Safety Australia & New Zealand | $77k | This grant will support Yanni Kyriacos (through Good Ancestors Project) with one year of costs for AI Safety movement building work in Australasia. source |
| Jan 2024 | Individual #8205 | $67k | 4-month stipend for MATS extension on mechanistic interpretability benchmark + 2-month stipend for career switch |
| Jan 2024 | Individual #3459 | $62k | Meta level adversarial evaluation of debate (scalable oversight technique) on simple math problems (MATS 5.0 project) |
| Jan 2024 | Niels uit de Bos | $62k | 4-month salary and office for MATS 5.0 extension on adversarial circuit evaluation + 2-month runway for career switch source |
| Jan 2024 | Individual #2970 | $60k | 6-month stipend for a small group of collaborators to continue research on the Agent Structure Problem |
| Jan 2024 | Individual #4249 | $60k | 4-6 month salary to do circuit-based mech interp on Mamba, as part of the MATS extension program |
| Jan 2024 | Individual #9486 | $56k | 6-month researcher stipend to explore the effect of chat fine-tuning on LLM capability elicitation |
| Jan 2024 | Individual #1421 | $55k | Research on how much language models can infer about their current user, and interpretability work on such inferences |
| Jan 2024 | Individual #9796 | $55k | 6-month stipend to continue independent AI alignment research from MATS 5.0 on situational awareness and deception |
| Jan 2024 | Individual #2054 | $52k | 6 months of funding for MATS 5.0 extension, with projects on latent adversarial training and persona explainability |
| Jan 2024 | Individual #1717 | $50k | 4-month stipend for 3 people to create demonstrations of provably undetectable backdoors |
| Jan 2024 | University of Massachusetts Amherst | $50k | Data collection for a new paradigm for AI alignment based on downstream outcomes and human flourishing source |
| Jan 2024 | Individual #2519 | $41k | Exploring the feasibility of circuit-style analysis on the level of SAE features (MATS extension) |
| Jan 2024 | Individual #5502 | $40k | 6-month stipend to continue independent interpretability research |
| Jan 2024 | Individual #2826 | $40k | 6-month stipend to work on an ML safety project, with the aim of joining a ML safety team full-time after |
| Jan 2024 | Individual #8081 | $40k | 6-month stipend to work on techical alignment research as part of MATS 5.0 extension program |
| Jan 2024 | Individual #8879 | $40k | 4-month stipend to research the mechanisms of refusal in chat LLMs |
| Jan 2024 | Individual #3096 | $40k | 6-month stipend for Sparse Autoencoder Mech Interp projects |
| Jan 2024 | Individual #1418 | $39k | 6-month stipend for conducting AI-safety research during the MATS 5.0 extension program and beyond |
| Jan 2024 | Individual #6139 | $37k | 6-month stipend to do an unpaid internship focused on using theory/interpretability to increase the safety of AI systems |
| Jan 2024 | Individual #4142 | $35k | 6-month salary to verify neural network scalably for RL and produce a human to super-human scalable oversight benchmark |
| Jan 2024 | Individual #8089 | $34k | 4 months of stipend for MATS extension work in London studying the safety implications of LLM self-recognition |
| Jan 2024 | Dioptra (informal research group working on evals) | $32k | This grant will support Josh Clymer and collaborators with summer stipends + research budget to execute technical safety standards projects. source |
| Jan 2024 | Individual #1288 | $30k | 4-month expenses for AI safety research on personas and sandbagging during the MATS 5.0 extension program |
| Jan 2024 | Individual #1210 | $30k | 6-month salary to transition to a career in AI safety while working on AI safety projects |
| Jan 2024 | Individual #2366 | $30k | 4-month stipend to study refusals and jailbreaks in chat LLMs under Neel Nanda as part of the MATS 5.0 extension program |
| Jan 2024 | Individual #7182 | $25k | 4-month stipend to continue AI safety projects |
| Jan 2024 | Individual #8003 | $23k | Four months of funding for a MATS 5.0 extension, working on improving methods in latent adversarial training |
| Jan 2024 | Individual #4741 | $23k | 3-month stipend during post-SERI MATS alignment job search and wrapping up paper w/ mentor |
| Jan 2024 | Individual #5386 | $19k | 1-month pt. stipend for 4 MATS scholars working on autonomous web-browsing LLM agents that can hire humans + safety evals |
| Jan 2024 | Individual #9150 | $18k | MATS 3-month stipend to use singular learning theory to explain & control the development of values in ML systems |
| Jan 2024 | Individual #8284 | $15k | 1-month full-time + 3 months part-time salary to work on two research projects during the MATS 5.0 extension program |
| Jan 2024 | Individual #8208 | $11k | 7 months of coworking-space funding continuation, during interpretability research project |
| Jan 2024 | Individual #6275 | $10k | Virtual AI Safety Unconference 2024 is a collaborative online event by and for researchers of AI safety |
| Jan 2024 | Individual #6816 | $9k | 3 months relocation from Chad to London to work on Eliciting Latent Knowledge with Individual #8144 from Apollo Research |
| Jan 2024 | Individual #8656 | $6k | 1 month long literature review on in-context learning and its relevance to AI alignment |
| Jan 2024 | Individual #5500 | $5k | A podcast mainly themed around AI x-risk, aimed at a non-technical audience |
2023 136 grants · $5.5M
| Date | Recipient | Amount | Purpose |
|---|---|---|---|
| Dec 2023 | Individual #8208 | $80k | May 2023–Mar 2024 payout report (EA Forum appendix): One-year stipend and compute for technical alignment research |
| Dec 2023 | Individual #1420 | $75k | May 2023–Mar 2024 payout report (EA Forum appendix): Six-month stipend for interpretability, control and activation engineering work |
| Dec 2023 | Individual #6108 | $61k | May 2023–Mar 2024 payout report (EA Forum appendix): Nine-month WhiteBox mechanistic interpretability training pilot in Manila |
| Dec 2023 | Existential Risk Observatory | $24k | May 2023–Mar 2024 payout report (EA Forum appendix): AI existential risk events with experts and policymakers source |
| Dec 2023 | Individual #2539 | $5k | May 2023–Mar 2024 payout report (EA Forum appendix): Workshop applying the boundaries concept to AI safety |
| Nov 2023 | Individual #9204 | $50k | May 2023–Mar 2024 payout report (EA Forum appendix): PhD funding for AIXI extensions to reflective agents |
| Nov 2023 | Prompt Human Inc. | $43k | May 2023–Mar 2024 payout report (EA Forum appendix): Six months of model psychology and evaluation research source |
| Nov 2023 | Individual #1851 | $10k | May 2023–Mar 2024 payout report (EA Forum appendix): Compute for a prosocial incentive training technique for LLMs |
| Nov 2023 | Samotsvety Forecasting | $6k | May 2023–Mar 2024 payout report (EA Forum appendix): General support for the Samotsvety forecasting team [forecasting; counted for now] source |
| Nov 2023 | Individual #4223 | $2k | May 2023–Mar 2024 payout report (EA Forum appendix): Compute for an experiment on emergent steganography in language models |
| Oct 2023 | Apart Research | $273k | EA Funds grants database (2023 Q4): 6 months of funding (salaries & ops costs) for AI Safety talent incubation through research sprints and fellowships source |
| Oct 2023 | Catalyze Impact | $123k | EA Funds grants database (2023 Q4): 6-month incubation program for technical AI safety research organizations source |
| Oct 2023 | Nora Ammann | $103k | EA Funds grants database (2023 Q4): 1 year funding for PIBBSS (incl. several programs, e.g. fellowship 2024, affiliate program, reading group) source |
| Oct 2023 | Alignment Ecosystem Development | $99k | EA Funds grants database (2023 Q4): 1-year stipend to continue building and maintaining key digital infrastructure for the AI safety ecosystem source |
| Oct 2023 | Individual #8959 | $72k | May 2023–Mar 2024 payout report (EA Forum appendix): Twelve-month stipend for research on LLM modularity and goal modelling |
| Oct 2023 | Individual #7899 | $61k | EA Funds grants database (2023 Q4): Six month study grant to speed up my career pivot into AI safety and alignment research, with specific deliverables |
| Oct 2023 | Individual #2228 | $42k | May 2023–Mar 2024 payout report (EA Forum appendix): Mechanistic interpretability research mentored by David Bau |
| Oct 2023 | Individual #1311 | $42k | EA Funds grants database (2023 Q4): 6-month 1 FTE funding to train Multi-Objective RLAIF models and compare their safety performance to standard RLAIF |
| Oct 2023 | Individual #3096 | $40k | May 2023–Mar 2024 payout report (EA Forum appendix): Continued sparse autoencoder research for automatic feature discovery |
| Oct 2023 | Individual #2479 | $40k | May 2023–Mar 2024 payout report (EA Forum appendix): Stipend for developmental interpretability and singular learning theory research |
| Oct 2023 | Individual #8843 | $36k | May 2023–Mar 2024 payout report (EA Forum appendix): Stipend to write up sparse coding paper and further research |
| Oct 2023 | Berkeley Existential Risk Initiative | $30k | May 2023–Mar 2024 payout report (EA Forum appendix): Operational support for Team Shard interpretability and steering research source |
| Oct 2023 | Individual #7723 | $28k | May 2023–Mar 2024 payout report (EA Forum appendix): Three-month stipend for MATS work on internal concept extraction |
| Oct 2023 | Individual #3175 | $27k | May 2023–Mar 2024 payout report (EA Forum appendix): Tools for accelerating alignment (Supervising AIs Improving AIs agenda) |
| Oct 2023 | Individual #1640 | $26k | May 2023–Mar 2024 payout report (EA Forum appendix): Six-month stipend for mechanistic interpretability of attention |
| Oct 2023 | Individual #9670 | $15k | May 2023–Mar 2024 payout report (EA Forum appendix): Four weeks building a cryptographic anonymous whistleblower credential tool |
| Oct 2023 | Individual #1420 | $15k | May 2023–Mar 2024 payout report (EA Forum appendix): Retroactive grant for study of Goodhart effects on heavy-tailed distributions |
| Oct 2023 | Individual #6955 | $15k | May 2023–Mar 2024 payout report (EA Forum appendix): Retroactive grant for study of Goodhart effects on heavy-tailed distributions |
| Oct 2023 | Individual #1160 | $11k | May 2023–Mar 2024 payout report (EA Forum appendix): Stipend for AI safety technical and governance research |
| Oct 2023 | Individual #6844 | $8k | May 2023–Mar 2024 payout report (EA Forum appendix): Academic and technical AI safety community events in London |
| Oct 2023 | Individual #8003 | $8k | May 2023–Mar 2024 payout report (EA Forum appendix): Six-month part-time stipend for LM interpretability research |
| Oct 2023 | Individual #7391 | $7k | EA Funds grants database (2023 Q4): 4-month stipend for upskilling within the field of economic governance of AI |
| Oct 2023 | Individual #7886 | $6k | May 2023–Mar 2024 payout report (EA Forum appendix): Support for AI governance projects |
| Oct 2023 | Individual #3769 | $5k | EA Funds grants database (2023 Q4): Funding for having written AI safety distillation posts on the topic of membranes/boundaries |
| Sep 2023 | Individual #4685 | $50k | May 2023–Mar 2024 payout report (EA Forum appendix): Six-month research on AI development and public engagement |
| Sep 2023 | Individual #4109 | $40k | May 2023–Mar 2024 payout report (EA Forum appendix): One year of part-time independent AI interpretability research |
| Sep 2023 | Individual #8123 | $33k | May 2023–Mar 2024 payout report (EA Forum appendix): Six months of AI governance white papers and case studies |
| Sep 2023 | Individual #4612 | $12k | May 2023–Mar 2024 payout report (EA Forum appendix): Three-month SERI MATS research on knowledge-removal techniques |
| Sep 2023 | Individual #4685 | $10k | May 2023–Mar 2024 payout report (EA Forum appendix): Two-month GovAI project on the state of AI development |
| Sep 2023 | Individual #3253 | $8k | May 2023–Mar 2024 payout report (EA Forum appendix): Four-month alignment capacity building and research engineering skills |
| Aug 2023 | Individual #3286 | $70k | May 2023–Mar 2024 payout report (EA Forum appendix): Six-month transition to interpretability research (UMD advising) |
| Aug 2023 | Ossian Labs | $55k | May 2023–Mar 2024 payout report (EA Forum appendix): Debate as a verification tool for agents' outputs source |
| Aug 2023 | Individual #4775 | $50k | May 2023–Mar 2024 payout report (EA Forum appendix): Stipend to build open-source mechanistic interpretability tooling |
| Aug 2023 | Individual #2228 | $48k | May 2023–Mar 2024 payout report (EA Forum appendix): Six-month stipend for interpretability research on attention-head superposition |
| Aug 2023 | Individual #8081 | $5k | May 2023–Mar 2024 payout report (EA Forum appendix): Four-month stipend extending thesis on causal knowledge representation |
| Jul 2023 | Individual #3307 | $200k | EA Funds grants database (2023 Q3): 1-year stipend to continue research on agency, focused on natural abstraction |
| Jul 2023 | Robert Miles | $122k | The grants database gives the following intended use of funds: "1yr salary to make videos and podcasts about AI Safety/Alignment, and build a community to help new people get involved". From Vipul Naik's donations database (via OpenBook) source |
| Jul 2023 | Individual #9570 | $90k | May 2023–Mar 2024 payout report (EA Forum appendix): Six months of experiments on collective human intelligence for alignment |
| Jul 2023 | Individual #5260 | $66k | May 2023–Mar 2024 payout report (EA Forum appendix): Oxford PhD funding plus alignment research tool development |
| Jul 2023 | Neel Nanda | $52k | The grants database gives the following intended use of funds: "6 months of funding for Individual #8266 to work with me (Neel Nanda) on mechanistic interpretability research". From Vipul Naik's donations database (via OpenBook) source |
| Jul 2023 | P.H.I | $42k | 6 to 12 month fundings to continue working on model psychology and evaluation source |
| Jul 2023 | MentaLeap | $40k | EA Funds grants database (2023 Q3): In MentaLeap, cybersecurity experts, AI researchers, and neuroscientists collaborate to reverse-engineer neural networks source |
| Jul 2023 | Individual #5502 | $35k | May 2023–Mar 2024 payout report (EA Forum appendix): Stipend for independent mechanistic interpretability research and open-source tooling |
| Jul 2023 | Nathaniel Sharadin | $33k | EA Funds grants database (2023 Q3): Undergrad buyout to teach AI safety in Hong Kong’s new MA program on AI; China-West AI Safety workshop source |
| Jul 2023 | Individual #4854 | $22k | EA Funds grants database (2023 Q3): 5-month funding to continue upskilling in mechanistic interpretability post-SERI MATs, and to continue open projects |
| Jul 2023 | Individual #2773 | $19k | May 2023–Mar 2024 payout report (EA Forum appendix): Identifying key steps to reduce risks from learned optimisation |
| Jul 2023 | Individual #3079 | $10k | May 2023–Mar 2024 payout report (EA Forum appendix): Move to a Munich mathematics master's programme |
| Jul 2023 | Individual #8263 | $9k | May 2023–Mar 2024 payout report (EA Forum appendix): Part-time AI governance research with lab governance teams |
| Jun 2023 | AI Safety Support Ltd. | $50k | May 2023–Mar 2024 payout report (EA Forum appendix): Six-month stipend and expenses for decision transformer interpretability work source |
| Jun 2023 | Individual #9382 | $12k | May 2023–Mar 2024 payout report (EA Forum appendix): Independent AI safety research and field-building in South Africa |
| Jun 2023 | Individual #9476 | $9k | May 2023–Mar 2024 payout report (EA Forum appendix): Two-month trial of alignment research |
| Jun 2023 | Individual #6076 | $8k | May 2023–Mar 2024 payout report (EA Forum appendix): Six-month alignment curriculum study and summaries |
| Jun 2023 | Individual #8551 | $7k | May 2023–Mar 2024 payout report (EA Forum appendix): AI Safety Camp research on search algorithms in transformers |
| Jun 2023 | Individual #8326 | $7k | May 2023–Mar 2024 payout report (EA Forum appendix): Review of goal misgeneralisation via Active Inference; collective decision-making projects |
| Jun 2023 | Individual #7187 | $2k | May 2023–Mar 2024 payout report (EA Forum appendix): Self-study in ML, AI safety and moral reasoning |
| Jun 2023 | Individual #7378 | $1k | May 2023–Mar 2024 payout report (EA Forum appendix): Scholarship for technical AI alignment upskilling |
| Jun 2023 | Individual #1860 | $500 | May 2023–Mar 2024 payout report (EA Forum appendix): Laptop for ML study and independent AI safety work |
| May 2023 | Individual #9390 | $82k | May 2023–Mar 2024 payout report (EA Forum appendix): Alignment research stipend on value lock-in and minimal paternalism |
| May 2023 | Individual #3612 | $33k | May 2023–Mar 2024 payout report (EA Forum appendix): Extending the Discovering Latent Knowledge paper through SERI MATS |
| May 2023 | Individual #9554 | $32k | May 2023–Mar 2024 payout report (EA Forum appendix): Research stipend (two people) on neural network modularity formalisms |
| May 2023 | Individual #6773 | $32k | May 2023–Mar 2024 payout report (EA Forum appendix): Research stipend on formalisms for modularity in neural networks |
| May 2023 | Individual #6203 | $19k | May 2023–Mar 2024 payout report (EA Forum appendix): PyTorch upskilling and AI safety research, virtual AGISF cohort |
| May 2023 | Individual #8209 | $13k | May 2023–Mar 2024 payout report (EA Forum appendix): Research on shutdown evasion in LLMs and LLM alignment tools |
| Apr 2023 | Alexander Turner | $220k | April 2023 payout report (Jan 2022–Apr 2023): Year-long stipend for shard theory and RL mechanistic interpretability research (approved, not yet paid at time of report) source |
| Apr 2023 | Vanessa Kosoy | $100k | April 2023 payout report (Jan 2022–Apr 2023): Learning-theoretic AI alignment research agenda (half of a 2-year stipend) source |
| Apr 2023 | Jeffrey Ladish (Palisade Research) | $98k | April 2023 payout report (Jan 2022–Apr 2023): Six-month stipend and expenses to start Palisade Research (write-up only, approved, not yet paid at time of report; dated to the report) source |
| Apr 2023 | Individual #4710 | $55k | This grant provides funding for a project that explores debate as a tool that can verify the output of agents which have more domain knowledge than their human counterparts. source |
| Apr 2023 | Individual #3260 | $45k | EA Funds grants database (2023 Q2): This grant is funding a $35,000 stipend plus $10,000 in compute costs for Individual #3260's independent inference-based AI interpretability research. |
| Apr 2023 | Alexander Turner | $40k | EA Funds grants database (2023 Q2): Conference publication of interpretability and LM-steering results source |
| Apr 2023 | Individual #27045 | $40k | 6-month salary to build experience in AI interpretability research before PhD applications |
| Apr 2023 | Individual #1623 | $32k | April 2023 payout report (Jan 2022–Apr 2023): 4-month SERI MATS extension in London on cyborgism |
| Apr 2023 | Individual #6608 | $28k | EA Funds grants database (2023 Q2): 6-month salary for an AISC project and continuing independent mechanistic interpretability projects |
| Apr 2023 | Individual #6351 | $16k | April 2023 payout report (Jan 2022–Apr 2023): 4-month stipend on most interpretable directions in GPT-2-small's residual stream |
| Apr 2023 | Individual #5357 | $14k | April 2023 payout report (Jan 2022–Apr 2023): 6-month stipend to upskill in maths, ML and alignment |
| Apr 2023 | Individual #9092 | $11k | April 2023 payout report (Jan 2022–Apr 2023): 6-month stipend on geometric rationality, ergodicity economics, decision theory |
| Apr 2023 | Robert Long | $11k | April 2023 payout report (Jan 2022–Apr 2023): Workshop on consciousness science and near-term AI (approved, not yet paid at time of report) source |
| Apr 2023 | Individual #6141 | $8k | April 2023 payout report (Jan 2022–Apr 2023): Mathematics of Machine Learning course at UIUC |
| Apr 2023 | Individual #7389 | $6k | April 2023 payout report (Jan 2022–Apr 2023): 6-month upskilling stipend in agent foundations, starting a MIRIx group |
| Apr 2023 | ACX Atlanta | $5k | One year funding of ACX meetup in Atlanta Georgia source |
| Apr 2023 | Individual #2482 | $3k | April 2023 payout report (Jan 2022–Apr 2023): 5-month part-time stipend for paper on implications of compute access |
| Apr 2023 | Individual #1405 | $2k | April 2023 payout report (Jan 2022–Apr 2023): Attend Symposium on AGI Safety at Oxford |
| Apr 2023 | Individual #2654 | $2k | EA Funds grants database (2023 Q2): I'm writing a research paper that introduces an instruction-following generalization benchmark and I need compute funds |
| Mar 2023 | Leap Laboratories (Jessica Rumbelow) | $195k | April 2023 payout report (Jan 2022–Apr 2023): One year seed funding for a new AI interpretability research organisation source |
| Mar 2023 | Individual #8630 | $167k | April 2023 payout report (Jan 2022–Apr 2023): 6-month stipend continuing SERI MATS work extending Discovering Latent Knowledge |
| Mar 2023 | Individual #2990 | $120k | April 2023 payout report (Jan 2022–Apr 2023): 12-month stipend developing LLM tools for alignment research |
| Mar 2023 | Alexander Turner | $115k | April 2023 payout report (Jan 2022–Apr 2023): Research on writing new motivations into a policy network via decision-influences source |
| Mar 2023 | Nora Ammann | $100k | April 2023 payout report (Jan 2022–Apr 2023): PIBBSS research fellowship: six additional fellows source |
| Mar 2023 | Individual #8959 | $70k | EA Funds grants database (2023 Q1): 12-Month Salary and Compute Expenses to do AI Safety Research with LLMs source |
| Mar 2023 | Robert Miles | $55k | April 2023 payout report (Jan 2022–Apr 2023): Additional AISafety.info Distillation Fellowship fellows source |
| Mar 2023 | Individual #9614 | $50k | April 2023 payout report (Jan 2022–Apr 2023): 6-month stipend to upskill in technical AI safety |
| Mar 2023 | Individual #9764 | $45k | April 2023 payout report (Jan 2022–Apr 2023): 9 months for early-career alignment researcher working with Owain Evans |
| Mar 2023 | Individual #4484 | $30k | April 2023 payout report (Jan 2022–Apr 2023): 4-month stipend for research toward world-model interpretability |
| Mar 2023 | Individual #4660 | $29k | April 2023 payout report (Jan 2022–Apr 2023): 6-month stipend for AI alignment research on predictability limits |
| Mar 2023 | Individual #1362 | $26k | April 2023 payout report (Jan 2022–Apr 2023): 6-month stipend for AI safety upskilling and research projects |
| Mar 2023 | Individual #6297 | $24k | April 2023 payout report (Jan 2022–Apr 2023): 3-month SERI MATS extension on agent foundations research |
| Mar 2023 | Individual #7823 | $15k | April 2023 payout report (Jan 2022–Apr 2023): Part-time stipend and developer costs for AI governance document-sharing hub |
| Mar 2023 | Individual #7849 | $9k | April 2023 payout report (Jan 2022–Apr 2023): 8-month support testing fit for AI governance social science research |
| Mar 2023 | Individual #1827 | $4k | April 2023 payout report (Jan 2022–Apr 2023): Attend Redwood Research's REMIX mechanistic interpretability program |
| Mar 2023 | Individual #8449 | $3k | April 2023 payout report (Jan 2022–Apr 2023): Maintaining an alignment research dataset copy in the Arctic World Archive for five years |
| Feb 2023 | Individual #6868, Andrea Miotti, Katrina Joslin (Conjecture) | $73k | April 2023 payout report (Jan 2022–Apr 2023): 2-day workshop connecting US and UK alignment researchers with Japanese AI researchers source |
| Feb 2023 | Individual #6700 | $50k | April 2023 payout report (Jan 2022–Apr 2023): 6-month stipend for circuits research in decision transformers |
| Feb 2023 | Individual #9750 | $30k | April 2023 payout report (Jan 2022–Apr 2023): 6-month stipend for independent formal alignment and agent foundations research |
| Feb 2023 | Wyatt Tessari | $17k | April 2023 payout report (Jan 2022–Apr 2023): 3-month stipend to grow the AGI governance and safety community in Canada source |
| Feb 2023 | Individual #8624 | $11k | April 2023 payout report (Jan 2022–Apr 2023): Compute for fine-tuning LLMs for an interpretability challenge |
| Feb 2023 | Daniel Kokotajlo | $10k | April 2023 payout report (Jan 2022–Apr 2023): Research retreat on decision theory or cause prioritisation source |
| Feb 2023 | Individual #7585 | $10k | April 2023 payout report (Jan 2022–Apr 2023): 1-year stipend for improving alignment researchers' abilities via one-on-one conversations |
| Feb 2023 | Individual #7560 | $8k | April 2023 payout report (Jan 2022–Apr 2023): Transition from AI capabilities to AI safety research |
| Feb 2023 | Individual #2970 | $8k | April 2023 payout report (Jan 2022–Apr 2023): Research stipend to develop a framework of optimisation |
| Feb 2023 | Individual #3469 | $8k | April 2023 payout report (Jan 2022–Apr 2023): 6-week stipend to publish blogposts synthesising Singular Learning Theory |
| Feb 2023 | Individual #1806 | $5k | April 2023 payout report (Jan 2022–Apr 2023): 3-month scholarship for AI safety upskilling (Reward Side-Channels proposal) |
| Feb 2023 | Individual #4132 | $3k | April 2023 payout report (Jan 2022–Apr 2023): Interpretability methods on large language models for AI safety |
| Jan 2023 | Jessica Rumbelow | $195k | One year of seed funding for a new AI interpretability research organisation source |
| Jan 2023 | Individual #9554 | $73k | April 2023 payout report (Jan 2022–Apr 2023): 6-month stipend for two people finding formalisms for neural network modularity |
| Jan 2023 | Individual #2912 | $70k | April 2023 payout report (Jan 2022–Apr 2023): 6-month stipend for distillation and coordination in AI governance and strategy |
| Jan 2023 | Individual #3096 | $40k | EA Funds grants database (2023 Q1): 6-month salary to interpret neurons in language models & build tools to accelerate this process. The aim is to understand all features and circuits in a model and use this understanding to predict out of distribution performance in high-stake s |
| Jan 2023 | Individual #6193 | $35k | April 2023 payout report (Jan 2022–Apr 2023): 8-month stipend for assisting academics, skilling up, personal research |
| Jan 2023 | Individual #29409 | $30k | April 2023 payout report (Jan 2022–Apr 2023): 18 months support for alignment and corrigibility research agenda |
| Jan 2023 | Sam Marks | $26k | April 2023 payout report (Jan 2022–Apr 2023): 3-week stipend for three people reviewing AI alignment agendas source |
| Jan 2023 | Individual #1774 | $25k | April 2023 payout report (Jan 2022–Apr 2023): AI alignment outreach and field-building in France |
| Jan 2023 | Daniel Filan | $24k | April 2023 payout report (Jan 2022–Apr 2023): 12 more episodes of AXRP, the AI X-risk Research Podcast source |
| Jan 2023 | Individual #1038 | $20k | April 2023 payout report (Jan 2022–Apr 2023): 3-month support exploring AI governance careers |
| Jan 2023 | Individual #9382 | $12k | 4 month salary for independent research and AIS field building in South Africa, including working with the AI Safety Hub to coordinate reading groups, research projects and hackathons to empower people to start working on research. source |
| Jan 2023 | Individual #6416 | $10k | April 2023 payout report (Jan 2022–Apr 2023): Human evaluations of ML methods for aligning language models |
| Jan 2023 | Individual #2808 | $8k | April 2023 payout report (Jan 2022–Apr 2023): Scholarship for PhD student working on AI safety research |
| Jan 2023 | Individual #1475 | $6k | April 2023 payout report (Jan 2022–Apr 2023): Cambridge AI Safety group projects, incl. deceptive alignment demonstrations |
| Jan 2023 | Individual #6844 | $2k | April 2023 payout report (Jan 2022–Apr 2023): PhD in AI safety: technical research and community building |
2022 130 grants · $6.8M
| Date | Recipient | Amount | Purpose |
|---|---|---|---|
| Dec 2022 | Individual #9334 | $73k | April 2023 payout report (Jan 2022–Apr 2023): Participant stipends for AI Safety Camp Virtual 2023 |
| Dec 2022 | Individual #3142 | $54k | April 2023 payout report (Jan 2022–Apr 2023): Investigate AI alignment options |
| Nov 2022 | Individual #4214 | $96k | April 2023 payout report (Jan 2022–Apr 2023): 1-year research stipend for upskilling in technical AI alignment research |
| Nov 2022 | Individual #9727 | $50k | April 2023 payout report (Jan 2022–Apr 2023): 1-year stipend and compute for AI safety via debate with LLMs |
| Nov 2022 | Individual #4227 | $40k | April 2023 payout report (Jan 2022–Apr 2023): 6-month stipend for nuclear weapons risk research and AI strategy upskilling |
| Nov 2022 | Individual #1418 | $25k | April 2023 payout report (Jan 2022–Apr 2023): 6-month research stipend on AI manipulation of humans |
| Nov 2022 | Individual #3855 | $24k | April 2023 payout report (Jan 2022–Apr 2023): 6-month stipend for upskilling and framing computational systems into meaningful concepts |
| Nov 2022 | Individual #2058 | $24k | April 2023 payout report (Jan 2022–Apr 2023): 6-month stipend turning intuitions like goals and abilities into computational concepts |
| Nov 2022 | Individual #9156 | $20k | April 2023 payout report (Jan 2022–Apr 2023): 4-month stipend for an early-career alignment researcher testing fit |
| Nov 2022 | Individual #5099 | $15k | April 2023 payout report (Jan 2022–Apr 2023): 4-month funding for independent alignment research and study |
| Nov 2022 | Individual #1931 | $12k | April 2023 payout report (Jan 2022–Apr 2023): 4-month research visit with David Krueger on non-myopia in LLMs |
| Nov 2022 | Individual #8071 | $6k | April 2023 payout report (Jan 2022–Apr 2023): 3-month stipend to skill up in ML and alignment |
| Nov 2022 | Individual #9616 | $5k | April 2023 payout report (Jan 2022–Apr 2023): Support to conduct work in AI safety |
| Nov 2022 | Individual #8318 | $4k | April 2023 payout report (Jan 2022–Apr 2023): Support for AI safety research |
| Oct 2022 | Transformative Futures Institute (TFI) | $495k | Funding to start a longtermist org and support research (EA Funds lists the grantee as Transformative Futures Foresight Institute; TFI works on AI foresight and strategy) source |
| Oct 2022 | Individual #5795 | $210k | April 2023 payout report (Jan 2022–Apr 2023): 2 years of technical safety research on foundation models |
| Oct 2022 | Individual #8208 | $100k | April 2023 payout report (Jan 2022–Apr 2023): Alignment distillation with Team Shard |
| Oct 2022 | Individual #9150 | $96k | April 2023 payout report (Jan 2022–Apr 2023): 12-month alignment research stipend |
| Oct 2022 | Conjecture Ltd | $73k | A 2-day workshop to connect alignment researchers from the US, UK, and AI researchers and entrepreneurs from Japan source |
| Oct 2022 | Daniel Herrmann | $64k | April 2023 payout report (Jan 2022–Apr 2023): PhD on embedded agency, freeing teaching time source |
| Oct 2022 | Individual #3025 | $62k | April 2023 payout report (Jan 2022–Apr 2023): 9-month part-time AI safety research stipend |
| Oct 2022 | Individual #2725 | $55k | April 2023 payout report (Jan 2022–Apr 2023): ML upskilling for prosaic alignment research |
| Oct 2022 | Individual #1908 | $40k | April 2023 payout report (Jan 2022–Apr 2023): 6-month stipend on model-based RL alignment problems |
| Oct 2022 | Individual #5786 | $38k | April 2023 payout report (Jan 2022–Apr 2023): Research in machine learning and computational statistics |
| Oct 2022 | Individual #29409 | $30k | 6 months of independent alignment research and upskilling |
| Oct 2022 | Individual #8843 | $20k | April 2023 payout report (Jan 2022–Apr 2023): Preventing steganography with multiple agents |
| Oct 2022 | Individual #9026 | $10k | April 2023 payout report (Jan 2022–Apr 2023): Set up AI safety groups at Swedish universities |
| Oct 2022 | Individual #6416 | $10k | Funding to perform human evaluations for evaluating different machine learning methods for aligning language models source |
| Oct 2022 | Boston Astral Codex Ten | $4k | Payment for part-time rationality community building source |
| Oct 2022 | Individual #8026 | $2k | April 2023 payout report (Jan 2022–Apr 2023): AI safety research |
| Sep 2022 | Individual #3307 | $180k | April 2023 payout report (Jan 2022–Apr 2023): 1-year stipend for natural abstraction research |
| Sep 2022 | Lone Pine Games, LLC | $100k | EA Funds grants database (2022 Q3): Develop and market video game to explain the Stop Button Problem to the public & STEM individuals source |
| Sep 2022 | Individual #8027 | $60k | April 2023 payout report (Jan 2022–Apr 2023): Transition from academic philosophy to AI alignment |
| Sep 2022 | Individual #8959 | $50k | April 2023 payout report (Jan 2022–Apr 2023): 6-month SERI MATS stipend on theoretical alignment |
| Sep 2022 | Individual #3096 | $40k | April 2023 payout report (Jan 2022–Apr 2023): 6-month stipend on shard theory |
| Sep 2022 | Individual #2170, Luan Ademi | $26k | April 2023 payout report (Jan 2022–Apr 2023): Modularity research and computation budget source |
| Sep 2022 | Individual #5720 | $25k | April 2023 payout report (Jan 2022–Apr 2023): 12-month stipend to move into alignment research |
| Sep 2022 | Individual #2146 | $17k | April 2023 payout report (Jan 2022–Apr 2023): Reverse-engineering human social instincts via brain-like AGI |
| Sep 2022 | Individual #8931 | $7k | April 2023 payout report (Jan 2022–Apr 2023): PhD program support |
| Sep 2022 | Individual #3740 | $5k | April 2023 payout report (Jan 2022–Apr 2023): AI Safety Nudge Competition |
| Aug 2022 | Individual #4109 | $63k | April 2023 payout report (Jan 2022–Apr 2023): AI safety research and concrete projects |
| Aug 2022 | Individual #3364 | $50k | April 2023 payout report (Jan 2022–Apr 2023): Non-fiction book on AGI threat |
| Aug 2022 | Individual #5819 | $36k | April 2023 payout report (Jan 2022–Apr 2023): 3-month independent alignment study |
| Aug 2022 | Individual #4886 | $26k | April 2023 payout report (Jan 2022–Apr 2023): Career exploration and AI alignment project |
| Aug 2022 | Steve Petersen | $21k | April 2023 payout report (Jan 2022–Apr 2023): Research stipend on agency for AI safety source |
| Aug 2022 | Individual #3612 | $16k | April 2023 payout report (Jan 2022–Apr 2023): MLSS scholar upskilling and Berkeley visit |
| Aug 2022 | Individual #5889 | $14k | April 2023 payout report (Jan 2022–Apr 2023): 12-month stipend for AI safety research |
| Aug 2022 | Individual #1368 | $2k | April 2023 payout report (Jan 2022–Apr 2023): Equipment stipend for MLSS scholar |
| Aug 2022 | Individual #5735 | $745 | April 2023 payout report (Jan 2022–Apr 2023): Support for MLSS participation in AI alignment |
| Jul 2022 | Individual #1436 | $100k | April 2023 payout report (Jan 2022–Apr 2023): Video game explaining the Stop Button Problem |
| Jul 2022 | Individual #9535 | $72k | April 2023 payout report (Jan 2022–Apr 2023): Research event for ELK contest winners |
| Jul 2022 | Training for Good | $69k | EU Tech Policy Fellowship with ~10 trainees source |
| Jul 2022 | Newspeak House | $50k | One year of funding to improve an established community hub for EA in London source |
| Jul 2022 | Individual #9390 | $47k | April 2023 payout report (Jan 2022–Apr 2023): Goal-inference and choice-maximisation alignment research |
| Jul 2022 | Individual #2283 | $11k | April 2023 payout report (Jan 2022–Apr 2023): Academic project on factors relevant to digital consciousness |
| Jul 2022 | Individual #3547 | $9k | April 2023 payout report (Jan 2022–Apr 2023): Workshop to evaluate a new alignment research programme |
| Jul 2022 | Individual #5077 | $5k | April 2023 payout report (Jan 2022–Apr 2023): Stanford AI Professional Program tuition |
| Jul 2022 | Individual #4932 | $5k | April 2023 payout report (Jan 2022–Apr 2023): Self-study of ML and neuro/cogsci for AGI safety |
| Jul 2022 | Individual #1775 | $4k | April 2023 payout report (Jan 2022–Apr 2023): Infrabayesianism upskilling before SERI MATS |
| Jul 2022 | Individual #1806 | $1k | April 2023 payout report (Jan 2022–Apr 2023): Technical AI safety upskilling and fit testing |
| Jun 2022 | Individual #4179 | $316k | April 2023 payout report (Jan 2022–Apr 2023): SERI MATS: scaling alignment theorists via mentors |
| Jun 2022 | Nora Ammann | $180k | April 2023 payout report (Jan 2022–Apr 2023): PIBBSS fellowship expansion and local residency source |
| Jun 2022 | Individual #5482 | $79k | April 2023 payout report (Jan 2022–Apr 2023): ML for AI safety work |
| Jun 2022 | Individual #7345 | $70k | April 2023 payout report (Jan 2022–Apr 2023): Overview of current AI alignment research |
| Jun 2022 | Individual #6281 | $60k | April 2023 payout report (Jan 2022–Apr 2023): Paid internships for Oxford students in AI safety |
| Jun 2022 | Individual #4179, Piers de Raveschoot | $27k | April 2023 payout report (Jan 2022–Apr 2023): Retroactive grant for managing MATS 1.0 and 2.0 source |
| Jun 2022 | Individual #3175 | $22k | April 2023 payout report (Jan 2022–Apr 2023): Dataset and tool for alignment research (AISC) |
| Jun 2022 | Individual #5738 | $17k | April 2023 payout report (Jan 2022–Apr 2023): Upskilling for AI governance before Harvard PhD |
| Jun 2022 | Individual #4193 | $15k | April 2023 payout report (Jan 2022–Apr 2023): 6-month stipend for AI alignment research |
| Jun 2022 | Individual #9026 | $15k | April 2023 payout report (Jan 2022–Apr 2023): Distillation course for AI safety theory researchers |
| Jun 2022 | Individual #6844 | $6k | April 2023 payout report (Jan 2022–Apr 2023): PhD in AI safety at Imperial College London |
| Jun 2022 | Individual #9230 | $5k | April 2023 payout report (Jan 2022–Apr 2023): Guide to AI safety researchers for laypeople |
| Jun 2022 | Individual #5149 | $4k | April 2023 payout report (Jan 2022–Apr 2023): Equipment for technical AI safety research |
| Jun 2022 | Individual #2851 | $4k | April 2023 payout report (Jan 2022–Apr 2023): AI policy studies in ML Safety Scholars and Oxford |
| Jun 2022 | Individual #4760 | $2k | April 2023 payout report (Jan 2022–Apr 2023): Co-founder matching weekend for human data org |
| May 2022 | CHERI / Individual #1838 | $135k | April 2023 payout report (Jan 2022–Apr 2023): Stipends for CHERI 2022 summer residence students source |
| May 2022 | Individual #9889 | $125k | April 2023 payout report (Jan 2022–Apr 2023): Investigate origins of modularity in neural networks |
| May 2022 | Wyatt Tessari | $87k | April 2023 payout report (Jan 2022–Apr 2023): Connect and expand AGI safety community in Canada source |
| May 2022 | Individual #4324 | $60k | April 2023 payout report (Jan 2022–Apr 2023): Dissertation on public ethical attitudes toward x-risk |
| May 2022 | Marius Hobbhahn | $50k | April 2023 payout report (Jan 2022–Apr 2023): Pilot program nudging people into AI safety source |
| May 2022 | Individual #8029 | $25k | April 2023 payout report (Jan 2022–Apr 2023): Prosaic alignment research with multimodal chess model |
| May 2022 | Individual #8476 | $14k | April 2023 payout report (Jan 2022–Apr 2023): Research on penalising RL agent betrayal |
| May 2022 | Individual #1867 | $12k | April 2023 payout report (Jan 2022–Apr 2023): Two years of AI safety PhD funding at Oxford |
| May 2022 | Individual #6591 | $10k | April 2023 payout report ([name withheld] 2022–Apr 2023): Language Models as Tools for Alignment |
| May 2022 | Individual #3736 | $10k | April 2023 payout report (Jan 2022–Apr 2023): Gatherings for AI safety discussion over 12 months |
| May 2022 | Individual #9042 | $10k | April 2023 payout report (Jan 2022–Apr 2023): Applied technical AI alignment research |
| May 2022 | Individual #8081 | $5k | April 2023 payout report (Jan 2022–Apr 2023): ML security project on model backdooring |
| May 2022 | Individual #9936 | $3k | April 2023 payout report (Jan 2022–Apr 2023): International viability of FHI's Windfall Clause |
| May 2022 | Individual #2808 | $3k | April 2023 payout report (Jan 2022–Apr 2023): Computer for AI alignment work and fellowship |
| May 2022 | Individual #3035 | $2k | April 2023 payout report (Jan 2022–Apr 2023): Map AI ideal governance research |
| Apr 2022 | Centre for the Governance of AI | $402k | April 2023 payout report (Jan 2022–Apr 2023): Salaries and overheads for academic AI governance group source |
| Apr 2022 | Individual #4462 | $26k | April 2023 payout report (Jan 2022–Apr 2023): Report on emergency powers in x-risk governance |
| Apr 2022 | Individual #9267 | $25k | April 2023 payout report (Jan 2022–Apr 2023): Alignment theory agenda evaluation |
| Apr 2022 | Individual #1927 | $13k | April 2023 payout report (Jan 2022–Apr 2023): Neural network interpretability research |
| Apr 2022 | Individual #9156 | $7k | April 2023 payout report (Jan 2022–Apr 2023): Support for technical AI alignment research |
| Apr 2022 | Individual #9720 | $4k | April 2023 payout report (Jan 2022–Apr 2023): Starting funds for DPhil on safe ML |
| Apr 2022 | Individual #5305 | $4k | April 2023 payout report (Jan 2022–Apr 2023): Equipment for AI safety research |
| Apr 2022 | Individual #4988 | $2k | April 2023 payout report (Jan 2022–Apr 2023): AI Safety Camp project on human dogmatism in training |
| Mar 2022 | Individual #7688 | $234k | April 2023 payout report (Jan 2022–Apr 2023): Trial London organisation to 10x AI safety researchers |
| Mar 2022 | Individual #3532 | $150k | April 2023 payout report (Jan 2022–Apr 2023): Stipend for polysemantic neurons and volunteer alignment research |
| Mar 2022 | Individual #8637 | $110k | April 2023 payout report (Jan 2022–Apr 2023): Third Human-Aligned AI Summer School in Prague |
| Mar 2022 | Individual #8289 | $69k | April 2023 payout report (Jan 2022–Apr 2023): EU Tech Policy Fellowship with about 10 trainees |
| Mar 2022 | Individual #2172 | $6k | April 2023 payout report (Jan 2022–Apr 2023): Research longtermist lessons from COVID |
| Feb 2022 | Individual #1052 | $80k | April 2023 payout report (Jan 2022–Apr 2023): Health coaching for AI safety workers |
| Feb 2022 | Stuart Armstrong | $34k | April 2023 payout report (Jan 2022–Apr 2023): Set up research company in AI alignment source |
| Feb 2022 | Marius Hobbhahn | $30k | April 2023 payout report (Jan 2022–Apr 2023): Research on AI safety source |
| Feb 2022 | Vael Gates | $10k | April 2023 payout report (Jan 2022–Apr 2023): Study on AI researchers' perceptions of safety source |
| Feb 2022 | Individual #7725 | $4k | April 2023 payout report (Jan 2022–Apr 2023): Alignment theory mentorship program with Evan Hubinger |
| Jan 2022 | Individual #9928 | $349k | Amount from EA Funds' grants database |
| Jan 2022 | Individual #9235 | $275k | Amount from EA Funds' grants database |
| Jan 2022 | Berkeley Existential Risk Initiative | $135k | EA Funds grants database (2022 Q1): Help InterACT when university systems cannot, supporting InterACT’s work enabling human-compatible robots and AI agents source |
| Jan 2022 | Columbia University | $90k | Support for AI-safety related CS PhD thesis on enabling AI agents to accurately report their actions source |
| Jan 2022 | Robert Miles | $82k | The grants database gives the following intended use of funds: "1-year salary to make videos and podcasts about AI Safety/Alignment, and to build a community to help new people get involved". From Vipul Naik's donations database (via OpenBook) source |
| Jan 2022 | Lennart Heim | $68k | Amount from EA Funds' grants database source |
| Jan 2022 | Individual #6015 | $50k | April 2023 payout report (Jan 2022–Apr 2023): Support to work on research projects relevant to AI alignment |
| Jan 2022 | Individual #5410 | $50k | April 2023 payout report (Jan 2022–Apr 2023): Support for researching value learning |
| Jan 2022 | Individual #3096 | $40k | April 2023 payout report (Jan 2022–Apr 2023): Support to create LM tools aiding alignment research |
| Jan 2022 | University of Otago, Wellington, New Zealand | $27k | Fund a research fellow to identify island societies that are likely to survive sun-blocking catastrophes and research ways to optimise their chances of survival. source |
| Jan 2022 | Individual #3407 | $24k | Amount from EA Funds' grants database |
| Jan 2022 | Individual #8482 | $23k | EA Funds grants database (2022 Q1): 6-month part-time (20h/week) salary to further develop and refine the feature visualization library Lucent |
| Jan 2022 | Individual #4304 | $22k | Amount from EA Funds' grants database |
| Jan 2022 | Individual #9125 | $22k | Amount from EA Funds' grants database |
| Jan 2022 | Individual #6892 | $18k | Amount from EA Funds' grants database |
| Jan 2022 | Individual #6297 | $16k | EA Funds grants database (2022 Q1): Support to work on AI alignment research |
| Jan 2022 | Individual #9111 | $13k | April 2023 payout report (Jan 2022–Apr 2023): Educational scholarship in AI safety |
| Jan 2022 | Individual #1326 | $13k | Amount from EA Funds' grants database |
| Jan 2022 | Individual #8208 | $12k | Amount from EA Funds' grants database |
| Jan 2022 | Alexander Turner | $7k | EA Funds grants database (2022 Q1): PhD Stipend Top Up for CHAI PhD Student. source |
| Jan 2022 | Alexander Turner | $1k | The grants database gives the following intended use of funds: "Ad campaign for "Optimal Policies Tend To Seek Power" to ML researchers on Twitter". From Vipul Naik's donations database (via OpenBook) source |
| 2022 | Alignment Research Center | $55k | April 2023 payout report (Jan 2022–Apr 2023): Support for a research & networking event for winners of the Eliciting Latent Knowledge contest (separate from the $72,000 Individual #9535 grant for an ELK winners event) source |
2021 49 grants · $3.7M
| Date | Recipient | Amount | Purpose |
|---|---|---|---|
| Dec 2021 | EA Switzerland/PIBBSS Fellowship | $305k | December 2021 payout report (Aug–Dec 2021): 10-12 week summer interdisciplinary AI alignment research fellowship source |
| Dec 2021 | Berkeley Existential Risk Initiative | $250k | December 2021 payout report (Aug–Dec 2021): 12-month software developer salary for a Seldonian ML algorithms library source |
| Dec 2021 | Individual #6214 | $122k | December 2021 payout report (Aug–Dec 2021): Two-year funding for a PhD in Public Policy in Europe focused on AI safety |
| Dec 2021 | Individual #8859 | $100k | December 2021 payout report (Aug–Dec 2021): Two-year funding for public and expert surveys on AI governance and forecasting |
| Dec 2021 | Individual #4848 | $90k | December 2021 payout report (Aug–Dec 2021): Funding to finish an AI-safety related CS PhD |
| Dec 2021 | Individual #4707 | $70k | December 2021 payout report (Aug–Dec 2021): 6-month salary for biorisk and policy work and setting up an organization in Israel |
| Dec 2021 | Individual #8008 | $60k | December 2021 payout report (Aug–Dec 2021): 6-month salary for independent study plus special projects |
| Dec 2021 | Individual #3307 | $50k | December 2021 payout report (Aug–Dec 2021): 6-month salary for general AI alignment research |
| Dec 2021 | Individual #1564 | $45k | December 2021 payout report (Aug–Dec 2021): 9-month apprenticeship with Individual #3307 (AI alignment) |
| Dec 2021 | Individual #9928 | $20k | December 2021 payout report (Aug–Dec 2021): 9.5 months of strategic outsourcing to read up on AI safety and find mentors |
| Dec 2021 | Individual #1395 | $19k | December 2021 payout report (Aug–Dec 2021): 10-month salary for AI safety research (scaling laws or interpretability) |
| Dec 2021 | Adam Shimi | $17k | December 2021 payout report (Aug–Dec 2021): Slack money for increased AI alignment research productivity source |
| Dec 2021 | Gurkenglas | $14k | December 2021 payout report (Aug–Dec 2021): 3-month salary to produce a neural network interpretability tool source |
| Dec 2021 | Individual #3904 | $11k | December 2021 payout report (Aug–Dec 2021): Living costs stipend for extra US semester and OSINT equipment and software |
| Dec 2021 | Individual #6282 | $5k | December 2021 payout report (Aug–Dec 2021): 3-month funding for an AI takeoff speed project |
| Oct 2021 | University of Oxford, Department of Experimental Psychology | $78k | EA Funds grants database (2021 Q4): DPhil project in AI that addresses safety concerns in ML algorithms and positions Kai to work on China-West AI relations source |
| Jul 2021 | Ezra Karger, Individual #5138, Philip Tetlock | $200k | July 2021 payout report: Existential risk forecasting tournament (LTFF share; another donor covered $372,000 of the $572,000 asked) source |
| Jul 2021 | New Governance of AI nonprofit (GovAI) | $177k | July 2021 payout report: Setting up GovAI as an independent nonprofit source |
| Jul 2021 | Individual #3044 | $150k | July 2021 payout report: Simulations of human cultural acquisition as an AI alignment testbed |
| Jul 2021 | Individual #1534 | $100k | July 2021 payout report: Income replacement while moving to part-time work to pursue an AI PhD |
| Jul 2021 | Individual #2467 | $86k | July 2021 payout report: Financial support for research productivity during his PhD (AI safety) |
| Jul 2021 | Individual #9388 | $80k | July 2021 payout report: Independent research on the frames underlying AI alignment |
| Jul 2021 | Individual #3429 | $35k | July 2021 payout report: Independent research on amplification approaches to AI alignment |
| Jul 2021 | Individual #7093 | $28k | July 2021 payout report: Eight months of salary for technical AI safety research |
| Jul 2021 | Individual #8624 | $28k | July 2021 payout report: Fees for a master's program in machine learning |
| Jul 2021 | AISS Inc | $25k | July 2021 payout report: Six months of salary for Individual #1052's 1-on-1 support to AI safety researchers source |
| Jul 2021 | Effective Altruism Switzerland | $11k | July 2021 payout report: Stipends and costs for four extra students in CHERI's summer research program source |
| Jul 2021 | Individual #9720 | $5k | July 2021 payout report: DPhil funding with an AI safety and China-West relations angle |
| Apr 2021 | Individual #4551 | $250k | May 2021 payout report (Nov 2020 round to Apr 2021): PhD in computer science focused on AI safety |
| Apr 2021 | David Krueger | $200k | May 2021 payout report (Nov 2020 round to Apr 2021): Computing resources and researcher salaries at a Cambridge lab (gross; up to $120,000 conditionally reimbursable) source |
| Apr 2021 | Legal Priorities Project | $135k | May 2021 payout report (Nov 2020 round to Apr 2021): Hiring staff for longtermist legal research and operations source |
| Apr 2021 | AI Safety Camp | $85k | May 2021 payout report (Nov 2020 round to Apr 2021): Virtual and in-person camp to test fit for AI safety research source |
| Apr 2021 | Individual #9691 | $80k | May 2021 payout report (Nov 2020 round to Apr 2021): AI forecasting and strategy research |
| Apr 2021 | Individual #4707 | $80k | May 2021 payout report (Nov 2020 round to Apr 2021): Understanding the structure of AI risks for prioritization |
| Apr 2021 | Anton Korinek | $72k | May 2021 payout report (Nov 2020 round to Apr 2021): Free online course on the economics of transformative AI source |
| Apr 2021 | Rethink Priorities | $70k | May 2021 payout report (Nov 2020 round to Apr 2021): Research on global security, forecasting, and public communication source |
| Apr 2021 | Adam Shimi | $60k | May 2021 payout report (Nov 2020 round to Apr 2021): One year of independent AI alignment research source |
| Apr 2021 | Stanford Existential Risks Initiative | $60k | May 2021 payout report (Nov 2020 round to Apr 2021): General support via the Berkeley Existential Risks Initiative source |
| Apr 2021 | Center for Human-Compatible AI | $48k | May 2021 payout report (Nov 2020 round to Apr 2021): Hiring research engineers for technical projects source |
| Apr 2021 | Individual #3307 | $35k | May 2021 payout report (Nov 2020 round to Apr 2021): Tools to test the natural abstraction hypothesis |
| Apr 2021 | Alexander Turner | $30k | May 2021 payout report (Nov 2020 round to Apr 2021): Formalizing the side effect avoidance problem source |
| Apr 2021 | Daniel Filan | $5k | May 2021 payout report (Nov 2020 round to Apr 2021): Technical support for the AXRP podcast source |
| Apr 2021 | Individual #9928 | $3k | May 2021 payout report (Nov 2020 round to Apr 2021): Extending a conservative RL agent framework |
| Apr 2021 | Individual #3687 | $2k | May 2021 payout report (Nov 2020 round to Apr 2021): Paper or post on cognitive and evolutionary insights for alignment |
| Jan 2021 | Institute for Law & AI | $135k | Hiring staff to carry out longtermist academic legal research and increase the operational capacity of the organization. source |
| Jan 2021 | Expii, Inc. | $100k | New way to fight pandemics: 1-3 months of salaries for app R&D and communications in pilots and to mass public source |
| Jan 2021 | Future of Humanity Institute | $55k | EA Funds grants database (2021 Q1): 12-month salary to provide runway after finishing RSP source |
| Jan 2021 | BugSeq Bioinformatics Inc. | $38k | 50% of 9-month salary for bioinformatician at BugSeq to democratize analysis of nanopore metagenomic sequencing data source |
| Jan 2021 | SPARC | $15k | Support multiple SPARC project operations during 2021 source |
2020 25 grants · $1.2M
| Date | Recipient | Amount | Purpose |
|---|---|---|---|
| Nov 2020 | Richard Ngo | $150k | November 2020 grant recommendations (posted 3 Dec 2020): Off-cycle, up to $150,000: 3-year Cambridge PhD on the analogy between human and AGI development source |
| Nov 2020 | Vanessa Kosoy | $100k | November 2020 grant recommendations (posted 3 Dec 2020): Mathematical theory of AGI and AGI alignment (learning-theoretic agenda) source |
| Nov 2020 | Individual #6630 | $55k | November 2020 grant recommendations (posted 3 Dec 2020): Up to $55,000: how forecast accuracy changes with prediction timeframe [forecasting; counted for now] |
| Nov 2020 | Lee Sharkey | $45k | November 2020 grant recommendations (posted 3 Dec 2020): Research on real-time monitoring and analysis of artificial agents for AI control source |
| Nov 2020 | Nuño Sempere | $41k | November 2020 grant recommendations (posted 3 Dec 2020): A year of independent research on forecasting and improving the long-term future [forecasting; counted for now] source |
| Nov 2020 | Individual #4982 | $24k | November 2020 grant recommendations (posted 3 Dec 2020): Research and advice for legal practitioners on long-term challenges of AI in the judiciary |
| Nov 2020 | Individual #1435 | $4k | November 2020 grant recommendations (posted 3 Dec 2020): Relocation costs for a research assistant role on Jess Whittlestone's mid-term AI impacts work |
| Sep 2020 | Center for Human-Compatible AI | $75k | September 2020 payout report (paid 4 Sep 2020): Hiring a research engineer for CHAI's technical projects source |
| Sep 2020 | AI Impacts | $75k | September 2020 payout report (paid 4 Sep 2020): Research on decision-relevant questions about AI's future source |
| Sep 2020 | Robert Miles | $60k | September 2020 payout report (paid 4 Sep 2020): AI safety videos and media support to AI safety organisations source |
| Sep 2020 | Alex Turner | $30k | September 2020 payout report (paid 4 Sep 2020): When proposed AI designs seek power over their environment source |
| Sep 2020 | Individual #3429 | $25k | September 2020 payout report (paid 4 Sep 2020): Algorithms, environments and tests for debate-based AI safety |
| Sep 2020 | Individual #6319 | $8k | September 2020 payout report (paid 4 Sep 2020): Support for AI alignment research and job applications |
| Sep 2020 | Individual #2414 | $5k | September 2020 payout report (paid 4 Sep 2020): Survey of experts on AI risk scenarios |
| Sep 2020 | Individual #4075 | $5k | September 2020 payout report (paid 4 Sep 2020): 'Human-Aligned AI' event at NeurIPS |
| Sep 2020 | Individual #9275 | $5k | September 2020 payout report (paid 4 Sep 2020): Workshop on recent progress in verified software |
| Apr 2020 | Machine Intelligence Research Institute | $100k | April 2020 payout report (paid 15 Apr 2020): General support [report rows sum to $552,900 vs the stated $488,350 total] source |
| Apr 2020 | Rethink Priorities | $68k | April 2020 payout report (paid 15 Apr 2020): Restricted: nuclear weapons and AI arms control research [report rows sum to $552,900 vs the stated $488,350 total] source |
| Apr 2020 | Metaculus (Anthony Aguirre) | $65k | April 2020 payout report (paid 15 Apr 2020): Making the Metaculus forecasting platform useful for EA organisations [forecasting; counted for now] [report rows sum to $552,900 vs the stated $488,350 total] source |
| Apr 2020 | Dan Hendrycks | $55k | April 2020 payout report (paid 15 Apr 2020): Benchmark for testing NLP models on human values [report rows sum to $552,900 vs the stated $488,350 total] source |
| Apr 2020 | Individual #73908 | $40k | April 2020 payout report (paid 15 Apr 2020): Long-term macrostrategy and AI alignment research; career transition [report rows sum to $552,900 vs the stated $488,350 total] |
| Apr 2020 | Individual #3551 | $32k | April 2020 payout report (paid 15 Apr 2020): Competition law and long-term AI strategy [report rows sum to $552,900 vs the stated $488,350 total] |
| Apr 2020 | Individual #8747 | $10k | April 2020 payout report (paid 15 Apr 2020): Counterfactual impact minimisation research [report rows sum to $552,900 vs the stated $488,350 total] |
| Apr 2020 | Individual #1707 | $8k | April 2020 payout report (paid 15 Apr 2020): Inferring human mental models from behaviour (AI alignment) [report rows sum to $552,900 vs the stated $488,350 total] |
| Jan 2020 | Anthony Aguirre | $65k | Increasing usefulness and availability of Metaculus, a fully-functional quantitative forecasting/prediction platform with >170,000 predictions and >1500 questions to date. source |
2019 30 grants · $1.1M
| Date | Recipient | Amount | Purpose |
|---|---|---|---|
| Nov 2019 | Individual #1865 | $62k | November 2019 payout report (paid 22 Nov 2019): APPG for Future Generations secretariat (UK extreme-risk policy) |
| Nov 2019 | Individual #5073 | $43k | November 2019 payout report (paid 22 Nov 2019): A year of research funding to move into full-time AI safety work |
| Nov 2019 | Individual #9691 | $40k | November 2019 payout report (paid 22 Nov 2019): Independent AI forecasting and strategy research |
| Nov 2019 | Individual #3307 | $30k | November 2019 payout report (paid 22 Nov 2019): Theory of abstraction for embedded agency |
| Nov 2019 | Individual #9102 | $30k | November 2019 payout report (paid 22 Nov 2019): Independent agent foundations research |
| Nov 2019 | AI Safety Camp Toronto | $29k | November 2019 payout report (paid 22 Nov 2019): Research camp for aspiring researchers on concrete AI safety problems source |
| Nov 2019 | Individual #3429 | $10k | November 2019 payout report (paid 22 Nov 2019): Investigation of AI safety via debate and ML training |
| Aug 2019 | Jess Whittlestone | $75k | August 2019 payout report (paid 31 Aug 2019): Postdoc on links between short- and long-term AI policy, plus ML skill-building source |
| Aug 2019 | AI Safety Camp | $41k | August 2019 payout report (paid 31 Aug 2019): Research programme for prospective AI safety researchers source |
| Aug 2019 | Sören Mindermann | $37k | August 2019 payout report (paid 31 Aug 2019): Supplemental funding for an AI strategy PhD at Oxford/FHI source |
| Aug 2019 | Alexander Gietelink Oldenziel | $30k | August 2019 payout report (paid 31 Aug 2019): Independent AI safety research on self-reference (type, topos and category theory) source |
| Aug 2019 | Individual #4707 | $30k | August 2019 payout report (paid 31 Aug 2019): Multi-model research on corporate and state actors relevant to existential risk |
| Aug 2019 | Individual #7563 | $23k | August 2019 payout report (paid 31 Aug 2019): A year of technical upskilling to contribute to AI safety |
| Aug 2019 | Individual #9321 | $10k | August 2019 payout report (paid 31 Aug 2019): ML upskilling for AI safety research |
| Apr 2019 | Individual #7668 | $25k | Supporting aspiring researchers of AI alignment to boost themselves into productivity source |
| Mar 2019 | Metaculus (Anthony Aguirre) | $70k | April 2019 payout report (paid 21 Mar 2019): Expanding the Metaculus forecasting platform and community [forecasting; counted for now] source |
| Mar 2019 | Ozzie Gooen | $70k | April 2019 payout report (paid 21 Mar 2019): Forecasting infrastructure including Foretold [forecasting; counted for now] source |
| Mar 2019 | Machine Intelligence Research Institute | $50k | April 2019 payout report (paid 21 Mar 2019): Unrestricted donation source |
| Mar 2019 | Ought | $50k | April 2019 payout report (paid 21 Mar 2019): Unrestricted donation source |
| Mar 2019 | Individual #8971 | $40k | April 2019 payout report (paid 21 Mar 2019): Scaling AI strategy scenario role-play and the researcher pipeline source |
| Mar 2019 | Robert Miles | $39k | April 2019 payout report (paid 21 Mar 2019): Video content on AI alignment source |
| Mar 2019 | Individual #7098 | $30k | April 2019 payout report (paid 21 Mar 2019): AI safety research linking internal and external views of value synthesis |
| Mar 2019 | Individual #3938 | $30k | April 2019 payout report (paid 21 Mar 2019): AI safety research on safe exploration and robustness |
| Mar 2019 | Individual #9691 | $30k | April 2019 payout report (paid 21 Mar 2019): Independent research on AI forecasting and strategy |
| Mar 2019 | Individual #3388 | $30k | April 2019 payout report (paid 21 Mar 2019): Formalising perceptual complexity for safe intelligence amplification |
| Mar 2019 | Alex Turner | $30k | April 2019 payout report (paid 21 Mar 2019): 'Limited Agent Foundations' thesis on mild optimisation and corrigibility source |
| Mar 2019 | Individual #5353 | $27k | April 2019 payout report (paid 21 Mar 2019): Private platform giving x-risk researchers superforecaster-level prediction [forecasting; counted for now] |
| Mar 2019 | AI Safety Camp (Individual #7668) | $25k | April 2019 payout report (paid 21 Mar 2019): AI alignment research camp for aspiring researchers source |
| Mar 2019 | Individual #2912 | $18k | April 2019 payout report (paid 21 Mar 2019): Two-day career workshop for European EAs interested in AI governance |
| Mar 2019 | Individual #6275 | $10k | April 2019 payout report (paid 21 Mar 2019): Upskilling in modern AI, deep RL and AI safety before an ML PhD |
2018 5 grants · $564k
| Date | Recipient | Amount | Purpose |
|---|---|---|---|
| Nov 2018 | Machine Intelligence Research Institute | $40k | November 2018 payout report (paid 30 Nov 2018): Research directions in MIRI's 2018 update source |
| Nov 2018 | AI summer school (Jan Kulveit) | $21k | November 2018 payout report (paid 30 Nov 2018): Second year of a summer school on AI safety technical problems source |
| Nov 2018 | Ought | $10k | November 2018 payout report (paid 30 Nov 2018): Nonprofit implementing AI alignment concepts in real-world applications source |
| Nov 2018 | AI Safety Unconference (Individual #6275 and Vaughn DiMarco) | $5k | November 2018 payout report (paid 30 Nov 2018): CAD 6,000 (~$4,500): AI alignment unconference on the last day of NeurIPS 2018 source |
| Aug 2018 | Machine Intelligence Research Institute (MIRI) | $489k | July 2018 payout report (paid 15 Aug 2018): General support; grantees encouraged to trade money for staff time and productivity. Joint recommendation with the EA Community Fund; LTFF total USD 917,000 source |
2017 1 grant · $15k
| Date | Recipient | Amount | Purpose |
|---|---|---|---|
| Mar 2017 | Berkeley Existential Risk Initiative (BERI) | $15k | March 2017 payout (paid 21 Mar 2017): Start-up funding for BERI, giving existential-risk researchers administrative, expert-consultation and technical support (USD 14,838.02 of $50,000 requested; the fund held only this amount) source |