Navigating Transformative AI↗

Applications: Open
Apply ↗All 658 grants ↓
Programme of Coefficient Giving
“To reduce the risk of global catastrophe and help society prepare”In its own words: coefficientgiving.org
Field-buildingGovernanceTechnical

Coefficient Giving's main AI fund, which has made over 440 grants. It covers technical AI safety, AI governance and policy, capacity building in the field, and projects for short AI timelines.

Show detailsHide details

Coefficient Giving's AI fund, covering technical AI safety, AI governance and policy, field capacity building, and projects that matter most if transformative AI arrives soon. Its capacity-building programme takes applications on a rolling basis, for anything from small grants to individuals up to multi-year grants to organisations.

Typical grant $484k ($206k–$1.5M)

On applying “Technical AI safety research aimed at making advanced AI systems more trustworthy, robust, controllable, and aligned.” coefficientgiving.org

Itemised here $1.3B in 658 grants

’21
’22
’23
’24
’25
’26
Led by Claire Zabel (Managing Director), Luke Muehlhauser (Managing Director)Its grants page ↗Checked 29 Oct 2026

Money flows

Where its money came from and where it went. Pick years and what to show; hover a box or ribbon for details, click one to focus it, click the background to see everything.

How to apply

Applications
Open
Governance and technical RFPs closed; may reopen
Who can apply
Academics, Individuals, New organisations, Organisations

Programmes

Biggest recipients

All grants

658 grants totalling $1.3B, newest first. Recipients link to their own pages; people who received grants without a public profile are shown by number.

2026 77 grants · $451M
DateRecipientAmountPurpose
Oct 2026Cornell University (Lionel Levine)$1.5M18-month grant for AI safety research: mathematical tools for evaluating the model 'constitution' that shapes a frontier LLM's values (scoring constitution adherence, verifying which constitution a model was trained on, value change under recursive self-improvement); announced 5 source
2 Sep 2026Kairos$50MTwo years of funding for AI safety talent infrastructure: SPAR, Pathfinder, the Generator Residency, Global Challenges Project, and new Kairos Labs, Talent Operations and Special Projects teams source
Aug 2026Epoch AI$69MGeneral Support source
Aug 2026Sage$13MGeneral Support source
7 Jul 2026Resolution$160MAlignment research, including semiautomated alignment theory and empirics; structured as a $108m base plus $52m conditional on hiring success and compute needs. Coefficient Giving is Resolution’s sole funder to start. source
Jul 2026Simon Institute for Longterm Governance$5.2MStaffing Support source
Jul 2026ChinaTalk$3MPodcast, Newsletter, and Related Content source
Jun 2026P-Zero Research$5.6MAI Safety Research source
Jun 2026Augur$1.4MAI Supply Chain Research source
Jun 2026Various Individuals$720kCareer Transition Accelerator Program source
Jun 2026AI Standards Lab$470kAI Policy Standards Development source
May 2026Institute for AI Policy and Strategy$19MGeneral Support source
May 2026Geodesic Research$14MPretraining Techniques for Al Alignment source
May 2026Oxford Martin AI Governance Initiative$8.7MOxford AI Governance Initiative source
May 2026Albion East$5.3MAI Diplomatic Engagement Network General Support source
May 2026CSLib$3.9MInfrastructure for Formal Software Verification in Lean source
May 2026Foundations of Cooperative AI Lab$2MFoundations of Cooperative AI Research Center (Vincent Conitzer) source
May 2026Heron AI Security$1.9MAI Security Research Pilot source
May 2026Tara Research$1.8MAssessing Techniques for Detecting AI Dishonesty source
May 2026Observatorio de Riesgos Catastróficos Globales$1.5MAI Risk Explorer (AIRE) source
May 2026Apollo Research$696kStaff Support source
May 2026American Enterprise Institute$347kAI Policy Conversations source
May 2026Koddermann Public Affairs$327kAI Summit Alliance source
May 2026Jakob Foerster$279kReducing Encoded Reasoning in Chains of Thought (Jakob Foerster) source
May 2026Ofir Press$190kVideoGameBench source
May 2026Individual #8242$180kResearch on AI Persona Behavior
May 2026MATS Research$100kCompute for AI Safety Research source
May 2026Individual #4202$50kEvaluating Claude's Adherence to its Constitution
Apr 2026Center for Security and Emerging Technology$2.5MAI Frontiers Initiative source
Apr 2026Arcadia Impact$1.9MArcadia Impact Alignment Project source
Apr 2026SeedAI$1.9MGeneral Support source
Apr 2026Rethink Priorities$928kDevelopment of the Holistic Agent Leaderboard source
Apr 2026EconTAI Lab$897kOperating Support for EconTAI Lab (Anton Korinek) source
Apr 2026Cloud Security Alliance$717kGlobal Catastrophic Risk-Focused Security Standards source
Apr 2026James Mickens$666kTechniques For Containing Misaligned AI (James Mickens) source
Apr 2026Individual #8739$451kCybersecurity Benchmark Design (Individual #8739)
Apr 2026CORAL Research$420kAgent Foundations Research source
Apr 2026Individual #7254$226kDefenses Against LLM Backdoors (Individual #7254)
Apr 2026MATS Research$200kResearch on Exploration Hacking (Eyon Jang and Joschka Braun) source
Apr 2026University of California, Los Angeles$135kFoundations of Interpretability Workshop source
Apr 2026Glen Chou$120kControl Theory Research (Glen Chou) source
Apr 2026AI X-risk Research Podcast$51kProduction Support source
Apr 2026Kairos$50kResearch on Scalable Oversight (Individual #6197) source
Mar 2026Timaeus$11MGeneral Support source
Mar 2026Centre for the Governance of AI, Inc.$11MGeneral Support source
Mar 2026Epoch AI$2.7MPublic Data Center Tracker source
Mar 2026Andrew Ilyas$1.1MStudy on Covert Malicious Fine-Tuning (Andrew Ilyas) source
Mar 2026Cambridge in America$628kChain-of-Thought Faithfulness source
Mar 2026Positive AI Labs$500kTechnical and Community-Building Work source
Mar 2026Inversion Research$409kSecurity Research Space source
Mar 2026Individual #7484$371kImproved Latent Adversarial Training (Individual #7484)
Mar 2026Individual #6306$182kAI Evals Platform Development
Mar 2026Center for Long-Term Cybersecurity$64kAI Standards and Risk Management source
Feb 2026Centre for the Governance of AI, Inc.$8.3MGeneral Support source
Feb 2026Institute for Law & AI$6.4MGeneral Support source
Feb 2026Convergent Research$5MWork on Software Formal Verification source
Feb 2026The Vista Institute for AI Policy$2.1MGeneral Support source
Feb 2026Individual #6844$1.5MAI Control Evaluations
Feb 2026Alignment of Complex Systems Research Group$1MGeneral Support source
Feb 2026Meridian$859kTech Labs Program source
Feb 2026Aether$757kAI Control & Monitoring Projects source
Feb 2026Alec Radford$601kGradient Routing and Other AI Safety Research source
Feb 2026Center for Long-Term Cybersecurity$524kOperations Support source
Feb 2026Sarah Wiegreffe$268kStudy on Chain-of-Thought Necessity and Task Complexity (Sarah Wiegreffe) source
Feb 2026P-Zero Research$250kGeneral Support source
Feb 2026TransformerLens$133kLibrary for MechInterp Research source
Feb 2026Jacob Steinhardt$130kCompute Funds for AI Safety Research source
Feb 2026Individual #1823$100kExternalizing LLM Reasoning (Individual #1823)
Jan 2026Carnegie Endowment for International Peace$6MResearch and Programming Support source
Jan 2026Talos Network$5.2MGeneral Support source
Jan 2026Fewshot Corp$875kReward-Hacking Research source
Jan 2026Uri Maoz$733kAlignment Faking Research (Uri Maoz) source
Jan 2026John Hawthorne$732kMiscellaneous Research Projects (John Hawthorne) source
Jan 2026CEGIA$680kAI Governance Work source
Jan 2026Individual #7144$355kLLM Evals Projects (Individual #7144)
Jan 2026Meenakshi Khosla$231kStudy on The Universality of Embedding Spaces (Meenakshi Khosla) source
Jan 2026Thilo Hagendorff$187kResearch into Deceptive Behaviors in LLMs (Thilo Hagendorf) source
2025 183 grants · $321M
DateRecipientAmountPurpose
Dec 2025Various Individuals$9.9MRCT to Assess Impact of Technical AI Safety Research Grantmaking source
Dec 2025Shi Feng$3.1MStudy on Model Organisms of Reward-Hacking (Shi Feng and Kianté Brantley) source
Dec 2025ELLIS Institute Tübingen$1MResearch Group Support (Maksym Andriushchenko) source
Dec 2025Kianté Brantley$748kModel Organisms of Reward Hacking (Kianté Brantley and Shi Feng) source
Dec 2025Shi Feng$748kStudy on Model Organisms of Reward-Hacking (Shi Feng and Kianté Brantley) source
Dec 2025Lijie Chen$527kTheoretical AI Safety Projects (Lijie Chen) source
Dec 2025Ryan Cotterell$480kImproving Attribution in Circuit Discovery (Ryan Cotterell) source
Dec 2025University of Waterloo (Pascal Poupart and Sriram Ganapathi)$413kTwo-year grant to make agentic systems safer and more reliable through constraint learning, focused on multi-agent orchestrators (announced 17 Dec 2025) source
Dec 2025Chao Chen$331kRobust Detection of Unsafe LLM Behaviors (Chao Chen and Jiawei Zhou) source
Dec 2025Anna Ivanova$318kTraining Probes from Misaligned Models (Anna Ivanova) source
Dec 2025Cambridge Boston Alignment Initiative$275kSurvey-Based Research source
Dec 2025Philip Torr$225kResearch on LLM Steering Vectors (Philip Torr) source
Dec 2025Koddermann Public Affairs$149kRecruiting Support for AI Safety Organizations source
Dec 2025Albion East$103kAI Safety Strategy source
Dec 2025HartreeWorks$40kEducational Blog on AI Use source
Dec 2025Bin Yu$12kAI Safety Retreat (Bin Yu) source
Nov 2025Redwood Research$37MGeneral Support source
Nov 2025RAND Corporation$6MAI Security Research source
Nov 2025Timaeus$1.5MGeneral Support source
Nov 2025Nada Amin$653kLLM Techniques for Generating and Verifying Code (Nada Amin) source
Nov 2025The AI & Cyber Security Institute$612kPhishing Benchmark (Individual #4402) source
Nov 2025Sanmi Koyejo$504kResearch on Predicting AI Capabilities (Sanmi Koyejo) source
Nov 2025Hongseok Namkoong$451kNew Methods for Estimating Rare Event Probabilities (Hongseok Namkoong) source
Nov 2025Aaron Mueller$373kNon-Human-Like Features In LLMs (Aaron Mueller) source
Nov 2025Individual #5877$310kData Filtering for AI Alignment (Individual #5877)
Nov 2025Gautam Reddy$303kResearch on In-Context Learning (Gautam Reddy) source
Nov 2025ILINA Program$234kAI Governance Fellowships source
Nov 2025Centre for International Governance Innovation$136kGlobal AI Risks Initiative source
Nov 2025Arcadia Impact$32kResearch on Diffuse Threat Models in AI Systems source
Oct 2025Simplex$2MGeneral Support source
Oct 2025Zhijing Jin$926kAI Safety Research Projects (Zhijing Jin) source
Oct 2025Iliad$836kAI Alignment Theory source
Oct 2025Rethink Priorities$585kEvaluation of AI Agent Risk Attitudes source
Oct 2025Eric Darve$485kHierarchical Atlas for LLM Interpretability (Eric Darve) source
Oct 2025Walter Scheirer$471kRobust Unlearning Research (Walter Scheirer) source
Oct 2025Melanie Weber$437kNonlinear Structure in Language Models (Melanie Weber) source
Oct 2025Sanmi Koyejo$420kNovel Method for Concept Unlearning (Sanmi Koyejo) source
Oct 2025The Alan Turing Institute$384kAI Cybersecurity Evals for Critical National Infrastructure source
Oct 2025Yonatan Belinkov$365kCovert Communication in LLMs (Yonatan Belinkov) source
Oct 2025Yonatan Belinkov$329kWeight Pruning to Remove Harmful Mechanisms (Yonatan Belinkov) source
Oct 2025Jonathan May$258kResearch on Steganographic Encoding (Jonathan May) source
Oct 2025Liu Leqi$215kResearch on Chain-of-Thought Reasoning in LLMs (Liu Leqi) source
Oct 2025Individual #3051$201kResearch on Jailbreaking in LLMs (Individual #3051)
Oct 2025Andrew Perrault$188kStudy on Measuring LLM Values (Andrew Perrault) source
Oct 2025Individual #6994$124kRobust Unlearning Evaluations (Individual #6994)
Oct 2025Arb Research$15kShallow Review of AI Safety Research source
Sep 2025FAR AI$29MAI Safety Research and Field-building source
Sep 2025RAND Corporation$10MAI Evaluation and Testing source
Sep 2025Weiyan Shi$708kSabotage Benchmark (Weiyan Shi) source
Sep 2025Decode Research$707kInfrastructure for Interpretability Research source
Sep 2025Poseidon Research$640kEncoded Reasoning Project source
Sep 2025Gagandeep Singh$532kLatent Certified Training Network (Gagandeep Singh) source
Sep 2025Aviral Kumar and Aditi Raghunathan$466kAdversarial Reasoning Training (Aviral Kumar and Aditi Raghunathan) source
Sep 2025Christian Schroeder de Witt$352kMitigating Collusion in LLMs for Multi-Agent Security (Christian Schroeder de Witt) source
Sep 2025Individual #7470$335kAnalysis of Moral Preferences of AIs
Sep 2025Various Individuals$334kMid-Career Transition Grants source
Sep 2025Weiyan Shi$333kTechniques to Mitigate Emergent Misalignment (Weiyan Shi) source
Sep 2025Individual #2217$326kResearch on Unlearning Methods (Individual #2217)
Sep 2025Individual #4647$310kSteering Vectors for Externalizing LLM Reasoning (Individual #5877)
Sep 2025Flavio Calmon$304kLLM Discretion in Deliberative Alignment (Flavio Calmon) source
Sep 2025Meng Jiang$282kProbe-Based Interventions for Training (Meng Jiang) source
Sep 2025Meridian$273kImproved Sleeper-Agent Techniques source
Sep 2025Xinya Du$219kControl Evaluations for AI Debate (Xinya Du) source
Sep 2025Hanjie Chen$218kResearch on Alignment Faking (Hanjie Chen) source
Sep 2025zkBricks$209kDefenses Against LLM Backdoor Attacks (Mingyuan Wang and Sanjam Garg) source
Sep 2025Dawn Song$200kAI Cybersecurity Research and Workshop (Dawn Song) source
Sep 2025Mila$196kOff-target Effects of Fine-tuning in LLMs (Aly Kassem and Golnoosh Farnadi) source
Sep 2025Varun Chandrasekaran$119kLow-Perplexity Jailbreak Testing (Varun Chandrasekaran) source
Sep 2025Simon Institute for Longterm Governance$94kInternational AI Governance source
Aug 2025Centre for the Governance of AI, Inc.$11MGeneral Support source
Aug 2025Rethink Priorities$6.1M"Truthful AI" Research Group source
Aug 2025AI Verification and Evaluation Research Institute (AVERI)$5MThird-Party AI Auditing & Advocacy source
Aug 2025Berkeley Existential Risk Initiative$648kAI Governance source
Aug 2025Lu Wang$638kAlignment Faking Experiments (Lu Wang) source
Aug 2025Meridian$561kResearch on Realistic Alignment Faking source
Aug 2025Diyi Yang$531kRisks in Multi-Agent LLM Systems (Diyi Yang) source
Aug 2025Yu Meng$482kLatent Adversarial Training Method (Yu Meng) source
Aug 2025Nicola Paoletti and Osvaldo Simeone$440kVerifiably Robust Conformal Probes (Nicola Paoletti and Osvaldo Simeone) source
Aug 2025Scott Niekum$426kResearch on Emergent Misalignment (Scott Niekum) source
Aug 2025ETH Zürich$357kResearch on Malware and Surveillance Capabilities of LLMs source
Aug 2025Huan Sun and Yu Su$354kEliciting Unintended Behaviors in Computer-Use Agents (Huan Sun and Yu Su) source
Aug 2025Alane Suhr$310kModularized Reasoning Language Models (Alane Suhr) source
Aug 2025Huan Sun and Yu Su$296kStudy on the Circuits Underlying the "Reversal Curse" (Huan Sun and Yu Su) source
Aug 2025Adam Oberman$295kResearch on Latent Adversarial Training (Adam Oberman) source
Aug 2025Scott Niekum$293kResearch on LLM Rare Event Estimation (Scott Niekum) source
Aug 2025Kaiqing Zhang$281kEmergent Collusion Project (Kaiqing Zhang) source
Aug 2025Yiqiao Zhong$200kReasoning in LLMs (Yiqiao Zhong) source
Aug 2025Rui Zhang$166kWork to Mitigate AI Agent Sandbagging (Rui Zhang) source
Aug 2025Individual #4360$165kDevelopment of White-Box Jailbreak Technique (Individual #4360)
Aug 2025Stephen Bach$125kResearch into AI "Self-Jailbreaking" (Stephen Bach) source
Aug 2025Anudeep Das, Gurjot Singh, and Pract Chantasantitam$58kStudy on Backdoors in AI Agents (Anudeep Das, Gurjot Singh, Pract Chantasantitam) source
Aug 2025Mark Crovella$53kMechanistic Interpretability Research (Mark Crovella) source
Aug 2025Steve Petersen$48kAgent Foundations Research (Steve Petersen) source
Jul 2025Byron Wallace$800kMechanistic Interpretability in Clinical Settings (Byron Wallace) source
Jul 2025George Pappas and Hamed Hassani$474kReachability Analysis for Jailbreak Detection (George Pappas and Hamed Hassani) source
Jul 2025Cadenza Labs$441kBenchmark for Detectors of LLM Dishonesty source
Jul 2025AI Security Forum$322kInternational AI Security Conferences source
Jul 2025Mila$310kMechanistic Interpretability Research (Danilo Bzdok) source
Jul 2025Somil Bansal$305kReachability Analysis for Jailbreak Detection (Somil Bansal) source
Jul 2025Individual #6550$298kResearch on AI Productivity Impacts
Jul 2025Sharon Li$294kStudy on Inductive Biases of LLMs (Sharon Li) source
Jul 2025George Pappas and Hamed Hassani$268kReasoning-Based Jailbreak Red Teaming (George Pappas and Hamed Hassani) source
Jul 2025Sharon Li$253kNon-Linear Probes for Feature Discovery & Steering (Sharon Li) source
Jul 2025Meridian$210kResearch on Chain-of-Thought Obfuscation source
Jul 2025University of Southern California$207kDetecting Hidden Knowledge in Language Models source
Jul 2025Carnegie Endowment for International Peace$160kFrontier AI and Geopolitics Research source
Jul 2025Individual #5361$91kRed-Teaming LLM Backdoor Attacks (Individual #5361)
Jul 2025Zohar Ringel$82kNeural Network Context Learning and Generalization (Zohar Ringel) source
Jul 2025Yue Xing$77kResearch on Latent Adversarial Training (Yue Xing) source
Jun 2025BlueDot Impact$26MGeneral Support source
Jun 2025OpenMined$11MSecure Enclaves for LLM Evaluation source
Jun 2025Epoch AI$8.5MAI Development Tracking and Analysis source
Jun 2025Center for a New American Security$8.3MAI Security and Stability Program source
Jun 2025Longview Philanthropy$4MRFP on Hardware-Enabled Mechanisms for AI Compliance source
Jun 2025Dawn Song$3.4MCyberoffense Benchmark (Dawn Song) source
Jun 2025Centre for the Governance of AI, Inc.$2.8MGeneral Support source
Jun 2025Noam Kolt$2.7MGovernance of AI Lab (Noam Kolt) source
Jun 2025Tatsunori Hashimoto$1.9MRobust AI Benchmarks (Tatsunori Hashimoto) source
Jun 2025Mila$1.9MAI Safety Projects source
Jun 2025Schwartz Reisman Institute for Technology and Society$700kAI Safety and Alignment Initiatives (Schwartz Reisman Institute for Technology and Society) source
Jun 2025Arcadia Impact$540kAI Governance Research Fellowship source
Jun 2025Emma Pierson$500kStudy on Frontier Model Behavior (Emma Pierson) source
Jun 2025Tom Coates$430kStructure-Preserving Maps Between LLMs (Tom Coates) source
Jun 2025Meridian$396kResearch on Emergent Misalignment source
Jun 2025Soothcheck Project$248kRed-teaming Probed Trusted Monitoring source
Jun 2025Meridian$245kResearch on Avoiding Encoded Reasoning in LLMs source
Jun 2025Conjecture Ltd$223kCybersecurity Bootcamp source
Jun 2025Individual #5877$218kStudy on Encoded Reasoning in LLMs (Individual #5877, Individual #5877)
Jun 2025Kairos$195kGeneral Support source
Jun 2025Atlas Computing$100kResearch Exploration source
Jun 2025Individual #1779$20kResearch on Prompt Injection Attacks (Individual #1779, Individual #1779)
Jun 2025International Conference on Machine Learning$13kAI Governance Workshop source
May 2025SL5 Task Force$8.4MFrontier AI Security Task Force source
May 2025Institute for Law & AI$5.3MGeneral Support and Field-Building source
May 2025Jacob Steinhardt$2.6MCompute Resources for AI Safety Research (Jacob Steinhardt) source
May 2025RAND Corporation$2.5MEmerging Technology Initiatives source
May 2025Palisade Research$2.1MGeneral Support source
May 2025RAND Corporation$2MTechnology and Security Policy Center source
May 2025Principles of Intelligence$1.7MAI Safety Summer Fellowship source
May 2025Scott Aaronson$1.6MResearch on AI Safety and Computational Complexity Theory (Scott Aaronson) source
May 2025Redwood Research$1.1MAI Safety Research Collaborations source
May 2025Theorem Labs$1MAI for Formal Software Verification (Contract) source
May 2025Centre for the Governance of AI, Inc.$1MGeneral Support source
May 2025Virginia Smith and Steven Wu$584kRobust AI Unlearning Techniques (Virginia Smith, Steven Wu) source
May 2025Sijia Liu, Shiyu Chang, and Mingyi Hong$484kRobust AI Unlearning Techniques (Sijia Liu, Shiyu Chang, Mingyi Hong) source
May 2025Cambridge Boston Alignment Initiative$350k2025 Summer Fellowship source
May 2025Berkeley Existential Risk Initiative$32kAI Governance Workshop source
Apr 2025Institute for AI Policy and Strategy$12MGeneral Support source
Apr 2025FAR AI$6.7MAI Field Building source
Apr 2025FAR AI$2.4MAI Communications and Outreach source
Apr 2025Talos Network$1.5MAI Governance Field-Building source
Apr 2025Christopher Potts$744kAI Interpretability Research (Christopher Potts) source
Apr 2025Carnegie Endowment for International Peace$444kAI Governance Research source
Apr 2025Daniel Kang$265kLLM Hacking Benchmarks source
Apr 2025Anqi Liu$95kCourse Buyouts (Anqi Liu) source
Apr 2025Arb Research$70kAI Governance Retreat source
Mar 2025MATS Research$6.9MAI Safety Research Expenses source
Mar 2025Oxford Martin AI Governance Initiative$5.4MOxford AI Governance Initiative source
Mar 2025Tarbell Center for AI Journalism$2.9MOperating Costs source
Mar 2025London Initiative for Safe AI$1.6MGeneral Support source
Mar 2025SeedAI$1.6MGeneral Support source
Mar 2025Colin Kahl$388kAI Standards Report (Colin Kahl) source
Mar 2025Institute for Security and Technology$284kSemiconductor Policy source
Mar 2025Philip Trammell$165kTransformative AI Summer Program (Philip Trammell) source
Mar 2025AI Safety Argentina$77kResearch Scholarships source
Mar 2025Epoch AI$70kFrontierMath Benchmark Improvements source
Mar 2025SecureBio$37kAI Benchmark Improvements source
Mar 2025Sincxpress Education$30kMechanistic Interpretability Course Development source
Feb 2025Epoch AI$4.1MGeneral Support source
Feb 2025Centre for the Governance of AI, Inc.$3MGeneral Support source
Feb 2025InterACT Lab$775kInterACT Lab (Anca Dragan) source
Feb 2025Daniel Kang$615kZero-knowledge Proofs for Secure AI Audits (Daniel Kang) source
Feb 2025Centre for the Governance of AI, Inc.$442kAI Governance Field-building source
Feb 2025Center for Responsible, Decentralized Intelligence$20kAI Safety Competition Prizes source
Jan 2025Neil Thompson$3.6MAI Trends and Impacts Research (Neil Thompson) source
Jan 2025ERA$2.5MAI Fellowships source
Jan 2025Timaeus$2MOperating Expenses source
Jan 2025Alignment Research Engineer Accelerator$1MAI Safety Technical Program source
Jan 2025Training for Good$461kOperating Costs and EU Tech Policy Fellowship source
Jan 2025Apart Research$161kAI Alignment Hackathons source
Jan 2025Andrew Reddie$100kAI Red-teaming Bootcamp (Andrew Reddie) source
Jan 2025Berkeley Existential Risk Initiative$59kInterACT Lab (Anca Dragan) source
Jan 2025Oxford AI Safety Initiative$18kOffice Access source
2024 123 grants · $137M
DateRecipientAmountPurpose
Dec 2024Christian Tarsney and Brad Knox$785kAI Safety Research (Christian Tarsney, Brad Knox) source
Dec 2024Daniel Kang$725kResearch on AI Benchmarks source
Dec 2024MATS Research$660kAI Safety Research Expenses source
Dec 2024Good Ancestors Policy$580kGood Ancestors Policy — Global Catastrophic Risks Advocacy — Open Philanthropy recommended two grants totaling $580,236 over two years to Good Ancestors to support its work advocating for policy measures in Australia that aim to mitigate catastrophic risks.... [Navigating Transfo source
Dec 2024Trajectory Labs$250kAI Safety Coworking Space source
Dec 2024Cambridge Boston Alignment Initiative$43kCybersecurity Bootcamp source
Nov 2024RAND Corporation$6MAI Security Research source
Nov 2024Tarbell Center for AI Journalism$816kGeneral Support source
Nov 2024Tony Blair Institute for Global Change$636kAI Governance Initiatives source
Nov 2024Centre for the Governance of AI, Inc.$600kGeneral Support source
Nov 2024AI Safety Hub Ltd$590kOperating Costs source
Nov 2024Centre for the Governance of AI, Inc.$400kGeneral Support source
Nov 2024Brianna Rosen and Ciaran Martin$265kAI Cybersecurity Project (Brianna Rosen, Ciaran Martin) source
Nov 2024AI Safety Hungary$22kAI Safety Capacity Building source
Nov 2024Sage$7kAI 2025 Forecasting Questions (Contract) source
Nov 2024Arb Research$5kShallow Review of AI Safety Research source
Oct 2024Centre for the Governance of AI, Inc.$2.5MGeneral Support source
Oct 2024Cambridge Boston Alignment Initiative$1.2MStudent AI Safety Groups source
Oct 2024Forecasting Research Institute$1.1MAI Progress Forecasting Panel source
Oct 2024Kairos$886kAI Safety University Group Support source
Oct 2024The Vista Institute for AI Policy$846kAI Law Field Building source
Oct 2024Kevin Jablonka$829kAnalytical Chemistry Benchmark (Kevin Jablonka) source
Oct 2024MATS Research$710kMATS Program Extension source
Oct 2024Langsikt$660kAI Safety Advocacy source
Oct 2024Forecasting Research Institute$359kTripwire Capability Evaluations source
Oct 2024Observatorio de Riesgos Catastróficos Globales$213kAI Risk Explorer source
Oct 2024Berkeley Existential Risk Initiative$35kOxford Martin AI Governance Initiative source
Oct 2024Virtue AI$30kNeurIPS Prizes source
Oct 2024Cameron Domenico Kirk-Giannini$27kAI Takeoff Speeds Paper (Cameron Domenico Kirk-Giannini) source
Oct 2024Gradient Institute$20kAustralian AI Safety Forum source
Oct 2024Inclusive Abundance Initiative$10kInclusive Abundance Initiative — Abundance Conference — Open Philanthropy recommended a grant of $10,000 to the Inclusive Abundance Initiative to support the Abundance Conference, a gathering focused on advancing solutions to scarcity challenges in... [Navigating Transformative A source
Sep 2024Yizheng Chen$1.7MLLM Cybersecurity Benchmark (Yizheng Chen) source
Sep 2024Arvind Narayanan$863kAI R&D Benchmark (Arvind Narayanan) source
Sep 2024Practical AI Alignment and Interpretability Research Group$737kInterpretability Work source
Sep 2024Jakob Foerster$622kLLM Research Replication (Jakob Foerster) source
Sep 2024Effective Institutions Project$400kAI Governance Work source
Sep 2024Wavefront Security$206kCybersecurity Services source
Sep 2024Florian Tramèr$130kLLM Adversarial Attacks Benchmark (Florian Tramér) source
Sep 2024Berkeley Existential Risk Initiative$30kAlgorithmic Alignment Group source
Aug 2024RAND Corporation$6MTechnology and Security Policy Center source
Aug 2024Centre for Long-Term Resilience$5.1MGeneral Support source
Aug 2024Center for Responsible Innovation$3MGeneral Support source
Aug 2024Americans for Responsible Innovation$3MGeneral Support source
Aug 2024Algorithmic Research Group$1.1MLanguage Model Capabilities Benchmarking source
Aug 2024Koushik Sen$740kSoftware Engineering Benchmark (Koushik Sen) source
Aug 2024Supervised Program for Alignment Research$189kResearch Mentorship Program source
Jul 2024RAND Corporation$5MEmerging Technology Initiatives source
Jul 2024Percy Liang$2.9MLLM Cybersecurity Benchmark (Percy Liang) source
Jul 2024Individual #3270$2.1MLLM Cybersecurity Benchmark (Individual #3270, Individual #3270, Individual #3270)
Jul 2024Center for Open Science$1.7MLLM Research Benchmark source
Jul 2024Najoung Kim and Sebastian Schuster$756kLLM Research Benchmark (Najoung Kim, Sebastian Schuster) source
Jul 2024London Initiative for Safe AI$739kGeneral Support source
Jul 2024FAR AI$676kAI Alignment Research Projects source
Jul 2024Talos Network$662kGeneral Support source
Jul 2024Cambridge in America$518kData Science Benchmark  (Lorenzo Pacchiardi, José Hernández-Orallo, Lucy Cheke) source
Jul 2024Foundation for American Innovation$424kAI Safety Policy Research and Advocacy (Exit Grant) source
Jul 2024Alignment Research Engineer Accelerator$318kAI Safety Technical Program source
Jul 2024Centre for International Governance Innovation$300kGlobal AI Risks Initiative source
Jul 2024Cambridge Boston Alignment Initiative$78kAI Research and Governance Workshop source
Jul 2024Individual #5447$70kLLM Model-Based Planning Report
Jul 2024Individual #6550$55kEconomics Research on AI Model Scaling Effects
Jun 2024Constellation$17MProgrammatic Activities and Operating Expenses source
Jun 2024FAR AI$12MAI Safety Regranting source
Jun 2024MATS Research$3.4MMATS Program 6.0 + 7.0 source
Jun 2024Palisade Research$1.7MGeneral Support source
Jun 2024Josh Kalla$596kLLM Persuasiveness Evaluation (Josh Kalla) source
Jun 2024William Wang$133kLLM Use Case Database (William Wang) source
Jun 2024Dongyeop Kang$74kLegal Automation Benchmark (Dongyeop Kang) source
Jun 2024Harmony Intelligence$54kLLM Moneymaking Benchmark source
May 2024MATS Research$2.4MMATS Program 6.0 + 7.0 source
May 2024Apollo Research$2.2MGeneral Support source
May 2024Mila$2MAI Safety Research source
May 2024David Bau$1.1MLarge Language Model Interpretability Research (David Bau) source
May 2024Karthik Narasimhan$1MSoftware Engineering LLM Benchmark (Karthik Narasimhan) source
May 2024Tatsunori Hashimoto$880kLLM-Generated Research Ideation Benchmark (Tatsunori Hashimoto) source
May 2024Sage$550kAI Explainers source
May 2024Metaculus$532kForecasting Tournaments source
May 2024Hong Shen and Fei Fang$267kLLM Use Case Database (Hong Shen, Fei Fang) source
May 2024AI Standards Lab$200kAI Standards and Risk Management Frameworks source
May 2024Effective Altruism Israel$139kInformation Security Talent Development source
May 2024Faculty AI$93kWargame for AI Documentary source
May 2024International Institute of Information Technology Hyderabad$7kAI Systems Course (Ponnurangam Kumaraguru) source
Apr 2024Constellation$3.2MGeneral Support source
Apr 2024RAND Corporation$2.5MEmerging Technology Fellowships and Research source
Apr 2024FAR AI$2.2MGeneral Support source
Apr 2024FAR AI$1.8MAI Field Building source
Apr 2024FAR AI$1.7MFAR Labs Office Space source
Apr 2024SeedAI$1.5MAI Policy Development and Related Events source
Apr 2024Simon Institute for Longterm Governance$1.5MGeneral Support source
Apr 2024Institute for AI Policy and Strategy$828kGeneral Support source
Apr 2024Benjamin Bergen$471kAI Persuasiveness Evaluation (Benjamin Bergen) source
Apr 2024LASR Labs$289kFellowship Program source
Apr 2024Forecasting Research Institute$125kRed-line Evaluations source
Apr 2024Rethink Priorities$116kResearch on LLM Use source
Apr 2024Dimitris Papailiopoulos$100kScalable Oversight Research (Dimitris Papailiopoulos) source
Apr 2024Jason Lee$100kScalable Oversight Research (Jason Lee) source
Apr 2024Forecasting Research Institute$100kForecasting Benchmark source
Apr 2024EA Netherlands$25kAI Safety Retreat source
Apr 2024Berkeley Existential Risk Initiative$21kAI for Epistemics Workshop source
Mar 2024London Initiative for Safe AI$821kLondon Coworking Space source
Mar 2024FutureSearch$607kBenchmark for Language Model Forecasting source
Mar 2024Graham Neubig$547kBenchmark for Web-Based Tasks (Graham Neubig) source
Mar 2024LawAI$300kGeneral Support source
Mar 2024Observatorio de Riesgos Catastróficos Globales$110kAI Policy Work source
Mar 2024Berkeley Existential Risk Initiative$45kLatent Adversarial Training Project source
Feb 2024Berkeley Existential Risk Initiative$713kAI Risk Management Frameworks source
Feb 2024Straumli$400kLLM Cyberoffense Benchmark source
Feb 2024Center for Long-Term Cybersecurity$200kAI Risk Management Frameworks source
Feb 2024Institute for Replication$174kLarge Language Model Replication Games source
Feb 2024Samet Oymak$100kScalable Oversight Research (Samet Oymak) source
Feb 2024Gabriel Weil$20kAI Governance Legal Research (Gabriel Weil) source
Jan 2024Institute for AI Policy and Strategy$3MGeneral Support source
Jan 2024Berkeley Existential Risk Initiative$1.1MCHAI Internships source
Jan 2024Martin Wattenberg$1MAI Interpretability, Controllability, and Safety Research (Martin Wattenberg, Fernanda Viégas) source
Jan 2024Daniel Kang$800kLLM Hacking Benchmarks (Daniel Kang) source
Jan 2024ERA$768kCambridge AI Fellowship source
Jan 2024FAR AI$646kAI Alignment Research Projects source
Jan 2024AI Safety Support$617kAstra Fellowship source
Jan 2024Individual #1953$223kLLM Misuse Database
Jan 2024Nice Light$127kAI Documentary source
2024Players Philanthropy Fund$110kPolicy research on AI in the EU and Latin America (fiscally sponsored project) — paid by Open Philanthropy Action Fund (501(c)(4), now Coefficient Giving Action Fund), tax year Jan–Dec 2024 (Form 990 Schedule I Part II; payment in that year, not the grant total) source
2024Future Tech Insights$100kImproving public understanding of AI safety — paid by Open Philanthropy Action Fund (501(c)(4), now Coefficient Giving Action Fund), tax year Jan–Dec 2024 (Form 990 Schedule I Part II; payment in that year, not the grant total) source
2024Ashgro$31kAI safety community-building work (fiscally sponsored project) — paid by Open Philanthropy Action Fund (501(c)(4), now Coefficient Giving Action Fund), tax year Jan–Dec 2024 (Form 990 Schedule I Part II; payment in that year, not the grant total) source
2023 101 grants · $91M
DateRecipientAmountPurpose
Dec 2023Safe AI Forum$1.2MSafe AI Forum — Operating Expenses — Open Philanthropy recommended two grants totaling $1,167,513 to the Safe AI Forum to support its work on AI policy. This falls within our focus area of potential risks from advanced artificial... [Navigating Transformative AI; Coefficient Givi source
Nov 2023Eleuther AI$2.6MGrant "to support the work of Nora Belrose. Nora will conduct research on AI interpretability and hire other researchers to assist her in this work.". From Vipul Naik's donations database (via OpenBook) source
Nov 2023London Initiative for Safe AI$237kLondon Initiative for Safe AI (LISA) — General Support — Open Philanthropy recommended a grant of $237,000 to the London Initiative for Safe AI (LISA) for general support. LISA is a research center that improves the safety of advanced AI systems by... [Navigating Transformative A source
Nov 2023Stanford University$120kStanford University — AI Economic Impacts Workshop — Open Philanthropy recommended a gift of $120,000 to Stanford University to support a workshop on the economic and societal impacts of transformative AI. One of the organizers was the Stanford Digital... [Navigating Transformati source
Nov 2023Alignment Research Engineer Accelerator$98kAlignment Research Engineer Accelerator — AI Safety Technical Program (2023) — Open Philanthropy recommended a grant of £80,268 ($98,186 at the time of conversion) to support the Alignment Research Engineer Accelerator (ARENA), a program to help individuals interested in AI... [N source
Oct 2023RAND$11MRAND Corporation — Emerging Technology Initiatives — Open Philanthropy gave a gift of $10.5 million to RAND Corporation, to be spent at the discretion of RAND president and CEO Jason Matheny. Matheny has allocated this funding across multiple... [Navigating Transformative AI; Coe source
Oct 2023Center for AI Safety$1.9MCenter for AI Safety — Exit Grant (October 2023) — Open Philanthropy recommended a grant of $1,866,559 to the Center for AI Safety (CAIS) for general support. CAIS works on research, field-building, and advocacy to reduce existential risks from... [Navigating Transformative AI; C source
Oct 2023Berkeley Existential Risk Initiative$70kGrant "to support [BERI's] university collaboration program. Selected applicants become eligible for support and services from BERI that would be difficult or impossible to obtain through normal university channels. BERI will use these.... From Vipul Naik's donations database (vi source
Oct 2023University of California, Berkeley$26kUniversity of California, Berkeley — AI Alignment Workshop — Open Philanthropy recommended a gift of $26,000 to UC Berkeley to support a small workshop bringing together experts in computational social choice theory and AI alignment. Professor Wesley H.... [Navigating Transformat source
30 Sep 2023Forecasting Research Institute$75kAI Worldviews Contest: Forecasting Research Institute Prize for the Existential Risk Persuasion Tournament (XPT) (Open Philanthropy prize, announced 30 Sep 2023) source
30 Sep 2023Basil Halperin, Individual #2053 and Individual #7312$50kAI Worldviews Contest first prize: 'AGI and the EMH: markets are not expecting aligned or unaligned AI in the next 30 years' (Open Philanthropy prize, announced 30 Sep 2023) source
30 Sep 2023Individual #6438$50kAI Worldviews Contest first prize: 'Evolution provides no evidence for the sharp left turn' (Open Philanthropy prize, announced 30 Sep 2023)
30 Sep 2023Individual #2769$38kAI Worldviews Contest second prize: 'Deceptive Alignment is <1% Likely by Default' (Open Philanthropy prize, announced 30 Sep 2023)
30 Sep 2023Individual #2324$38kAI Worldviews Contest second prize: 'AGI Catastrophe and Takeover: Some Reference Class-Based Priors' (Open Philanthropy prize, announced 30 Sep 2023)
30 Sep 2023Individual #6849$25kAI Worldviews Contest third prize: 'Imitation Learning is Probably Existentially Safe' (Open Philanthropy prize, announced 30 Sep 2023)
30 Sep 2023Individual #7590$25kAI Worldviews Contest third prize: "'Dissolving' AI Risk – Parameter Uncertainty in AI Future Forecasting" (Open Philanthropy prize, announced 30 Sep 2023)
Sep 2023OpenMined$6MGrant "to support work on developing software that facilitates access to advanced AI systems for external researchers and auditors while preserving privacy, security, and intellectual property.". From Vipul Naik's donations database (via OpenBook) source
Sep 2023Individual #4413$397kIndividual #4413 – Language Model Capabilities Benchmarking — Open Philanthropy recommended a grant of $397,350 to Individual #4413 to support a project developing evaluations that will benchmark the ability of language model agents to accelerate AI R&D. This... [Navigating Trans
Sep 2023FAR AI$167kGrant "to support a two-day alignment workshop in advance of NeurIPS 2023, a major machine learning and computational neuroscience conference.". From Vipul Naik's donations database (via OpenBook) source
Sep 2023Surge AI$124kGrant "to support Gabriel Recchia in producing data points for a research project on sandwiching experiments and capability evaluations of large language models." The webpage https://uk.linkedin.com/in/gabriel-recchia-38575b10 and the.... From Vipul Naik's donations database (via source
Sep 2023Northeastern University$116kGrant "to support a postdoctoral position for Sam Marks in Professor David Bau’s lab, where Sam will conduct research on mechanistic interpretability." The webpages https://baulab.info/ and.... From Vipul Naik's donations database (via OpenBook) source
Sep 2023University of Pennsylvania$110kGrant "to support a series of roundtables led by Professor Peter Conti-Brown. At these events, experts will discuss how insights from financial regulation might inform emerging discussions on AI governance." The webpage.... From Vipul Naik's donations database (via OpenBook) source
Sep 2023Berkeley Existential Risk Initiative$70kGrant " to support the creation of a scalable oversight dataset. The purpose of the dataset is to collect questions that non-experts can’t answer even with the internet at their disposal; these kinds of questions can be used to test how.... From Vipul Naik's donations database (v source
Aug 2023Guide Labs$750kGrant "to support a project developing and testing AI error diagnostics and model guiding tools. To support AI safety and alignment, these tools will be made freely available to the general public.". From Vipul Naik's donations database (via OpenBook) source
Aug 2023AI Impacts$620kAI Impacts — General Support (2023) — Open Philanthropy recommended a grant of $620,000 over two years to AI Impacts for general support. AI Impacts works to answer questions about the future of artificial intelligence. This follows our... [Navigating Transformative AI; Coefficie source
Aug 2023Modulo Research$408kGrant "to support research — led by Gabriel Recchia — into large language model sandwiching experiments, dataset development, and capability evaluations." The webpage https://uk.linkedin.com/in/gabriel-recchia-38575b10 and the LessWrong.... From Vipul Naik's donations database (v source
Aug 2023University of Maryland$350kUniversity of Maryland — Research on Neural Network Generalization — Open Philanthropy recommended a grant of $350,000 over three years to the University of Maryland to support research led by Professor Individual #5877 on how neural networks generalize. We sought... [Navigating source
Aug 2023AI Impacts$345kAI Impacts — Expert Survey on Progress in AI — Open Philanthropy recommended a grant of $345,000 to AI Impacts to support an expert survey on progress in artificial intelligence. AI Impacts works to answer questions about the future of artificial... [Navigating Transformative AI; source
Aug 2023AI Safety Communications Centre$288kThe grant page says: "This project provides the AI safety community with communications support, and connects journalists to AI safety experts and resources." https://aiscc.org/ is the linked grantee website.. From Vipul Naik's donations database (via OpenBook) source
Aug 2023Swiss AI Safety Summer Camp$51kGrant "to the Swiss AI Safety Summer Camp to support its 2023 bootcamp. The program offers a multidisciplinary learning experience through activities such as deep learning courses, paper readings, discussions, presentations, and.... From Vipul Naik's donations database (via OpenB source
Aug 2023University of Utah$32kGrant "to support Daniel Brown in developing a course on human-AI alignment.". From Vipul Naik's donations database (via OpenBook) source
Jul 2023Massachusetts Institute of Technology$2.9MMassachusetts Institute of Technology — AI Trends and Impacts Research (2023) — Open Philanthropy recommended a grant of $2,911,324 over four years to the Massachusetts Institute of Technology to support research led by Neil Thompson on modeling the trends and impacts of AI and.. source
Jul 2023FAR AI$460kFrom Vipul Naik's donations database (via OpenBook) source
Jul 2023Berkeley Existential Risk Initiative$35kGrant "to support a retreat for Anca Dragan’s BAIR lab group, where members will discuss potential risks from advanced artificial intelligence.". From Vipul Naik's donations database (via OpenBook) source
Jun 2023Horizon Institute for Public Service$12MGeneral support (emerging-tech policy fellowships, AI-heavy) — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Redwood Research$5.3MGrant "for general support. Redwood Research is a nonprofit research institution focused on aligning advanced AI with human interests.". From Vipul Naik's donations database (via OpenBook) source
Jun 2023Redwood Research$3MOperations of a coworking space for professionals working on the long-run future of humanity — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Apollo Research$1.5MApollo Research — Startup Funding — Open Philanthropy recommended a grant of $1,535,480 to Apollo Research for startup costs. Apollo Research is a new organization that will conduct research on how to evaluate whether AI models are... [Navigating Transformative AI; Coefficient Gi source
Jun 2023AI Safety Support$1.2MAI Safety Support — SERI MATS 4.0 — Open Philanthropy recommended three grants totaling $1,240,840 to AI Safety Support to support their collaboration with Stanford Existential Risks Initiative (SERI) on SERI’s Machine Learning... [Navigating Transformative AI; Coefficient Giving source
Jun 2023New York University$1MProject on language model alignment research — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023New York University$966kProject testing the truthfulness of AI systems — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Effective Ventures Foundation USA$770kLongview Philanthropy's collaborative AI policy work — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023University of Toronto$762kProjects related to AI alignment — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Stanford University$700kHonesty in language models — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Foundation for American Innovation$553kFoundation for American Innovation — AI Safety Policy Advocacy — Open Philanthropy recommended a grant of $552,500 to the Foundation for American Innovation to support its work on policy research and advocacy intended to improve AI safety. This falls within our... [Navigating Tra source
Jun 2023Center for Applied Rationality$500kLightcone project and team — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Stanford University$500kAI alignment research pipeline for young researchers — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Berkeley Existential Risk Initiative$429kBerkeley Existential Risk Initiative — SERI MATS 4.0 — Open Philanthropy recommended a grant of $428,942 to the Berkeley Existential Risk Initiative to support their collaboration with Stanford Existential Risks Initiative (SERI) on SERI’s Machine... [Navigating Transformative AI source
Jun 2023Cornell University$395kProject on improving AI systems' responses — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023University of Illinois Foundation$375kBenchmarks for language tasks — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Northeastern University$356kInitiative for the interpretable control of AI — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Stanford University$300kGenerative models of neural network representations — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Technion Israel Institute of Technology$260kInterpretability of large transformer language models — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Modulo Research$257kSharing research findings and advancing safe and beneficial AI — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Federation of American Scientists$204kFellowship aligned with long-term societal impacts of AI and biosecurity — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Federation of American Scientists$204kFellowship aligned with long-term societal impacts of AI and biosecurity (second line of the same amount on the filing) — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Forecasting Research Institute$150kProject on forecasts related to AI — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Concordia University$102kAdversarial attacks on interpretability in deep learning — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Players Philanthropy Fund$100kDevelopment of a database on AI incidents (fiscally sponsored project) — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Brookings Institution$92kFellowships for artificial intelligence experts — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Rethink Charity$45kAlignment theory research — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Center for Democracy and Technology$27kFellowship related to AI risks — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Carnegie Endowment for International Peace$26kTech policy fellowships related to AI policy — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2023Center for Applied Rationality$11kFellowship program on AI safety — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2022–Jun 2023 (990-PF Part XIV 3a; payment in that year, not the grant total) source
May 2023Centre for the Governance of AI$3MCentre for the Governance of AI — General Support (2023) — Open Philanthropy recommended a grant of $3,000,000 to the Centre for the Governance of AI (GovAI) for general support. GovAI conducts research on AI governance and works to develop a talent pipeline... [Navigating Transf source
May 2023Effective Ventures Foundation USA$1.2MOwain Evans Research Group — AI Evaluations Research — Open Philanthropy recommended a grant of $1,171,120 to Effective Ventures Foundation USA to support a new AI safety research group, TruthfulAI, led by Owain Evans, that will focus on evaluating... [Navigating Transformative A source
May 2023University of Chicago$250kUniversity of Chicago — Research on Complementary AI — Open Philanthropy recommended a grant of $250,000 to the University of Chicago to support research, led by Professor Chenhao Tan, on how to train AI systems to complement human efforts. This falls... [Navigating Transformativ source
May 2023Conjecture$224kConjecture — AI Safety Technical Program — Open Philanthropy recommended a grant of $223,569 to Conjecture to support the Alignment Research Engineer Accelerator (ARENA) program, which helps individuals interested in AI safety improve their... [Navigating Transformative AI; Coeff source
May 2023AI Safety Support$146kAI Safety Support — AI Safety Technical Program (May 2023) — Open Philanthropy recommended a grant of $146,165 to AI Safety Support to support the Alignment Research Engineer Accelerator (ARENA) program, which helps individuals interested in AI safety improve... [Navigating Trans source
May 2023Mila$50kMila — Workshop on Human-Level AI — Open Philanthropy recommended a grant of $50,000 to Mila - Quebec Artificial Intelligence Institute to support a workshop on human-level artificial intelligence, led by Professor Jacob Steinhardt,... [Navigating Transformative AI; Coefficient G source
Apr 2023Epoch$6.9MGrant "for general support. Epoch researches trends in machine learning to better understand the pace of progress in artificial intelligence, and to help forecast the development of advanced AI and its subsequent economic impacts.". From Vipul Naik's donations database (via OpenB source
Apr 2023RAND$5.5MRAND Corporation — Emerging Technology Fellowships and Research — Open Philanthropy gave a gift of $5.5 million to RAND Corporation, to be spent at RAND President Jason Matheny's discretion. Matheny has designated this funding to launch two new initiatives: a... [Navigating Trans source
Apr 2023Center for AI Safety$4MCenter for AI Safety — General Support (2023) — Open Philanthropy recommended a grant of $4,025,729 to the Center for AI Safety for general support. The Center for AI Safety works on research, field-building, and advocacy to reduce existential... [Navigating Transformative AI; Co source
Apr 2023AI Safety Support$444kThree grants "to support research led by Owain Evans to evaluate whether machine learning models have situational awareness. These grants were made to AI Safety Support, Effective Ventures Foundation USA, and the Berkeley Existential.... From Vipul Naik's donations database (via source
Apr 2023University of Maryland$313kGrant "to the University of Maryland to support a fellowship related to technology and national security.". From Vipul Naik's donations database (via OpenBook) source
Apr 2023Rethink Priorities$302kGrant "to support an in-person workshop bringing together professionals working on AI governance.". From Vipul Naik's donations database (via OpenBook) source
Apr 2023Stanford University$250kStanford University — Language Model Evaluations — Open Philanthropy recommended a grant of $250,000 to Stanford University to support Holistic Evaluation of Language Models (HELM), which is a project to evaluate language models using many different... [Navigating Transformative source
Apr 2023Conjecture$245kGrant "to support [Conjecture's] collaboration with the Stanford Existential Risks Initiative (SERI) on SERI’s Machine Learning Alignment Theory Scholars (MATS) program. MATS is an educational seminar and independent research program.... From Vipul Naik's donations database (via source
Apr 2023Leap Labs$230kGrant "to Leap Labs to support research on AI interpretability, particularly model agnostic interpretability." The links are as follows: https://www.alignmentforum.org/s/Tp3ryR4AxY56ctGh2/p/CzZ6Fch4JSpwCpu6C for AI interpretability and.... From Vipul Naik's donations database (vi source
Apr 2023Rethink Priorities$155kGrant "to support research on AI governance, with a focus on hardware security features.". From Vipul Naik's donations database (via OpenBook) source
Apr 2023University of Utah$140kUniversity of Utah — AI Alignment Research — Open Philanthropy recommended a grant of $140,000 to the University of Utah to support research led by Professor Daniel Brown on ways to verify the extent to which an AI system is aligned with human... [Navigating Transformative AI; Co source
Mar 2023FAR AI$280kGrant "to support FAR Labs, an office space in Berkeley for people working on AI safety and alignment.". From Vipul Naik's donations database (via OpenBook) source
Mar 2023FAR AI$100kFAR.AI — AI Interpretability Research — Open Philanthropy recommended a grant of $100,000 to FAR.AI to support a research project, led by Open Philanthropy AI Fellow Individual #3881, aimed at developing a neural network architecture that could... [Navigating Transformative AI; C source
Mar 2023University of Illinois$80kUniversity of Illinois — AI Alignment Research — Open Philanthropy recommended a grant of $80,000 to the University of Illinois to support Professor Ben Levinstein’s research on AI alignment. This falls within our focus area of potential risks from... [Navigating Transformative A source
Mar 2023California State University, San José$39kGrant "to support research by Professor Individual #7858 on AI forecasting and AI governance." The webpage https://www.sjsu.edu/people/yan.zhang/ is linked.. From Vipul Naik's donations database (via OpenBook) source
Feb 2023Center for AI Safety$1.4MGrant "to support the CAIS Philosophy Fellowship, which is a research fellowship that will support philosophers researching topics related to AI safety. This grant also supported a workshop on adversarial robustness, as well as prizes.... From Vipul Naik's donations database (via source
Feb 2023Longview Philanthropy$770kLongview Philanthropy — AI Policy Development at the OECD — Open Philanthropy recommended a grant of €720,000 (approximately $770,076 at the time of conversion) to Longview Philanthropy to support their collaboration with the Organization for Economic... [Navigating Transformativ source
Feb 2023University of Tübingen$575kGrant "to support research led by Professor Matthias Bethge on adversarial robustness as a means to improve AI safety.". From Vipul Naik's donations database (via OpenBook) source
Feb 2023Cornell University$343kCornell University — AI Safety Research — Open Philanthropy recommended a grant of $342,645 to Cornell University to support Professor Lionel Levine’s research related to AI alignment and safety. This falls within our focus area of potential... [Navigating Transformative AI; Coef source
Feb 2023Epoch$189kGrant "to support [Epoch's] “worldview investigations” related to AI." The linked blog post section https://www.openphilanthropy.org/research/our-progress-in-2019-and-plans-for-2020/#worldview-investigations describes this in more.... From Vipul Naik's donations database (via Ope source
Feb 2023Responsible AI Collaborative$100kGrant "to support its work maintaining the AI Incident Database, which is a database of incidents where AI systems have caused real-world harm." https://incidentdatabase.ai/ is the linked webpage for the AI Incident Database.. From Vipul Naik's donations database (via OpenBook) source
Feb 2023Brian Christian$38kGrant "to support a DPhil in psychology at the University of Oxford. His research will focus on human preferences, with the goal of informing efforts to align AI systems with human values.". From Vipul Naik's donations database (via OpenBook) source
Feb 2023Alignment Research Engineer Accelerator$19kGrant "to support the Alignment Research Engineer Accelerator (ARENA), which is a program to help individuals interested in AI safety improve their technical skills in machine learning.". From Vipul Naik's donations database (via OpenBook) source
Jan 2023University of California, Santa Cruz$114kGrant "to support research, led by Professor Cihang Xie, on adversarial robustness in AI systems. This funding will support salaries and other costs for two graduate students in Professor Xie’s lab." The webpage.... From Vipul Naik's donations database (via OpenBook) source
Jan 2023University of British Columbia$100kGrant "over two years to the University of British Columbia to support research led by Professor Jeff Clune on AI alignment." The webpage https://www.cs.ubc.ca/people/jeff-clune is linked.. From Vipul Naik's donations database (via OpenBook) source
Jan 2023University of Toronto$80kGrant "to support Toryn Klassen’s research on topics related to AI alignment.". From Vipul Naik's donations database (via OpenBook) source
Jan 2023Neel Nanda$70kGrant "to Neel Nanda to support his independent research on interpretability. His work is aimed at improving human understanding of neural networks and machine learning models.". From Vipul Naik's donations database (via OpenBook) source
Jan 2023Individual #7961$19kGrant "to Individual #7961 to support his independent technical research on AI alignment.". From Vipul Naik's donations database (via OpenBook)
2023Cambridge Boston Alignment Initiative$405kAI safety community-building work — paid by Open Philanthropy Action Fund (501(c)(4), now Coefficient Giving Action Fund), tax year Jan–Dec 2023 (Form 990 Schedule I, as reproduced on Kindora's funder page, listed there under 2024; payment in that year, not the grant total) [amou source
2023Federation of American Scientists$400kPolicy change addressing challenges with AI advancements — paid by Open Philanthropy Action Fund (501(c)(4), now Coefficient Giving Action Fund), tax year Jan–Dec 2023 (Form 990 Schedule I, as reproduced on Kindora's funder page, listed there under 2024; payment in that year, not source
2023IFP Action$342kAI policy — paid by Open Philanthropy Action Fund (501(c)(4), now Coefficient Giving Action Fund), tax year Jan–Dec 2023 (Form 990 Schedule I, as reproduced on Kindora's funder page, listed there under 2024; payment in that year, not the grant total) source
2022 68 grants · $66M
DateRecipientAmountPurpose
Dec 2022FAR AI$625kGrant "for general support. FAR AI works to incubate and accelerate research agendas to ensure AI systems are more trustworthy and beneficial to society.". From Vipul Naik's donations database (via OpenBook) source
Dec 2022Georgetown University$239kGrant "to support a fellowship related to AI and cybersecurity policy.". From Vipul Naik's donations database (via OpenBook) source
Dec 2022Purdue University$170kGrant "to support research led by Professor Xiangyu Zhang on improving the robustness of language models against adversarial attacks." The webpage https://www.cs.purdue.edu/homes/xyzhang/ is linked.. From Vipul Naik's donations database (via OpenBook) source
Dec 2022Individual #2350$110kGrant "to support [grantee's] independent research on AI alignment." The Google Scholar citations page https://scholar.google.com/citations?user=_6nYXQYAAAAJ is linked from the grantee's name.. From Vipul Naik's donations database (via OpenBook)
Dec 2022Apart Research$89kThe grant page says: "two grants totaling $130,050 to Apart Research to support their work hosting four “hackathons” where participants will work on small projects related to AI alignment.". From Vipul Naik's donations database (via OpenBook) source
Dec 2022FAR AI$50kGrant "to support [FAR AI's] research on machine learning interpretability, in collaboration with Open Philanthropy AI Fellow Individual #3881.". From Vipul Naik's donations database (via OpenBook) source
Dec 2022FAR AI$50kGrant "to support their Inverse Scaling Prize, which is a contest that awards prizes to contestants who find examples of tasks where language models perform worse as they scale.". From Vipul Naik's donations database (via OpenBook) source
Dec 2022Individual #5641$7kGrant "to support [grantee's] work to organize a workshop on AI risk.". From Vipul Naik's donations database (via OpenBook)
Nov 2022Center for AI Safety$5.2MGrant "for general support. The Center for AI Safety does technical research and field-building aimed at reducing catastrophic and existential risks from artificial intelligence.". From Vipul Naik's donations database (via OpenBook) source
Nov 2022Berkeley Existential Risk Initiative$2MGrant "to support their collaboration with the Stanford Existential Risks Initiative (SERI) on SERI’s Machine Learning Alignment Theory Scholars (MATS) program. MATS is an educational seminar and independent research program that aims.... From Vipul Naik's donations database (via source
Nov 2022AI Safety Support$1.5MGrant "to support [AI Safety Support's] collaboration with Stanford Existential Risks Initiative (SERI) on SERI’s Machine Learning Alignment Theory Scholars (MATS) program. MATS is an educational seminar and independent research program.... From Vipul Naik's donations database (v source
Nov 2022Alignment Research Center$1.3MGrant "for general support. The Alignment Research Center conducts research on how to align AI with human interests, with a focus on techniques that could be adopted in existing machine learning systems and effectively scale up to.... From Vipul Naik's donations database (via Ope source
Nov 2022Northeastern University$562kGrant "to support Professor David Bau’s research on interpreting large language models." The webpage https://baulab.info/ is linked.. From Vipul Naik's donations database (via OpenBook) source
Nov 2022Individual #5159$110kGrant "to support his independent journalism on topics related to computer science, AI, and AI safety." The webpage https://mordechairorvig.com/ is linked.. From Vipul Naik's donations database (via OpenBook)
Nov 2022Berkeley Existential Risk Initiative$100kGrant "for general support. BERI seeks to reduce existential risks to humanity by providing services and support to university-based research groups, including the Center for Human-Compatible AI at the University of California, Berkeley.". From Vipul Naik's donations database (vi source
Nov 2022Jacob Steinhardt$100kGrant "to provide operational support to Steinhardt’s lab at the University of California Berkeley, which specializes in research on how to align machine learning systems." The webpage https://jsteinhardt.stat.berkeley.edu/ is linked.. From Vipul Naik's donations database (via Op source
Nov 2022AI Safety Hub$47kAI Safety Hub — Safety Labs — Open Philanthropy recommended a grant of £37,359 (approximately $47,359 at the time of conversion) to AI Safety Hub to support its Safety Labs program, which will match students with mentors while... [Navigating Transformative AI; Coefficient Giving source
Oct 2022Conjecture$457kConjecture — SERI MATS Program in London (2022) — Open Philanthropy recommended a grant of $457,380 to Conjecture to support their collaboration with the Stanford Existential Risks Initiative (SERI) on SERI’s Machine Learning Alignment Theory... [Navigating Transformative AI; Coe source
Oct 2022Foundation Model Tracker$15kGrant "to Individual #7241 to support his work on maintaining Foundation Model Tracker, a website that tracks the release of large AI models." The webpage https://foundationmodeltracker.com/ is linked, but does not work as of 2023-11-19..... From Vipul Naik's donations database (
Oct 2022OxAI Safety Hub$12kGrant "to Catherine Brewer to support the OxAI Safety Hub, which is a new Oxford-based group working on building the AI safety community.". From Vipul Naik's donations database (via OpenBook) source
Sep 2022AI Safety Hub$204kThe grant page says: "Open Philanthropy recommended two grants totaling $235,000 to the AI Safety Hub to support their initial development costs, and to hire several contractors to work on projects related to AI safety. The AI Safety.... From Vipul Naik's donations database (via source
Sep 2022AI Alignment Awards$70kGrant "over 1.5 years to AI Alignment Awards to support a contest asking participants to share ideas on how AI systems can be designed or trained to avoid the shutdown problem." The webpage https://www.alignmentawards.com/shutdown is.... From Vipul Naik's donations database (via source
Sep 2022Centre for the Governance of AI$51kGrant "to support a workshop bringing together compute experts from several subfields, such as large-model infrastructure, ASIC design, and governance, to discuss compute governance ideas that could reduce existential risk from.... From Vipul Naik's donations database (via OpenBo source
Sep 2022Centre for the Governance of AI$19kGrant "to support a new research assistant.". From Vipul Naik's donations database (via OpenBook) source
Aug 2022Redwood Research$11MGrant "for general support. Redwood Research is a nonprofit research institution focused on aligning advanced AI with human interests.". From Vipul Naik's donations database (via OpenBook) source
Aug 2022FAR AI$464kGrant "to support research projects, led by Ethan Perez, related to misalignment in language models.". From Vipul Naik's donations database (via OpenBook) source
Aug 2022Centre for Effective Altruism$250kGrant "to rent and refurbish a temporary office space for one year for the Harvard AI Safety Team." The webpage https://haist.ai/ is linked.. From Vipul Naik's donations database (via OpenBook) source
Aug 2022Arizona State University$200kArizona State University — Adversarial Robustness Research — Open Philanthropy recommended a grant of $200,000 over three years to Arizona State University to support research led by Professor Chaowei Xiao on adversarial robustness in machine learning systems.... [Navigating Tran source
Aug 2022Individual #3182$175kGrant to "support [[name withheld]'s] work on AI alignment. [name withheld] will continue work on a website explaining how artificial intelligence poses a global risk, and continue work on proposals for experiments related to AI safety." The webpage.... From Vipul Naik's donation
Jul 2022Center for a New American Security$4.8MGrant to "support work related to artificial intelligence policy and governance.". From Vipul Naik's donations database (via OpenBook) source
Jul 2022Carnegie Mellon University$343kGrant to "support research led by Professor Aditi Raghunathan on adversarial examples (inputs optimized to cause machine learning models to make mistakes)." The webpages https://www.cs.cmu.edu/~aditirag/ and.... From Vipul Naik's donations database (via OpenBook) source
Jul 2022Stanford University$154kGrant "to support research on AI alignment by Professor Clark Barrett and Stanford student Individual #1851.". From Vipul Naik's donations database (via OpenBook) source
Jun 2022Epoch$2MGrant "for general support. Epoch is a research organization that works on investigating trends in machine learning and forecasting the development of transformative artificial intelligence.". From Vipul Naik's donations database (via OpenBook) source
Jun 2022Massachusetts Institute of Technology$1MDeception and truthfulness in language models — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2021–Jun 2022 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2022University of Massachusetts Amherst$822kImproving AI translation of novels — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2021–Jun 2022 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2022UC Berkeley$800kTruthfulness problems in language models — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2021–Jun 2022 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2022University of Chicago$749kCounterfactual feedback for AI systems — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2021–Jun 2022 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2022University of North Carolina at Chapel Hill$650kAI language generation project — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2021–Jun 2022 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2022Columbia University$603kAI language generation project — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2021–Jun 2022 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2022Cornell University$603kProject on improving AI systems' responses — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2021–Jun 2022 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2022AI Squared$500kBelief and reasoning dataset testing language-model consistency — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2021–Jun 2022 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2022Stanford University$500kAI alignment research pipeline for young researchers — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2021–Jun 2022 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2022Georgia Tech Research Corporation$458kDemocratizing reinforcement learning via non-expert feedback — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2021–Jun 2022 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2022University of Texas at Austin$433kFeedback to question-answering models — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2021–Jun 2022 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2022AI Impacts$365kGrant "for general support. AI Impacts works on strategic questions related to advanced artificial intelligence.". From Vipul Naik's donations database (via OpenBook) source
Jun 2022Princeton University$258kState-of-the-art computer vision models — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2021–Jun 2022 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2022Center for Democracy and Technology$55kFellowship on AI risks — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2021–Jun 2022 (990-PF Part XIV 3a; payment in that year, not the grant total) source
Jun 2022Berkeley Existential Risk Initiative$40kBerkeley Existential Risk Initiative — Language Model Alignment Research — Open Philanthropy recommended a grant of $40,000 over three years to the Berkeley Existential Risk Initiative to support a project led by Professor Samuel Bowman of New York University to develop a... [Nav source
Apr 2022Unknown recipients$1.8MOpen Phil AI Fellowship: Grant to provide scholarship to eleven machine learning researchers over five years.. From Vipul Naik's donations database (via OpenBook) source
Apr 2022Berkeley Existential Risk Initiative$1MGrant "to the Berkeley Existential Risk Initiative to support its collaboration with the Stanford Existential Risks Initiative (SERI) on the second cohort of the SERI Machine Learning Alignment Theory Scholars (MATS) Program. MATS is an.... From Vipul Naik's donations database (v source
Apr 2022Berkeley Existential Risk Initiative$210kGrant "to support work on the development and implementation of AI safety standards that may reduce potential risks from advanced artificial intelligence.". From Vipul Naik's donations database (via OpenBook) source
Apr 2022Berkeley Existential Risk Initiative$140kGrant "to the Berkeley Existential Risk Initiative to support its collaboration with Professor David Krueger.". From Vipul Naik's donations database (via OpenBook) source
Apr 2022AI Safety Support$42kGrant "to scale up a research group, led by Jaime Sevilla, which studies trends in machine learning.". From Vipul Naik's donations database (via OpenBook) source
Apr 2022OpenMined$28kGrant to "support research on the intersection between privacy-enhancing technologies and technical infrastructure for AI safety." The webpage https://en.wikipedia.org/wiki/Privacy-enhancing_technologies is linked.. From Vipul Naik's donations database (via OpenBook) source
Apr 2022Center for Long-Term Cybersecurity$20kGrant to "support work by CLTC’s AI Security Initiative on the development and implementation of AI standards.". From Vipul Naik's donations database (via OpenBook) source
Mar 2022Massachusetts Institute of Technology$13MGrant to "support research led by Neil Thompson on modeling the trends and impacts of AI and computing. Thompson will use this funding to hire new staff and expand his lab work.". From Vipul Naik's donations database (via OpenBook) source
Mar 2022Rethink Priorities$2.7MGrant "to Rethink Priorities to expand its research on topics related to AI governance.". From Vipul Naik's donations database (via OpenBook) source
Mar 2022Hofvarpnir Studios$1.4MHofvarpnir Studios — Compute Cluster for AI Safety Research — Open Philanthropy recommended a grant of $1,443,540 over three years to Hofvarpnir Studios to create and maintain a compute cluster for Jacob Steinhardt’s lab that will also be used by researchers at... [Navigating Tra source
Mar 2022Carnegie Endowment for International Peace$598kGrant to "support a research project on international AI governance led by Matt Sheehan.". From Vipul Naik's donations database (via OpenBook) source
Mar 2022Stiftung Neue Verantwortung$444kGrant to "support data-driven reports on AI-related talent flows and the global microchip supply chain.". From Vipul Naik's donations database (via OpenBook) source
Mar 2022Alignment Research Center$265kAlignment Research Center — General Support — Open Philanthropy recommended a grant of $265,000 to the Alignment Research Center (ARC) for general support. ARC focuses on developing strategies for AI alignment that can be adopted by industry... [Navigating Transformative AI; Coef source
Mar 2022Individual #7365$7kGrant to "support [grantee's] research on machine learning in collaboration with Professor David Krueger." The webpage https://www.davidscottkrueger.com/ is linked.. From Vipul Naik's donations database (via OpenBook)
Mar 2022Individual #6444$7kGrant to "support his research on machine learning in collaboration with Professor David Krueger." The webpage https://www.davidscottkrueger.com/ is linked.. From Vipul Naik's donations database (via OpenBook)
Feb 2022Berkeley Existential Risk Initiative$1.1MGrant "to support continued work with the Center for Human-Compatible AI (CHAI) at UC Berkeley. BERI will use the funding to facilitate the creation of an in-house compute cluster for CHAI’s use, purchase compute resources, and hire a.... From Vipul Naik's donations database (via source
Feb 2022National Academies of Sciences, Engineering, and Medicine$309kGrant to "support research on machine learning in safety-critical environments.". From Vipul Naik's donations database (via OpenBook) source
Feb 2022Unknown recipients$113kAI Funding for Individuals — Work and Study Support — Open Philanthropy recommended a total of $113,372 to support individuals pursuing work and study related to potential risks from advanced artificial intelligence. The grant amount was updated in... [Navigating Transformative A source
Feb 2022Individual #4438$53kGrant "to work on several short-term projects while [Individual #4438] explores different career options.". From Vipul Naik's donations database (via OpenBook)
Jan 2022The Wilson Center$2MGrant to "support [grantee's] AI policy training program, which is aimed at staffers for members of Congress and other policymakers. The program’s ultimate goal is to increase policymakers’ access to technical AI expertise.". From Vipul Naik's donations database (via OpenBook) source
2021 42 grants · $83M
DateRecipientAmountPurpose
Dec 2021Centre for the Governance of AI$2.5MGrant "to support activities related to building the field of AI governance research. GovAI intends to use this funding to conduct AI governance research and to develop a talent pipeline for those interested in entering the field.". From Vipul Naik's donations database (via OpenB source
Dec 2021Georgetown Universty$247kGrant "to support a fellowship related to AI and cybersecurity policy.". From Vipul Naik's donations database (via OpenBook) source
Nov 2021Redwood Research$9.4MGrant "for general support. Redwood Research is a new research institution that conducts research to better understand and make progress on AI alignment in order to improve the long-run future.". From Vipul Naik's donations database (via OpenBook) source
Nov 2021Stanford University$1.5MGrant to "support research led by Professor Percy Liang on AI safety and alignment.". From Vipul Naik's donations database (via OpenBook) source
Nov 2021Mila$238kGrant "to support a research project investigating AI consciousness and moral patienthood. The research will be conducted in collaboration with the Université de Montréal and the Future of Humanity Institute. This funding will support.... From Vipul Naik's donations database (via source
Nov 2021Berkeley Existential Risk Initiative$195kGrant "to support its collaboration with the Stanford Existential Risks Initiative (SERI) on the SERI ML Alignment Theory Scholars (MATS) Program. MATS is a two-month program where students will research problems related to AI alignment.... From Vipul Naik's donations database (v source
Oct 2021University of Washington$730kGrant to "support early-career research by Ludwig Schmidt on adversarial robustness as a means to improve AI safety.". From Vipul Naik's donations database (via OpenBook) source
Oct 2021FAR AI$426kGrant "to the Fund for Alignment Research, led by Ethan Perez, to support salaries and equipment for projects related to misalignment in language models. Perez plans to hire and supervise four engineers to work on these projects.". From Vipul Naik's donations database (via OpenBo source
Sep 2021Université de Montréal$211kGrant to "support a research project investigating AI consciousness and moral patienthood. The research will be conducted in collaboration with Mila and the Future of Humanity Institute. This funding will support post-docs and students.... From Vipul Naik's donations database (vi source
Sep 2021Center for a New American Security$101kGrant to "support a working group that will focus on mitigating risks from possible military applications of artificial intelligence. This group will be composed of technical and policy experts from the US, Russia, China, and Europe,.... From Vipul Naik's donations database (via source
Sep 2021Stanford University$78kGrant to "support the AI Index, which collects and reports data related to artificial intelligence, including data relevant to AI safety and AI ethics." The webpage https://aiindex.stanford.edu/ is linked.. From Vipul Naik's donations database (via OpenBook) source
Aug 2021Center for Security and Emerging Technology$39MThe grant page says: "CSET is a think tank, incubated by our January 2019 support, dedicated to policy analysis at the intersection of national and international security and emerging technologies. This funding is intended to augment.... From Vipul Naik's donations database (via source
Aug 2021Stanford University$331kGrant "to support early-career research by Individual #4108 on adversarial robustness as a means to improve AI safety.". From Vipul Naik's donations database (via OpenBook) source
Aug 2021Stanford University$331kStanford University — Adversarial Robustness Research (Shibani Santurkar) — Grant Investigator: Catherine Olsson This page was reviewed but not written by the grant investigators. Stanford University staff also reviewed this page prior to publication. Open Philanthropy... [Naviga source
Aug 2021University of Southern California$320kGrant "to support early-career research by Robin Jia on adversarial robustness and out-of-distribution generalization as a means to improve AI safety.". From Vipul Naik's donations database (via OpenBook) source
Aug 2021University of California, Berkeley$88kGrant to "support postdoctoral research by Aditi Raghunathan on adversarial robustness as a means to improve AI safety.". From Vipul Naik's donations database (via OpenBook) source
Jul 2021Rethink Priorities$612kRethink Priorities — AI Governance Research (2021) — Grant investigator: Luke Muehlhauser This page was reviewed but not written by the grant investigator. Rethink Priorities staff also reviewed this page prior to publication. Open Philanthropy... [Navigating Transformative AI; C source
Jul 2021Center for International Security and Cooperation$365kCenter for International Security and Cooperation — AI and Strategic Stability — Open Philanthropy recommended a grant of $365,361 to the Center for International Security and Cooperation (CISAC) to support work studying hypothetical scenarios related to AI and strategic... [Navi source
Jul 2021Berkeley Existential Risk Initiative$300kBerkeley Existential Risk Initiative — AI Standards (2021) — Open Philanthropy recommended a grant of $300,000 to the Berkeley Existential Risk Initiative to support work on the development and implementation of AI safety standards that may reduce potential... [Navigating Transfo source
Jul 2021Applied Research Laboratory for Intelligence and Security$70kApplied Research Laboratory for Intelligence and Security — Report on Security Clearances — Open Philanthropy recommended a grant of $70,000 to the Applied Research Laboratory for Intelligence and Security to conduct a study on US security clearance reform options. This falls wit source
Jul 2021Berkeley Existential Risk Initiative$70kBerkeley Existential Risk Initiative — MineRL BASALT Competition — Open Philanthropy recommended a grant of $70,000 to the Berkeley Existential Risk Initiative to support the MineRL BASALT competition. The competition asks participants to build AI systems that learn... [Navigatin source
Jul 2021University of California, Berkeley$25kCenter for Long-Term Cybersecurity — AI Standards (2021) — Open Philanthropy recommended a gift of $25,000 to the Center for Long-Term Cybersecurity (CLTC), via UC Berkeley, to support work by CLTC's AI Security Initiative on the development and... [Navigating Transformative AI; source
Jun 2021Center for Applied Rationality$460kLessWrong project and team — paid by Good Ventures Foundation on Open Philanthropy's advice, fiscal year Jul 2020–Jun 2021 (990-PF Part XV 3a; payment in that year, not the grant total) source
May 2021Carnegie Mellon University$330kCarnegie Mellon University — Adversarial Robustness Research — Grant Investigator: Catherine Olsson This page was reviewed but not written by the grant investigators. Carnegie Mellon staff also reviewed this page prior to publication. Open Philanthropy... [Navigating Transformati source
May 2021Individual #3182$175kGrant to support "work on an AI alignment project and related field-building efforts. [name withheld] plans to use this funding to produce writing and reports summarizing existing research and investigating potentially valuable projects relevant.... From Vipul Naik's donations da
May 2021Individual #5224$19kIndividual #5224 — Machine Learning Self-Study — Open Philanthropy recommended a grant of $19,200 to Individual #5224 to support four months of self-study in machine learning. This falls within our focus area of potential risks from advanced... [Navigating Transformative AI; Coef
Apr 2021Unknown recipients$1MOpen Phil AI Fellowship — 2021 Class — https://web.archive.org/web/20240601000000/https://openphilanthropy.org/grants/open-phil-ai-fellowship-2021-class/ [Navigating Transformative AI; Coefficient Giving grants archive] source
Apr 2021The Wilson Center$291kGrant "to pilot an AI policy training program. The Wilson Center is a non-partisan policy forum for tackling global issues through independent research and open dialogue.". From Vipul Naik's donations database (via OpenBook) source
Apr 2021University of Cambridge$250kGrant "to support Professor David Krueger’s machine learning research.". From Vipul Naik's donations database (via OpenBook) source
Apr 2021International Conference on Learning Representations$3kInternational Conference on Learning Representations — Security and Safety in Machine Learning Systems Workshop — Open Philanthropy recommended a grant of $3,000 to the International Conference on Learning Representations to support the Security and Safety in Machine Learning Sys source
Mar 2021Berkeley Existential Risk Initiative$210kGrant "to provide stipends for the Stanford Existential Risks Initiative (SERI) summer research fellowship program.". From Vipul Naik's donations database (via OpenBook) source
Mar 2021Hypermind$121kContractor agreement "to collaborate with Metaculus on an AI development forecasting tournament. Forecasts will cover the themes of hardware and supercomputing, performance and benchmarks, research trends, and economic and financial.... From Vipul Naik's donations database (via O source
Mar 2021Brian Christian$66kContractor agreement "with Brian Christian to support the promotion of his book The Alignment Problem: Machine Learning and Human Values.". From Vipul Naik's donations database (via OpenBook) source
Feb 2021Massachusetts Institute of Technology$1.4MGrant "to support research by Professor Aleksandr Madry on adversarial robustness as a means to improve AI safety.". From Vipul Naik's donations database (via OpenBook) source
Feb 2021University of Tübingen$590kThe grant page says the grant is "to support early-career research by Wieland Brendel on robustness as a means to improve AI safety.". From Vipul Naik's donations database (via OpenBook) source
Feb 2021University of California, Berkeley$330kGrant "to support research by Professor Dawn Song on adversarial robustness as a means to improve AI safety.". From Vipul Naik's donations database (via OpenBook) source
Feb 2021University of California, Berkeley$330kUC Berkeley — Adversarial Robustness Research (David Wagner) — Grant Investigator: Catherine Olsson and Individual #3182 This page was reviewed but not written by the grant investigators. UC Berkeley staff also reviewed this page prior to publication. Open... [Navigating Transfor source
Feb 2021University of Tübingen$300kGrant "to support research by Professor Matthias Hein on adversarial robustness as a means to improve AI safety.". From Vipul Naik's donations database (via OpenBook) source
Jan 2021University of California, Berkeley$12MUC Berkeley — Center for Human-Compatible Artificial Intelligence (2021) — Grant investigator: Nick Beckstead This page was reviewed but not written by the grant investigator. UC Berkeley staff also reviewed this page prior to publication. Open Philanthropy recommended a... [Navi source
Jan 2021Center for Security and Emerging Technology$8MThe grant page says "This funding is intended to augment our original support for CSET, particularly for its work on the intersection of security and artificial intelligence.". From Vipul Naik's donations database (via OpenBook) source
Jan 2021University of California, Santa Cruz$265kThe grant page says the grant is "to support early-career research by Cihang Xie on adversarial robustness as a means to improve AI safety.". From Vipul Naik's donations database (via OpenBook) source
Jan 2021Berryville Institute of Machine Learning$150kThe grant page says: "[the grant is] to support research led by Gary McGraw on machine learning security. The research will focus on building a taxonomy of known attacks on machine learning, exploring a hypothesis of representation and.... From Vipul Naik's donations database (vi source
2020 25 grants · $16M
DateRecipientAmountPurpose
Dec 2020University of Toronto$520kThe grant page says: "[the grant is] to support research on understanding, predicting, and controlling machine learning systems, led by Professor Chris Maddison, a former Open Phil AI Fellow. This funding is intended to enable three.... From Vipul Naik's donations database (via O source
Nov 2020Massachusetts Institute of Technology$551kMassachusetts Institute of Technology — AI Trends and Impacts Research (2020) — Grant investigators: Luke Muehlhauser This page was reviewed but not written by the grant investigator. Massachusetts Institute of Technology staff also reviewed this page prior to publication. Open.. source
Nov 2020AI Impacts$50kThe grant page says: "AI Impacts plans to use this grant to work on strategic questions related to potential risks from advanced artificial intelligence.". From Vipul Naik's donations database (via OpenBook) source
Oct 2020Center for a New American Security$117kGrant "to support work by Paul Scharre on projects related to AI and security.". From Vipul Naik's donations database (via OpenBook) source
Oct 2020Center for a New American Security$24kGrant "to support work exploring possible projects related to AI governance.". From Vipul Naik's donations database (via OpenBook) source
Oct 2020Individual #1405$370Grant "to support Participatory Approaches to Machine Learning, a virtual workshop held during the 2020 International Conference on Machine Learning.". From Vipul Naik's donations database (via OpenBook)
Sep 2020Center for Strategic and International Studies$118kGrant "to explore possible projects related to AI accident risk in the context of technology competition.". From Vipul Naik's donations database (via OpenBook) source
Sep 2020Center for International Security and Cooperation$67kGrant "to explore possible projects related to AI accident risk in the context of technology competition.". From Vipul Naik's donations database (via OpenBook) source
Sep 2020Rice, Hadley, Gates & Manuel LLC$25kContractor agreement "to explore possible projects related to AI accident risk in the context of technology competition.". From Vipul Naik's donations database (via OpenBook) source
Jun 2020The Wilson Center$497kGrant "to organize additional in-depth AI policy seminars as part of its seminar series.". From Vipul Naik's donations database (via OpenBook) source
Jun 2020Individual #9903$15kIndividual #9903 — Paper on Machine Learning Model Robustness — Grant Investigator: Luke Muehlhauser This page was reviewed but not written by the grant investigator. Individual #9903 also reviewed this page prior to publication. Open Philanthropy recommended a grant... [Navigati
May 2020Unknown recipients$2.3MOpen Phil AI Fellowship: Grant to provide scholarship to ten machine learning researchers over five years. From Vipul Naik's donations database (via OpenBook) source
May 2020Centre for the Governance of AI$450kThe grant page says: "GovAI intends to use these funds to support the visit of two senior researchers and a postdoc researcher.". From Vipul Naik's donations database (via OpenBook) source
May 2020International Conference on Learning Representations$4kGrant to the International Conference on Learning Representations to provide awards for the best papers submitted as part of the “Towards Trustworthy Machine Learning” virtual workshop.. From Vipul Naik's donations database (via OpenBook) source
Apr 2020World Economic Forum$50kGrant "to support a workshop hosted by the Global AI Council and co-developed with the Center for Human-Compatible AI at UC Berkeley. The workshop will facilitate the development of AI policy recommendations that could lead to future.... From Vipul Naik's donations database (via source
Mar 2020Unknown recipients$594kStudy and Training Related to AI Policy Careers: Grant is "flexible support to enable individuals to pursue and explore careers in artificial intelligence policy." Recipients include Emefa Agawu, Karson Elmgren, Individual #1686, Becca Kagan, and Individual #7147. The ways that.. source
Mar 2020Johns Hopkins University$55kGrant "to support the initial research of Professors Jared Kaplan and Brice Ménard on principles underlying neural network training and performance.". From Vipul Naik's donations database (via OpenBook) source
Feb 2020Machine Intelligence Research Institute$7.7MMIRI plans to use these funds for ongoing research and activities related to AI safety. From Vipul Naik's donations database (via OpenBook) source
Feb 2020WestExec$540kContractor agreement "to support the production and distribution of a report on advancing policy, process, and funding for the Department of Defense’s work on test, evaluation, verification, and validation for deep learning systems.". From Vipul Naik's donations database (via Ope source
Feb 2020The Wilson Center$368kGrant "to continue support for a series of in-depth AI policy seminars.". From Vipul Naik's donations database (via OpenBook) source
Jan 2020Ought$1.6MThe grant page says: "Ought conducts research on factored cognition, which we consider relevant to AI alignment and to reducing potential risks from advanced artificial intelligence.". From Vipul Naik's donations database (via OpenBook) source
Jan 2020Berkeley Existential Risk Initiative$150kThe grant page says: "BERI seeks to reduce existential risks to humanity, and collaborates with other long-termist organizations, including the Center for Human-Compatible AI at UC Berkeley. This funding is intended to help BERI.... From Vipul Naik's donations database (via OpenB source
Jan 2020RAND Corporation$31kGrant "to support exploratory research by Individual #9903 on the state of AI assurance methods.". From Vipul Naik's donations database (via OpenBook) source
Jan 2020Press Shop$17kGrant "to the publicity firm Press Shop to support expenses related to publicizing Professor Stuart Russell’s book Human Compatible: Artificial Intelligence and the Problem of Control.". From Vipul Naik's donations database (via OpenBook) source
Jan 2020Stanford University$7kThe grant "is intended to fund the travel costs for experts on AI safety to present at the [AI safety] seminar [led by Dorsa Sadigh].". From Vipul Naik's donations database (via OpenBook) source
2019 9 grants · $73M
DateRecipientAmountPurpose
Nov 2019University of California, Berkeley$1.1MThe grant page says: "This funding will allow Professor Steinhardt to fund students to work on robustness, value learning, aggregating preferences, and other areas of machine learning.". From Vipul Naik's donations database (via OpenBook) source
Nov 2019Ought$1MThe grant page says: "Ought conducts research on factored condition, which we consider relevant to AI alignment.". From Vipul Naik's donations database (via OpenBook) source
Nov 2019Berkeley Existential Risk Initiative$705kThe grant page says the grant is "to support continued work with the Center for Human-Compatible AI (CHAI) at UC Berkeley. This includes one year of support for machine learning researchers hired by BERI, and two years of support for CHAI.". From Vipul Naik's donations database ( source
Nov 2019Center for Human-Compatible AI$200kThe grant page says "CHAI plans to use these funds to support graduate student and postdoc research.". From Vipul Naik's donations database (via OpenBook) source
May 2019Unknown recipients$2.3MOpen Phil AI Fellowship: Grant to provide scholarship support to eight machine learning researchers over five years. From Vipul Naik's donations database (via OpenBook) source
Mar 2019OpenAI$10MGeneral support of OpenAI, third of three annual payments of $10M (grant a04ef1f9, 2017; split per year under convention 24). source
Feb 2019Machine Intelligence Research Institute$2.7MMIRI plans to use these funds for ongoing research and activities related to AI safety. Planned activities include alignment research, a summer fellows program, computer scientist workshops, and internship programs.. From Vipul Naik's donations database (via OpenBook) source
Jan 2019Center for Security and Emerging Technology$55MGrant via Georgetown University for the Center for Security and Emerging Technology (CSET), a new think tank led by Jason Matheny, formerly of IARPA, dedicated to policy analysis at the intersection of national and international.... From Vipul Naik's donations database (via OpenB source
Jan 2019Berkeley Existential Risk Initiative$250kGrant to temporarily or permanently hire machine learning research engineers dedicated to BERI’s collaboration with the Center for Human-compatible Artificial Intelligence (CHAI).. From Vipul Naik's donations database (via OpenBook) source
2018 13 grants · $14M
DateRecipientAmountPurpose
Nov 2018University of California, Berkeley$1.1MGrant "for machine learning researchers Pieter Abbeel and Aviv Tamar to study uses of generative models for robustness and interpretability. This funding will allow Mr. Abbeel and Mr. Tamar to fund PhD students and summer undergraduates.... From Vipul Naik's donations database (v source
Nov 2018Daniel Kang|Jacob Steinhardt|Yi Sun|Individual #9946$2kGrant "to reimburse technology costs for their efforts to study the robustness of machine learning models, especially robustness to unforeseen adversaries.". From Vipul Naik's donations database (via OpenBook) source
Aug 2018GoalsRL$8kDiscretionary grant to offset travel, registration, and other expenses associated with attending the GoalsRL 2018 workshop on goal specifications for reinforcement learning. The workshop was organized by Ashley Edwards, a recent.... From Vipul Naik's donations database (via OpenB source
Jul 2018University of Oxford$430kGrant to support research on the global politics of advanced artificial intelligence. The work will be led by Professor Allan Dafoe at the Future of Humanity Institute in Oxford, United Kingdom. The Open Philanthropy Project recommended.... From Vipul Naik's donations database (v source
Jul 2018The Wilson Center$400kGrant "to support a series of in-depth AI policy seminars.". From Vipul Naik's donations database (via OpenBook) source
Jul 2018Stanford University$100kGrant "to support machine learning security research led by Professor Dan Boneh and his PhD student, Individual #1779.". From Vipul Naik's donations database (via OpenBook)
Jun 2018Machine Intelligence Research Institute$150kGrant to suppport the artificial intelligence safety retraining project. MIRI intends to use these funds to provide stipends, structure, and guidance to promising computer programmers and other technically proficient individuals who are.... From Vipul Naik's donations database (v source
Jun 2018AI Impacts$100kThe grant page says: "AI Impacts plans to use this grant to work on strategic questions related to potential risks from advanced artificial intelligence.". From Vipul Naik's donations database (via OpenBook) source
May 2018Unknown recipients$1.1MOpen Phil AI Fellowship: Grant to provide scholarship support to seven machine learning researchers over five years. From Vipul Naik's donations database (via OpenBook) source
May 2018Ought$525kThe grant page says at https://www.openphilanthropy.org/focus/global-catastrophic-risks/potential-risks-advanced-artificial-intelligence/ought-general-support#Proposed_activities "Ought will conduct research on deliberation and.... From Vipul Naik's donations database (via OpenBo source
Apr 2018Stanford University$7kGrant to support the Neural Information Processing System (NIPS) workshop “Machine Learning and Computer Security.” at https://nips.cc/Conferences/2017/Schedule?showEvent=8775. From Vipul Naik's donations database (via OpenBook) source
Mar 2018OpenAI$10MGeneral support of OpenAI, second of three annual payments of $10M (grant a04ef1f9, 2017; split per year under convention 24). source
Feb 2018Unknown recipients$159kAI Scholarships: Discretionary grant; total across grants to two artificial intelligence researcher, both over two years. The funding is intended to be used for the students’ tuition, fees, living expenses, and travel during their respective degree.... From Vipul Naik's donations source
2017 11 grants · $23M
DateRecipientAmountPurpose
Oct 2017Machine Intelligence Research Institute$3.8MAccording to the grant page: "MIRI expects to use these funds mostly toward salaries of MIRI researchers, research engineers, and support staff.". From Vipul Naik's donations database (via OpenBook) source
Oct 2017University of California, Berkeley$1.5MThe grant page says: "The work will be led by Professors Sergey Levine and Anca Dragan, who will each devote approximately 20% of their time to the project, with additional assistance from four graduate students. They initially intend.... From Vipul Naik's donations database (via source
Jul 2017Mila$2.4MGrant "to support technical research on potential risks from advanced artificial intelligence (AI). $1.6 million of this grant will support Professor Yoshua Bengio and his co-investigators at the Université de Montréal, and $800,000.... From Vipul Naik's donations database (via O source
Jul 2017Berkeley Existential Risk Initiative$404kGrant to support work with the Center for Human-Compatible AI (CHAI) at UC Berkeley, to which the Open Philanthropy Project provided a two-year founding grant.... From Vipul Naik's donations database (via OpenBook) source
Jul 2017Yale University$299kGrant to support research into the global politics of artificial intelligence, led by Assistant Professor of Political Science, Allan Dafoe, who will conduct part of the research at the Future of Humanity Institute in Oxford, United.... From Vipul Naik's donations database (via O source
May 2017UCLA School of Law$1.5MGrant to support work on governance related to AI risk led by Edward Parson and Richard Re. From Vipul Naik's donations database (via OpenBook) source
May 2017Stanford University$1.3MThe grant is intended to fund about 20% of Percy Liang's time as well as about three graduate students. Liang expects to focus on a subset of these topics: robustness against adversarial attacks on ML systems, verification of the.... From Vipul Naik's donations database (via Open source
Mar 2017OpenAI$10MGeneral support of OpenAI, first of three annual payments of $10M (the grant page says 10 million USD per year for the next three years; total $30M, split per year under convention 24). The funding is also accompanied with Holden Karnofsky (Open Phil director) joining the OpenAI source
Mar 2017Future of Humanity Institute$2MGrant for general support. A related grant specifically for biosecurity work was granted in 2016-09, made earlier for logistical reasons. From Vipul Naik's donations database (via OpenBook) source
Mar 2017Stanford University$25kGrant "to enable Professor Liang to spend significant time engaging in our process to determine whether to provide his research group with a much larger grant." The larger grant.... From Vipul Naik's donations database (via OpenBook) source
Mar 2017Distill$25kGrant covers 25000 out of a total of 125000 USD initial endowment for the Distill prize https://distill.pub/prize/ administered by the Open Philanthropy Project. Other contributors to the endowment include Chris Olah, Greg Brockman,.... From Vipul Naik's donations database (via O source
2016 5 grants · $6.6M
DateRecipientAmountPurpose
Dec 2016AI Impacts$32kThe grant page says: "AI Impacts plans to use this grant to work on strategic questions related to potential risks from advanced artificial intelligence.". From Vipul Naik's donations database (via OpenBook) source
Nov 2016Electronic Frontier Foundation$199kGrant funded work by Peter Eckersley, whom the Open Philanthropy Project believed in. Followup conversation with Peter Eckersley and Individual #6823 of grantee organization at.... From Vipul Naik's donations database (via OpenBook) source
Aug 2016Center for Human-Compatible AI$5.6Mhttps://www.openphilanthropy.org/focus/global-catastrophic-risks/potential-risks-advanced-artificial-intelligence/uc-berkeley-center-human-compatible-ai#Budget_and_room_for_more_funding says: "Professor Russell estimates that the Center.... From Vipul Naik's donations database (v source
Aug 2016Machine Intelligence Research Institute$500kThe grant page, Section 3.1 Budget and room for more funding, says: "MIRI operates on a budget of approximately $2 million per year. At the time of our investigation, it had between $2.4 and $2.6 million in reserve. In 2015, MIRI’s.... From Vipul Naik's donations database (via Op source
Jun 2016George Mason University$277kEarmarked for Robin Hanson research. Grant page references https://www.openphilanthropy.org/focus/global-catastrophic-risks/potential-risks-advanced-artificial-intelligence for background. Original amount $264,525. Increased to $277,435.... From Vipul Naik's donations database (v source
2015 1 grant · $1.2M
DateRecipientAmountPurpose
Aug 2015Future of Life Institute$1.2MGrant accompanied a grant by Elon Musk to FLI for the same purpose. See also the March 2015 blog post https://www.openphilanthropy.org/blog/open-philanthropy-project-update-global-catastrophic-risks that describes strategy and.... From Vipul Naik's donations database (via OpenBoo source