“a philanthropic fund making grants and investments to ambitious projects”In its own words: forum.nunosempere.com
Philanthropic fund of the FTX Foundation, launched in February 2022, that made grants and investments to improve humanity's long-term prospects, including AI safety work. Closed in November 2022 when FTX collapsed and its executive team resigned, leaving many committed grants unpaid.
Show detailsHide details
Part of the FTX Foundation (announced 28 Feb 2022), it made grants and investments through three channels: a one-off open call (about 4% of 1,700+ applications funded), regranting budgets given to independent grantmakers, and staff-led grants, plus prizes. Staff-led grants made up the largest share of dollars.
Says it has given about $132M in total
Itemised here $55M in 93 grants
Money flows
Where its money came from and where it went. Pick years and what to show; hover a box or ribbon for details, click one to focus it, click the background to see everything.
How to apply
- Applications
- Closed
Biggest recipients
Passed on to other funders
- Longview Philanthropy 2022$15M
- Long-Term Future Fund 2022$3.9M
Gifts and pooled money between funders, as recorded on the site.
All grants
93 grants totalling $55M, newest first. Recipients link to their own pages; people who received grants without a public profile are shown by number.
2022 92 grants · $55M
| Date | Recipient | Amount | Purpose |
|---|---|---|---|
| Aug 2022 | Fund for Alignment Research | $1M | Regrant (recommended by an FTX regrantor): Operations: engineering support for alignment researchers source |
| Aug 2022 | Cihang Xie, UC Santa Cruz | $350k | Regrant (recommended by an FTX regrantor): Research on adversarial robustness and honest AI source |
| Aug 2022 | HR Luna Park | $200k | Regrant (recommended by an FTX regrantor): Headhunting ML engineers for AI safety organisations source |
| Aug 2022 | Machine Learning Moral Uncertainty Competition | $100k | Regrant (recommended by an FTX regrantor): Prizes for ML estimation of moral uncertainty source |
| Aug 2022 | The Inside View (Individual #4322) | $52k | Regrant (recommended by an FTX regrantor): 20 podcast/YouTube episodes on AI and its risks source |
| Aug 2022 | Individual #7222 | $30k | Regrant (recommended by an FTX regrantor): Three months of independent interpretability research |
| Aug 2022 | Charbel-Raphaël Segerie | $25k | Regrant (recommended by an FTX regrantor): Six months of AI safety mentoring and study source |
| Jul 2022 | Constellation | $3.9M | 18 months of operations for a longtermist coworking space in Berkeley source |
| Jul 2022 | Safety Philosophers Program | $1.3M | Regrant (recommended by an FTX regrantor): Seven-month AI safety research fellowship for philosophy academics source |
| Jul 2022 | Alignment Research Center | $1.3M | Researcher salaries, AI capability evaluation contractors, ELK prizes and workshops source |
| Jul 2022 | David Bau | $766k | Regrant (recommended by an FTX regrantor): 2-3 years of interpretability research on knowledge in LLMs source |
| Jul 2022 | AI Safety Community Building Hub | $500k | Regrant (recommended by an FTX regrantor): New organisation doing AI safety outreach to ML professionals source |
| Jul 2022 | Chatham House | $400k | Regrant (recommended by an FTX regrantor): UK convening and research on AI policy, pandemic, defence and great-power tech relations source |
| Jul 2022 | Chenhao Tan, University of Chicago | $250k | Regrant (recommended by an FTX regrantor): PhD student or postdoc to orient the lab toward AI safety source |
| Jul 2022 | Adji Bousso Dieng, Princeton University | $250k | Regrant (recommended by an FTX regrantor): Robust generative models under non-random missing data source |
| Jul 2022 | Tim Oates, University of Maryland, Baltimore County | $183k | Regrant (recommended by an FTX regrantor): Alignment research with a graduate student source |
| Jul 2022 | Existential Risk NeurIPS prize | $100k | Regrant (recommended by an FTX regrantor): Prizes for NeurIPS workshop papers, incl. best AI x-risk discussion source |
| Jul 2022 | The Treacherous Turn Game | $96k | Regrant (recommended by an FTX regrantor): Tabletop roleplaying game simulating advanced-AI risks source |
| Jul 2022 | AI Governance Summer Program | $91k | Regrant (recommended by an FTX regrantor): Ten mentored AI governance summer fellows source |
| Jul 2022 | Individual #7961 | $65k | Regrant (recommended by an FTX regrantor): Four months of theoretical AI safety research mentored by Evan Hubinger |
| Jul 2022 | Individual #7858 | $56k | Regrant (recommended by an FTX regrantor): Teaching buyout to forecast AGI scenarios and research alignment |
| Jul 2022 | Individual #1188 | $50k | Regrant (recommended by an FTX regrantor): Career transition from physics to AI safety |
| Jul 2022 | Individual #9412 | $50k | Regrant (recommended by an FTX regrantor): Three-year cybersecurity project for AI research, paid against progress reports |
| Jul 2022 | David Chapman | $48k | Regrant (recommended by an FTX regrantor): Independent research on AI risk magnitude and useful actions source |
| Jul 2022 | Individual #6111 | $43k | Regrant (recommended by an FTX regrantor): AI safety study and research assistance for Lennart Heim |
| Jul 2022 | Individual #6601 | $40k | Regrant (recommended by an FTX regrantor): Six months of AI safety work |
| Jul 2022 | Individual #5693 | $30k | Regrant (recommended by an FTX regrantor): Six months of interpretability and AI safety research |
| Jul 2022 | Individual #4507 | $26k | Regrant (recommended by an FTX regrantor): Teaching buyout for AI governance research |
| Jul 2022 | Simeon Campos | $25k | Regrant (recommended by an FTX regrantor): Part-time AI safety projects source |
| Jun 2022 | Long-Term Future Fund | $3.9M | Funding for LTFF's longtermist grantmaking (money to another funder; see transfer ftx-ltff-2022) source |
| Jun 2022 | Legal Priorities Project | $700k | One year of operating expenses and salaries source |
| Jun 2022 | Sergey Levine, UC Berkeley | $600k | Risks of deception and persuasion from LLMs with offline RL source |
| Jun 2022 | AI Safety Camp | $290k | Directors' salaries and camp logistics source |
| Jun 2022 | Differential Projections | $250k | New research org using probabilistic models to forecast transformative AI questions source |
| Jun 2022 | Emma Pierson, Cornell University | $250k | Regrant (recommended by an FTX regrantor): Research on fair and robustly aligned ML systems source |
| Jun 2022 | AI Impacts | $250k | Regrant (recommended by an FTX regrantor): Rerunning the 2016 expert survey on AI progress source |
| Jun 2022 | Individual #5451 | $182k | Site for collaboratively writing public forecasting questions [forecasting; counted for now] |
| Jun 2022 | Neel Nanda | $125k | Regrant (recommended by an FTX regrantor): A year of salary, an RA and compute for independent AI safety research source |
| Jun 2022 | Montaigne Institute | $68k | Regrant (recommended by an FTX regrantor): Full-time staff member on AI policy source |
| Jun 2022 | Individual #5966 | $38k | Regrant (recommended by an FTX regrantor): Five months building longtermist and AI alignment communities |
| Jun 2022 | Individual #7896 | $27k | Regrant (recommended by an FTX regrantor): Six months distilling AI alignment research |
| Jun 2022 | Individual #5020 | $25k | Regrant (recommended by an FTX regrantor): Summer research internship at Columbia on aligning program synthesis models |
| Jun 2022 | Individual #6700 | $25k | Regrant (recommended by an FTX regrantor): Career transition to longtermist work incl. biosecurity research |
| Jun 2022 | Individual #2708, Cornell University | $25k | Regrant (recommended by an FTX regrantor): Students and postdocs attend a human-centred AI conference and write a report source |
| May 2022 | Ought | $5M | Regrant (recommended by an FTX regrantor): Building Elicit; research on scaling human supervision via process-based systems source |
| May 2022 | Federation of American Scientists | $1M | Regrant (recommended by an FTX regrantor): Three years of a researcher and RA on high-skill immigration and AI policy source |
| May 2022 | Anca Dragan, UC Berkeley | $800k | Interactive alignment algorithms that learn causal features of human reward source |
| May 2022 | Sage | $700k | Pilot forecasting platform and paid team [forecasting; counted for now] source |
| May 2022 | Manifold Markets | $500k | Charity prediction market [forecasting; counted for now] source |
| May 2022 | Individual #2207 | $380k | Fine-tuning GPT-3 to find flaws in other models' arguments |
| May 2022 | Olle Häggström, Chalmers University of Technology | $380k | Regrant (recommended by an FTX regrantor): Research, outreach and policy work on x-risk and AI risk source |
| May 2022 | Association for Long Term Existence and Resilience (ALTER) | $320k | Academic research and advocacy on AI safety and biorisk policy source |
| May 2022 | Brian Christian | $300k | Book on human values and aligning AI with human preferences source |
| May 2022 | Daniel Brown, University of Utah | $280k | Value alignment verification algorithms and user studies source |
| May 2022 | Modeling Transformative AI Risks (Individual #1534, Individual #1758, Analytica Consulting) | $272k | Regrant (recommended by an FTX regrantor): Quantitative model of AI risks and interventions source |
| May 2022 | AI Alignment Prize on Inverse Scaling | $250k | Regrant (recommended by an FTX regrantor): Prizes for tasks where larger LMs do worse source |
| May 2022 | Individual #7252 | $230k | Training LLMs to represent prediction-market answer distributions [forecasting; counted for now] |
| May 2022 | AI Safety Support | $200k | Community building and alignment talent pipeline source |
| May 2022 | Individual #2771 | $190k | Student interns writing on AI safety, alternative proteins and biosecurity |
| May 2022 | Confido Institute | $190k | Regrant (recommended by an FTX regrantor): Forecasting and uncertainty-communication app [forecasting; counted for now] source |
| May 2022 | MineRL BASALT competition at NeurIPS | $155k | Regrant (recommended by an FTX regrantor): NeurIPS competition on learning from human feedback in Minecraft source |
| May 2022 | Essay Contest on Existential Risk in US Cost-Benefit Analysis (Legal Priorities Project) | $138k | Regrant (recommended by an FTX regrantor): Essay contest aimed at revising OMB Circular A-4 to account for x-risk source |
| May 2022 | Prometheus Science Bowl | $100k | Eliciting Latent Knowledge competition for students source |
| May 2022 | Apart Research | $95k | Regrant (recommended by an FTX regrantor): Founding an AI safety research and community platform source |
| May 2022 | Artificial Intelligence Summer Residency Program | $60k | Regrant (recommended by an FTX regrantor): Six-week AI safety residency in Berkeley source |
| May 2022 | Trojan Detection Challenge at NeurIPS 2022 | $50k | Regrant (recommended by an FTX regrantor): Prizes for detecting trojaned neural networks source |
| May 2022 | Individual #1573 | $46k | Regrant (recommended by an FTX regrantor): Salary, compute and scholarship for LM safety research |
| May 2022 | Individual #8028 | $43k | Regrant (recommended by an FTX regrantor): Four months of salary and compute for alignment research |
| May 2022 | Individual #3716 | $35k | Regrant (recommended by an FTX regrantor): Policy retreat on governing AI |
| May 2022 | Individual #8388 | $29k | Regrant (recommended by an FTX regrantor): Summer of alignment research in Berkeley |
| May 2022 | Individual #6584 | $8k | Summer at FHI researching differential tech development and existential risk |
| Apr 2022 | Lionel Levine, Cornell University | $1.5M | Alignment theory research at the Cornell maths department source |
| Apr 2022 | Simon Institute for Longterm Governance | $820k | Policy work with the UN system on preventing existential risks source |
| Apr 2022 | ML Safety Scholars Program | $490k | Regrant (recommended by an FTX regrantor): Nine-week summer ML safety programme for up to 100 students source |
| Apr 2022 | Legal Priorities Project | $480k | Research and outreach: two hires and a summer institute source |
| Apr 2022 | ALTER (Agent Foundations research with Vanessa Kosoy) | $200k | Regrant (recommended by an FTX regrantor): 1.5-3 years of a maths researcher on the learning-theoretic AI safety agenda source |
| Apr 2022 | EffiSciences | $135k | Promoting high-impact research (AI safety, biosecurity, climate) among French students and academics source |
| Apr 2022 | Individual #4075 | $100k | Research assistants for a PhD student working on AI safety |
| Apr 2022 | AI Risk Public Materials Competition | $40k | Regrant (recommended by an FTX regrantor): Two competitions for public materials on AI x-risk source |
| Apr 2022 | Individual #1420 | $38k | Regrant (recommended by an FTX regrantor): Three months of AI safety research |
| Apr 2022 | Adversarial Robustness Prizes at ECCV | $30k | Regrant (recommended by an FTX regrantor): Prizes for long-term-relevant adversarial robustness papers source |
| Apr 2022 | Individual #6610 | $28k | Regrant (recommended by an FTX regrantor): Applying cryptography to AI safety |
| Mar 2022 | Swift Centre for Applied Forecasting | $2M | Regrant (recommended by an FTX regrantor): New applied forecasting centre [forecasting; counted for now] source |
| Mar 2022 | Manifold Markets | $1M | Regrant (recommended by an FTX regrantor): Play-money prediction market platform [forecasting; counted for now] source |
| Mar 2022 | Rethink Priorities | $700k | Research and projects on humanity's long-term prospects source |
| Mar 2022 | Berkeley Existential Risk Initiative | $100k | Second core operations hire supporting university x-risk research groups source |
| Mar 2022 | Individual #9397 | $100k | High-quality materials for learning about AI safety |
| Mar 2022 | Individual #5153 | $50k | Regrant (recommended by an FTX regrantor): Six months of AI safety research |
| Feb 2022 | Longview Philanthropy | $15M | Longview's independent grantmaking on global priorities research, nuclear weapons policy and other longtermist issues (money to another funder; see transfer ftx-longview-2022) source |
| Feb 2022 | Lightcone Infrastructure | $2M | LessWrong, events and office space source |
| 2022 | Pathos Labs (PopShift) | $50k | Convening tech and existential-risk experts with TV writers; month not given source |
| 2022 | Topos Institute | $30k | Regrant (recommended by an FTX regrantor): Second 'Finding the Right Abstractions' workshop linking category theory and alignment; month not given source |
2021 1 grant · $158k
| Date | Recipient | Amount | Purpose |
|---|---|---|---|
| Jun 2021 | Individual #5415 | $158k | Regrant (recommended by an FTX regrantor): PhD at Cambridge linking algorithmic information theory, epistemology and AGI (dated June 2021 on the page) |