Trace

Long-Term Future Fund

funds.effectivealtruism.org/funds/far-future · fund · EA Funds: Long-Term Future Fund, Effective Altruism Funds: Long-Term Future Fund, Long Term Future Fund, LTFF

Total granted
$31,503,290
Grants
715
Average size
$44,122
Coverage
88%
itemized by recipient
Years active
2017–26

Grants over time

$0$5.0M$10M$15M2017201820192020202120222023202420252026

Biggest cause areas

Technical AI safety research$14,149,24445%320
AI safety fieldbuilding$9,778,42531%249
AI governance, policy, and advocacy$2,705,4359%67
AI safety meta$2,496,5758%56
EA infrastructure$627,3682%8
AI safety adjacent$621,4482%19
Other existential risk$612,4922%14
Biosecurity$370,5581%11

Biggest recipients

Machine Intelligence Research Institute$678,9942%4
Effective Altruism Geneva$534,1372%6
Robert Miles$507,5372%6
Transformative Futures Foresight Institute$494,5102%1
John Wentworth$445,0001%4
Alexander Turner$436,4611%6
AI Safety Support$421,0001%3
Centre for the Governance of AI, Inc.$401,5371%1

Grants received 22 · $7,931,286 · $396,564 average

DateFunderViaAmountCauseSourcePurpose
Sep 19, 2024Zach Stein-PerlmanManifund$20Other existential riskmanifundLong-Term Future Fund
Jul 29, 2024Manifund BankManifund$25,437Other existential riskmanifundLong-Term Future Fund
Feb 10, 2024Robin GreenManifund$10,000Other existential riskmanifundLong-Term Future Fund
Jan 15, 2024Callum McDougallManifund$2,000Other existential riskmanifundLong-Term Future Fund
Jan 15, 2024Evan HubingerManifund$100,000Other existential riskmanifundLong-Term Future Fund
Jan 15, 2024Adrian KellyManifund$3,000Other existential riskmanifundLong-Term Future Fund
Jan 15, 2024Yashvardhan SharmaManifund$1,000Other existential riskmanifundLong-Term Future Fund
Oct 26, 2023Jaan TallinnSurvival and Flourishing Fund$692,000Other existential risksffGeneral Support of Long-Term Future Fund
2022FTX Future Fund$3,900,000EA infrastructureftx_future_fundWe recommended funding to support their longtermist grantmaking. — Effective Altruism
Nov 20, 2021Jaan TallinnSurvival and Flourishing Fund$1,417,000Other existential risksffGeneral Support of Long-Term Future Fund
Jul 28, 2021Jaan TallinnCentre for Effective Altruism$995,000Otherjaan_onlineGeneral support for Long-Term Future Fund (EA Funds)
Jul 2021Jaan TallinnSurvival and Flourishing Fund$675,000Other existential risksffGeneral support of Long-Term Future Fund
Jun 23, 2021Jacob Steinhardt$11,225Other existential riskvipul_donations
Mar 6, 2021Patrick Brinich-Langlois$500AI governance, policy, and advocacyvipul_donations
Oct 16, 2019Patrick Brinich-Langlois$44,000AI governance, policy, and advocacyvipul_donations
Nov 27, 2018Patrick Brinich-Langlois$2,504AI governance, policy, and advocacyvipul_donations
Oct 27, 2018Patrick Brinich-Langlois$14,000AI governance, policy, and advocacyvipul_donations
2018Haseeb QureshiOther existential riskvipul_donationsMoney for the Long Term Future Fund to use for its grants
Dec 29, 2017Patrick Brinich-Langlois$11,100AI governance, policy, and advocacyvipul_donations
Dec 18, 2017Morgan DavisAI safetyvipul_donationsSplit between the different funds: 5% for animal welfare, 5% for global development, 15% for EA Community, and 75% for the long-term future fund. Donor also considered donating to Berkeley Existential Risk Initiative (BERI), which she is impressed by, and sees a need for after encountering bureaucracy in academia while working as grant manager for the Open Philanthropy Project. However, she ultimately felt that the fund managers for Effective Altruism Funds would be able to make better decisions
Aug 28, 2017Patrick Brinich-Langlois$20,000AI governance, policy, and advocacyvipul_donations
Mar 25, 2017Patrick Brinich-Langlois$7,500AI governance, policy, and advocacyvipul_donations

Grants made

DateRecipientViaAmountCauseSourcePurpose
Apr 2026Katherine (Katie) DammerEA Funds$10,000Training pipelinesea_fundsPhD tutition funding
Jan 2026Simon GrimmEA Funds$30,000Career transitionsea_fundsStipend to support career exploration (10 weeks+) and a writing project on AI & Germany/Europe
Jan 2026Coleman SnellEA Funds$23,920AI safety fieldbuildingea_funds6 months of research assistance & miscellaneous admin help provided to Sean O hEigeartaigh, of between 20 - 32 h/week
Jan 2026Lida Safety ResearchEA Funds$121,388AI governance, policy, and advocacyea_fundsA wargame simulation to analyze AI policies intended to prevent catastrophes, for education and statistical research
Jan 2026Lise du BuissonEA Funds$8,023AI safety fieldbuildingea_funds6th (last) month of active grant with ID: a3rRl000000yduXIAQ (from my grantee portal)
Jan 2026DNAISEA Funds$95,205Local groupsea_fundsFunding for Dutch AI Safety Network
Oct 2025Horizon OmegaEA Funds$30,100Local groupsea_funds12 months of Montréal AI safety fieldbuilding and EA meetups
Oct 2025IliadEA Funds$56,000Foundationsea_funds"Agent Foundations 2026 at CMU" will be a small, 5-day conference on agent foundations research
Oct 2025Suzy ShepherdEA Funds$6,466Advocacyea_fundsTop-up funding for making a short fiction film on AI x-risk
Oct 2025Yixiong HaoEA Funds$20,000Local groupsea_funds1-year stipend for leading the AI Safety Initiative at Georgia Tech (15-20 hours/week)
Jul 2025Robert MilesEA Funds$150,000Advocacyea_funds1-year funding to produce monthly videos on AI safety and alignment, hiring regular contractors to help expedite thing
Jul 2025Unknown RecipientsEA Funds$100,000Controlea_fundsInvestigating steganographic reasoning in LLM agents via AutoGen-style paraphrased communication benchmarks
Apr 2025SecureBioEA Funds$7,118Biosecurityea_fundsTen field-building events for global catastrophic risks in the greater Boston area for Spring/Summer 2025
Apr 2025Dhruvin PatelEA Funds$1,000Eventsea_fundsTop-up: Travel funding to attend the workshop on biosecurity and AI safety in the UK
Apr 2025Liam PatellEA Funds$45,000AI governance, policy, and advocacyea_funds3-month stipend to do independent AI governance research
Apr 2025Epistea, z.sEA Funds$115,000Eventsea_fundsOrganizing the fifth Human-Aligned AI Summer School (HAAISS), a 4-day conference in Prague for 120 participants
Apr 2025Lise du BuissonEA Funds$38,758Career transitionsea_funds5-month stipend for career transition, independent research, and public outreach in AI safety and its impact on us
Apr 2025Unknown RecipientsEA Funds$10,000Training pipelinesea_fundsTop up funding on biodefense PhD tuition
Apr 2025Hebrew UniverstyEA Funds$5,200Alignment methodsea_funds6-month research extending the landmark Betley et al. emergent misalignment paper through fine-tuning experiments on bas
Apr 2025Aryeh BrillEA Funds$150,000Interpretabilityea_fundsStipend and expenses for independent AI alignment research on scaling laws and interpretability
Jan 2025Macrostrategy Research InitiativeEA Funds$150,000Other existential riskea_fundsOne year of operating expenses for a nonprofit that facilitates and amplifies Nick Bostrom's work
Jan 2025Aysja JohnsonEA Funds$100,000AI governance, policy, and advocacyea_funds1.5 year stipend for thorough investigation and analysis of AI lab scaling policies
Jan 2025Suzy ShepherdEA Funds$25,000Advocacyea_fundsDevelop a short fiction film at a top film school, to spread accurate and emotive understanding of AI x-risk
Jan 2025For Collaborative Work with AI:FAREA Funds$16,698AI governance, policy, and advocacyea_funds5-months funding for RA work with Sean Ó hÉigeartaigh on AI Governance research assistance / AI:FAR admin assistance
Jan 2025Mordechai RorvigEA Funds$50,000Advocacyea_funds6-months of part-time stipend to launch a new science journalism outlet focused on AI Safety
Jan 2025Nicky CaseEA Funds$80,000Advocacyea_funds1-year stipend to make accessible-yet-rigorous explainers on AI Alignment/Security, in the form of games/videos/articles
Oct 2024Formation ResearchEA Funds$10,000Other existential riskea_funds12-month salary to set up a new org doing research and creating interventions to minimise lock-in risk
Oct 2024Unknown RecipientsEA Funds$30,500Career transitionsea_funds6 months continuation of AI safety research I did this past summer to help my career transition
Oct 2024Michel JustenEA Funds$5,000Advocacyea_fundsCreate an animated video essay explaining how AI could accelerate AI R&D and its implications for AI governance
Oct 2024Unknown RecipientsEA Funds$2,562Training pipelinesea_fundsMATS Extension - SF Office Cost and Conference Travel
Oct 2024Unknown RecipientsEA Funds$20,000Training pipelinesea_fundsUpskilling for AI safety research
Oct 2024Caleb RakEA Funds$20,700Foundationsea_fundsA 4-5 day workshop for agent foundations researchers at Carnegie Mellon University in March, 2025
Jul 2024Stanford UniversityEA Funds$22,325Interpretabilityea_funds4-month stipend to bring to completion a mechanistic interpretability research project on how neural networks perform co
Jul 2024Jose GrohEA Funds$85,000Career transitionsea_funds6-month career transition and independent research in AI safety and risk mitigation
Jul 2024Julian GuidoteEA Funds$7,200Technical AI safety researchea_funds9-week stipend for two part-time researchers to write and publish a policy proposal: Mandatory AI Safety ‘Red Bonds’
Jul 2024Unknown RecipientsEA Funds$50,000Technical AI safety researchea_funds1-year spending for my theoretical AI interp. research, and a supporting group for AI independent reseachers in EU
Jul 2024Vasil GeorgievEA Funds$30,000Controlea_funds4-month salary to continue work on AI Control as a MATS extension
Jul 2024Vojtech KovarikEA Funds$49,333Alignment methodsea_funds8 months stipend during job transition, to finish current projects (AI Goodharting, coop. AI) and find suitable next topic
Jul 2024Tyler TracyEA Funds$30,000Controlea_funds4-month stipend to continue work on AI Control as a MATS extension
Jul 2024Santeri TaniEA Funds$73,333Technical AI safety researchea_funds11 months stipend for 1.5 FTEs and funding for other costs for an AI Safety field-building organization TUTKE in Finland
Jul 2024Michael Pearce, Alice Riggs, Thomas DoomsEA Funds$80,000Interpretabilityea_fundsDeveloping weight-based decomposition methods for interpretability - MATS extension, 6 months stipend for 2 people
Jul 2024Keith WynroeEA Funds$37,000Interpretabilityea_funds6-month salary and compute budget for continuing work on mechanistic interpretability for attention layers
Jul 2024Einar UrdshalsEA Funds$50,000Training pipelinesea_fundsMentored independent research and upskilling to transition from theoretical physics PhD to AI safety
Jul 2024Dhruvin PatelEA Funds$1,800Eventsea_fundsTravel Funding Request for Early-Career Researcher to Attend Workshop on Biosecurity and AI Safety
Jul 2024David AbecassisEA Funds$40,000Controlea_fundsDevelop proposals for off-switch designs for AI, including policy games, that have been rigorously evaluated for their effectiveness, technical feasibility and political viability
Jul 2024Logan SmithEA Funds$40,000Interpretabilityea_funds6 month stipend for SAE-circuits
Jul 2024The AI Governance Archive (TAIGA)EA Funds$125,000Technical AI safety researchea_fundsA private online platform for research-sharing amongst the AI governance community
Jul 2024Rauno Arike, Elizabeth DonowayEA Funds$60,000Controlea_funds4-month stipend and expenses to create a benchmark for evaluating goal-directedness in language models
Jul 2024Unknown RecipientsEA Funds$15,800Eventsea_funds4-month stipend for working on a mainline AI scenario and funding to attend defense conferences
Jul 2024Jannik BrinkmannEA Funds$10,000Interpretabilityea_funds4-month part-time salary to work on interpretability projects with David Bau and Logan Riggs
Jul 2024Claire ShortEA Funds$80,000Technical AI safety researchea_fundsStipend and expenses to run the second Athena mentorship program for gender-minority researchers in technical AI alignment
Jul 2024Nikola MooreEA Funds$5,000Technical AI safety researchea_funds9-month programme to help language and cognition scientists repurpose their existing skills for long-termist research
Jul 2024David Williams-KingEA Funds$27,000Advocacyea_funds9 months support for an in-depth YouTube channel about AI safety and how AI will impact us all
Jul 2024Philip TrippenbachEA Funds$5,720Advocacyea_fundsTwo workshops on strategic communications around AI safety, focused on the AI safety community
Jul 2024Wilson WuEA Funds$20,000Foundationsea_fundsResearching neural net generalization on algorithmic tasks, upskilling in math relevant to singular learning theory
Jul 2024Neil CrawfordEA Funds$16,337Technical AI safety researchea_funds7-month stipend for organising AI Alignment Irvine (AIAI)
Jul 2024Krzysztof GwiazdaEA Funds$5,000Interpretabilityea_funds2 month funding to get into mechanistic interpretability and to do 2-3 projects, than learn briefly related fields
Jul 2024Kai FronsdalEA Funds$27,000Controlea_funds4-month grant to conduct deceptive alignment evaluation research and explore control and mitigation strategies
Jul 2024Cody RushingEA Funds$30,000Controlea_funds4-month stipend to continue work on AI Control as a MATS extension
Jul 2024Constantin WeisserEA Funds$80,000Evalsea_funds3-month stipend for MATS extension establishing a benchmark for LLMs’ tendency to influence human preferences
Jul 2024Andis DragunsEA Funds$40,000Interpretabilityea_funds4-month salary for finding and characterising provably hard cases for mechanistic anomaly detection
Jul 2024Javier Ferrando Monsonís and Oscar Balcells ObesoEA Funds$60,000Interpretabilityea_funds4-months stipend to apply mechanistic interpretability to a real-world application, hallucinations
Jul 2024Axel HøjmarkEA Funds$70,000Strategy & forecastingea_funds4-month stipend: Research on agent scaling laws—relationships between training compute and agent capabilities of LLMs
Jul 2024Alex Cloud, Jacob Goldman-Wetzler, Evžen Wybitul, Joseph MillerEA Funds$160,000Interpretabilityea_funds6-month stipends to develop and apply a novel method for localizing information and computation in neural networks
Jul 2024Adelin KasslerEA Funds$40,000Technical AI safety researchea_fundsDeveloping noise-injection methods to reveal and reduce deceptive behaviors in language models prior to deployment
Jul 2024Unknown RecipientsEA Funds$31,000Interpretabilityea_funds3-month funding to work on unlearning with sparse autoencoders
Jul 2024Eric EasleyEA Funds$40,000Technical AI safety researchea_funds6-month stipend to remove conditional bad behaviors from LLMs via a learned latent space intervention
Jul 2024Unknown RecipientsEA Funds$40,000Interpretabilityea_fundsRobust unlearning evaluation and interpretability - MATS extension, 6 months
Jul 2024Unknown RecipientsEA Funds$37,872Legalea_fundsTuition support for law school to work on AI policy
Apr 2024Horizon EventsEA Funds$6,000Foundationsea_fundsMonthly seminar series on Guaranteed Safe AI, from July to December 2024
Apr 2024Yashvardhan SharmaEA Funds$6,000Technical governanceea_funds12-week part-time stipend to research specialized AI hardware requirements for large AI training, with IAPS mentor Asher Brass
Apr 2024Geneva Centre for Security PolicyEA Funds$120,000Training pipelinesea_fundsA fellowship for 3 fellows in synthetic biology, artificial intelligence and neurotechnology to bridge policy and tech
Apr 2024Bryce MeyerEA Funds$90,000Technical AI safety researchea_fundsYear-long stipend to work as the primary maintainer of TransformerLens, and implement large changes to the code base.
Apr 2024Alex InfangerEA Funds$30,000Interpretabilityea_funds6-month stipend to work on AI alignment research (automated redteaming, interpretability)
Apr 2024Thomas KwaEA Funds$60,000Interpretabilityea_funds6-month stipend to continue research on benchmarks for interpretability and on characterizing Goodhart's Law
Apr 2024Unknown RecipientsEA Funds$83,333Technical AI safety researchea_funds8 months stipend for AI security projects and to explore setting up an organization
Apr 2024Aishwarya SaxenaEA Funds$77,544Legalea_funds6-month stipend to work on a research project on AI Liability Insurance as an additional lever for AI Safety
Apr 2024Codruta LugojEA Funds$23,360Controlea_funds5-month salary to continue work on evaluating agent self-improvement capabilities
Apr 2024Aryeh BrillEA Funds$45,000Technical AI safety researchea_funds12-month support for independent AI alignment research
Apr 2024José Villalobos RuizEA Funds$33,700International governanceea_funds6-month salary to finish writing a book on international AI governance and three other smaller AI governance projects
Apr 2024Luise WoehlkeEA Funds$6,230Domestic policyea_funds8-week stipend for a research project supervised by John Halstead, PhD, on US regulatory decision-making and Frontier AI
Apr 2024Daniel FilanEA Funds$44,802Epistemic infrastructureea_fundsThis grant will support Daniel Filan in producing 18 episodes of AXRP, the AI X-risk Research Podcast. The podcast aims to increase in-depth understanding of potential risks from artificial intelligence.
Apr 2024Sahil KulshresthaEA Funds$30,000Foundationsea_fundsDevelopment of mathematical language for highly adaptive entities (having stable commitments, not stable mechanisms)
Apr 2024Arun JoseEA Funds$70,000Interpretabilityea_funds1-year stipend for independent research primarily on high-level interpretability
Apr 2024Tilman RäukerEA Funds$13,000Controlea_funds4 weeks expenses for FAR Labs Residency for research group focusing on goal-directedness in transformer models
Apr 2024Unknown RecipientsEA Funds$20,000Biosecurityea_funds1 semester of funds for PhD program in biodefense
Apr 2024Andrew ZengEA Funds$12,000International governanceea_funds3-month stipend to support research on the state of AI safety in China and implications for AI existential risk
Apr 2024Simon LermenEA Funds$36,000Securityea_funds6-month stipend on evaluating robustness of AI agents safety guardrails and for running an AI spear-phishing study
Apr 2024Coleman SnellEA Funds$31,650Strategy & forecastingea_fundsFunding for 6-Month AI strategy/policy research stay at CSER with Seán Ó hÉigeartaigh & Matthew Gentzel
Apr 2024Mikhail BaranchukEA Funds$12,600Securityea_funds3-month stipend and cloud credits to research AI collusion mitigation strategies and develop secure steganography
Apr 2024Unknown RecipientsEA Funds$12,233Domestic policyea_funds6-month stipend for an unpaid internship on AI policy at the Ministry of Economic Development in Italy to contribute to AI safety
Apr 2024Sarah Hastings-WoodhouseEA Funds$10,120Advocacyea_funds4-month stipend for a career transition period to explore roles in AI safety communications
Apr 2024Dioptra (informal research group working on evals)EA Funds$9,072Technical AI safety researchea_fundsRetroactive funding for GameBench paper
Apr 2024Unknown RecipientsEA Funds$2,000Technical AI safety researchea_fundsFunding for EAG-related travel and career planning.
Apr 2024Morgan SimpsonEA Funds$11,244Career transitionsea_funds12 week 0.6FT upskilling stipend for technical governance research management
Apr 2024Satvik GolechhaEA Funds$30,000Interpretabilityea_funds6-month stipend to work on safe and robust reasoning via mechanistically interpreting representations
Apr 2024Unknown RecipientsEA Funds$16,000Technical AI safety researchea_funds6-month salary top-up for an internship at the CNAS Technology and National Security Program, helping to formulate policy recommendations to mitigate national security risks from AI and other emerging technologies.
Apr 2024Matt MacDermottEA Funds$10,000Technical AI safety researchea_funds6 month AI alignment internship stipend top-up
Apr 2024Sumeet MotwaniEA Funds$1,875Technical AI safety researchea_fundsGrant to attend ICLR 2024 for an accepted alignment related paper as an undergraduate student
Apr 2024Nicky PochinkovEA Funds$80,000Interpretabilityea_funds12 month stipend and expenses to research in AI Safety (Unlearning; Modularity; Probing Long-term behaviour)
Apr 2024University of Texas at AustinEA Funds$50,000Technical AI safety researchea_funds3–6 months stipend for first full year as a research professor of CS at UT Austin, researching technical AI alignment
Apr 2024Kunvar ThamanEA Funds$2,500Evalsea_fundsSeeking funds to present “Benchmark Inflation” at ICML 2024, my paper on making AI progress measures more accurate
Apr 2024Hannah ErleabchEA Funds$20,000Research hubsea_funds3-month stipend to continue working on goal misgeneralisation project for ICLR deadline, plus travel funding
Apr 2024Glauber De BonaEA Funds$40,000Career transitionsea_funds6-months stipend for transitioning to independent research on AI Safety
Apr 2024Gideon FutermanEA Funds$5,000Technical AI safety researchea_fundsSpend 3 months (part time) assessing plausible pathways to slowing AI
Apr 2024Brian TanEA Funds$86,400Interpretabilityea_funds~4 FTE for 9 months to fund WhiteBox Research, mainly for the 2nd cohort of our AI Interpretability Fellowship in Manila
Apr 2024Brian TanEA Funds$10,120Interpretabilityea_funds$10,120 for most of the ops expenses of the research phase (June-Sep 2024) of WhiteBox’s AI Interpretability Fellowship
Apr 2024Unknown RecipientsEA Funds$4,200Biosecurityea_funds1.5-week salary to travel for bioinformatics work
Jan 2024Lukas FluriEA Funds$37,120Interpretabilityea_funds6-month stipend to do an unpaid internship focused on using theory/interpretability to increase the safety of AI systems
Jan 2024Unknown RecipientsEA Funds$25,000Alignment methods, Career transitions, Economicsea_funds4-month salary to continue collaborations, conduct research, upskill, and network in the field of AI alignment
Jan 2024TimaeusEA Funds$100,000Technical AI safety researchea_fundsSalary Top-Up for Timaeus' Employees & Contractors
Jan 2024Iván Arcuschin MorenoEA Funds$67,000Interpretabilityea_funds4-month stipend for MATS extension on mechanistic interpretability benchmark + 2-month stipend for career switch
Jan 2024Epistea, z.sEA Funds$160,000Training pipelinesea_fundsOrganizing the fourth Human-Aligned AI Summer School (HAAISS), a 4-day conference in Prague/Vienna for 130 participants
Jan 2024Sviatoslav ChalnevEA Funds$40,000Interpretabilityea_funds6-month stipend to continue independent interpretability research
Jan 2024Lucy FarnikEA Funds$41,000Interpretabilityea_fundsExploring the feasibility of circuit-style analysis on the level of SAE features (MATS extension)
Jan 2024Decode ResearchEA Funds$275,000Interpretabilityea_funds1 year of stipend + compute + contracts for an AI interpretability research platform for LLMs
Jan 2024Aengus LynchEA Funds$52,119Securityea_funds6 months of funding for MATS 5.0 extension, with projects on latent adversarial training and persona explainability
Jan 2024Alfie LamertonEA Funds$6,000Technical AI safety researchea_funds1 month long literature review on in-context learning and its relevance to AI alignment
Jan 2024Niels uit de BosEA Funds$62,000Evalsea_funds4-month salary and office for MATS 5.0 extension on adversarial circuit evaluation + 2-month runway for career switch
Jan 2024Unknown RecipientsEA Funds$3,000Global health and developmentea_fundsTravel expenses to present at the Global Health Security Conference
Jan 2024Unknown RecipientsEA Funds$44,000Interpretabilityea_fundsSix months of upskilling and research in ML interpretability
Jan 2024Michael ParkerEA Funds$50,000Technical AI safety researchea_fundsCatalog the history of U.S. high-consequence pathogen regulations, evaluate their performance, and chart a way forward
Jan 2024Unknown RecipientsEA Funds$9,675Technical AI safety researchea_fundsLiving cost top off while working on long-term relevant research at DC think tank
Jan 2024Felix HofstätterEA Funds$38,688Training pipelinesea_funds6-month stipend for conducting AI-safety research during the MATS 5.0 extension program and beyond
Jan 2024Dioptra (informal research group working on evals)EA Funds$32,000Evalsea_fundsThis grant will support Josh Clymer and collaborators with summer stipends + research budget to execute technical safety standards projects.
Jan 2024Egg Syntax (legal: Jesse Davis)EA Funds$55,000Interpretabilityea_fundsResearch on how much language models can infer about their current user, and interpretability work on such inferences
Jan 2024Aidan EwartEA Funds$23,100Securityea_fundsFour months of funding for a MATS 5.0 extension, working on improving methods in latent adversarial training
Jan 2024Joe KwonEA Funds$40,000Technical AI safety researchea_funds6-month stipend to work on an ML safety project, with the aim of joining a ML safety team full-time after
Jan 2024Tristan WilliamsEA Funds$2,000Other existential riskea_fundsThis grant will support Tristan with funding to attend EAG and to apply for grad school, aiming for an impactful policy role targeting x-risk reduction.
Jan 2024Garrett BakerEA Funds$17,500Foundationsea_fundsMATS 3-month stipend to use singular learning theory to explain & control the development of values in ML systems
Jan 2024Roman SoletskyiEA Funds$35,000Interpretabilityea_funds6-month salary to verify neural network scalably for RL and produce a human to super-human scalable oversight benchmark
Jan 2024Hayden PeacockEA Funds$5,000Technical AI safety researchea_funds2 Months of living expenses while I try to establish a broad-spectrum antiviral research organization
Jan 2024University of Massachusetts AmherstEA Funds$50,000Alignment methodsea_fundsData collection for a new paradigm for AI alignment based on downstream outcomes and human flourishing
Jan 2024Unknown RecipientsEA Funds$127,000AI × bioea_funds1 year stipend for policy and technical work on biosecurity
Jan 2024Unknown RecipientsEA Funds$9,250Otherea_fundsFunds for early-career expenses and travel to visit research mentors over the end of the semester and the summer 2024
Jan 2024Sarah Hastings-WoodhouseEA Funds$5,000Advocacyea_fundsA podcast mainly themed around AI x-risk, aimed at a non-technical audience
Jan 2024Andrew GritsevskiyEA Funds$50,336Securityea_funds4-month stipend for 3 people to create demonstrations of provably undetectable backdoors
Jan 2024Thomas CostelloEA Funds$115,000Technical AI safety researchea_fundsExperimentally testing generative AI's ability to persuade humans about hazardous topics
Jan 2024Sara PriceEA Funds$55,000Controlea_funds6-month stipend to continue independent AI alignment research from MATS 5.0 on situational awareness and deception
Jan 2024Unknown RecipientsEA Funds$27,720Training pipelinesea_fundsResearch stipend to continue MATS 5.0 project on language models’ internal representations of uncertainty
Jan 2024Lewis HammondEA Funds$86,600Alignment methodsea_fundsCompute costs for experiments to evaluate different scalable oversight protocols
Jan 2024Orpheus LummisEA Funds$10,000Eventsea_fundsVirtual AI Safety Unconference 2024 is a collaborative online event by and for researchers of AI safety
Jan 2024Cindy WuEA Funds$40,000Training pipelinesea_funds6-month stipend to work on techical alignment research as part of MATS 5.0 extension program
Jan 2024Theodore ChapmanEA Funds$55,660Evalsea_funds6-month researcher stipend to explore the effect of chat fine-tuning on LLM capability elicitation
Jan 2024Unknown RecipientsEA Funds$3,821Global health and developmentea_fundsTravel Support to present biosecurity policy research at the Global Health Security Conference
Jan 2024Dillon BowenEA Funds$30,000Career transitionsea_funds6-month salary to transition to a career in AI safety while working on AI safety projects
Jan 2024Unknown RecipientsEA Funds$2,200Technical AI safety researchea_funds1 month room and flight to visit MIT FutureTech
Jan 2024David UdellEA Funds$10,500Interpretabilityea_funds7 months of coworking-space funding continuation, during interpretability research project
Jan 2024AI Safety Australia & New ZealandEA Funds$77,000Local groupsea_fundsThis grant will support Yanni Kyriacos (through Good Ancestors Project) with one year of costs for AI Safety movement building work in Australasia.
Jan 2024Aleksandar MakelovEA Funds$22,500Training pipelinesea_funds3-month stipend during post-SERI MATS alignment job search and wrapping up paper w/ mentor
Jan 2024Oscar Balcells ObesoEA Funds$40,000Interpretabilityea_funds4-month stipend to research the mechanisms of refusal in chat LLMs
Jan 2024Alex AltairEA Funds$60,000Foundations, Local groupsea_funds6-month stipend for a small group of collaborators to continue research on the Agent Structure Problem
Jan 2024Teun van der WeijEA Funds$30,087Controlea_funds4-month expenses for AI safety research on personas and sandbagging during the MATS 5.0 extension program
Jan 2024Aaquib SyedEA Funds$30,000Evalsea_funds4-month stipend to study refusals and jailbreaks in chat LLMs under Neel Nanda as part of the MATS 5.0 extension program
Jan 2024Abhay SheshadriEA Funds$15,075Training pipelinesea_funds1-month full-time + 3 months part-time salary to work on two research projects during the MATS 5.0 extension program
Jan 2024Logan SmithEA Funds$40,000Interpretabilityea_funds6-month stipend for Sparse Autoencoder Mech Interp projects
Jan 2024Sumeet MotwaniEA Funds$19,000Evalsea_funds1-month pt. stipend for 4 MATS scholars working on autonomous web-browsing LLM agents that can hire humans + safety evals
Jan 2024Arjun PanicksseryEA Funds$34,100Training pipelinesea_funds4 months of stipend for MATS extension work in London studying the safety implications of LLM self-recognition
Jan 2024Unknown RecipientsEA Funds$37,000Interpretabilityea_funds1.5 years’ salary and compute to research consequences of deep learning theory for mechanistic interpretability
Jan 2024Danielle EnsignEA Funds$60,000Interpretabilityea_funds4-6 month salary to do circuit-based mech interp on Mamba, as part of the MATS extension program
Jan 2024Hannah ErlebachEA Funds$25,216Career transitionsea_funds4-month stipend to continue AI safety projects
Jan 2024Yoav TzfatiEA Funds$62,150Evalsea_fundsMeta level adversarial evaluation of debate (scalable oversight technique) on simple math problems (MATS 5.0 project)
Jan 2024Sienka DouniaEA Funds$8,500Technical AI safety researchea_funds3 months relocation from Chad to London to work on Eliciting Latent Knowledge with Jake Mendel from Apollo Research
Oct 2023Rafael Andersson LipcseyEA Funds$7,000International governance, Career transitions, Economicsea_funds4-month stipend for upskilling within the field of economic governance of AI
Oct 2023Unknown RecipientsEA Funds$15,000Career transitionsea_fundsThree-month salary to continue work on AI safety research and look for further funding opportunities
Oct 2023Samotsvety ForecastingEA Funds$6,000Otherea_fundsGeneral support for a forecasting team
Oct 2023Marcus WilliamsEA Funds$42,000Alignment methodsea_funds6-month 1 FTE funding to train Multi-Objective RLAIF models and compare their safety performance to standard RLAIF
Oct 2023Apart ResearchEA Funds$272,800Training pipelines, Org incubation & opsea_funds6 months of funding (salaries & ops costs) for AI Safety talent incubation through research sprints and fellowships
Oct 2023Chris LakinEA Funds$5,000Eventsea_fundsA small, short workshop focused on coordinating/planning/applying «boundaries» idea to safety
Oct 2023Philip QuirkeEA Funds$61,000Alignment methods, Career transitionsea_fundsSix month study grant to speed up my career pivot into AI safety and alignment research, with specific deliverables
Oct 2023Existential Risk ObservatoryEA Funds$24,339Eventsea_fundsOrganize AI xrisk events with experts (e.g. Stuart Russell), politicians, and journalists to influence policymaking
Oct 2023Felix BinderEA Funds$2,000Securityea_fundsCompute for experiment about how steganography in large language models might arise as a result of benign optimization
Oct 2023Alignment Ecosystem DevelopmentEA Funds$99,330Career transitionsea_funds1-year stipend to continue building and maintaining key digital infrastructure for the AI safety ecosystem
Oct 2023Catalyze ImpactEA Funds$122,507Org incubation & opsea_funds6-month incubation program for technical AI safety research organizations
Oct 2023Nora AmmannEA Funds$102,500Training pipelines, Local groupsea_funds1 year funding for PIBBSS (incl. several programs, e.g. fellowship 2024, affiliate program, reading group)
Oct 2023Chris LakinEA Funds$4,500Epistemic infrastructureea_fundsFunding for having written AI safety distillation posts on the topic of membranes/boundaries
Jul 2023MentaLeapEA Funds$40,000AI × cyber, Economicsea_fundsIn MentaLeap, cybersecurity experts, AI researchers, and neuroscientists collaborate to reverse-engineer neural networks
Jul 2023David UdellEA Funds$80,000Alignment methods, Career transitionsea_fundsOne year stipend and compute budget, for full-time technical AI alignment research
Jul 2023Ross NordbyEA Funds$40,000Technical AI safety researchea_fundsPart-time salary for independent AI safety research
Jul 2023Thomas KwaEA Funds$95,000Interpretability, Alignment methods, Career transitionsea_funds6-month salary for independent alignment research in interpretability or control
Jul 2023Unknown RecipientsEA Funds$48,423Interpretabilityea_funds4-month salary and expenses to research an approach to identify feature directions in neural networks
Jul 2023Aidan EwartEA Funds$7,700Interpretability, Alignment methods, Career transitionsea_funds6-month salary for part-time independent research on LM interpretability for AI alignment
Jul 2023Nathaniel SharadinEA Funds$33,000Eventsea_fundsUndergrad buyout to teach AI safety in Hong Kong’s new MA program on AI; China-West AI Safety workshop
Jul 2023Arran McCutcheonEA Funds$6,000International governance, Career transitionsea_funds3-month part-time salary in order to work on AI governance projects and activities
Jul 2023Brian TanEA Funds$61,460Interpretability, Training pipelinesea_fundsWhiteBox Research: 1.9 FTE for 9 months to pilot a training program in Manila focused on Mechanistic Interpretability
Jul 2023John WentworthEA Funds$200,000Foundationsea_funds1-year stipend to continue research on agency, focused on natural abstraction
Jul 2023Shashwat GoelEA Funds$12,000Training pipelinesea_fundsSERI MATS 3-month extension to study knowledge removal in Language Models
Jul 2023Logan SmithEA Funds$40,000Interpretabilityea_funds6 month salary for further pursuing sparse autoencoders for automatic feature finding
Jul 2023Unknown RecipientsEA Funds$27,450Org incubation & ops, AI welfareea_funds6m of research in nascent areas of EA/longtermism (e.g. digital sentience) with the aim of founding a new org or company
Jul 2023Thomas KwaEA Funds$29,760Foundationsea_fundsRetroactive grant to study Goodhart effects on heavy-tailed distributions
Jul 2023Robert MilesEA Funds$121,575Alignment methods, Advocacy, Local groups, Career transitionsea_funds1yr stipend to make videos and podcasts about AI Safety/Alignment, and build a community to help new people get involved
Jul 2023Riya SharmaEA Funds$1,700Otherea_fundsFunding to attend BWC meeting to discuss transparency with country representatives & work on research project
Jul 2023Imperial College LondonEA Funds$5,090Biosecurityea_fundsFunds to support travel for research with the Nucleic Acid Observatory relating to biosecurity and GCBRs
Jul 2023Unknown RecipientsEA Funds$52,200Foundations, Training pipelinesea_funds6 months MATS extension to work on a paper on (dis)empowerment.
Jul 2023Bilal ChughtaiEA Funds$41,000Interpretabilityea_funds6 month salary to work on mech interp research with mentorship from Prof David Bau
Jul 2023Unknown RecipientsEA Funds$30,000Career transitions, Strategy & forecasting, Economicsea_funds5-month stipend to create a research agenda and conduct research using the IO literature in economics for AI strategy
Jul 2023Unknown RecipientsEA Funds$20,000Career transitionsea_fundsGeneral support for an AI safety researcher in a transitionary phase for 3-5 months
Jul 2023Unknown RecipientsEA Funds$7,400Interpretability, Training pipelinesea_funds4-month salary for remote part-time mechanistic interpretability research under Neel Nanda extending SERI MATS research
Jul 2023P.H.IEA Funds$42,000Alignment methods, Evalsea_funds6 to 12 month fundings to continue working on model psychology and evaluation
Jul 2023Neel Nanda$52,000Interpretabilityvipul_donationsThe grants database gives the following intended use of funds: "6 months of funding for Arthur Conmy to work with me (Neel Nanda) on mechanistic interpretability research"
Jul 2023Hoagy CunninghamEA Funds$35,300Training pipelinesea_funds6 month SERI MATS London extension phase for continuing and scaling up the sparse coding project
Jul 2023Alexander MannEA Funds$36,000Otherea_fundsA megaproject proposal: Building a longtermist industrial conglomerate aligned via a reputation based economy
Jul 2023Unknown RecipientsEA Funds$40,680International governance, Local groupsea_funds9-month university tuition support for technical AI safety research focused on empowering AI governance interventions
Jul 2023Keith WynroeEA Funds$21,989Interpretability, Training pipelinesea_funds5-month funding to continue upskilling in mechanistic interpretability post-SERI MATs, and to continue open projects
Jul 2023Ann-Kathrin DombrowskiEA Funds$27,260Training pipelinesea_funds3-months salary for SERI MATS extention to work on internal concept extraction
Apr 2023Unknown RecipientsEA Funds$63,242Interpretability, Alignment methods, Career transitionsea_funds6-month grant to pivot into AI alignment research. Goals include upskilling in linear algebra and probability theory, independent mechanistic interpretability research and working on AI Safety Camp research project "Understanding Search in Transformers."
Apr 2023Unknown RecipientsEA Funds$17,000Otherea_funds1 year salary to outline vulnerabilities, propose solution, get buy-in for the security of benchtop DNA synthesis
Apr 2023Sviatoslav ChalnevEA Funds$35,000Interpretabilityea_fundsThis grant is funding for a 6-month stipend for Sviatoslav Chalnev to work on independent interpretability research, specifically mechanistic interpretability and open-source tooling for interpretability research.
Apr 2023Harrison GietzEA Funds$10,750Career transitionsea_funds4-month fund for full time AI safety technical and/or governance research
Apr 2023Unknown RecipientsEA Funds$48,000Interpretability, Alignment methods, Career transitionsea_funds6-month stipend for up-skilling in technical AI alignment & doing independent interpretability research
Apr 2023Unknown RecipientsEA Funds$40,000Career transitionsea_fundsThis grant provides a 6 month stipend at £30k to transition into technical AI safety research.
Apr 2023Francis Rhys WardEA Funds$8,000Eventsea_fundsFunding for (academic/technical) AI safety community events in London
Apr 2023Unknown RecipientsEA Funds$115,000Research infrastructureea_fundsFunding towards the Computer Science Master's program at NYU to pursue technical AI safety research.
Apr 2023Unknown RecipientsEA Funds$14,000Local groups, EA infrastructureea_funds4-month career transition grant to upskill in organisation-building and community-building. Harry is the Logistics Co-Lead at SPARC this summer and has been accepted into Tee Barnett's Coaching Program.
Apr 2023Kristy LokeEA Funds$10,000Otherea_funds6 month project - pending description
Apr 2023Alexander TurnerEA Funds$30,000Interpretabilityea_fundsThis grant provides 5 months of funding for office space for collaboration on interpretability/model-steering alignment research
Apr 2023Matthias DellagoEA Funds$25,491Interpretability, Alignment methods, Career transitionsea_fundsStipend for a master’s thesis and paper on technical alignment research: mechanistic interpretability of attention
Apr 2023Bryce MeyerEA Funds$50,000Interpretability, Career transitionsea_funds6-month salary to build & enhance open-source mechanistic interpretability tooling for AI safety researchers
Apr 2023Benjamin StewartEA Funds$3,138Local groups, Biosecurityea_funds3-month (+buffer to prepare project reports) part-time salary to upskill in biosecurity research and prioritisation. Courses include Infectious Disease Modelling by Imperial College London. Projects include UChicago's Market Shaping Accelerator challenge.
Apr 2023Jacques ThibodeauEA Funds$27,108Alignment methods, Career transitionsea_funds12-month salary to continue working tools for accelerating alignment and the Supervising AIs Improving AIs agenda
Apr 2023Viktor RehnbergEA Funds$19,248Otherea_fundsThis grant will support Viktor Rehnberg's project identifying key steps in reducing risks from learned optimisation and working towards solutions that seem the most important. Viktor will start working on this project as part of the SERI MATS program.
Apr 2023Roman LeventovEA Funds$6,500Corporate governance, Career transitionsea_funds6-month salary to continue developing as an AI safety researcher. Goals include writing a review paper about goal misgeneralisation from the perspective of Active Inference and pursue collaborative projects on collective decision-making systems.
Apr 2023Unknown RecipientsEA Funds$60,000Advocacyea_fundsVideos explaining developments within AI and their impact on society
Apr 2023Simon LermenEA Funds$13,000Alignment methods, Control, Career transitionsea_funds3-month salary + compute expenses to study and publish on shutdown evasion in LLMs and to use LLMs as tools for alignment
Apr 2023Cindy WuEA Funds$5,000Career transitionsea_fundsThis grant provides a stipend for Cindy Wu to spend 4 months working on AI safety research.
Apr 2023Unknown RecipientsEA Funds$4,344Career transitionsea_fundsStipend for 4-month placement at the MIT Computer Science and Artificial Intelligence Laboratory.
Apr 2023Unknown RecipientsEA Funds$1,000Otherea_fundsSmall grant to spend on productivity/research related things
Apr 2023Artem KarpovEA Funds$1,739Global health and developmentea_funds6-month support for self study and development in ML and AI Safety. Goals include producing an academic paper while working on the "Inducing Human-Like Biases in Moral Reasoning LMs" project run by AI Safety Camp.
Apr 2023Cole WyethEA Funds$50,000Foundationsea_fundsStudying extensions of the AIXI model to reflective agents to understand the behavior of self modifying A.G.I
Apr 2023Amritanshu PrasadEA Funds$8,000Alignment methods, Career transitionsea_funds6-month Scholarship to support Amritanshu Prasad's upskilling in technical AI alignment. Amritanshu will study the AGI Safety Fundamentals Alignment Curriculum and create an accessible and informative summary of the curriculum.
Apr 2023Scott ViteriEA Funds$10,000Training pipelinesea_funds1 year PhD funding and compute funding to research a novel method for training prosociality into large language models
Apr 2023Unknown RecipientsEA Funds$48,000Controlea_funds6-month salary for study of mesa-optimisation and deception in order to advance our understanding of how transformers solve algorithmic tasks and provide a concrete example of mechanistic interpretability for deception.
Apr 2023Unknown RecipientsEA Funds$7,700International governanceea_funds3-month unpaid AI Governance internship to build career capital at the Millennium Project, a global futurist think tank
Apr 2023Unknown RecipientsEA Funds$9,887Otherea_funds1 year of funding to help cover expenses of transferring to a MSc, studying Mathematics with a minor in Informatics.
Apr 2023Christopher MathwinEA Funds$28,000Interpretability, Career transitionsea_funds6-month salary for an AISC project and continuing independent mechanistic interpretability projects
Apr 2023Joshua ClymerEA Funds$1,500Evalsea_fundsI'm writing a research paper that introduces an instruction-following generalization benchmark and I need compute funds
Apr 2023Alexander TurnerEA Funds$40,000Interpretabilityea_fundsConference publication of interpretability and LM-steering results
Apr 2023Codruta LugojEA Funds$7,200Alignment methods, Career transitionsea_funds4-month wage for alignment upskilling: gain research eng skills (projects) + understand current alignment agendas
Apr 2023Logan StrohlEA Funds$80,000EA infrastructureea_funds1 year stipend to develop materials demonstrating an investigative procedure for advancing the art of rationality
Apr 2023Carson EzellEA Funds$8,673International governance, Career transitions, Strategy & forecastingea_fundsThis grant provides a 3-month part-time stipend for Carson Ezell to conduct 2 research projects related to AI governance and strategy.
Apr 2023Vaidehi AgarwallaEA Funds$10,500Otherea_funds$10,500 in funding to run a trial of a longtermist mentorship program similar to Magnify Mentoring but unrestricted
Apr 2023Yuxiao LiEA Funds$45,000Interpretability, Career transitionsea_fundsThis grant is funding a $35,000 stipend plus $10,000 in compute costs for Yuxiao Li's independent inference-based AI interpretability research.
Apr 2023Morgan SimpsonEA Funds$31,600International governance, Career transitionsea_funds6-month salary to produce 2 AI governance white papers and a series of case studies, with additional research costs
Apr 2023Bart BussmannEA Funds$8,800Alignment methods, Career transitionsea_funds2-month salary to test suitability for technical AI alignment research and identify a research direction
Apr 2023Unknown RecipientsEA Funds$8,000Technical governanceea_fundsTwo months' salary to work on hardware-related AI governance, including limiting the actors who can create dangerous AI
Apr 2023Nathaniel MonsonEA Funds$70,000Interpretability, Alignment methodsea_fundsThis grant is for Nathaniel Monson to spend 6 months studying to transition to AI alignment research, with a focus on methods for mechanistic interpretability and resolving polysemanticity.
Apr 2023Kurt BrownEA Funds$15,000Corporate governanceea_funds4 weeks dev time to make a cryptographic tool enabling anonymous whistleblowers to prove their credentials
Apr 2023Akbir KhanEA Funds$55,000Alignment methodsea_fundsThis grant provides funding for a project that explores debate as a tool that can verify the output of agents which have more domain knowledge than their human counterparts.
Apr 2023ACX AtlantaEA Funds$5,000Eventsea_fundsOne year funding of ACX meetup in Atlanta Georgia
Apr 2023Guillaume CorlouerEA Funds$6,636Interpretabilityea_fundsFunding to do research on understanding search in transformers at the AI safety camp during 14 weeks

Showing 250 of 715. ·