Trace

Rubi Hudson

www.alignmentforum.org/users/rubi-j-hudson · individual · Manifund

Technical AI safety researchOther

Received
$675,450
from 10 funders
Grants
10
Funders
10
Years active
2023–26

Grants over time

$0$200K$400K$600K$800K2023202420252026
UK AI Security InstituteKeri WarrEvan HubingerRyan Kiddraber3All others

Biggest funders

UK AI Security Institute$589,50087%1
Keri Warr$40,0006%1
Evan Hubinger$33,0005%1
Ryan Kidd$10,0001%1
raber3$1,4500%1
gnutella$1,0000%1
Vincent Weisser$2000%1
Carolina Oliveira$1500%1

Reviews

Evan Hubinger · Manifund · full post · Sep 6, 2023

Avoiding Incentives for Performative Prediction in AI, Sep 2023

Read more ▾

**Main points in favor of this grant**

I am excited about more work along the lines of the existing "Incentivizing honest performative predictions with proper scoring rules" paper. I think that there are serious safety problems surrounding predictors that select their predictions to influence the world in such a way as to make those predictions true ("self-fulfilling prophecies") and I am excited about this work as a way to discover mechanisms for dealing with those sorts of problems. "Conditioning Predictive Models" discusses these sorts of issues in more detail. Rubi is a great person to work on this as he was an author on both of those papers.

**Donor's main reservations**

I think my main reservations here are just around Rubi's opportunity costs, though I think this is reasonably exciting work and I trust Rubi to make a good judgement about what he should be spending his time working on. The most likely failure mode here would probably be that the additional work here doesn't turn up anything else new or interesting that wasn't already surfaced in the "Incentivizing honest performative predictions with proper scoring rules" paper.

**Process for deciding amount**

I think that $33k is a reasonable amount given the timeframe and work.

**Conflicts of interest**

Rubi was a previous mentee of mine in SERI MATS and a coauthor of mine on "Conditioning Predictive Models."

Grants received

Date ↓FunderViaAmountCauseSourcePurpose
Nov 7, 2026gnutellaManifund$1,000OthermanifundPrincipled Agents
Oct 21, 2026SmittyManifund$100OthermanifundPrincipled Agents
Oct 20, 2026David Williams-KingManifund$50OthermanifundPrincipled Agents
Oct 20, 2026Ryan KiddManifund$10,000OthermanifundPrincipled Agents
Oct 20, 2026Carolina OliveiraManifund$150OthermanifundPrincipled Agents
Oct 20, 2026raber3Manifund$1,450OthermanifundPrincipled Agents
Oct 20, 2026Keri WarrManifund$40,000OthermanifundPrincipled Agents
Feb 19, 2026UK AI Security InstitutePrinciples of Intelligence~$589,500*Technical AI safety researchuk_aisiConstructing robust incentivizes for AI agents to act cautiously — led by Rubi Hudson. — Alignment Project
Oct 1, 2023Vincent WeisserManifund$200Alignment methodsmanifundAvoiding Incentives for Performative Prediction in AI
Sep 11, 2023Evan HubingerManifund$33,000Alignment methodsmanifundAvoiding Incentives for Performative Prediction in AI

* UK AISI reported a total of 27m GBP over 60 projects, so estimating each of them at the average grant size.