individual · Manifund
Technical AI safety research
| Evan Hubinger | $5,000 | 70% | 1 |
| Neel Nanda | $2,000 | 28% | 1 |
| Vincent Weisser | $150 | 2% | 1 |
Neel Nanda · Manifund · full post · Jan 7, 2025
Unprompted Unfaithful Chain of Thought Dataset Project, Jan 2025
Read more ▾Show less ▴I think this is a no brainer to fund - unfaithful CoT is an important thing to understand (especially given the rise of o1-style models), this dataset seems like a significant improvement over state of the art for studying this phenomena (especially the focus on reproducibility), and the requested amount is small and seems reasonable. I have mentored Rob before and think he's competent and capable of executing on this well.
Conflicts of interest: I've mentored Rob a bunch in the past. This project specifically is largely supervised by Arthur, not me, but I may still be somewhat involved. My bar for spending time on a project is higher than my bar for funding it, so I'm not too concerned about bias/impaired judgement here, especially given the small size of the grant.
Evan Hubinger · Manifund · full post · Nov 7, 2023
Scaling Training Process Transparency, Nov 2023
Read more ▾Show less ▴**Main points in favor of this grant**
I am excited about more work in the realm of training transparency, and I know that Rob is capable of executing here from having mentored him previously.
**Donor's main reservations**
The main way I could imagine this being a bad idea is if it's not a good use of Rob's time, but I'll defer to his judgement there.
**Process for deciding amount**
I'd likely be willing to fund more than 5k, but I'll cover the full expenses being requested for now.
**Conflicts of interest**
Rob was a mentee of mine in the SERI MATS program.
| Date ↓ | Funder | Via | Amount | Cause | Source | Purpose |
|---|---|---|---|---|---|---|
| Jan 16, 2025 | Neel Nanda | Manifund | $2,000 | Evals | manifund | Unprompted Unfaithful Chain of Thought Dataset Project |
| Dec 5, 2023 | Evan Hubinger | Manifund | $5,000 | Control | manifund | Scaling Training Process Transparency |
| Dec 5, 2023 | Vincent Weisser | Manifund | $150 | Control | manifund | Scaling Training Process Transparency |