aypan17.github.io · individual · Manifund
Technical AI safety research
| Dan Hendrycks | $190,000 | 100% | 1 |
Dan Hendrycks · Manifund · full post · Dec 24, 2023
Removing Hazardous Knowledge from AIs, Dec 2023
Read more ▾Show less ▴Main points in favor of this grant
Removing hazardous capabilities from models would greatly help reduce AI x-risk from malicious use and unilateral actors. Alex is a researcher with a strong track record who is interested in AI safety and has done previous AI safety research. The timing is right; NIST has been tasked by the recent EO to help develop standards and regulations on “dual-use foundation models.” Research now has a much higher likelihood of helping shape regulation.
Donor's main reservations
This is a relatively complex project with many moving parts. It’s crucial that the project is executed well on a relatively short timeline.
Process for deciding amount
It was estimated by the researchers that this was the total amount needed for the dataset. I have reviewed the budget and approved.
Conflicts of interest
I will be helping advise this project.
| Date ↓ | Funder | Via | Amount | Cause | Source | Purpose |
|---|---|---|---|---|---|---|
| Jan 16, 2024 | Dan Hendrycks | Manifund | $190,000 | Alignment methods | manifund | Removing Hazardous Knowledge from AIs |
| 2022 | Future of Life Institute | — | Training pipelines | fli | PhD Fellow, Class of 2022 — UC Berkeley. Per-fellow total not published. — Vitalik Buterin PhD Fellowship |