Trace

Alexander Pan

aypan17.github.io · individual · Manifund

Technical AI safety research

Received
$190,000
from 2 funders
Grants
2
Funders
2
Years active
2022–24

Grants over time

$0$50K$100K$150K$200K2024

Biggest funders

Dan Hendrycks$190,000100%1

Reviews

Dan Hendrycks · Manifund · full post · Dec 24, 2023

Removing Hazardous Knowledge from AIs, Dec 2023

Read more ▾

Main points in favor of this grant

Removing hazardous capabilities from models would greatly help reduce AI x-risk from malicious use and unilateral actors. Alex is a researcher with a strong track record who is interested in AI safety and has done previous AI safety research. The timing is right; NIST has been tasked by the recent EO to help develop standards and regulations on “dual-use foundation models.” Research now has a much higher likelihood of helping shape regulation.

Donor's main reservations

This is a relatively complex project with many moving parts. It’s crucial that the project is executed well on a relatively short timeline.

Process for deciding amount

It was estimated by the researchers that this was the total amount needed for the dataset. I have reviewed the budget and approved.

Conflicts of interest

I will be helping advise this project.

Grants received

Date ↓FunderViaAmountCauseSourcePurpose
Jan 16, 2024Dan HendrycksManifund$190,000Alignment methodsmanifundRemoving Hazardous Knowledge from AIs
2022Future of Life Institute—Training pipelinesfliPhD Fellow, Class of 2022 — UC Berkeley. Per-fellow total not published. — Vitalik Buterin PhD Fellowship