Falcon Fund

Animal Welfare Midtraining Data Creation

$20,000

**Project summary**

There is a short window of opportunity to provide mid-training data that helps AI models reason well about animal welfare. Constance Li has been leading a sprint project to get this done with a few people I like (Allen Lu, among others).

This funding slightly funges with Sentient Futures funding, but I’m very okay with that. I’m expecting more money to come into the Falcon Fund, so I am awarding $20k here.

The idea is to train on data where AIs treat animals well and behave admirably towards them, but, most importantly, to explain why the decisions are being made so that, hopefully, this generalizes out of distribution. Fiction is completely fine for this.

I think it's quite reasonable to think “animal welfare people” should be doing this as opposed to lab employees. They have much more nuanced, well-thought-out views on why things are bad for animals, from a variety of philosophical perspectives, and will do a better job of explaining why.

**What are this project's goals and how can they be achieved?**

Create mid-training data to give to the AI Labs

**How will this funding be used?**

Pay people to create the mid-training data.

**Who is on the team, and what's their track record on similar projects?**

Constance Li - Leads Sentient Futures

Allen Lu - Created the MANTA benchmark

Aidan Kanknyoku - Animal welfare alignment team at Anima

Sentient Futures Residents

**What are the most likely causes and outcomes if this project fails? (premortem)**

This turns out not to be that useful; it's quite speculative. It could also just get trained out in RL.

**What other funding is this person or project getting?**

It's part of Sentient Futures, but they don't have enough money.

**Main points in favor of this grant**

The project seems good and promising, and I don't know of any other grantmaker who would make this.

**Donor's main reservations**

I think this is unlikely to have very large effects on models, at least at this scale.

**Process for deciding the amount**

I think it could use more than this. My main uncertainty is how much funding the Falcon Fund will get.

**Conflicts of interest**

N/A

Please disclose e.g. any romantic, professional, financial, housemate, or familial relationships you have with the grant recipient(s).

I am also making a small donation as a sign of support. I have a lot of respect for Marcus and this seems like an awesome initiative!

Tandena, I think this is great work. Thank you for doing it. I'm glad my offer to pay enticed you to do this. Post this on the EA forum?

I've been looking for someone to do this for a while, and I found this person from the Sentient Futures fellowship. They were recommended to me, and I worked with them on the shape of this project.

It's very important to know how the animal agriculture industry is adopting technology so we can determine if any of them are very bad and we can build solutions that are better.

I also paid back a $4000 loan so the total size of the grant is $64000