Trace

Civic AI Security Program, Inc.

civai.org · organization

Nonprofit, known as CivAI, that builds live software demonstrations of AI capabilities and risks and briefs policymakers, civil society and the public with them.

Leadership

Team

headcount not published

source, Oct 2026

Technical AI safety researchAI governance, policy, and advocacyOther

Received
$860,543
from 2 funders
Grants
3
Funders
2
Years active
2025–26

Grants over time

$0$200K$400K$600K$800K20252026
Jaan TallinnJulia Wise and Jeff Kaufman

Biggest funders

Jaan Tallinn$850,00099%2
Julia Wise and Jeff Kaufman$10,5431%1

Reviews

Zvi Mowshowitz · nonprofits.zone · full post · Nov 26, 2025

Confidence: High, Funding needs: High

Read more ▾

I was impressed by the demo I was given (so a demo demo?). There’s no question such demos fill a niche and there aren’t many good other candidates for the niche.

The bear case is that the demos are about near term threats, so does this help with the things that matter? It’s a good question. My presumption is yes, that raising situational awareness about current threats is highly useful. That once people notice that there is danger, that they will ask better questions, and keep going. But I always do worry about drawing eyes to the wrong prize.

To donate, click here or email contact@civai.org.

Michael Dickens · mdickens.me · full post · Nov 18, 2024

Classification: Might fund if I had a lot more money

Read more ▾

CivAI raises awareness about AI dangers by building interactive software to demonstrate AI capabilities, for example AI-powered cybersecurity threats.

This org is new which makes it difficult to evaluate. It appears to have the same theory of change as Palisade Research (which I review below), but I like Palisade better, for three reasons:

  • None of CivAI’s work so far appears relevant to x-risk. For example, its most recent demo focuses on generating fake images for deceptive purposes.
  • I think Palisade’s methods for demonstrating capabilities are more likely to get attention (credence: 65%).
  • I’m more confident in Palisade’s ability to communicate with policy-makers.

CivAI does not appear to be seeking donations. There is no option to donate through the website.

Grants received

Date ↓FunderViaAmountCauseSourcePurpose
Sep 2026Jaan TallinnSurvival and Flourishing Fund$250,000AdvocacysffGeneral support
Dec 25, 2025Julia Wise and Jeff Kaufman$10,543Otherjefftk25% of $42,172 donation; via donor advised fund — Personal donations
Sep 2025Jaan TallinnSurvival and Flourishing Fund$600,000Technical AI safety researchsffGeneral support