Promptfoo

Founded by Ian W.

Open-source CLI and security platform for testing, evaluating, and red-teaming LLM prompts, RAG pipelines, and AI agents.

Cost

Free Trial

Rating

★ People love it

Time to value

Quick Setup (< 1 hour)

You can use Promptfoo to test AI applications and catch security vulnerabilities during development. It runs automated red team attacks against your AI apps, agents, and workflows to find prompt injections, jailbreaks, data leaks, and other security issues. The tool integrates with CI/CD pipelines and provides remediation guidance directly in pull requests to help developers fix problems before they reach production.

What Promptfoo does

Generate thousands of context-aware security attacksScan AI applications for prompt injection vulnerabilitiesTest agent tool use for security violationsMonitor RAG systems for data leakageIntegrate security testing into CI/CD workflowsCreate custom attack scenarios for specific applicationsTrack security fixes across development teamsGenerate security reports for compliance requirementsAutomated red team attacks for AI applicationsCustom attack generation for specific targetsReal-time threat intelligence from 300k+ usersCI/CD pipeline integration for continuous testingRemediation guidance directly in pull requestsTests 50+ vulnerability types including prompt injectionContext-aware attacks tailored to business logicAgent and RAG workflow testing capabilities

Tutorials & Demos

Frequently asked

Microsoft Azure AWS

AWS

Hugging Face Gemini

Want a tailored answer?

See whether Promptfoo fits your stack.

Techbible weighs Promptfoo against what you already pay for, your team shape, and the work that's actually happening. Free to start.

Side by side

Compare Promptfoo

Search the catalog or pick a similar tool to compare pricing, features, and fit.

Or pick from similar tools

More in AI Orchestration and MLOps

All tools →

A visual AI playground

Tersa is an open source canvas for building AI workflows. Drag, drop connect and run nodes to build your own workflows powered by various industry-leading AI models.

AI Reliability for Production LLMs

Latitude is the reliability layer for AI products: detect failures, measure performance, and automatically improve model quality

AIMLAPI

AI API service providing easy access to over 200 AI models.

AMESA

Build and deploy AI agents to automate complex industrial processes.

Adaption

Build adaptive AI that learns continuously from your data

Agenta

Agenta is an open-source platform for building robust LLM Application. It provides tools for prompt engineering, evaluation, debugging, and monitoring of complex LLM Apps.

Agentic Fabriq

A security and identity layer that manages permissions, authentication, and governance for AI agents acting across enterprise tools.

Archestra

Enterprise MCP platform with security guardrails, compliance controls, and a curated catalog of 900+ evaluated Model Context Protocol servers for AI agents.