AI Security Toolkit
Open-source tools to scan, protect, monitor, and comply. Free for individuals and open-source projects.
On the roadmap
Tools we're planning next. Want to help build them or see one prioritized? Get in touch.
Prompt Firewall
Plannedopensecureai/prompt-firewallRuntime middleware to filter malicious inputs and validate LLM outputs in real-time. Planned support for Python, Node.js, and Go.
Key Features
- Real-time input filtering
- Output content validation
- Custom rule engine
- PII detection & redaction
- Drop-in SDK integration
Red Team Toolkit
Plannedopensecureai/redteamAutomated red teaming framework for LLMs. Generate adversarial inputs, test guardrails, and measure model robustness against known attack patterns.
Key Features
- Automated jailbreak testing
- Prompt leak detection
- Data extraction probes
- Custom attack scenarios
- Detailed reporting
Model Integrity Checker
Plannedopensecureai/integrityVerify AI model provenance and integrity across the supply chain. Detect tampering, poisoning, and unauthorized modifications.
Key Features
- Model hash verification
- Training data audit
- Backdoor detection
- Provenance tracking
- SBOM generation
Compliance Dashboard
Plannedopensecureai/complyMap AI deployments against regulatory frameworks. Auto-generate compliance documentation and track remediation progress.
Key Features
- EU AI Act mapping
- NIST AI RMF alignment
- ISO 42001 compliance
- Risk scoring engine
- Audit trail generation
LLM Observability
Plannedopensecureai/observeMonitor LLM applications in production for security anomalies, prompt injection attempts, and unusual behavior patterns.
Key Features
- Real-time threat monitoring
- Anomaly detection
- Usage analytics
- Alert integration
- Custom dashboards