AIR Blackbox
Open-source AI agent governance and auditing framework.
AIR Blackbox is an open-source AI agent governance framework released in February 2026 by the AIR Blackbox Team, which defines itself as a "black box flight recorder for autonomous AI agents." Just as an aircraft's black box records all flight data in a tamper-proof manner, this tool seals the entire LLM invocation with an HMAC-SHA256 chain and an ML-DSA-65 (FIPS 204, Dilithium3 family) quantum-resistant signature, creating an audit chain where any tampering attempt is immediately detected. Its core operation involves simply replacing the base_url of existing OpenAI/Anthropic API calls with a local gateway, transparently intercepting and recording the entire prompt, response, and tool invocation with approximately 0.3ms (median) overhead per call, without requiring code refactoring.
Existing logging systems have three fundamental limitations. First, if someone has write access to the log repository, they can modify the records, making tamper-proof verification impossible. Second, most logging only captures the response and does not fully record the entire prompt context, intermediate reasoning process, and tool invocation chain. Third, raw logs alone cannot satisfy the requirements of Article 12 of the EU AI Act, which mandates tamper-proof logs, retention periods, and guaranteed audit access. AIR Blackbox addresses these three limitations with a four-layer architecture (Verify, Filter, Stabilize, Protect). The Verify layer prevents tampering with HMAC chains and quantum-resistant signatures, the Filter layer blocks 20 patterns of PII detection and prompt injection attacks before they reach the model, the Stabilize layer detects drift in the compliance status of the CI/CD pipeline, and the Protect layer cryptographically guarantees human oversight attestation. While tools like Arthur AI and Lakera focus on a single aspect, input filtering, AIR Blackbox covers the entire lifecycle, from pre-policy enforcement to post-audit evidence packaging.
Practical use case scenarios include: First, preparing for EU AI Act compliance audits. With a single line, air-blackbox comply --scan . -v, it runs over 51 static checks against Articles 9-15 for the entire Python AI project and automatically generates reports mapping to four frameworks: ISO 42001, NIST AI RMF, and Colorado SB 24-205. Second, using the Covenant YAML policy in air-gate to pre-define the actions that an agent can perform and issue Ed25519-signed bilateral receipts for all actions, allowing the entire multi-agent delegation chain to be tracked. Third, packaging the audit chain, scan results, SHA-256 manifest, and ML-DSA-65 signature into a self-verifiable .air-evidence ZIP file with the air-blackbox export command, allowing auditors to complete a PASS/FAIL determination in under 2 seconds with a single line, python verify.py, without requiring separate installation. It provides a drop-in trust layer for seven major frameworks, including LangChain, CrewAI, OpenAI Agents SDK, Anthropic Claude SDK, Google ADK, AutoGen, and Haystack, allowing integration with minimal changes to existing agent code.
💻 System Requirements
Not required (CPU only — the scanner itself does not perform LLM inference). For Pro/Enterprise tiers, if using Ollama-based fine-tuning models, 4GB+ GPU is recommended.
Tens of MB for pip packages. Approximately 2GB including the entire platform (air-platform) Docker image. Audit logs increase proportionally to the number of calls.
⚡ Installation
4-1. Quick Start
pip install air-blackbox
# Run EU AI Act gap analysis
air-blackbox comply --scan . -v
4-2. Full Platform Deployment (Gateway + Episode Store + Policy Engine + Observability)
git clone https://github.com/airblackbox/air-platform.git
cd air-platform
cp .env.example .env # Configure settings such as OPENAI_API_KEY
make up # Starts in approximately 8 seconds
4-3. Installation including Gate (Pre-Policy Enforcement)
pip install air-blackbox[gate]
4-4. Basic Gateway Integration (Minimal Code Changes)
from openai import OpenAI
# Replace only the base_url with the local gateway
client = OpenAI(
base_url="http://localhost:8080/v1",
default_headers={"X-Gateway-Key": "your-key"}
)
4-5. Kubernetes Deployment
helm install air deploy/helm/air-gateway \
--set providerURL=https://api.openai.com \
--set vault.existingSecret=air-vault-creds
🧬 Bio Use Cases
Pre-Audit for EU AI Act Compliance
Scan the entire Python AI project for 51 items based on Articles 9-15 using air-blackbox comply --scan . -v. Automatically generate mapping reports for ISO 42001, NIST AI RMF, and Colorado SB 24-205. Integrate with CI/CD using GitHub Action (compliance-action) to automatically verify compliance status for each PR.
Multi-Agent Behavior Control and Audit Trail
Define allowed actions, prohibited actions, and actions requiring approval for each agent declaratively using air-gate Covenant YAML. Issue Ed25519 signed, bidirectional receipts for all actions. Fully trace the delegation chain between agents using gate.walk_delegation_chain(). Useful for demonstrating accountability in high-risk AI systems such as finance, healthcare, and legal applications.
Self-Verification and Submission of Evidence for Audit
Package the audit chain, scan results, SHA-256 manifest, and ML-DSA-65 signatures into a .air-evidence ZIP file using air-blackbox export. Auditors can complete the PASS/FAIL assessment with just python verify.py (no separate installation required). Suitable for accumulating evidence in preparation for the mandatory application deadline for high-risk AI on December 2027.
FAQ
What is AIR Blackbox?
AIR Blackbox is an open-source AI agent governance framework released in February 2026 by the AIR Blackbox Team, which defines itself as a "black box flight recorder for autonomous AI agents." Just as an aircraft's black box records all flight data in a tamper-proof manner, this tool seals the entire LLM invocation with an HMAC-SHA256 chain and an ML-DSA-65 (FIPS 204, Dilithium3 family) quantum-resistant signature, creating an audit chain where any tampering attempt is immediately detected. Its core operation involves simply replacing the base_url of existing OpenAI/Anthropic API calls with a local gateway, transparently intercepting and recording the entire prompt, response, and tool invocation with approximately 0.3ms (median) overhead per call, without requiring code refactoring. Existing logging systems have three fundamental limitations. First, if someone has write access to the log repository, they can modify the records, making tamper-proof verification impossible. Second, most logging only captures the response and does not fully record the entire prompt context, intermediate reasoning process, and tool invocation chain. Third, raw logs alone cannot satisfy the requirements of Article 12 of the EU AI Act, which mandates tamper-proof logs, retention periods, and guaranteed audit access. AIR Blackbox addresses these three limitations with a four-layer architecture (Verify, Filter, Stabilize, Protect). The Verify layer prevents tampering with HMAC chains and quantum-resistant signatures, the Filter layer blocks 20 patterns of PII detection and prompt injection attacks before they reach the model, the Stabilize layer detects drift in the compliance status of the CI/CD pipeline, and the Protect layer cryptographically guarantees human oversight attestation. While tools like Arthur AI and Lakera focus on a single aspect, input filtering, AIR Blackbox covers the entire lifecycle, from pre-policy enforcement to post-audit evidence packaging. Practical use case scenarios include: First, preparing for EU AI Act compliance audits. With a single line, air-blackbox comply --scan . -v, it runs over 51 static checks against Articles 9-15 for the entire Python AI project and automatically generates reports mapping to four frameworks: ISO 42001, NIST AI RMF, and Colorado SB 24-205. Second, using the Covenant YAML policy in air-gate to pre-define the actions that an agent can perform and issue Ed25519-signed bilateral receipts for all actions, allowing the entire multi-agent delegation chain to be tracked. Third, packaging the audit chain, scan results, SHA-256 manifest, and ML-DSA-65 signature into a self-verifiable .air-evidence ZIP file with the air-blackbox export command, allowing auditors to complete a PASS/FAIL determination in under 2 seconds with a single line, python verify.py, without requiring separate installation. It provides a drop-in trust layer for seven major frameworks, including LangChain, CrewAI, OpenAI Agents SDK, Anthropic Claude SDK, Google ADK, AutoGen, and Haystack, allowing integration with minimal changes to existing agent code.
When should I use AIR Blackbox?
Open-source AI agent governance and auditing framework.
What is a biomedical use case for AIR Blackbox?
Pre-Audit for EU AI Act Compliance: Scan the entire Python AI project for 51 items based on Articles 9-15 using air-blackbox comply --scan . -v. Automatically generate mapping reports for ISO 42001, NIST AI RMF, and Colorado SB 24-205. Integrate with CI/CD using GitHub Action (compliance-action) to automatically verify compliance status for each PR.
📝 Update Notes
- vv1.15.09/14/2026
이번 업데이트에서는 서명 검증 오류를 수정하여, 변조되지 않은 유효한 데이터가 잘못된 것으로 판정되던 문제를 해결했어요. 보안 취약점에 대한 대대적인 패치를 통해 실험 데이터의 위변조 공격으로부터 연구 자산을 더욱 강력하게 보호할 수 있게 되었습니다. 또한, 더욱 엄격한 검증 옵션이 추가되어 규제 준수(Compliance)가 필수적인 생명공학 연구 데이터의 신뢰성과 무결성을 한층 높였습니다.
- vv1.14.08/7/2026
이번 AIR Blackbox v1.14.0 업데이트는 데이터의 무결성과 보안 검증 기능을 대폭 강화했어요. RFC 3161 및 M2 투명성 로그 앵커링 기술이 도입되어, 연구 데이터의 위변조 여부를 더욱 정밀하게 추적하고 증명할 수 있게 되었답니다. 특히 보안 인증과 데이터 격리 기능이 개선되어, 민감한 실험 데이터의 보안을 유지하면서 규제 준수(Compliance)를 위한 증거를 확보해야 하는 생명공학 연구원분들께 매우 유용한 업데이트예요.
- vv1.13.26/19/2026
AIR Blackbox v1.13.2는 최신 EU AI 법안의 규제 일정을 반영하여, 글로벌 기준에 맞춘 생명공학 연구의 컴플라이언스 대응을 더욱 정확하게 지원해요. 암호학적 서명과 투명성 로그 기능을 강화해 AI 모델의 검증 과정과 데이터 무결성을 제3자에게도 증명할 수 있는 강력한 보안 체계를 갖추었습니다. 또한, 스캐너의 정밀도가 개선되어 AI 결과물의 오류를 더 정확히 잡아낼 수 있으므로, 데이터의 신뢰도가 생명인 바이오 연구 워크플로우의 안정성을 높이는 데 큰 도움이 될 거예요.
🧪 Related Code of Life
No related Code of Life posts yet.