qa-testing-blueprints

Enterprise QA-11X v3.0 skill pack & MCP server (@sinfallas/mcp-qa-11x) for 27+ AI coding agents: 10 modular SKILL.md skills, 18 MCP tools, and 12 stack blueprints enforcing a 13-layer QA pyramid, ephemeral non-root Docker execution (Rule Zero), >=95% coverage, Screenplay E2E, AST blast radius, AI evals, and DISA STIG V6R5 / OWASP v4.2 security.

ドキュメント

🌐 Language: English | Español

QA Testing Blueprints Logo

QA Testing Blueprints (QA-11X v3.0)

Zero-Infra Agentic QA, AI Evals & DevSecOps Governance Blueprint

License: MIT Rule Zero: Ephemeral Docker Trivy Scan Modular AI Skills AI Coding Agents FINOS CALM

QA-11X v3.0 turns both AI Coding Agents (Google Antigravity, Claude Code, Cursor, Windsurf, Codex, Copilot, Hermes Agent, and 20+ more) and human engineering teams into deterministic Staff-level QA & DevSecOps operators. Every check runs inside ephemeral, non-root Docker containers (Rule Zero) with zero host contamination, enforcing >= 95% coverage, real database/contract parity, dual-mode AI evaluations, and DISA ASD STIG V6R5 + OWASP v4.2 security controls from day one.


⚡ 30-Second Zero-Friction Quickstart

Bootstrap any repository in 30 seconds without cloning this monorepo:

# Auto-detect stacks & vibe-coded markers, configure .qa-11x.json, AGENTS.md, ACTIVE_TASK.md & PR workflow:
npx -y @sinfallas/mcp-qa-11x@latest quickstart

# Explicit tier, output language policy, agent selection, or dry-run preview:
npx -y @sinfallas/mcp-qa-11x@latest quickstart --tier standard --lang en --agents auto
npx -y @sinfallas/mcp-qa-11x@latest quickstart --tier enterprise --lang es --dry-run

Add Proportional PR Protection to GitHub Actions

Use the hardened composite action .github/actions/qa-11x-pr-check/action.yml in your pull-request workflow:

name: QA-11X PR Check
on: [pull_request]
permissions:
  contents: read
jobs:
  qa-11x:
    runs-on: ubuntu-latest
    timeout-minutes: 20
    steps:
      - uses: actions/checkout@11bd71901bbe5b1630ceea73d27597364c9af683
        with:
          fetch-depth: 0
      - uses: tecno-consultores/qa-testing-blueprints/.github/actions/qa-11x-pr-check@v2
        with:
          tier: standard
          lang: en

🧭 Differential Architecture (QA-11X v3.0)

flowchart TD
    UserReq["Developer or PR Trigger"] --> Quickstart["npx @sinfallas/mcp-qa-11x quickstart"]
    Quickstart --> Router{"3-Path Execution & Tiers"}
    Router -->|"DOCS_ONLY"| FastDocs["make sync-governance + make lint-docs"]
    Router -->|"MICRO_CHANGE / standard"| BlastAST["AST Blast Radius & Tiered CI"]
    Router -->|"FULL_11X / enterprise"| FullPyramid["13-Layer QA Pyramid + FINOS CALM"]
    BlastAST --> RuleZero["Rule Zero Non-Root Docker sinfallas/*"]
    FullPyramid --> RuleZero
    RuleZero --> Shields["AI Evals Dual-Mode + DISA/OWASP + Release Gate"]
    FastDocs --> LocalCommit["Certified Local Commit QA-GIT-GATE-01"]
    Shields --> LocalCommit

Progressive Adoption Tiers

TierTarget AdoptionIncluded Gates & Guarantees
starterDay-1 Adoption (30s)Zero-plain-text secret scanning, Rule Zero container hygiene, .qa-11x.json, AGENTS.md connector across 27+ AI coding agents, and DOCS_ONLY fast-path
standardDaily PR WorkflowsEverything in starter + >= 95% unit coverage, strict types (mypy --strict, tsc, PHPStan max), AST Blast-Radius CI partitioning (40%–60% compute savings), and UI anti-pattern linting (QA-UI-ANTI-001..005)
enterpriseRegulated ProductionFull 13-layer FULL_11X pyramid, blocking FINOS CALM architecture validation, PostgreSQL 17 RLS + WORM seq_num audit chains, DISA STIG V6R5 / OWASP v4.2, 3-phase clock assertions (t < starts_at, starts_at <= t <= ends_at, t > ends_at), Pact + k6 load, and multi-signal Release Readiness Gate (GO / NO_GO / SKIPPED)

Zero-Infra Ephemeral Docker Matrix (sinfallas/*)

All runtime, lint, mutation, contract, and BDD suites execute inside non-root containers (-u "$(id -u):$(id -g)" -e HOME=/tmp) with Trivy HIGH/CRITICAL = 0:

Ephemeral ImageRole in QA-11X v3.0Certified Tags & Pre-Baked Tooling
sinfallas/base-python-uvPython, FastAPI, AI Evals & Vibe-Rescue3.11, 3.12, 3.13, 3.14, 3.15, latest (uv, ruff, mypy, pytest, bandit, radon, mutmut, deepeval, pact-python, tesseract-ocr)
sinfallas/base-node-ionicMCP Server, Node, Vue 3, React & CALM22, 24, 26, latest (pnpm, promptfoo, @finos/calm-cli, playwright, @axe-core/playwright, @pact-foundation/pact)
sinfallas/base-mobile-appiumNative & Hybrid Mobile W3C Bridge (Android/iOS)26, latest (Node.js 26, pnpm, OpenJDK 21, Android SDK/ADB, Appium 3, uiautomator2, xcuitest, WebdriverIO v9)
sinfallas/basephpcomposerPHP 8.2–8.5 APIs & Services8.2, 8.3, 8.4, 8.5, latest (pcov, phpstan, psalm, pest, phpunit, infection)
sinfallas/karatelabsAPI & HTTP/Edge/OSHP/XML BDD Contracts1.5.1 / 11x-v2-local (Java + Maven + Karate JUnit5; proportional to stateful multi-service FULL_11X flows)
sinfallas/base-bash-qaDevOps & POSIX Shell Scriptslatest (ShellCheck, shfmt, BATS-core, bats-mock, kcov)
sinfallas/remote-graphifyAST Context Optimization & Blast Radiuslatest (graphify Tree-sitter AST graph & cluster extraction)
Infra & Load EnginesLive DB, Cache & Smoke Loadpostgres:17-alpine, eqalpha/keydb:alpine, grafana/k6:2.4.0

🗂️ Full-Stack, Mobile, AI Evals & Vibe-Rescue Blueprints

DirectoryDomainKey v2.0 Capabilities
fastapi/Python Async APIsRuff, Mypy strict, PostgreSQL 17 RLS + Alembic parity, Pact V4 consumer (test_pact_consumer.py), k6 smoke load (smoke.k6.js), Karate BDD
python/Python Libraries & CLIsUV, Ruff (CC <= 5), Mypy strict, Pytest >= 95%, Hypothesis, Mutmut (MSI >= 80%), Bandit
node-backend/Node.js / TS MicroservicesESLint --max-warnings 0, Vitest >= 95%, Pact V4 provider verifier (provider.pact.test.ts), Stryker, ZAP
vue3/Vue 3 + Vite FrontendsScreenplay Actor.ts, Self-Healing DOM semanticLocator.ts, Vitest >= 95%, @axe-core, Lighthouse CI
react-frontend/React + Vite FrontendsScreenplay Actor.ts, Self-Healing DOM semanticLocator.ts, RTL, Playwright, @axe-core
php/PHP 8.2–8.5 ServicesPHP-CS-Fixer, PHPStan Level Max, Psalm Taint Analysis, Pest/PHPUnit + PCOV >= 95%, Infection
bash-scripts/POSIX / Bash AutomationShellCheck, shfmt, BATS-core, bats-mock, kcov >= 95%
mobile-appium/Native & Hybrid MobileAppium 3 / W3C + WebdriverIO (wdio.conf.ts), MobileActor.ts (Android, iOS, Ionic, RN)
ai-evals/Dual-Mode AI & Multimodal QARAG faithfulness, Promptfoo OWASP LLM Top 10, WebRTC voice latency (test_voice_websocket_latency.py), PDF/OCR Decimal (test_pdf_table_fidelity.py), golden_from_traces.py
vibe-rescue/Vibe-to-Enterprise Hardeningaudit_vibe_prototype.py (VIBE-SEC-001..QA-005), PostgreSQL 17 RLS/WORM template (rls_hardening.sql)
architecture/Architecture-as-CodeBlocking FINOS CALM topology (qa-11x.calm.json) & 7 mandatory 11X controls (make validate-calm)
mcp-server/@sinfallas/mcp-qa-11xNode.js MCP server (stdio), quickstart, install-skill, init-agents, reconcile-agents, tms-sync & A2A agent card

🛠 Testing Tools Matrix

Below is the corporate validation stack summarized per environment and test type. N/A indicates test categories that do not apply due to the intrinsic nature of the environment (e.g. a standalone Python CLI, Bash script, or declarative architecture topology does not expose an HTTP server, so DAST and Chaos Engineering do not apply).

EnvironmentLinting / FormattingUnit Tests / MockingCoverageDependency AuditStatic Security (SAST)MutationBDD / Black-BoxConcurrency / StressProfiling / ComplexityDAST (Dynamic)Chaos EngineeringObservability (Metrics)IaC / Docker AuditLocal Git Hooks
Python (python/)Ruff + Mypy (Strict)Pytest + Hypothesis + pytest-mock / respxPytest-Cov (>= 95%)pip-audit + CycloneDX SBOMBanditMutmut (>= 80%)N/AN/Apy-spy / memray + Radon (CC <= A)N/AN/APushgateway + PrometheusTrivy + Hadolint + GitleaksLefthook
FastAPI (fastapi/)Ruff + Mypy (Strict)Pytest + pytest-asyncio + respx + PostgreSQL 17 + KeyDB + AlembicPytest-Cov (>= 95%)pip-audit + CycloneDX SBOMBanditMutmut (>= 80%)Karate Labs + Schemathesis + Pact V4Locust (Headless) + k6py-spy / memray + Radon (CC <= A)OWASP ZAP BaselinePumbaprometheus-fastapi-instrumentator + PrometheusTrivy + Hadolint + GitleaksLefthook
Node Backend (node-backend/)ESLint (--max-warnings 0) + Prettier + tscVitest + Supertest + Nock@vitest/coverage-v8 (>= 95%)pnpm audit + .npmrc (ignore-scripts=true)eslint-plugin-securityStryker (>= 80%)Karate Labs + Pact V4Artillery + k60x + Clinic.js + SonarJS (<= 15)OWASP ZAP BaselinePumbaexpress-prom-bundle + PrometheusTrivy + Hadolint + GitleaksLefthook
Vue 3 (vue3/)ESLint (--max-warnings 0) + Prettier + vue-tscVitest + Vue Test Utils + Screenplay + Playwright + @axe-core@vitest/coverage-v8 (>= 95%)pnpm audit + .npmrc (ignore-scripts=true)eslint-plugin-securityStrykerKarate Labs (HTTP/OSHP) + Playwright UIN/ALighthouse CI + SonarJS (<= 15)OWASP ZAP BaselineN/Anginx-prometheus-exporter + PrometheusTrivy + Hadolint + GitleaksLefthook
React (react-frontend/)ESLint (--max-warnings 0) + Prettier + tscVitest + React Testing Library + Screenplay + Playwright + @axe-core@vitest/coverage-v8 (>= 95%)pnpm audit + .npmrc (ignore-scripts=true)eslint-plugin-security + react-hooksStrykerKarate Labs (HTTP/OSHP) + Playwright UIN/ALighthouse CI + SonarJS (<= 15)OWASP ZAP BaselineN/Anginx-prometheus-exporter + PrometheusTrivy + Hadolint + GitleaksLefthook
PHP 8.2–8.5 (php/)PHP-CS-Fixer (@PER-CS2.0) + PHPStan (Level Max)Pest / PHPUnit 11.5+ + MockHandler + PostgreSQL 17 + KeyDBPCOV (>= 95%)composer audit + roave/security-advisories + CycloneDX SBOMPsalm (--taint-analysis)Infection (MSI >= 80%)Karate Labs + Swagger-PHP / SchemathesisLocust / k6tomasvotruba/cognitive-complexity (<= 9)OWASP ZAP BaselinePumbapromphp/prometheus_client_php + PrometheusTrivy + Hadolint + GitleaksLefthook
Bash (bash-scripts/)ShellCheck + shfmtBATS-core + bats-support + bats-assert + bats-file + bats-mockkcov (>= 95%)N/AShellCheckN/AN/AN/Ahyperfine + time -vN/AN/APushgateway + PrometheusTrivy + Hadolint + GitleaksLefthook
Mobile Appium (mobile-appium/)tsc --strict + PrettierWebdriverIO v9 + MobileActor Screenplay (W3C Bridge, Android/iOS/Ionic/RN)node:test / C8 (>= 95%)pnpm audit + .npmrc + CycloneDX SBOMeslint-plugin-security + Deep-Link / Biometry guardsN/AAppium 3 (uiautomator2/xcuitest) + Karate BFFN/ACC <= 5 + Fail-Verbose /tmp TracesN/A (delegated to BFF OWASP ZAP)N/A (Offline Sync & Biometry toggle)Allure JSON Fail-Verbose (/tmp)Trivy + Hadolint + Gitleaks (sinfallas/base-mobile-appium:26)Lefthook
AI Evals (ai-evals/)Ruff (CC <= 5) + Mypy (Strict)Pytest asyncio + DeepEval + WebRTC Voice + PDF/OCR DecimalPytest-Cov (>= 95%)pip-audit + CycloneDX SBOMBandit + Promptfoo OWASP LLM Top 10N/ADeepEval + Promptfoo (Offline + Live)WebRTC TTFB <= 500msRadon (CC <= A) + golden_from_traces.pyPromptfoo LLM Red-TeamN/AJSON Eval Trajectory TraceTrivy + GitleaksLefthook
Vibe Rescue (vibe-rescue/)Ruff (CC <= 5) + Mypy (Strict)Pytest + audit_vibe_prototype.py (VIBE-SEC-001..QA-005)Pytest-Cov (>= 95%)pip-audit + rls_hardening.sqlBandit + RLS / AES-256-GCM / WORMN/AQA-11X 10/10 Rescue GateN/ARadon (CC <= 5)OWASP ZAP (post-rescue)N/AFinding State Tracker JSONTrivy + Hadolint + GitleaksLefthook
Architecture (architecture/)AJV CLI / CALM (validate_calm_architecture.sh)CALM Schema & 11-Control Verification (qa-11x.calm.json)N/ACALM Control Integrity11 Blocking Architecture Controls (RLS/WORM/mTLS)N/AFINOS CALM Architecture GateN/AGraphify AST Coupling / Layer CheckN/AN/ACALM Validation ReportTrivy + GitleaksLefthook
MCP Server (mcp-server/)ESLint (--max-warnings 0) + Prettier + tscVitest + run-example-e2e.mjs (Clean-Room stdio)@vitest/coverage-v8 (>= 95%)pnpm audit + .npmrc (ignore-scripts=true)eslint-plugin-security + promptGuard + audit_security_stig_owaspStrykerKarate Labs (mcp_cli_test.feature)N/ASonarJS (<= 15)N/AN/APass-Quiet Telemetry & PR_VERDICT SHA-256Trivy + GitleaksLefthook

🛡️ Dual-Mode AI Evals, Local LLMs & Security Shield

  1. Mode 1 — Zero-Cost Deterministic Offline Contracts (make test-ai-offline):
    • Runs hermetic RAG, agent-trajectory, WebRTC voice (TTFB p95 <= 500ms), and OCR Decimal table checks with stubbed judges (>= 95% coverage, CC <= 5, mypy --strict) at $0 API cost.
    • Protects MCP tool execution fail-closed via promptGuard.ts (NFKC canonicalization, zero-width/Trojan Source sanitization, prompt-injection & QA-GIT-GATE-01 bypass prevention, PII/secret redaction using <EXAMPLE_REDACTED> placeholders).
    • Compresses long transcripts deterministically with .agents/scripts/compact_context_11x.py and supports air-gapped Ollama / vLLM profiles plus A2A Agent Card discovery (agentCard.ts, docs/specs/14_LOCAL_LLM_AND_A2A_PROFILES.md).
  2. Mode 2 — On-Demand Probabilistic & Red-Team Audits (make audit-llm):
    • Executes DeepEval (GEval, TaskCompletionMetric, faithfulness) and Promptfoo OWASP LLM Top 10 red-teaming against configured cloud providers or local Ollama/vLLM endpoints (SKIPPED_NO_LLM_SECRETS_CONFIGURED when credentials are absent in CI).

🤖 10 Modular Skills (< 20 KB), MCP Server & 27+ AI Agents

  • Progressive Skill Routing (< 20 KB budget): Led by .agents/skills/qa-11x-architect/SKILL.md (< 12 KB), loading 9 specialized sub-skills on demand (qa-11x-devsecops-hardener, qa-11x-systematic-debugging, qa-11x-screenplay-builder, qa-11x-llm-evaluator, qa-11x-vibe-rescue, qa-11x-docker-certifier, docker-trivy-keydb-hardening, graphify-ast-navigator, refactoring-ui).
  • Public MCP Surface (@sinfallas/mcp-qa-11x v3.0.0): Exposes 18 Tools and 12 Resources (blueprint://*) over stdio — combining the 12 core v1 tools + 6 v2.0 evaluators (FINOS CALM, Release Gate, Agent Trajectory Evals, OWASP LLM Red Team, Vibe-Rescue, Enterprise TMS Sync) protected end-to-end by promptGuard & TaskStateGuard.
  • Human-Confirmed Git Closure (QA-GIT-GATE-01): Enforced by .agents/rules/git_closure_gate.md — agents certify locally via make certify and stop at a local git commit; automatic git push or npm publish is strictly forbidden.
  • Setup & Catalog Guides: See docs/agent-setup.en.md (English), docs/agent-setup.md (Spanish), RESOURCES.md, llms.txt (GEO index), catalogs/ (QASkills, SkillsLLM), docs/01_ARQUITECTURA_PIRAMIDE_11X.md, TESTING.md, SECURITY.md, and ROADMAP.md.
# Install global skills, operational scripts, and thin AGENTS.md connector across detected IDEs:
npx -y @sinfallas/mcp-qa-11x@latest install-skill --init-agents --include-scripts --reconcile

📄 Author, Copyright & License

  • Author: Jesus Palencia (<sinfallas@gmail.com>)
  • Copyright: Copyright (C) 2026 Jesus Palencia <sinfallas@gmail.com> (Creado en Tecno Consultores)
  • License: Distributed under the MIT License.