Executive Thesis: Most AI code review pipelines fail for three structural reasons: (1) they diagnose from truncated grep snippets without caller/callee blast-radius graphs, (2) they have zero persistent memory of project invariants or previously refuted false positives, and (3) the same model family grades its own homework—producing shortcut contagion. I replaced that brittle pattern with a 6-stage closed-loop audit and self-distillation pipeline trained through KruschStack (npx krusch-stack) to benefit KruschStack. Every audit turn is hydrated by my 3-Tier MCP substrate (krusch-context-mcp, krusch-git, krusch-fs-mcp), filtered through an 11-checkpoint investigation with mandatory Adversarial Steel-Manning, verified by an isolated Cross-Family Referee (Gemma 4 + Hermes 3 vs. Qwen3-30B-MoE / Gemini 4 Argon) until two consecutive zero-finding passes converge, and compiled into an 18,131-row test-gated SFT + DPO corpus across 7 splits (krush420/sovereign-code-audit-sft) that fine-tunes my 8B Edge LoRA (L1, 15.7x DolphinBench lift), 30B Student LoRA (L2), and 120B Teacher LoRA (L2.5).
88 / 88
Repositories Audited & Verified
119+ Full Multi-Phase Sweeps
3-Tier MCP
Invariants + AST Call Graphs
+ Bounded OS Page Trees
18,131 SFT+DPO
7 Splits: 11-Phase + Elitist 120B
+ Argon + Lego & Agent Tool DPO
93.4% · 15.7x
30B Token Acc & 8B DolphinBench
Lift via Wave-4 QLoRA+DPO
Open-Source Artifact Live Repository Role in the KruschStack Ecosystem
🛠️ KruschStack MCP Spine github.com/kruschdev/krusch-stack Unified 7-Pillar, 39-Tool MCP Server & CLI (npx krusch-stack init) that generated and verified the entire training corpus.
🤖 Jean SRE Daemon github.com/kruschdev/Jean-SRE-by-kruschdev 24/7 Autonomous 11-Phase Code Auditor, 6-MCP Harness, Zero-Leak Dataset Sanitizer & Single-GPU 96GB Blackwell QLoRA Scripts.
📊 SFT + DPO Dataset (18,131 rows) krush420/sovereign-code-audit-sft 7 Splits on Hugging Face: code_audit_11phase_sft (15,290), elitist_120b_teacher (2,208), argon_golden_remediations (401), lego_brick_adoption_sft + dpo_pairs (150), and dolphin_agent_tool_sft + dpo_pairs (82).
🛡️ 8B Edge QLoRA+DPO (L1) krush420/llama3-hermes3-8b-sre-lora Wave-4 QLoRA + DPO adapter for NousResearch/Hermes-3-Llama-3.1-8B—lifts Official 600-task DolphinBench accuracy 15.7x (1.17% → 18.33% at $0.00).
30B Student QLoRA+DPO (L2) krush420/qwen3-coder-30b-sre-lora Wave-4 QLoRA + DPO adapter + Ollama Modelfile for Qwen/Qwen3-Coder-30B-A3B-Instruct (token acc 93.36%, 42.67% $0.00 DolphinBench 600).
🧠 120B Teacher QLoRA+DPO (L2.5) krush420/gpt-oss-120b-sre-lora Native MXFP4 Wave-4 QLoRA + DPO adapter + Ollama Modelfile for openai/gpt-oss-120b (loss 7.448 → 1.737, token acc 64.89%).

1. Why Naive LLM Code Audits Fail in Production

If you point a raw frontier or local LLM at a repository and ask it to "find bugs," three failure modes immediately dominate:

My autonomous SRE and code-audit engine (Jean SRE, running 24/7 across my 8-node bare-metal cluster) was engineered to solve all three failure modes at the substrate level—and then turn every verified audit and code repair into high-signal training data tailored specifically to my stack.

┌─────────────────────────────────────────────────────────────────────────────────────────┐
│                THE KRUSCHDEV CLOSED-LOOP AUDIT & DISTILLATION PIPELINE                  │
├─────────────────────────────────────────────────────────────────────────────────────────┤
│ STAGE 1 · 3-TIER MCP CONTEXT HYDRATION (`buildProjectAuditContext`)                     │
│           Tier 1 (`krusch-context-mcp`): Active Invariants (INV-*), Historical Bug Filter│
│           Tier 2A (`krusch-git`): Brace-Matched AST Symbols + Multi-Hop Caller CTEs     │
│           Tier 2B/2C (`krusch-fs` + Argon): Page Trees, Rubric Switch & 3-Viewport UI   │
├────────────────────────────────────────────┬────────────────────────────────────────────┤
│                                            ▼                                            │
│ STAGE 2 · 11-CHECKPOINT INVESTIGATION & ADVERSARIAL STEEL-MAN FILTER                    │
│           Phases `0_ORIENTATION` ──► `1.8_RISK_MAP` (Zero-Truncation Symbol Reads)      │
│           ──► Phase `1.9_ADVERSARIAL_REVIEW` (Steel-Man Status Quo + Refute Traps)      │
│           ──► Phase `2_MASTER_BACKLOG` (Verified `[BUG|SEC|ARCH|PERF|TEST-XX]` Cards)   │
├────────────────────────────────────────────┬────────────────────────────────────────────┤
│                                            ▼                                            │
│ STAGE 3 · FROZEN SPEC, DISJOINT SUBAGENTS & STAGED 2PC REPAIR (`krusch-harness`)        │
│           Freeze `spec.md` (`{ ok, tool, summary, data }`) ──► Disjoint File Fan-Out    │
│           ──► Orchestrator Choke-Point Wiring ──► Postgres `staged_diffs` + Sandbox     │
├────────────────────────────────────────────┬────────────────────────────────────────────┤
│                                            ▼                                            │
│ STAGE 4 · CROSS-FAMILY "REFEREE OVER JUDGE" CONVERGENCE (`lib/spec-verifier.js`)        │
│           Generator (`Qwen3-30B-MoE` / `Argon`) vs. Isolated Referees (`Gemma 4` +      │
│           `Hermes 3` at temp=0.0, zero reasoning trace) ──► 2 Consecutive Zero Passes   │
├────────────────────────────────────────────┬────────────────────────────────────────────┤
│                                            ▼                                            │
│ STAGE 5 · PORTABLE SFT+DPO CURATION & REJECTION SAMPLING (`scoreElitistTrajectory`)     │
│           100% Unit Test Gate + `$WORKSPACE_ROOT` Path Normalization + Citation Scoring │
│           ──► 18,131 Zero-Leak SFT + DPO Rows Across 7 Splits (`sovereign-code-audit`)  │
├────────────────────────────────────────────┬────────────────────────────────────────────┤
│                                            ▼                                            │
│ STAGE 6 · 3-TIER WAVE-4 QLoRA + DPO DISTILLATION ON 96GB BLACKWELL G4                   │
│           Track 1: `gpt-oss-120b` (128 MoE Experts Frozen in 4-bit MXFP4 + BF16 LoRA)   │
│           Track 2: `Qwen3-Coder-30B-A3B` (93.36% Acc · 42.67% $0.00 DolphinBench 600)   │
│           Track 3: `Hermes-3-Llama-3.1-8B` (15.7x DolphinBench Lift · Edge Referee)     │
└─────────────────────────────────────────────────────────────────────────────────────────┘

2. Stage I: How the 3-Tier MCP Stack Hydrates Context Before a Single Token Is Sampled

A language model is only as effective as the structural truth in its context window. Rather than letting an auditor wander blindly through a repository with raw shell commands, buildProjectAuditContext in jean_sre_sweep.js and my interactive 3-Tier MCP stack pre-hydrate a deterministic, token-budgeted context frame for every single audit phase.

A. Tier 1 (krusch-context-mcp): Bounded Invariant Hydration & Historical Bug Tagging

Every session and audit phase begins with Turn-1 Zero-Trust Hydration via krusch-context-mcp (v1.9.0). As my autonomous daemon accumulated over 2,350 episodic memories across 88 targets (a 60MB+ SQLite WAL + PostgreSQL 16 store), I engineered three critical hydration guarantees so models get maximum signal with zero latency or stale-memory confusion:

B. Tier 2A (krusch-git): Relational AST Symbol Tables & Multi-Hop Caller Graphs

Before judging any module, the auditor queries krusch-git (v1.2.2) to hydrate the repository's structural graph from PostgreSQL 16 + pgvector:

C. Tier 2B & 2C (krusch-fs-mcp, Dynamic Rubric Switching & Gemini 4 Argon UI Telemetry)

// Excerpt from projects/jean-sre/src/jean_sre_sweep.js:
// Assembling the grounded 3-Tier MCP context frame for each audit checkpoint
function buildProjectAuditContext(projectPath, phase, inflightBlock = '', options = {}) {
  const isColabBurst = Boolean(options.isColabBurst);
  const sections = [];

  // 1. Source-prioritized file tree (src, server, lib, app, bin, scripts first)
  const files = listProjectFiles(projectPath);
  sections.push(formatBoundedFileTree(files, isColabBurst ? 90 : 50));

  // 2. Project manifest, spec.md invariants & pyproject.toml / package.json detection
  const specBrief = buildProjectSpecAndDocsBrief(projectPath);
  if (specBrief) sections.push(specBrief.slice(0, isColabBurst ? 2600 : 1800));

  // 3. Tier 2A AST Symbol Table & Inbound/Outbound Dependency Graph
  const astSummary = buildAstContextSection(projectPath, phase);
  if (astSummary) sections.push(astSummary.slice(0, isColabBurst ? 2800 : 2000));

  // 4. Runtime 120B Teacher-to-30B Student Distilled Prior (Refuted Traps + Tool Queries)
  const teacherBrief = !isColabBurst ? loadDistilledTeacherBrief(projectPath, 1200) : '';
  if (teacherBrief) sections.push(teacherBrief);

  // 5. Live Hermetic Test Suite Execution (node --test / /opt/venv/bin/pytest)
  if (shouldIncludeLiveTests(phase, isColabBurst)) {
    const testSuiteResult = runProjectVerificationSuite(projectPath, {
      force: phase === '1.7_VERIFICATION_AUDIT'
    });
    if (testSuiteResult?.report) sections.push(testSuiteResult.report.slice(0, 3600));
  }

  // 6. Live Source Verification placed LAST so ground truth overrides prior summaries
  const pendingEvidence = buildPendingIssueCodeEvidence(inflightBlock, projectPath, phase);
  if (pendingEvidence) {
    sections.push(
      `**🔍 Live Source Verification (GROUND TRUTH — overrides prior summary):**\n` +
      pendingEvidence.slice(0, isColabBurst ? 8500 : 6500)
    );
  }
  return sections.join('\n\n');
}

3. Stage II: The 11-Checkpoint Investigation & Adversarial Steel-Man Filter

Instead of asking an LLM to audit an entire repository in a single pass—which causes middle-of-context attention decay—my pipeline decomposes every audit into 11 sequential, state-checkpointed phases written to projects/<repo>/.agent/audit/:

Checkpoint Phase Primary MCP & Verification Tools Engineering Objective & Zero-False-Positive Rule
0_ORIENTATION krusch_context_retrieve, krusch_fs_page_tree, krusch_git_file_symbols Read AGENTS.md, spec.md, manifests, and top entrypoint symbols to establish the project's exact purpose and active invariants.
1.1_STANDARD_MAPPING krusch_fs_locate, krusch_git_search_symbols, read_file Compare explicit linter/runtime rules (ESM vs. Python 3.12) against actual AST symbol and import conventions.
1.2_COMPLIANCE_MATRIX krusch_context_retrieve, krusch_context_nudge, read_file Evaluate Pass A (Letter), Pass B (Spirit), and Pass C (Project Purpose) with verbatim file:line quotes.
1.3_CRITICAL_PATH krusch_git_dependency_graph, krusch_git_file_symbols, read_file Trace the highest-value transaction end-to-end across every hop, reading the full startLine-endLine implementation of each hop.
1.4_BOUNDARY_AUDIT
1.5_ANTI_PATTERN
1.6_STRUCTURAL_STRESS
krusch_git_dependency_graph, krusch_git_semantic_search, krusch_fs_page_tree Audit layer coupling, hunt swallowed errors or uncancelled async calls via Hybrid BM25+Vector RRF, and flag files with >3 distinct responsibilities.
1.7_VERIFICATION_AUDIT
1.8_RISK_MAP
runProjectVerificationSuite (node --test / pytest), auditPageWithArgon Execute the live test suite inside the container, map concurrency/transaction lock risks, and verify UI breakpoints.
1.9_ADVERSARIAL_REVIEW read_file <path>:<start>-<end>, dependency_graph <symbol> Mandatory Steel-Man Gate: Re-read the full function body and all callers of the top 3 findings and write the strongest possible defense of the current code.
2_MASTER_BACKLOG parseMasterBacklogCards, krusch_context_remember Emit structured task cards ([BUG-01], [ARCH-01], [SEC-01]) containing only findings that survived Phase 1.9 with verbatim file:line proof.

Why Phase 1.9 (Adversarial Self-Review) Eliminates Hallucinated Tickets

The single highest-leverage checkpoint in my pipeline is Phase 1.9_ADVERSARIAL_REVIEW. Before any finding is promoted to master_backlog.md, the auditor is forced to execute an adversarial self-interrogation:

  1. Never Diagnose From a Truncated Preview: If a symbol preview says [showing lines X-Y of N], the model is forbidden from claiming validation is missing until it reads the complete startLine-endLine range.
  2. Steel-Man the Status Quo: For its highest-severity candidate finding, the model must check every caller via krusch_git_dependency_graph and articulate the strongest engineering case for why the existing code is already safe and compliant.
  3. Explicit Refutation Logging (4. NOT FLAGGED): Whenever Phase 1.9 proves a candidate bug was a false alarm (for example, an apparent SQL injection that is actually parameterized in the shared wrapper, or an ephemeral test fixture guarded by test_* prefix checks), it logs the item under 4. NOT FLAGGED / REFUTED. As I show in Section 6, those refutations are automatically extracted into teacher_120b_distilled.json so smaller student models never fall into the same trap.

4. Stage III: Spec-First Remediation, Disjoint Subagents & Staged 2PC Execution

Once master_backlog.md produces verified task cards, remediation follows two strict execution tracks depending on blast radius:

5. Stage IV: The Cross-Family "Referee over Judge" Convergence Gate

Even with a frozen specification and passing unit tests, how do you guarantee an autonomous coding agent didn't take a subtle architectural shortcut—like hardcoding a return value or bypassing a shared toolkit primitive?

In @krusch/toolkit (lib/spec-verifier.js), I implemented a Dual-Zero-Finding Convergence Gate grounded in Specification-First Convergence (arXiv: 2608.12440) and Agents Catching Agents: Shortcut Cascades (arXiv: 2608.03744):

// Excerpt from lib/spec-verifier.js:
// Detecting "Shortcut Contagion" (arXiv: 2608.03744) between Primary Auditor and Isolated Referee
export function evaluateRefereeConsensus(auditorFindings = [], refereeFindings = []) {
  const normAud = Array.isArray(auditorFindings) ? auditorFindings : [];
  const normRef = Array.isArray(refereeFindings) ? refereeFindings : [];

  const auditorClean = normAud.length === 0;
  const refereeClean = normRef.length === 0;

  const missedByAuditor = normRef.filter(rf =>
    !normAud.some(af => af.file === rf.file &&
      (af.invariant === rf.invariant || af.description === rf.description))
  );

  // Contagion occurs when the primary auditor rubber-stamps code that the zero-trace Referee catches
  const hasContagion = auditorClean && !refereeClean;
  const consensus = (auditorClean && refereeClean) || missedByAuditor.length === 0;

  return {
    hasContagion,
    consensus,
    missedByAuditor,
    combinedFindings: [
      ...normAud,
      ...missedByAuditor.map(item => ({ ...item, source: 'referee_independent' }))
    ]
  };
}

6. Stage V: What Makes the Training Data High Quality? Inside My SFT Curation & Rejection-Sampling Engine

Most organizations that attempt to fine-tune local coding models make a fatal mistake: they dump raw, unfiltered chat logs into a JSONL file and train on their own model's hallucinations, verbose filler, and machine-specific file paths. In my pipeline (projects/jean-sre/scripts/export-120b-distillation.js and src/harness.js), no trajectory enters the training set unless it survives a multi-stage deterministic quality gate.

A. The 5-Gate Training Data Quality Pipeline

  1. Gate 1 — Hermetic Test & Linter Verification (Execution Truth): Candidate code remediations (including Gemini 4 Argon Golden Remediations) are only recorded after the patched repository passes 100% of its automated test suite (node --test or /opt/venv/bin/pytest) and zero oxlint errors inside an isolated container.
  2. Gate 2 — Hard Anti-Hallucination & CoT Leak Filter: Both recordTeacherSftTurn and scoreElitistTrajectory immediately discard (score = 0) any trajectory that contains a HALLUCINATION FLAG, leaked <think> reasoning tags, or truncated responses under 400 characters.
  3. Gate 3 — Multi-Signal Elitist Trajectory Scoring (scoreElitistTrajectory): Every candidate 120B/Argon turn is scored on concrete grounding signals:
    • +10 pts — Argon Golden Remediation Provenance: End-to-end patches synthesized or verified by gemini-4-argon and confirmed by unit tests.
    • +3 pts — Verbatim file:line Citations: Requires at least 3 exact coordinate citations (e.g., src/unified-retrieval.js:37 or #L190-L293) verified against the hydrated AST symbol table.
    • +2 pts — Concrete Code Diffs: Contains >=2 fenced implementation or unified diff blocks.
    • +2 pts — Structured Audit Taxonomy: Emits formal card identifiers ([BUG-XX], [SEC-XX], [PERF-XX], [ARCH-XX], [TEST-XX]).
    • +2 pts — Explicit Invariant & Refutation Grounding: Explicitly cites project invariants (INV-XX) or formal hypothesis verdicts (VERIFIED / REFUTED).
  4. Gate 4 — Stratified Project:Phase Bucket Capping (Anti-Skew): To prevent large repositories from dominating gradient updates, exportElitist120bDataset filters for elitist_score >= 5, sorts descending by quality score, deduplicates by content signature, and caps selection to the top 4 trajectories per (project, phase) bucket across 83 distilled targets—while oversampling Argon Golden Remediations 2x in the 120B teacher set and 3x in the 30B student set.
  5. Gate 5 — Portable Path Normalization (normalizePortableSftText): Raw container logs contain machine-specific paths like /home/agent/workspace/projects/krusch-git/ or /home/developer/workspace/projects/. Before writing to JSONL, normalizePortableSftText strips host-specific prefixes into repo-relative coordinates and $WORKSPACE_ROOT across all 18,131 SFT + DPO rows so the fine-tuned weights generalize cleanly to any environment.
// Excerpt from projects/jean-sre/scripts/export-120b-distillation.js:
// Rejection-sampling & scoring 120B and Gemini 4 Argon trajectories for Elitist QLoRA
export function scoreElitistTrajectory(row) {
  if (!row || !Array.isArray(row.messages) || row.messages.length < 3) return 0;
  const assistant = String(row.messages[2]?.content || '');
  if (assistant.length < 400) return 0;
  if (assistant.includes('HALLUCINATION FLAG') || assistant.includes('<think>')) return 0;

  let score = 0;
  // 1. Argon-verified + unit-test-gated golden remediations get maximum priority
  if (row.source === 'argon_golden_remediation' || String(row.teacher_model || '').includes('argon')) {
    score += 10;
  }
  // 2. Verbatim file:line citations (e.g., src/foo.js:42 or #L10-L25)
  const lineCites = assistant.match(/[a-zA-Z0-9_./-]+(?::\d+|#L\d+)/g) || [];
  if (lineCites.length >= 3) score += 3;
  else if (lineCites.length >= 1) score += 1;

  // 3. Concrete fenced code blocks or unified diffs
  const codeBlocks = assistant.match(/```[\s\S]*?```/g) || [];
  if (codeBlocks.length >= 2) score += 2;
  else if (codeBlocks.length === 1) score += 1;

  // 4. Structured audit IDs & explicit invariant/refutation checks
  if (/\[(?:BUG|SEC|PERF|ARCH|TEST)-\d+\]/.test(assistant)) score += 2;
  if (/\b(?:REFUTED|VERIFIED|INV-\d+)\b/.test(assistant)) score += 2;

  return score;
}

B. Runtime Teacher-to-Student Distillation (teacher_120b_distilled.json)

Training weights via QLoRA is only half of the distillation story. Between fine-tuning runs, distillTeacherKnowledgeForStudent mines every completed 120B and Argon audit directory to generate a compact per-repository teacher_120b_distilled.json artifact (capped at 850–1,200 characters) that is injected directly into the local 30B Student's prompt on every sweep:

7. Stage VI: Wave-4 QLoRA + DPO Fine-Tuning on 96GB NVIDIA Blackwell G4

When I provision my on-demand L2.5 Colab Burst Tier (./scripts/colab-ollama-g4.sh train-both)—backed by a 96GB NVIDIA RTX PRO 6000 Blackwell Server Edition (G4, sm_120)—I execute a Wave-4 QLoRA + DPO Fine-Tuning Pipeline across my 120B Burst Teacher (krush420/gpt-oss-120b-sre-lora), 30B Local Workhorse Student (krush420/qwen3-coder-30b-sre-lora), and 8B Edge Referee (krush420/llama3-hermes3-8b-sre-lora, lifting Official 600-task DolphinBench accuracy 15.7x from 1.17% → 18.33% at $0.00).

Training Dimension Track 1 · 120B Elitist Teacher QLoRA
(krush420/gpt-oss-120b-sre-lora)
Track 2 · 30B Local Student QLoRA
(krush420/qwen3-coder-30b-sre-lora)
Base Model Architecture openai/gpt-oss-120b
(116.8B Total MoE · 5.1B Active · 128 Experts/Layer)
Qwen/Qwen3-Coder-30B-A3B-Instruct
(30.5B Total MoE · 3.3B Active · Local Workhorse)
Training Corpus & Oversampling Elitist + Wave-4 DPO (elitist_120b_teacher 2,208 + 401 Argon + Lego & Agent Tool SFT/DPO) 18,131 Total SFT + DPO Corpus (sovereign-code-audit-sft across all 7 splits: 15,290 11-phase + 2,208 Elitist + 401 Argon + 232 Lego/Tool SFT+DPO)
Quantization & VRAM Strategy Native Blackwell 4-bit MXFP4
(Mxfp4Config(dequantize=False) keeps all 128 MoE experts frozen in ~60.8GB VRAM via Pre-LN residual gradient flow on 96GB G4)
4-bit NF4 Attention + BF16 3D MoE
(BitsAndBytesConfig with torch.bfloat16 compute dtype and gradient checkpointing)
LoRA Target Modules & Rank BF16 Attention Projections Only:
q_proj, k_proj, v_proj, o_proj
(r=16, alpha=32, dropout=0.05 · 11.94M trainable params, 46MB adapter)
BF16 Attention Projections:
q_proj, k_proj, v_proj, o_proj
(r=16, alpha=32, dropout=0.05 · 25.17M trainable params, 15MB adapter)
Convergence & Token Accuracy Loss 7.448 → 1.737 (eval_loss=1.8054)
Token Accuracy: 20.11% → 64.89%
Loss 0.731 → 0.214 (eval_loss=0.3358)
Token Accuracy: 81.07% → 93.36% (90.35% eval)
Deployment Target & Throughput ollama create gpt-oss-sre:120b -f Modelfile on 96GB Blackwell G4 (~117.7 tok/s over SSH loopback tunnel) ollama create qwen3-coder-30b-sre:latest -f Modelfile on Node-02 Dual RTX 2080 Ti NVLink (124.2 tok/s · 100% GPU resident)

Why Native Blackwell MXFP4 Makes Single-GPU 120B QLoRA Possible

De-quantizing a 120B-parameter model into 16-bit precision requires ~240GB of VRAM—normally demanding a multi-GPU H100/A100 node. Because NVIDIA's RTX PRO 6000 Blackwell (sm_120) natively supports 4-bit microscaling floating-point (MXFP4), my Track 1 script passes Mxfp4Config(dequantize=False) to Hugging Face transformers:

# Excerpt from projects/jean-sre/scripts/train_gpt_oss_120b_qlora_g4.py:
# Freezing 128 MoE experts in native Blackwell 4-bit MXFP4 while training BF16 Attention LoRA
def build_quantization_config():
    from transformers import Mxfp4Config
    return Mxfp4Config(dequantize=False)

model = AutoModelForCausalLM.from_pretrained(
    "openai/gpt-oss-120b",
    quantization_config=build_quantization_config(),
    device_map="auto",
    torch_dtype=torch.bfloat16,
    attn_implementation="sdpa",
    trust_remote_code=True,
)
model = prepare_model_for_kbit_training(model, use_gradient_checkpointing=True)

# Target BF16 attention projections only so the 128 MXFP4 experts remain frozen in 4-bit (~60.8GB VRAM)
lora_config = LoraConfig(
    r=16,
    lora_alpha=32,
    lora_dropout=0.05,
    bias="none",
    task_type="CAUSAL_LM",
    target_modules=["q_proj", "k_proj", "v_proj", "o_proj"],
)

The Compounding Flywheel Effect

Because the training examples are constructed using the exact same buildProjectAuditContext MCP hydration frame that the models see at inference time, the fine-tuned 30B Student and 120B Teacher don't just learn generic Python or JavaScript syntax. They learn how to read krusch-git AST dependency graphs, how to honor krusch-context-mcp invariants (`INV-*`), how to import `@krusch/toolkit` primitives instead of writing inline boilerplate, and how to refute false positives during Phase 1.9 adversarial reviews.

Every time a frontier escalation (`gemini-4-argon`) or a 120B burst audit solves a hard bug and passes 100% of unit tests, that trajectory permanently upgrades my local weights—turning cloud inference from a recurring operating expense into a compounding capital asset.

Explore the Full 2026 Sovereign AI Tech Stack

npx krusch-stack init · 7 MCP Servers · @krusch/toolkit · 2PC Execution Harness

Read 2026 Tech Stack Blueprint → 🤗 Download SFT Dataset & LoRA Weights →