Public report — Orleankka, published 3 Aug 2026. Concrete security findings (CVE IDs, secret matches, dependency versions) are hidden in this version; ask the repo owner for the full report.
Watchdog 03-08-2026 @ 15:40 UTC Public
Code Health Audit

OrleansContrib/Orleankka

51% Adequate
CriticalWeakAdequateStrongExemplary
lower third — near Weak

Small · 9,278 LoC · 23 projects · rebuild ~0.1 person-years · weakest lens: Readiness (46%)

Grounded in facts. Every number here is computed, not narrated — reproducible, tool-backed, and traceable to a line of code. How to trust this ▸

48/51dimensions tool-verifieddeterministic · confidence 1.0 · 3 LLM-assisted, advisory
37findings with an exact file:lineof 44 — the remainder are repo-wide signals (a dimension-level measurement, not a single line); open any file:line and verify
51/98dimensions across the health lenses9278 LoC · 23 projects — wide & deep

Executive summary

Read through the Production lens — the standard calibration. *Green* means good enough to run in production. The score is absolute and comparable across repos.

OrleansContrib/Orleankka is sound in substance but carries real gaps (51%). It is not in crisis, but the issues below raise the cost of changing it — friction its consumers ultimately inherit.

It is strongest in Security (100%) — its security and compliance posture is in good shape. Architecture (97%) is solid too.

The area that most needs attention is Readiness (46%) — releases are harder to depend on — versioning, release notes and dependency hygiene are thin, so consumers can't easily tell what changed or trust an upgrade. Maturity (46%) is the next concern — onboarding is slow — key decisions and the architecture aren't written down, so contributors have to reverse-engineer the intent.

Leadership focus, highest impact first: Make types internal by default (Library API & versioning); Record significant decisions one document per decision (Architecture documentation); Nothing pauses a release for a human (Deployment & Rollback).

For scale: Small (~9,278 production lines); rebuilding it from scratch would take roughly ~0.1 person-years (~1 engineer). Approximate, ±~30%.

It builds on a genuinely strong Security foundation (100%); the priorities above are the highest-leverage way to bring the rest up to that level.

How the score is built — each lens's share of the headline Width is the lens's weight in the worst-heaviest fold (the weakest area pulls hardest); colour is that lens's own band. A lens fixes the score in proportion to its width.
Readiness 46% · 46% weightMaturity 46% · 25% weightCode Health 51% · 14% weightPerformance 54% · 8% weightArchitecture 97% · 4% weightSecurity 100% · 2% weight

No single dominant problem — the weakest areas are close, so progress on any of them moves the score.

Code composition — where the lines go
Business logic 11%Plumbing 53%Tests 36%
New since the last scan (55+)

55 finding(s) are new versus the previous scan (2026-07-29) — surfaced by this scheduled scan itself, no pull request required.

  • D2 · ReferencedAssemblyHelper.AddFromDependencyContext (cognitive 17) Source/Orleankka/ReferencedAssemblyHelper.cs
  • D3 · TooManyMethods: ActorBehavior Source/Orleankka.Legacy.Runtime/Behaviors/ActorBehavior.cs
  • D4 · Duplicated block (13 lines × 2) Samples/CSharp/Streams/Chat.Client/Program.cs
  • D4 · Duplicated block (12 lines × 2) Samples/CSharp/EventSourcing/Idiomatic/Program.cs
  • D4 · Duplicated block (9 lines × 2) Source/Orleankka.Runtime/Dispatcher.cs
  • D8 · Coverage not measured
  • D10 · Skipped test: Flushes_state_after_every_successful_search Samples/CSharp/Demo/Demo.App.Tests/TopicFixture.cs
  • D16 · dormant codebase — no living knowledge left to concentrate
  • D17 · CommentedOutCode Samples/CSharp/Demo/Demo.App.Tests/TopicFixture.cs
  • D17 · BareSuppressMessage Source/Orleankka/ActorRef.cs
  • D17 · BareSuppressMessage Source/Orleankka/ClientEndpoint.cs
  • D17 · BareSuppressMessage Tests/Orleankka.Tests/Features/Actor_behaviors/Switchable_behaviors.cs
  • D17 · NoWarnInCsproj Directory.Build.props
  • D19 · Low XML-doc coverage: Orleankka Source/Orleankka/Orleankka.csproj
  • D19 · Low XML-doc coverage: Demo.App Samples/CSharp/Demo/Demo.App/Demo.App.csproj
  • D19 · Low XML-doc coverage: Reentrant Samples/CSharp/Reentrant/Reentrant.csproj
  • D19 · Low XML-doc coverage: Idiomatic Samples/CSharp/EventSourcing/Idiomatic/Idiomatic.csproj
  • D19 · Low XML-doc coverage: GES Samples/CSharp/EventSourcing/Persistence/GES/GES.csproj
  • D19 · Low XML-doc coverage: Streamstone Samples/CSharp/EventSourcing/Persistence/Streamstone/Streamstone.csproj
  • D19 · Low XML-doc coverage: Chat.Client Samples/CSharp/Streams/Chat.Client/Chat.Client.csproj
  • D19 · Low XML-doc coverage: Chat.Server Samples/CSharp/Streams/Chat.Server/Chat.Server.csproj
  • D19 · Low XML-doc coverage: Chat.Server Samples/CSharp/Observers/Chat.Server/Chat.Server.csproj
  • D19 · Low XML-doc coverage: Chat.Client Samples/CSharp/Observers/Chat.Client/Chat.Client.csproj
  • D19 · Low XML-doc coverage: Chat.Shared Samples/CSharp/Observers/Chat.Shared/Chat.Shared.csproj
  • D19 · Low XML-doc coverage: Orleankka.TestKit Source/Orleankka.TestKit/Orleankka.TestKit.csproj
  • D19 · Low XML-doc coverage: Chat.Shared Samples/CSharp/Streams/Chat.Shared/Chat.Shared.csproj
  • D19 · Low XML-doc coverage: Orleankka.Runtime Source/Orleankka.Runtime/Orleankka.Runtime.csproj
  • D19 · Low XML-doc coverage: HelloWorld Samples/CSharp/HelloWorld/HelloWorld.csproj
  • D19 · Low XML-doc coverage: Lightbulb Samples/CSharp/FSM/Lightbulb/Lightbulb.csproj
  • D19 · Low XML-doc coverage: ProcessManager Samples/CSharp/FSM/ProcessManager/ProcessManager.csproj
  • D19 · Low XML-doc coverage: Orleankka.Legacy.Runtime Source/Orleankka.Legacy.Runtime/Orleankka.Legacy.Runtime.csproj
  • D19 · Low XML-doc coverage: Orleankka.Client Source/Orleankka.Client/Orleankka.Client.csproj
  • D19 · Low XML-doc coverage: Orleankka.Http.AspNetCore Source/Orleankka.Http.AspNetCore/Orleankka.Http.AspNetCore.csproj
  • D35 · Change coupling: ActivationService.cs ↔ TimerService.cs Source/Orleankka.Runtime/Services/ActivationService.cs
  • X1 · async void method: Run Samples/CSharp/Demo/Demo.App/App.cs
  • X1 · Sync-over-async (deadlock risk) Samples/CSharp/EventSourcing/Persistence/Streamstone/Program.cs
  • IC1 · Unfinished stub — throws NotImplementedException Source/Orleankka/ClientObservable.cs
  • IC1 · Unfinished stub — throws NotImplementedException Source/Orleankka/ClientObservable.cs
  • IC1 · Unfinished stub — throws NotImplementedException Source/Orleankka/Http/HttpActorSystem.cs
  • IC1 · Unfinished stub — throws NotImplementedException Source/Orleankka/Http/HttpActorSystem.cs
  • PF3 · Sync-over-async blocking
  • PF3 · Awaits without ConfigureAwait(false)
  • SC1 · NuGet dependencies are not locked
  • SC1 · JavaScript dependencies are not locked
  • GD1 · Unfinished stub — throws NotImplementedException Source/Orleankka/ActorRef.cs
  • GD1 · Unfinished stub — throws NotImplementedException Source/Orleankka/ActorRef.cs
  • GD1 · Unfinished stub — throws NotImplementedException Source/Orleankka/ClientObservable.cs
  • GD1 · Unfinished stub — throws NotImplementedException Source/Orleankka/ClientObservable.cs
  • GD1 · Unfinished stub — throws NotImplementedException Source/Orleankka/Http/HttpActorEndpoint.cs
  • GD1 · Unfinished stub — throws NotImplementedException Source/Orleankka/Http/HttpActorEndpoint.cs
  • GD1 · Unfinished stub — throws NotImplementedException Source/Orleankka/Http/HttpActorSystem.cs
  • GD1 · Unfinished stub — throws NotImplementedException Source/Orleankka/Http/HttpActorSystem.cs
  • GD1 · Unfinished stub — throws NotImplementedException Source/Orleankka/Syntax.cs
  • GD1 · Unfinished stub — throws NotImplementedException Source/Orleankka.TestKit/ActorSystemMock.cs
  • GD1 · Unfinished stub — throws NotImplementedException Source/Orleankka.Legacy.Runtime/Behaviors/CustomBehavior.cs

A full-fidelity diff against the previous run's complete recorded findings — line-move tolerant: a finding that only shifted line counts as unchanged, only genuinely new titles/files surface here.

Rebuild cost & value ~ Modeled — €3,800–€19,000
Cost to rebuild€3,800–€19,000 (0.1 person-years (63–196 h), ~1 engineer)
Domain complexityLow — harder problems cost more per line
Quality factor0.7× (at 51% quality) — the last 20% of quality is most of the work
Size & shapeSmall · 48% boilerplate · 35% straight-line · 18% branching logic

This codebase represents roughly ~0.1 person-years of build effort (about ~€11,000 to rebuild). Its weakest lens is Readiness at 46% — the part of that asset most exposed by the findings below.

How we model this: boilerplate at a scaffolding rate + logic × domain Low (×0.9) — library/CLI × a 0.7× quality factor, at €60–95/h; indicative, ±~30%. Indicative only — most sensitive to the hourly rate and the domain tier (both tunable in config).

Top priorities

The highest-leverage moves; the full ranked list is in the Roadmap below.

1
Resolve the 1 Dormant codebase finding(s) in Knowledge Freshness.
+4.8 pts · Low effort · Knowledge Freshness
2
Resolve the 1 redundant comment finding(s) in Comment Value — start with TopicFixture.cs.
+2.8 pts · Low effort · Comment Value
3
Make types internal by default; expose only the deliberate public API so internals can change without breaking consumers.
+5.1 pts · Medium effort · Library API & versioning

Diagnosis — what's actually going on

Value concentrated against a weak lens · Medium · Value at risk
This is a Small asset (~0.1 person-years to rebuild), and its weakest lens is Readiness at 46%. The operational and business risk on an asset this size concentrates there — that's where remediation buys the most protection.
Evidence: valuation: Small, ~0.1 person-years rebuild (9,278 LoC) · weakest lens: Readiness 46%
→ Direct remediation budget at Readiness first — highest risk-reduction per euro on an asset this size.
Highest-leverage move · Medium · Leverage
Of everything flagged, the best return on effort is: Make types internal by default; expose only the deliberate public API so internals can change without breaking consumers. The rest can wait behind it.
Evidence: priority ranking: top of 5 ranked by impact/effort
→ Make types internal by default; expose only the deliberate public API so internals can change without breaking consumers.

Architecture — module dependency graph

Project dependencies, layered top-to-bottom; arrows show direction. Any dashed red edge points upward or sideways — a layering smell or cycle. A clean layered graph has none.

arch Chat.Client (Samples/CSharp/Observers/Chat.Client) Client) Chat.Shared (Samples/CSharp/Observers/Chat.Shared) Shared) Chat.Client (Samples/CSharp/Observers/Chat.Client)->Chat.Shared (Samples/CSharp/Observers/Chat.Shared) Orleankka Orleankka Chat.Client (Samples/CSharp/Observers/Chat.Client)->Orleankka Orleankka.Client Client Chat.Client (Samples/CSharp/Observers/Chat.Client)->Orleankka.Client Chat.Client (Samples/CSharp/Streams/Chat.Client) Client) Chat.Shared (Samples/CSharp/Streams/Chat.Shared) Shared) Chat.Client (Samples/CSharp/Streams/Chat.Client)->Chat.Shared (Samples/CSharp/Streams/Chat.Shared) Chat.Client (Samples/CSharp/Streams/Chat.Client)->Orleankka.Client Chat.Server (Samples/CSharp/Observers/Chat.Server) Server) Chat.Server (Samples/CSharp/Observers/Chat.Server)->Chat.Shared (Samples/CSharp/Observers/Chat.Shared) Chat.Server (Samples/CSharp/Observers/Chat.Server)->Orleankka Orleankka.Runtime Runtime Chat.Server (Samples/CSharp/Observers/Chat.Server)->Orleankka.Runtime Chat.Server (Samples/CSharp/Streams/Chat.Server) Server) Chat.Server (Samples/CSharp/Streams/Chat.Server)->Chat.Shared (Samples/CSharp/Streams/Chat.Shared) Chat.Server (Samples/CSharp/Streams/Chat.Server)->Orleankka Chat.Server (Samples/CSharp/Streams/Chat.Server)->Orleankka.Runtime Chat.Shared (Samples/CSharp/Observers/Chat.Shared)->Orleankka Chat.Shared (Samples/CSharp/Streams/Chat.Shared)->Orleankka Demo.App App Demo.App->Orleankka Demo.App->Orleankka.Client Demo.App->Orleankka.Runtime GES GES GES->Orleankka.Client GES->Orleankka.Runtime HelloWorld HelloWorld HelloWorld->Orleankka HelloWorld->Orleankka.Client HelloWorld->Orleankka.Runtime Idiomatic Idiomatic Idiomatic->Orleankka Idiomatic->Orleankka.Client Idiomatic->Orleankka.Runtime Lightbulb Lightbulb Lightbulb->Orleankka Lightbulb->Orleankka.Client Lightbulb->Orleankka.Runtime Orleankka.Client->Orleankka Orleankka.Http.AspNetCore AspNetCore Orleankka.Http.AspNetCore->Orleankka Orleankka.Legacy.Runtime Runtime Orleankka.Legacy.Runtime->Orleankka.Runtime Orleankka.Runtime->Orleankka ProcessManager ProcessManager ProcessManager->Orleankka ProcessManager->Orleankka.Client ProcessManager->Orleankka.Runtime Reentrant Reentrant Reentrant->Orleankka Reentrant->Orleankka.Client Reentrant->Orleankka.Runtime Streamstone Streamstone Streamstone->Orleankka.Client Streamstone->Orleankka.Runtime Tools Tools

Architecture — module dependency matrix

14 modules, 14 dependencies — 2 dependency cycles, shown as the red cell(s) above the diagonal. Rows and columns are the same modules, ordered so that a module only depends on ones above it. A cell means the row depends on the column, and its number is how many type pairs create that dependency. Read one thing: is anything above the diagonal? A mark there is a dependency cycle. (A cycle is all this shows — an unusual but cycle-free dependency sits below the diagonal like any other.)

Orleankka.Annotations…eankka.Legacy.ClusterOrleankka.UtilityOrleans.Serialization…nkka.Legacy.BehaviorsOrleankka.MetaOrleankka.ServicesOrleankkaOrleankka.BehaviorsOrleankka.ClientOrleankka.HttpOrleankka.LegacyOrleankka.Cluster…ankka.Http.AspNetCoreOrleankka.Annotations1…eankka.Legacy.Cluster2Orleankka.Utility3Orleans.Serialization4…nkka.Legacy.Behaviors5Orleankka.Meta6Orleankka.Services7Orleankka8Orleankka.Behaviors9Orleankka.Client10Orleankka.Http11Orleankka.Legacy12Orleankka.Cluster13…ankka.Http.AspNetCore14423412749244111

At a glance — Code Health · 51% · Adequate · gated by X5

At a glance — Architecture · 97% · Exemplary

At a glance — Maturity · 46% · Weak · gated by D34, M2

At a glance — Readiness · 46% · Weak · gated by P3, P10

At a glance — Security · 100% · Exemplary

At a glance — Performance · 54% · Adequate

Security & Compliance — OWASP Top-10 mapping

Findings mapped to OWASP categories; the specific CVEs/secrets are in the Security dimension cards below and findings.md (redacted only on the public version of this report).

OWASP categoryFindingsSeverity
A03:2021 — Injection1Medium

Roadmap

First, restrict the library's public API by making types internal by default to protect consumers from breaking changes. Next, establish architecture decision records to document significant design choices and their consequences. Then, implement a manual approval gate for releases to prevent bad builds from reaching users. After that, address dormant codebase findings to ensure knowledge remains current. Finally, add cancellation tokens to all asynchronous methods to ensure work stops promptly when needed.

Ranked by impact ÷ effort. "Helps" is the estimated gain on the 0–100 health score.

Do thisHelpsEffortDimension
Resolve the 1 Dormant codebase finding(s) in Knowledge Freshness.+4.8 ptsLowKnowledge Freshness
Resolve the 1 redundant comment finding(s) in Comment Value — start with TopicFixture.cs.+2.8 ptsLowComment Value
Make types internal by default; expose only the deliberate public API so internals can change without breaking consumers.+5.1 ptsMediumLibrary API & versioning
Record significant decisions one document per decision — dated, stating the context, the decision and its consequences — and keep them together wherever your design docs already live (a conventional `docs/adr/` tree with `NNNN-title.md` names is the most discoverable form).+5.0 ptsMediumArchitecture documentation
Nothing pauses a release for a human: publish as a draft release (or gate the release job on a protected tag/manual dispatch) so a bad build can be stopped before users can download it.+5.0 ptsMediumDeployment & Rollback
Thread a CancellationToken through async methods so work stops promptly on cancellation.+3.9 ptsMediumCancellation propagation
Interpolated log message defeats structured logging+3.9 ptsMediumStructured logging
Enable <Nullable>enable</Nullable> across all projects and resolve warnings rather than suppressing with `!`.+3.9 ptsMediumNullable reference types

File quality

Per-file score 0–10 — a quality signature. Of 33 files carrying findings, judged against the Production bar: 0% slop · 6% mixed · 94% near-clean.

FileScoreBandWorst signal
Samples/CSharp/Demo/Demo.App.Tests/TopicFixture.cs6.2MixedExplicit Debt: CommentedOutCode
Directory.Build.props7.6MixedExplicit Debt: NoWarnInCsproj
Source/Orleankka/ActorRef.cs8.2Near-cleanExplicit Debt: BareSuppressMessage
Source/Orleankka/ClientEndpoint.cs8.2Near-cleanExplicit Debt: BareSuppressMessage
Tests/Orleankka.Tests/Features/Actor_behaviors/Switchable_behaviors.cs8.2Near-cleanExplicit Debt: BareSuppressMessage
Source/Orleankka/ReferencedAssemblyHelper.cs8.5Near-cleanCognitive Complexity: ReferencedAssemblyHelper.AddFromDependencyContext (cognitive 17)
Source/Orleankka.Legacy.Runtime/Behaviors/ActorBehavior.cs8.5Near-cleanGod Classes: TooManyMethods: ActorBehavior
Samples/CSharp/Streams/Chat.Client/Program.cs8.5Near-cleanCode Duplication: Duplicated block (13 lines × 2)
Samples/CSharp/EventSourcing/Idiomatic/Program.cs8.5Near-cleanCode Duplication: Duplicated block (12 lines × 2)
Source/Orleankka.Runtime/Dispatcher.cs8.5Near-cleanCode Duplication: Duplicated block (9 lines × 2)
Source/Orleankka/Orleankka.csproj8.5Near-cleanDocumentation Quality: Low XML-doc coverage: Orleankka
Samples/CSharp/Demo/Demo.App/Demo.App.csproj8.5Near-cleanDocumentation Quality: Low XML-doc coverage: Demo.App
Samples/CSharp/Reentrant/Reentrant.csproj8.5Near-cleanDocumentation Quality: Low XML-doc coverage: Reentrant
Samples/CSharp/EventSourcing/Idiomatic/Idiomatic.csproj8.5Near-cleanDocumentation Quality: Low XML-doc coverage: Idiomatic
Samples/CSharp/EventSourcing/Persistence/GES/GES.csproj8.5Near-cleanDocumentation Quality: Low XML-doc coverage: GES
Samples/CSharp/EventSourcing/Persistence/Streamstone/Streamstone.csproj8.5Near-cleanDocumentation Quality: Low XML-doc coverage: Streamstone
Samples/CSharp/Streams/Chat.Client/Chat.Client.csproj8.5Near-cleanDocumentation Quality: Low XML-doc coverage: Chat.Client
Samples/CSharp/Streams/Chat.Server/Chat.Server.csproj8.5Near-cleanDocumentation Quality: Low XML-doc coverage: Chat.Server
Samples/CSharp/Observers/Chat.Server/Chat.Server.csproj8.5Near-cleanDocumentation Quality: Low XML-doc coverage: Chat.Server
Samples/CSharp/Observers/Chat.Client/Chat.Client.csproj8.5Near-cleanDocumentation Quality: Low XML-doc coverage: Chat.Client

Methodology & how to trust this report

Watchdog is a deep, periodic assessment — run each sprint, monthly, or quarterly, taking the time to go wider and deeper than a quick check and surfacing in one coherent report what you'd otherwise piece together from a dozen separate tools. It scores deterministically: the same commit yields the same score, every run. 48 of 51 evaluated dimensions are computed purely by tools and static analysis (confidence 1.0); 3 documentation/naming judgement(s) are LLM-assisted and labelled advisory. Overall confidence is 0.6 — the weighted average across measured dimensions; it falls as more of the score leans on LLM-assisted judgement and rises when it's fully tool-backed.

Every figure here is one of three kinds, and we label which: ✓ Measured — a deterministic fact (LoC, complexity, coverage); ~ Modeled — an estimate from a stated model (cost, effort, value-at-risk), always a range with its assumptions, never a precise fact; ◐ Advisory — an LLM prose judgement. We never present a modelled estimate as if it were measured. Perfect or absent scores carry their provenance too (ADR-0011): ✓ Tool-verified means the property itself was measured across the surface; ○ Nothing flagged means the probes came back clean — a claim bounded by what a repository can show; ⊘ Not evidenced means a working control (a tested restore, an automated rollback) showed no positive evidence — absence of evidence is not evidence of a control, so it's excluded from the score rather than awarded a spurious 10; ◐ Sampled · advisory marks an LLM verdict over a bounded sample — advisory, never a deterministic measurement.

What we checked — 51 dimensions across the health lenses
D1D2D3D4D5D6D9D10D11D12D13D14D15D17D18D19D21D24D26D28D29D33D34D35AX1AX10AX2AX3AX4AX5AX6AX8GD1IC1M1M2M3M4P1P10P3P4P6PF1PF2PF3X1X2X3X4X5

Each chip is a dimension scored from real signals across architecture, testing, dependencies, security & compliance, documentation, git-history and code quality — in one coherent pass. A surface report typically covers a handful.

How to trust any code-health report — three questions
  1. Can you open the finding? Real findings cite a repo-relative file and line you can open at the cited line — never an absolute scratch path. Here, 37 of 44 do; the remainder are repo-wide signals — a dimension-level measurement, not a single line. (Every path in this report is repo-relative by construction: paths are normalized at the producer and the report is rejected if any rooted path leaks through.)
  2. Is there a tool behind the number? Every score below names the method that produced it — Roslyn, git, a scanner, or (for a handful of documentation/naming dimensions) an LLM labelled sampled · advisory — not a narrative.
  3. Does re-running give the same result? Run it again on the same commit and the score — and this report, byte for byte — is identical. A report whose numbers move between runs is describing the run, not the code.

This report answers yes to all three. That's the bar to hold any assessment to.

Tools & methods

The actual versions used this run (captured at analysis time) — re-run on the same commit for the identical score.

MethodBacksVersionEvaluator
Roslyn static analysisComplexity, cohesion, coupling, dead code, API surface, layering5.3.0✓ deterministic
Native secret scannerHardcoded secrets / credentials1.0.0✓ deterministic
jscpdCode duplication✓ deterministic
Coverage (coverlet / dotnet-coverage)Line & branch coverage10.0.302✓ deterministic
NuGet / dotnetOutdated, vulnerable & deprecated dependencies10.0.302✓ deterministic
git / LibGit2SharpChurn hotspots, knowledge concentration, history2.43.0 · 0.31.0✓ deterministic
gitleaks · semgrep · trivySecrets in history, SAST, CVEs, IaC & container, PII / GDPR1.86.0 · 0.69.3✓ deterministic
LLM (sampled · advisory)Documentation quality, ADR conformance, naming — sampled over a bounded sample; advisory, never a deterministic measurementLocal LLM◐ LLM · sampled · advisory

Every finding is locatable in findings.md. Run 019fc848-4990-7cee-9185-bda59b5a9b5a.

The exact command behind every deep-scan dimension — tool, version, invocation and retained raw output — is in Appendix B — Reproduction & audit trail.

Run transparency — what happened this run

A clean run — every tool resolved and ran, and every applicable dimension was measured at full confidence. No scanner was unavailable, no analysis timed out or crashed, and nothing fell back to a degraded estimate.

When something does degrade — a missing scanner, a shallow clone, an LLM hiccup — it is named here explicitly and its exact cause recorded in diagnostics.md, never absorbed silently into the score.

Repo exclusion declarations (.gitattributes linguist-generated/vendored, .editorconfig generated_code): none declared — every source file was scored.

Limitations & what we did not check

Watchdog assesses the repository exactly as committed, and only the repository. By design it does not reach outside the source tree: the live cloud account, the running CI/CD pipeline, the host's branch-protection and approval rules, the production configuration, or a restore actually exercised against a backup are all out of scope. That boundary is a feature, not a gap — a repo-relative, deterministic scan re-runs identically on any commit and every finding opens at a real file and line, where a live audit can neither be reproduced nor traced. The visible consequence is that controls which leave no in-repo evidence are reported as "not evidenced" and excluded from the score rather than awarded a number a static scan cannot justify.

Per-dimension blind spots

For each dimension that was measured, what a static, repo-only scan structurally cannot see — the honest edge of the measurement, not a failure of it.

  • D1 Cyclomatic Complexity: Cyclomatic complexity counts branches statically — it cannot tell an essential decision tree from accidental tangle, nor see complexity that lives in data or configuration (large switch-case token tables, DSL lexers/parsers, data-as-code rule tables) rather than control flow: a tokenizer's many single-character cases read as high complexity though each branch is trivial.
  • D2 Cognitive Complexity: Cognitive-complexity heuristics approximate how hard code is to follow; genuine domain difficulty and well-named intent that eases reading are not captured.
  • D3 God Classes: "God class" is sized by members and responsibilities visible in the type — a deliberately broad facade over a coherent subsystem can read the same as an accidental grab-bag. For front-end JS the file-length check is cohesion-aware (a single-responsibility module — one class/IIFE — earns a 3× threshold), but cohesion is approximated from top-level declarations, not true dependency structure.
  • D4 Code Duplication: Duplication is token-similarity (jscpd) — it finds copy-paste, not semantic duplication expressed differently. Committed machine-written code (scaffolded migrations, designer/codegen output, protobuf/OpenAPI stubs, model snapshots) is EXCLUDED — its repetition is the tool's, not the team's — so the score reflects hand-written duplication only.
  • D5 Coupling: Coupling is measured between projects/assemblies — runtime coupling through DI, reflection, messaging or shared databases is invisible to a static reference graph.
  • D6 Cohesion (LCOM4): LCOM4 cohesion is syntactic — it infers connectivity from which methods touch which fields/methods by name, not from real runtime behaviour or intent.
  • D9 Test Distribution: The test-pyramid shape is inferred from project/folder naming and references, with a single test host bucketed per-file by its path tier and content signals — a suite that names tiers unconventionally and gives no per-file signal can still be mis-bucketed.
  • D10 Test Quality: Assertion density is structural — it cannot tell a meaningful behavioural assertion from a trivial one, only that an assertion is present.
  • D11 Test Reliability: Flakiness is inferred from history/markers — Watchdog runs the suite once (for coverage), not the repeated runs under varied conditions that reveal nondeterminism, so a flaky test never recorded as failing is invisible here.
  • D12 Dependency Hygiene: Dependency health reads manifests and lockfiles — a vulnerability in a vendored/copied dependency, or risk from how a dependency is actually used, is outside this view.
  • D13 Secret Scanning: Secret detection is signature- and entropy-based on the current tree — a secret that does not match a known pattern, or one already rotated, will not be flagged (a clean scan is "nothing matched", not "no secrets exist").
  • D14 License Compliance: License compatibility is checked against declared package metadata and a policy — mislabelled or missing license metadata, and obligations that depend on how you distribute, are not resolved here.
  • D15 Churn × Complexity Hotspots: Churn hotspots come from git history — a freshly imported or squashed repository has no churn signal, and recent rewrites can mask a historically risky file.
  • D17 Explicit Debt: Acknowledged-debt signals (TODO/FIXME, suppressions, dead code) are textual — undocumented debt that nobody marked, and debt that lives in design rather than annotations, is invisible. Committed machine-written code (scaffolded migrations, designer/codegen output, generated stubs) is excluded — it is never the team's dead code to delete.
  • D18 Solution Shape: Build integrity reflects whether the solution compiled in this environment — a build that needs a private feed, a specific SDK, or a generated file absent from the repo can read as broken when it is merely unreproducible here.
  • D19 Documentation Quality: Documentation quality is judged by an LLM over a bounded sample of docs — it reads what is written, not whether the docs match the running system, and it is advisory, not a measurement.
  • D21 Naming Consistency: Naming quality is an LLM judgement over a bounded sample — it assesses clarity/consistency of the names it sees, not domain-correctness, and is advisory.
  • D24 Comment Value: Comment value (WHY vs WHAT) is an LLM judgement over a bounded sample — it is advisory and cannot weigh a comment against the precise code change it was written to explain.
  • D26 Project Cohesion: Project focus is sized from members/namespaces per project — a project that is broad by deliberate design reads the same as one that has sprawled.
  • D28 Secrets (history): Secret-history scanning sweeps the git log for known patterns — a secret that predates the available history, or never matched a signature, is not found (clean means "nothing matched in the history we can see").
  • D29 Static Analysis (SAST): SAST findings are pattern-based (semgrep) — it finds classes of bug it has rules for; logic flaws, auth/authorization gaps and issues needing runtime context are out of reach (and clean means "no rule matched").
  • D33 JS/npm Dependency Vulnerabilities: JS/npm CVE matching reads package manifests and lockfiles — risk from how a dependency is used, and advisories not yet published, fall outside this scan.
  • D34 Knowledge Freshness: Freshness is decayed commit RECENCY, not comprehension — code read often but rarely committed reads as orphaned, and stable code that genuinely needs no changes is penalised the same as forgotten code; bot/squash commits distort it like the bus factor.
  • D35 Change Coupling: Change coupling is co-change in COMMITS — files split across separate commits, or coupled only through a shared config/build step, read as uncoupled, and a sweeping commit (rename/format) is excluded so it doesn't couple everything. It shows that files change together, not WHY: a high coupling can be a healthy cohesive pair as readily as a hidden leak.
  • AX10 Code composition: Role is inferred from namespace/folder convention, not semantics — a domain concept living in a folder named "Services" reads as application, and the split is lines-of-code, not business value. The business-logic-share score is a SOFT, FLOORED signal: it contributes to the Architecture lens but is floored at the Critical gate, so an infrastructure-heavy design (a gateway, an ETL, a driver) is legitimately low without being nuked to zero.
  • M4 Documentation accuracy: Onboarding quality is an LLM read of the docs/setup present — it cannot run the onboarding or measure how long a real new joiner takes; the verdict is sampled and advisory.
  • P4 Deployment & Rollback: Approval/branch-protection rules live in repository settings the scan cannot see — only their in-repo evidence (config files, workflows) is checked, so a control enforced purely in the host's settings reads as "not evidenced".
  • P6 Release Hygiene: Rollback/observability controls are inferred from repo artefacts (pipelines, dashboards-as-code) — controls configured in external tooling, with no in-repo trace, cannot be credited.

The LLM boundary

LLM-set scores this run (4): D19, D21, D24, M4 (model: Local LLM). For these, a model reads a bounded sample and sets the numeric score (documentation, ADR quality, naming, comment value, onboarding) — D25 sets the ADR-conformance fraction over sampled code, D22 judges API accuracy over a sample. These are sampled and advisory by design: they vary at the margins between runs and are never a deterministic measurement. Every other score in this report is tool-computed at confidence 1.0.

Dimensions

D1 · Cyclomatic Complexity10.0 / 10Exemplary✓ Tool-verified

What it measures: How tangled the control flow is — methods with many branches are hard to test and change.

Method: Cyclomatic complexity per method (1 + decision points), computed exhaustively across production source; test projects separated by convention. Deterministic.

Maturity: DocumentedVerifiedPrevented · effective 10.0 / 10 · rule-coverage 100% · ceiling Prevented

0 method(s) exceeded the cyclomatic complexity threshold of 15.

✓ On the Gold path — maintain.

Detailed fixes: d1_recommendation.md.

D2 · Cognitive Complexity9.8 / 10Exemplary✓ Tool-verified

What it measures: How hard the code is for a person to follow, beyond raw branching.

Method: Cognitive complexity per method (Sonar-style nesting-penalized score), computed exhaustively over production code, excluding test projects. Deterministic.

Maturity: DocumentedVerifiedPrevented · effective 9.8 / 10 · rule-coverage 100% · ceiling Prevented

1 method(s) exceeded the cognitive complexity threshold of 15; the worst was ReferencedAssemblyHelper.AddFromDependencyContext at 17.

ReferencedAssemblyHelper.AddFromDependencyContext (cognitive 17)Source/Orleankka/ReferencedAssemblyHelper.cs:93

✓ On the Gold path — maintain.

Detailed fixes: d2_recommendation.md · top locations in Appendix A, every location in findings.md.

D3 · God Classes9.5 / 10Exemplary✓ Tool-verified

What it measures: Over-large classes that try to do too much ("god classes").

Method: God-class detection by line and method-count thresholds per logical type (partial classes unified), filtered for generated code and registration/contract false positives. Deterministic.

Maturity: DocumentedVerifiedPrevented · effective 9.5 / 10 · rule-coverage 100% · ceiling Prevented

1 god class(es) detected.

TooManyMethods: ActorBehaviorSource/Orleankka.Legacy.Runtime/Behaviors/ActorBehavior.cs:0

✓ On the Gold path — maintain.

Detailed fixes: d3_recommendation.md · top locations in Appendix A, every location in findings.md.

D4 · Code Duplication9.9 / 10Exemplary✓ Tool-verified

What it measures: Copy-pasted code that should be shared instead.

Method: Code duplication via token-stream sliding windows with type-aware normalization (locals masked, type names preserved), density-scored per KLoC of production code. Deterministic.

Maturity: DocumentedVerifiedPrevented · effective 9.9 / 10 · rule-coverage 100% · ceiling Verified

3 duplicated block group(s) detected.

Duplicated block (13 lines × 2)Samples/CSharp/Streams/Chat.Client/Program.cs:19
Duplicated block (12 lines × 2)Samples/CSharp/EventSourcing/Idiomatic/Program.cs:33
Duplicated block (9 lines × 2)Source/Orleankka.Runtime/Dispatcher.cs:392

✓ On the Gold path — maintain.

Detailed fixes: d4_recommendation.md · top locations in Appendix A, every location in findings.md.

D5 · Coupling10.0 / 10Exemplary✓ Tool-verified

What it measures: Whether volatile projects sit underneath others that depend on them (so their churn ripples upward), and whether project dependencies form cycles. A widely-depended-on but stable shared/kernel project is healthy, not penalised.

Method: Dependency cycles via elementary-DFS over real .csproj references, plus Martin instability (afferent/efferent) per project. Exhaustive over the reference graph, deterministic.

Coverage: Exhaustive · type-level: afferent/efferent coupling + cycles computed over every production type — the population is all types, not a name convention.

Maturity: DocumentedVerifiedPrevented · effective 10.0 / 10 · rule-coverage 100% · ceiling Prevented

20 projects, 0 dependency cycle(s), 0 unstable depended-on project(s).

✓ On the Gold path — maintain.

Detailed fixes: d5_recommendation.md.

D6 · Cohesion (LCOM4)10.0 / 10Exemplary✓ Tool-verified

What it measures: Whether a class's methods are focused on a single responsibility.

Method: LCOM4 cohesion per production class with at least two methods: connected components of methods sharing state or calls, computed syntactically. Deterministic, not a proxy.

Coverage: Exhaustive · type-level: LCOM4 cohesion computed over every production class — the population is all types, not a name convention.

Maturity: DocumentedVerifiedPrevented · effective 10.0 / 10 · rule-coverage 100% · ceiling Verified

0 of 36 classes have LCOM4 above 3.

✓ On the Gold path — maintain.

Detailed fixes: d6_recommendation.md.

D9 · Test Distribution10.0 / 10Exemplary✓ Tool-verified

What it measures: Whether the test suite has a healthy mix of unit / integration / end-to-end tests.

Method: Test projects classified (Unit/Integration/BDD/E2E) from compiled metadata; test methods counted exhaustively across projects with placement-agnostic disk fallback. Deterministic.

Maturity: DocumentedVerifiedPrevented · effective 10.0 / 10 · rule-coverage 100% · ceiling Documented

135 test methods: 135 unit, 0 integration, 0 BDD, 0 e2e.

✓ On the Gold path — maintain.

Detailed fixes: d9_recommendation.md.

D10 · Test Quality9.9 / 10Exemplary✓ Tool-verified

What it measures: Whether the tests truly assert behaviour rather than just running the code.

Method: Per-test assertions, skips, and mock references analyzed via Roslyn; structured skip-reason tags (BUG:/ENV:) separate documented deferrals from debt. Deterministic.

Maturity: DocumentedVerifiedPrevented · effective 9.9 / 10 · rule-coverage 100% · ceiling Prevented

2 skipped (1 with a documented reason), 0 zero-assertion, no mocking-framework packages referenced (hand-written doubles or no mocking) across 135 tests.

Skipped test: Flushes_state_after_every_successful_searchSamples/CSharp/Demo/Demo.App.Tests/TopicFixture.cs:97
Skipped (documented): When_actor_received_reentrant_message_via_StreamTests/Orleankka.Tests/Features/Reentrant_messages.cs:225

✓ On the Gold path — maintain.

Detailed fixes: d10_recommendation.md · top locations in Appendix A, every location in findings.md.

D11 · Test Reliability10.0 / 10Exemplary✓ Tool-verified

What it measures: Whether the tests pass reliably, with no flakiness.

Method: Suite re-run N times within tiered wall-clock budgets (unit to e2e); tests failing non-deterministically across runs flagged; guarded tests retried when #if guards detected.

Maturity: DocumentedVerifiedPrevented · effective 10.0 / 10 · rule-coverage 100% · ceiling Verified

0 flaky across 1 measured tier(s). unit: not included — too large to re-run within its budget; other: measured (0 flaky).

✓ On the Gold path — maintain.

Detailed fixes: d11_recommendation.md.

D12 · Dependency Hygiene10.0 / 10Exemplary✓ Tool-verified

What it measures: Whether dependencies are current, secure, and not bloated.

Method: Manifest scan via dotnet list package across all projects; worst-signal-per-package deduction (saturating for vulnerabilities, capped-linear for deprecation/outdated) per KLoC. Exhaustive, deterministic.

Maturity: DocumentedVerifiedPrevented · effective 10.0 / 10 · rule-coverage 100% · ceiling Verified

0 outdated, 0 vulnerable, 0 deprecated packages.

✓ On the Gold path — maintain.

Detailed fixes: d12_recommendation.md.

D13 · Secret Scanning10.0 / 10Exemplary○ Nothing flagged

What it measures: Whether any secrets (keys, tokens, passwords) have leaked into the code.

Method: In-process native secret scanner (entropy plus signature patterns) across all tracked files; no external tool. A clean result is a measured 10, not no-data zero. Deterministic.

Maturity: DocumentedVerifiedPrevented · effective 10.0 / 10 · rule-coverage 100% · ceiling Prevented

Secret scan ran and found no leaked secrets.

✓ On the Gold path — maintain.

Detailed fixes: d13_recommendation.md.

D14 · License Compliance10.0 / 10Exemplary○ Nothing flagged

What it measures: Whether the licenses of third-party packages are compatible with your policy.

Method: Third-party package licenses resolved from declared package metadata and checked against the configured policy (allow/deny/copyleft). Deterministic; clean = no incompatible license found at metadata depth.

Maturity: DocumentedVerifiedPrevented · effective 10.0 / 10 · rule-coverage 100% · ceiling Verified

0 of 2 packages use a banned license.

✓ On the Gold path — maintain.

Detailed fixes: d14_recommendation.md.

D15 · Churn × Complexity Hotspots10.0 / 10Exemplary✓ Tool-verified

What it measures: Files that change often and are also complex — the riskiest hotspots.

Method: Per production file churn times cyclomatic complexity over a rolling window, computed from git and Roslyn/JS/Razor analysis. Exhaustive, deterministic per commit date.

Maturity: DocumentedVerifiedPrevented · effective 10.0 / 10 · rule-coverage 100% · ceiling Documented

No churn × complexity hotspots in the window.

✓ On the Gold path — maintain.

Detailed fixes: d15_recommendation.md.

D17 · Explicit Debt9.5 / 10Exemplary✓ Tool-verified

What it measures: Acknowledged debt left in the code — TODOs, dead code, suppressed warnings.

Method: Roslyn syntactic debt markers (suppressions/TODO/FIXME/HACK/empty-catch/commented-code/Obsolete) plus SymbolFinder dead-code analysis; weighted-debt-per-KLoC density deducted 2.0x per unit. Deterministic, exhaustive.

Maturity: DocumentedVerifiedPrevented · effective 9.5 / 10 · rule-coverage 100% · ceiling Prevented

5 deducted debt markers + 0 dead symbols across 8165 LoC (0.3/KLoC) → score 9.5.

NoWarnInCsprojDirectory.Build.props:34
BareSuppressMessage · ×3Source/Orleankka/ActorRef.cs:92
CommentedOutCodeSamples/CSharp/Demo/Demo.App.Tests/TopicFixture.cs:113

✓ On the Gold path — maintain.

Detailed fixes: d17_recommendation.md · top locations in Appendix A, every location in findings.md.

D18 · Solution Shape9.4 / 10Exemplary✓ Tool-verified

What it measures: Whether the solution is laid out in a sensible, conventional structure.

Method: Solution structure: project count, decomposition, shell-project detection, build success (confirmed failures cap the score); traced to actual .sln files and binaries. Deterministic.

Maturity: DocumentedVerifiedPrevented · effective 9.4 / 10 · rule-coverage 100% · ceiling Documented

23 projects, 193 source files, 13284 hand-written lines of code (8165 production / 5119 test), 49 inter-project edges.

Thin analysable surface across projects

✓ On the Gold path — maintain.

Detailed fixes: d18_recommendation.md · top locations in Appendix A, every location in findings.md.

D19 · Documentation Quality / 10Adequate◐ Sampled · advisory

What it measures: Whether the project's documentation is clear, complete, and useful.

Method: Judged by language model at low temperature (0.0-0.1) on a deterministic doc sample (READMEs plus first 25 architecture docs), with two-pass stability filtering. Advisory, sampled.

Maturity: DocumentedVerifiedPrevented · effective Adequate / 10 · rule-coverage 100% · ceiling Documented

Orleankka has strong README coverage and an architecture document for the main project plus four separate projects with detailed installation/build/run guides. The XML-doc coverage is dismal (0% on most projects), but the open-source community repository README is clear and complete: it states the problem domain, lists features, shows install commands, explains build requirements, and documents packages while clipping mid-sentence.

Low XML-doc coverage: Orleankka · ×20Source/Orleankka/Orleankka.csproj
The README mentions Orleankka's YouTube references and a slide link but does not cite any source material or include links to the actual documentation (e.g. features page) that it claims to be based on.README.md
The README is largely feature-driven and install-focused, with no dedicated Examples or Usage section for the core message-based API.README.md

What to do

  1. Resolve the 20 Low XML-doc coverage finding(s) in Documentation Quality — start with Chat.Client.csproj (2), Chat.Server.csproj (2), Chat.Shared.csproj (2). — One of this dimension's main actionable groups (20 warning-level).
  2. Resolve the 1 The README mentions Orleankka's YouTube references and a slide link but… finding(s) in Documentation Quality — start with README.md. — One of this dimension's main actionable groups (1 recommendation-level).
  3. Resolve the 1 The README is largely feature-driven and install-focused, with no… finding(s) in Documentation Quality — start with README.md. — One of this dimension's main actionable groups (1 recommendation-level).

Detailed fixes: d19_recommendation.md · top locations in Appendix A, every location in findings.md.

D21 · Naming Consistency / 10Exemplary◐ Sampled · advisory

What it measures: Whether names — types, methods, variables — are clear and consistent.

Method: Judged by language model at low temperature (0.0-0.1) on a deterministic random symbol sample (fixed size, not exhaustive), with disclosed confidence band. Advisory, sampled.

Maturity: DocumentedVerifiedPrevented · effective Exemplary / 10 · rule-coverage 100% · ceiling Verified

0 naming inconsistencies across 200 sampled symbols.

✓ On the Gold path — maintain.

Detailed fixes: d21_recommendation.md.

D24 · Comment Value / 10Weak◐ Sampled · advisory

What it measures: Whether comments are worth it — explaining WHY (valuable) rather than WHAT (redundant).

Method: Judged by language model at low temperature (0.0-0.1) on deterministically sampled inline comments with surrounding code; findings verified back to sampled comments by substring match. Advisory, sampled.

Maturity: DocumentedVerifiedPrevented · effective Weak / 10 · rule-coverage 100% · ceiling Documented

12 valuable / 1 redundant across 79 sampled comments; 1 shown with locations.

redundant commentSamples/CSharp/Demo/Demo.App.Tests/TopicFixture.cs:82

What to do

  1. Resolve the 1 redundant comment finding(s) in Comment Value — start with TopicFixture.cs. — One of this dimension's main actionable groups (1 recommendation-level).

Detailed fixes: d24_recommendation.md · top locations in Appendix A, every location in findings.md.

D26 · Project Cohesion10.0 / 10Exemplary✓ Tool-verified

What it measures: Whether each project is a focused, coherent unit rather than an oversized grab-bag.

Method: Project size overshoot penalties (LoC / public-type count / namespace count, 2-of-3 flag) weighted by log magnitude. Exhaustive across projects, deterministic, LLM-independent.

Maturity: DocumentedVerifiedPrevented · effective 10.0 / 10 · rule-coverage 100% · ceiling Documented

0 of 23 projects flagged as possibly oversized/incoherent.

✓ On the Gold path — maintain.

Detailed fixes: d26_recommendation.md.

D28 · Secrets (history)10.0 / 10Exemplary○ Nothing flagged

What it measures: Whether any secrets were ever committed — scanned across the full git history, not just now.

Method: Git-history secret scan via gitleaks detect over full history in an isolated checkout; each match flagged High. Exhaustive; degrades cleanly when tool absent.

Maturity: DocumentedVerifiedPrevented · effective 10.0 / 10 · rule-coverage 100% · ceiling Documented

gitleaks scanned the full history AND the current working tree and found no secrets.

✓ On the Gold path — maintain.

Detailed fixes: d28_recommendation.md.

D29 · Static Analysis (SAST)9.9 / 10Exemplary✓ Tool-verified

What it measures: Real static-analysis (SAST) findings — likely security bugs in the code, any language.

Method: Polyglot static analysis via semgrep across the repo using the pinned, image-baked p/security-audit + p/owasp-top-ten rulesets (no scan-time registry fetch); severity rules (ERROR/WARNING/INFO) map to a full-band severity-weighted score. Exhaustive, deterministic; degrades on parse failure.

Coverage: semgrep pattern rules over all files — exhaustive for the rule set, blind to classes of bug without a rule (clean = no rule matched).

Maturity: DocumentedVerifiedPrevented · effective 9.9 / 10 · rule-coverage 100% · ceiling Documented

1 finding(s): 0 critical, 0 high, 0 medium, 1 low.

Low: stacktrace-disclosureSamples/CSharp/FSM/ProcessManager/Startup.cs:17detected by semgrep finding

✓ On the Gold path — maintain.

Detailed fixes: d29_recommendation.md · top locations in Appendix A, every location in findings.md.

D33 · JS/npm Dependency Vulnerabilities10.0 / 10Exemplary○ Nothing flagged

What it measures: Whether JavaScript/npm dependencies have known published vulnerabilities (CVEs) — the npm ecosystem's biggest risk.

Method: JS/npm CVE scan via trivy fs --scanners vuln over JS manifests (package.json/yarn.lock/pnpm-lock/bun.lockb); 0-10 tight normalizer. NotApplicable without JS manifests. Exhaustive, deterministic.

Maturity: DocumentedVerifiedPrevented · effective 10.0 / 10 · rule-coverage 100% · ceiling Documented

No known-vulnerable JS/npm dependencies.

✓ On the Gold path — maintain.

Detailed fixes: d33_recommendation.md.

D34 · Knowledge Freshness0.0 / 10Critical✓ Tool-verified

What it measures: Whether anyone still has living knowledge of each file, or it has been orphaned — last understood long ago by someone now gone quiet. The sibling of the bus factor: D16 asks who owns it, D34 asks whether anyone still knows it.

Method: File orphaning as total living-knowledge decay below one focused-commit's worth within a year, computed per-file from the D16 decay model. Exhaustive, deterministic over fixed history.

Maturity: DocumentedVerifiedPrevented · effective 0.0 / 10 · rule-coverage 100% · ceiling Documented

26 of 26 significant source file(s) are orphaned — their living knowledge has decayed to nothing, so no one currently understands them. The largest is Source/Orleankka.Runtime/Dispatcher.cs.

Dormant codebase

What to do

  1. Resolve the 1 Dormant codebase finding(s) in Knowledge Freshness. — One of this dimension's main actionable groups (1 recommendation-level).

Detailed fixes: d34_recommendation.md · top locations in Appendix A, every location in findings.md.

D35 · Change Coupling9.9 / 10Exemplary✓ Tool-verified

What it measures: Whether files that change together actually belong together — pairs that repeatedly co-change in git history despite having no explicit code dependency, surfacing the hidden/logical coupling (and boundaries in the wrong place) a static scan can't see.

Method: Pairwise co-occurrence over the per-commit file sets in git history (production source only — tests and generated dropped): Degree-of-Coupling = shared ÷ min individual revisions, reported above noise floors (each file ≥10 revisions, ≥5 shared commits, ≥50% strength); sweeping commits excluded. Deterministic over fixed history.

Coverage: Population: PRODUCTION source files only — test and generated files are dropped before pairing, so a class co-changing with its own test (trivially ~100%) can't drown the real production↔production coupling. Pairs ranked by Degree-of-Coupling; coupling through a build step, config, or non-source file isn't seen.

Maturity: DocumentedVerifiedPrevented · effective 9.9 / 10 · rule-coverage 100% · ceiling Documented

Strongest change-coupling: ActivationService.cs↔TimerService.cs 67%

Change coupling: ActivationService.cs ↔ TimerService.csSource/Orleankka.Runtime/Services/ActivationService.cs

✓ On the Gold path — maintain.

Detailed fixes: d35_recommendation.md · top locations in Appendix A, every location in findings.md.

Frontend & cross-cutting dimensions

R = React/JS · M = Maturity · P = Readiness.

AX1 · Captive dependencies10.0 / 10Exemplary✓ Tool-verified

Other · Architecture — Whether any singleton service captures a scoped/transient dependency — a silent lifetime/threading bug.

Method: Roslyn scan: DI registrations parsed from AddSingleton/Scoped/Transient; each singleton checked for captured shorter-lifetime dependencies. Exhaustive, deterministic.

AX10 · Code composition8.8 / 10Strong✓ Tool-verified

Other · Architecture — How the codebase splits by code ROLE — domain, application, infrastructure, test, generated. The significance map behind the knowledge/coupling weighting, and a DDD signal in its own right: a thin domain core under fat infrastructure is the anemic-domain smell, quantified.

Method: Roslyn line-count by code ROLE: every source file classified Domain/Application/Infrastructure/Test/Generated by namespace + path convention (the shared CodeRoleClassifier), then significant lines summed per role. Deterministic; the advisory score is the business-logic (domain+application) share of production code.

Coverage: Population: ALL source files, each bucketed into ONE of five roles (Domain/Application/Infrastructure/Test/Generated) by namespace + path convention — a file whose layer isn't named in the convention falls to Application (the neutral default), and the split is line-count, not semantic depth or business value.

What to do

  • The domain core is a small share of production code — check that business logic isn't leaking into the application/infrastructure layers (a thin domain is the anemic-domain smell).
AX2 · Stateful singletons10.0 / 10Exemplary✓ Tool-verified

Other · Architecture — Whether singleton services avoid mutable shared instance state that concurrent callers would race on.

Method: Roslyn scan: singleton field mutations unguarded by lock or Interlocked, per type; syntax-based guard detection. Deterministic, traceable per field.

AX3 · Project dependency cycles10.0 / 10Exemplary✓ Tool-verified

Other · Architecture — Whether the project-reference graph is acyclic (cycles block independent build/deploy and signal eroding boundaries).

Method: Project reference cycles via elementary-DFS over real .csproj references, using the engine shared with D5/D7; cyclic versus acyclic. Exhaustive, deterministic.

AX4 · Dependency direction10.0 / 10Exemplary✓ Tool-verified

Other · Architecture — Whether dependencies point inward (Domain ← Application ← Infrastructure/Web) — the clean-architecture dependency rule, checked across the project graph.

Method: Layer violations by name-segment inference (Domain/Core to Application to Infrastructure/Web) over the project-reference graph. Exhaustive over all projects, deterministic.

AX5 · Architecture & structure10.0 / 10Exemplary✓ Tool-verified

Other · Architecture — Whether the codebase has a recognisable, scale-appropriate structure (a named architectural style, or modular enough for its size) rather than being an ad-hoc ball of mud.

Method: Roslyn plus csproj analysis: architecture style detection (DDD, clean, vertical-slice, CQRS) and structure fitness for repo size. Deterministic.

AX6 · Interface segregation10.0 / 10Exemplary✓ Tool-verified

Other · Architecture — Whether interfaces stay focused rather than fat — the Interface-Segregation principle (SOLID 'I').

Method: Roslyn scan: public interface member counts; fat-interface threshold (over 15 members) flagged per type. Deterministic, type-level.

AX8 · Test isolation10.0 / 10Exemplary✓ Tool-verified

Other · Architecture — Whether production projects stay free of references to test projects — tests may depend on production, never the reverse.

Method: Csproj graph: each production project checked for references to test projects (identified by test-framework presence, not name). Zero violations is clean. Deterministic.

GD1 · Unfinished & placeholder code9.7 / 10Exemplary✓ Tool-verified

Other · Code Health — Unreviewed-generation residue: shipped members still throwing NotImplementedException, and placeholder string literals left in non-test, non-generated code. Scored as a quality signature, never as a claim about authorship.

Method: Roslyn syntax scan: NotImplementedException throws and placeholder string literals in non-test, non-generated shipped code. Deterministic, code-shape signature.

  • A shipped member still throws NotImplementedException — generated scaffolding that was never completed. Implement it or remove the dead surface. (×11) — ActorRef.cs:97, ActorRef.cs:146, ClientObservable.cs:84, …

What to do

  • Finish or delete NotImplementedException stubs and replace placeholder literals before shipping.
IC1 · Incompleteness & stubs7.7 / 10Strong✓ Tool-verified

Other · Code Health — Unfinished work detected by code SHAPE, not keywords: members that only throw a "not implemented" exception, methods that take inputs and return a constant, async methods that never await, dead `if (false)` / `#if false` branches, and skeleton types most of whose members are holes. A real, objective slice of technical debt.

Method: Roslyn syntax scan: incompleteness by code shape (constant-returning methods, async-never-await, #if false branches, skeleton types), not keyword-gated. Deterministic, code-shape heuristic.

  • `OnError` is a shipped member whose whole body throws NotImplementedException — scaffolding that was never completed. Implement it or remove the dead surface. — ClientObservable.cs:82
  • `OnCompleted` is a shipped member whose whole body throws NotImplementedException — scaffolding that was never completed. Implement it or remove the dead surface. — ClientObservable.cs:87
  • `StreamOf` is a shipped member whose whole body throws NotImplementedException — scaffolding that was never completed. Implement it or remove the dead surface. — HttpActorSystem.cs:31
  • `ClientOf` is a shipped member whose whole body throws NotImplementedException — scaffolding that was never completed. Implement it or remove the dead surface. — HttpActorSystem.cs:32
  • A test is skipped/ignored — coverage that looks present but never runs. Re-enable it or delete it so the green run means something. (×2) — TopicFixture.cs:98, Reentrant_messages.cs:225

What to do

  • Finish or delete the unfinished stubs (NotImplementedException / empty / constant-returning bodies) — they are dead surface that looks live.
  • Clear the softer debt: remove commented-out code and dead branches, re-enable or delete skipped tests, and replace blanket warning suppressions with targeted ones.
M1 · Documentation (README)6.8 / 10Adequate✓ Tool-verified

Maturity · Maturity — Whether the repo and its projects have a README, and whether it's substantive and current.

Method: Filesystem scan: README presence, word count, and headings for depth; git history for staleness. Exhaustive across root and project dirs, deterministic.

What to do

  • Add a 'Testing' section to the root README — how to run the test suite.
  • Add an 'Architecture' / 'How it works' section to the root README — the high-level shape.
  • Add a README to the 22 of 23 project(s) that lack one — worth up to 1.9 pts.
M2 · Architecture documentation0.0 / 10Critical✓ Tool-verified

Maturity · Maturity — Whether key decisions (ADRs) and the high-level shape (C4/diagrams) are written down.

Method: Filesystem scan: ADR folder/naming conventions or content, plus Mermaid/PlantUML/C4/architecture.md discovery. Exhaustive, deterministic.

  • No Architecture Decision Records found — no conventional ADR directory, no `NNNN-title.md` documents and nothing ADR-shaped by content. Design rationale recorded elsewhere (a design-notes tree, a mailing list, pull-request discussion) is not visible to this check and is not re-findable per decision, so a future maintainer cannot ask why one choice was made and get an answer.
  • No C4/PlantUML/Mermaid diagram or architecture.md — the high-level shape isn't documented.

What to do

  • Record significant decisions one document per decision — dated, stating the context, the decision and its consequences — and keep them together wherever your design docs already live (a conventional `docs/adr/` tree with `NNNN-title.md` names is the most discoverable form).
  • Add a C4 context/container diagram (Structurizr, PlantUML or Mermaid) or an architecture.md overview.
M3 · Folder & project structure8.0 / 10Strong✓ Tool-verified

Maturity · Maturity — Whether the repo is organised deliberately — src/test separation and consistent project naming.

Method: Filesystem scan: src/test folder separation and namespace-prefix consistency (majority RootNamespace agreement). Exhaustive across projects, deterministic.

  • Only 11/23 projects share a common root namespace — the code's module identity is inconsistent.

What to do

  • Adopt a consistent root-namespace convention (a shared prefix, e.g. Acme.*); short project-file/directory names are fine as long as the RootNamespace is uniform.
M4 · Documentation accuracy10.0 / 10Exemplary◐ Sampled · advisory

Maturity · Maturity — Whether the README actually describes the code that exists (LLM-judged, advisory).

Method: Judged by language model at low temperature: README accuracy versus actual projects, within a disclosed tolerance. Advisory, not a measured number.

P1 · CI/CD gates8.5 / 10Strong✓ Tool-verified

Readiness · Readiness — Whether an automated pipeline builds and tests every change.

Method: Filesystem scan: CI workflow files (.github/workflows, .gitlab-ci.yml, etc.) for build and test stages. Exhaustive, deterministic.

  • A CI pipeline exists and the word "test" appears, but no explicit test-runner invocation (your stack's test command, or a test job) was matched — so either the gate runs tests through a step this pass could not recognise, or "test" is incidental here (a path, "latest", a reporter). Check the coverage dimensions first: if this repo has no test suite yet, that is the finding and this row follows from it. If a suite does exist, make the runner step explicit so the gate is unambiguous.

What to do

  • Run the test suite in CI via an explicit runner step for your stack, and gate merges on it.
P10 · Library API & versioning2.0 / 10Critical✓ Tool-verified

Readiness · Readiness — For a library: a deliberate (small) public API surface and explicit semantic versioning so consumers can depend on it safely.

Method: Roslyn scan: public API surface area and semantic-versioning markers (SemVer attributes, changelog entries) for libraries. Exhaustive, deterministic.

  • 295/364 types (81%) are public. For a library, every public type is a stability contract — make internal-by-default and expose only the intended API.
  • No <Version>/<VersionPrefix>/GitVersion/MinVer detected. A published library needs explicit semantic versioning so consumers can reason about breaking changes.

What to do

  • Make types internal by default; expose only the deliberate public API so internals can change without breaking consumers.
  • Stamp a semantic version (csproj <Version> or GitVersion/MinVer) and follow semver for breaking changes.
P3 · Security & performance tooling0.0 / 10Critical✓ Tool-verified

Readiness · Readiness — Whether SAST, secret/dependency scanning and performance benchmarking are wired in (presence, not runtime).

Method: Filesystem scan: SAST configuration, dependency-update automation, secret scanning, and a benchmark harness or benchmark step — in this repository's own ecosystem. Exhaustive, deterministic.

  • No static application security testing detected. For this repository's stack, add CodeQL's csharp pack (it analyses VB.NET too), or a security analyzer package (or `semgrep --config=auto`, which runs on any language) as a CI step.

What to do

  • Add a SAST step to CI running what this repository's stack ships: CodeQL's csharp pack (it analyses VB.NET too), or a security analyzer package — or `semgrep --config=auto`, which runs on any language — so a security regression fails the build instead of landing.
  • Enable Dependabot/Renovate or a dependency-review gate.
  • Add gitleaks/trufflehog in CI to block PRs that introduce committed secrets.
P4 · Deployment & Rollback5.0 / 10Adequate✓ Tool-verified

Readiness · Readiness — Whether releases are automated and safely reversible (probes, rolling updates, approval gates) — from manifests/pipeline files, not the live environment.

Method: Filesystem scan: deployment manifests/IaC (K8s YAML, Helm, Terraform) for rolling updates, probes, approval gates, migration hooks. Exhaustive, deterministic.

What to do

  • Nothing pauses a release for a human: publish as a draft release (or gate the release job on a protected tag/manual dispatch) so a bad build can be stopped before users can download it.
P6 · Release Hygiene10.0 / 10Exemplary✓ Tool-verified

Readiness · Readiness — Whether releases are traceable — a maintained changelog and explicit version stamping.

Method: Filesystem scan: changelog file presence and version tags in csproj or git tags. Exhaustive, deterministic.

PF1 · Benchmark discipline6.0 / 10Adequate✓ Tool-verified

Readiness · Performance — Whether the library protects its performance with benchmarks — a benchmark suite, allocation/memory measurement, and (ideally) a CI gate. Presence is credited as a bonus, never a deduction.

Method: Repo + source scan: BenchmarkDotNet referenced (csproj/source), [Benchmark]/[MemoryDiagnoser] attribute counts, and a benchmark step in CI — scored as a bonus ladder (absence is neutral, never a deduction). Deterministic, presence detection.

  • No benchmark suite was found. Where code is performance-sensitive, a benchmark guards against silent regressions — but it's a bonus here, not a deduction.

What to do

  • Add a benchmarking harness for the hot paths and run it in CI to catch regressions (for .NET, a BenchmarkDotNet project with [MemoryDiagnoser] to track allocations).
PF2 · Allocation hygiene6.2 / 10Adequate✓ Tool-verified

Readiness · Performance — Whether the code is written to minimise allocations so it doesn't pressure its host's memory manager — buffer/slice views over copies, object pooling, stack or value-type allocation, and buffer writers. Reward-only: credited where present, never penalised where a simpler style is fine.

Method: Production-source scan: density (per 1k LoC) of allocation-aware APIs — Span/Memory, ArrayPool/ObjectPool, stackalloc, ValueTask, value-type structs, IBufferWriter, string.Create, SkipLocalsInit. Reward-only. Deterministic, syntax/text detection.

What to do

  • Raise allocation-aware density on the hot paths — currently 4 use(s) across 9,347 production line(s) (~0.4/1k). More Span/Memory, pooling (ArrayPool/ObjectPool), stackalloc and ValueTask on the allocation-heavy paths climbs this toward 10.
PF3 · Async & latency hygiene4.5 / 10Weak✓ Tool-verified

Readiness · Performance — Whether asynchronous code keeps its host responsive — a library awaits with ConfigureAwait(false) (so it never captures and stalls the host's context) and avoids sync-over-async blocking (.Wait()/.GetAwaiter().GetResult()) that wastes threads and risks deadlock.

Method: Production-source scan: sync-over-async blocking (.Wait()/.GetAwaiter().GetResult()) counted everywhere, and — for a library with ≥5 awaits — the share of awaits using ConfigureAwait(false). Deterministic, syntax/text detection.

  • 1 blocking call(s) on async work (.Wait()/.GetAwaiter().GetResult()) — these waste a thread and can deadlock in a consumer with a synchronization context.
  • Only 0/308 awaits use ConfigureAwait(false). A library that captures the caller's context can stall or deadlock its host — the classic way a dependency drags an app down.

What to do

  • Make the call chain async end-to-end and await it — never block on a Task with .Wait()/.GetAwaiter().GetResult() in library code.
  • In library code, append .ConfigureAwait(false) to every await (or set <ConfigureAwait>false</ConfigureAwait> / use the analyzer CA2007) so the library never captures the host's context.
X1 · Async correctness7.2 / 10Strong✓ Tool-verified

Other · Code Health — Whether the code avoids sync-over-async (deadlock-prone blocking on tasks) and async void.

Method: Roslyn syntax scan: async methods scanned for .Wait()/.GetAwaiter().GetResult() and async-void outside event handlers. Deterministic, hard fact per invocation.

  • `async void` can't be awaited and its exceptions crash the process instead of propagating. Return `Task` — or, where the delegate contract requires void (timer/event/callback registrations), make this a thin void shim that awaits a Task-returning inner method inside try/catch so exceptions are contained. — App.cs:20
  • Blocking on a Task with `.Wait()`/`.GetAwaiter().GetResult()` can deadlock (and wastes a thread). Prefer awaiting it: make the caller `async` and `await` instead. Where a synchronous entry point must stay — a public sync API you cannot break, or a process entry point that must not return until the work finishes — the block belongs in ONE documented bridge and never inside code that is already async; and where it already is that bridge, give the wait a TIMEOUT so a hung task fails the call instead of hanging the process. — Program.cs:36

What to do

  • async void method: Run
X2 · Cancellation propagation4.0 / 10Weak✓ Tool-verified

Other · Code Health — Whether async methods accept a CancellationToken so work can be cancelled (adoption curve).

Method: Roslyn scan: every async method (excluding framework-fixed overrides/Blazor handlers) checked for CancellationToken parameter presence. Deterministic, adoption percentage.

  • Only 0/92 async methods accept a CancellationToken, so in-flight work can't be stopped early when the caller gives up — whatever ends it in your host (shutdown signal, timeout, abandoned request, user cancel). Thread a token through the call chain and honour it at each await and loop; where a method genuinely cannot be interrupted, omitting it is a deliberate choice — judge against your hosting model.
  • No CancellationToken parameter — this work can't be stopped early once started. (×24) — ActorRef.cs:49, HttpActorEndpoint.cs:44, HttpActorEndpoint.cs:58, …
  • No CancellationToken parameter — the body observes an ambient token instead (a field or a context object), so the work does stop on cancellation, but a caller cannot cancel this call independently of the owner that created that token. — Program.cs:36

What to do

  • Thread a CancellationToken through async methods so work stops promptly on cancellation.
X3 · Exception handling10.0 / 10Exemplary○ Nothing flagged

Other · Code Health — Whether exceptions are handled rather than silently swallowed or rethrown with lost stack traces.

Method: Roslyn syntax scan: every catch clause counted; empty catches and bare rethrows flagged. Population is all catch clauses, not estimated. Deterministic, hard fact.

X4 · Structured logging4.3 / 10Weak✓ Tool-verified

Other · Code Health — Whether log calls use message templates (queryable) rather than interpolated strings.

Method: Roslyn syntax scan: every log call-site counted; interpolated-string first-argument violations flagged. Population is all log calls, not estimated. Deterministic.

  • Logging an interpolated string (`$"..."`) collapses the event to plain text — you lose the named, queryable properties structured logging exists for. Use a message template with placeholders: `LogInformation("User {UserId} did {Action}", id, action)`. If these calls go through a logging wrapper that only accepts a pre-formatted string, give the wrapper a template+args overload that forwards to the underlying logger, then migrate call sites to it. — Storage.cs:51

What to do

  • Interpolated log message defeats structured logging
X5 · Nullable reference types2.0 / 10Critical✓ Tool-verified

Other · Code Health — Whether nullable reference types are enabled and not undermined by heavy `!` suppression.

Method: Roslyn compiler-options scan: NullableContextOptions per project; null-forgiving (!) suppression density per 1k syntax nodes. Deterministic, adoption plus suppression penalty.

  • 0/20 NRT-eligible project(s) enable <Nullable>enable</Nullable> (projects targeting a pre-C#-8 framework are excluded — NRTs aren't available there). NRTs catch a whole class of null-deref bugs at compile time.

What to do

  • Enable <Nullable>enable</Nullable> across all projects and resolve warnings rather than suppressing with `!`.

Reference — by lens

The score is the rank-weighted fold of these lenses (worst-heaviest), each including its meta-dimensions; a lens with a Critical contributor is capped at Fair (its band reads "gated by …") and is never the strongest area however high its average.

LensScoreRatingImpact
Code Health51%Adequate — gated by X5Capped at Fair by a Critical contributor — resolve it before relying on this lens.
Architecture97%ExemplarySolid.
Maturity46%Weak — gated by D34, M2Capped at Fair by a Critical contributor — resolve it before relying on this lens.
Readiness46%Weak — gated by P3, P10Capped at Fair by a Critical contributor — resolve it before relying on this lens.
Security100%ExemplaryStrongest area.
Performance54%AdequateAcceptable, with room to improve.
Not included — 47 check(s) not relevant to this codebase

These checks had nothing to measure here (no tests, no git history, the codebase is small, or the architecture style doesn't apply), so they're omitted above rather than scored low.

  • AC1 Text alternatives — No web markup found — accessibility is not applicable to this repository.
  • AC2 Forms & labels — No web markup found — accessibility is not applicable to this repository.
  • AC3 Page structure — No web markup found — accessibility is not applicable to this repository.
  • AC4 Keyboard semantics — No web markup found — accessibility is not applicable to this repository.
  • AC5 ARIA correctness — No web markup found — accessibility is not applicable to this repository.
  • AC6 Visual & motion safety — No web markup found — accessibility is not applicable to this repository.
  • AC7 A11y enforcement — No web markup found — accessibility is not applicable to this repository.
  • AX7 Slice cohesion — not applicable — not a vertical-slice architecture
  • AX9 CQS / query purity — no CQRS query handlers detected — query purity is not applicable to this codebase
  • AXB2 Runtime readiness — Advisory — this card reports evidence and never carries a score, so there is nothing missing here.
  • C1 Data Protection — No personal data detected in the analyzed source — no PII-typed entity/column names (Email, FirstName, DateOfBirth, …), no ASP.NET Identity / user-account model, and no stored user credentials. GDPR data-protection controls are therefore N/A here. If this is intentional, record the no-PII posture in an ADR; if the app does process personal data, name those fields conventionally so this dimension activates.
  • C2 Access Controls — No access-control surface detected in the analyzed source — no web/app surface to authorize (no HTTP API or web-UI project) and no authorization code at all (no [Authorize]/policies, no imperative guard methods). Access control is therefore N/A here — this is a library/CLI, which is authorized by its CALLER, not by itself. If this codebase grows request handlers, the dimension reactivates and a default-deny posture is expected then.
  • C3 Audit Trail — No personal data detected in the analyzed source — no PII-typed entity/column names (Email, FirstName, DateOfBirth, …), no ASP.NET Identity / user-account model, and no stored user credentials. GDPR data-protection controls are therefore N/A here. If this is intentional, record the no-PII posture in an ADR; if the app does process personal data, name those fields conventionally so this dimension activates.
  • C4 Data Retention — No personal data detected in the analyzed source — no PII-typed entity/column names (Email, FirstName, DateOfBirth, …), no ASP.NET Identity / user-account model, and no stored user credentials. GDPR data-protection controls are therefore N/A here. If this is intentional, record the no-PII posture in an ADR; if the app does process personal data, name those fields conventionally so this dimension activates.
  • C5 Data-Subject Rights — No personal data detected in the analyzed source — no PII-typed entity/column names (Email, FirstName, DateOfBirth, …), no ASP.NET Identity / user-account model, and no stored user credentials. GDPR data-protection controls are therefore N/A here. If this is intentional, record the no-PII posture in an ADR; if the app does process personal data, name those fields conventionally so this dimension activates.
  • D16 Bus Factor — dormant codebase — no living knowledge left to concentrate
  • D20 ADR Quality — N/A — ADRs are expected on deployable products with a user-facing host, not consumed libraries; no ADR log is required here.
  • D22 Internal API Consistency — No exposed public API
  • D23 Boundary Type-Coupling — Bounded contexts not declared
  • D25 ADR Conformance — no ADRs to check
  • D27 Navigability — symbol resolution incomplete — navigability not assessed
  • D30 Dependency Vulnerabilities — the solution did not restore on the analyzer's .NET SDK (an SDK/target-framework/restore mismatch, common for an older codebase), so there was no restored dependency graph to scan for NuGet CVEs — excluded rather than scored; re-run on an SDK that can restore this solution
  • D31 IaC & Container Security — No Infrastructure-as-Code or container manifests found (Dockerfile, Terraform, Kubernetes/Helm, CloudFormation); nothing to scan.
  • D32 Data Compliance (PII/GDPR) — No PII/GDPR-handling patterns detected (p/gdpr ruleset) — no data-compliance surface to assess.
  • D36 Supply-chain Provenance & Signing — No CI/build pipeline found (.github/.forgejo/.gitea workflows, .gitlab-ci.yml, azure-pipelines*.yml, .pipelines/, .vsts-ci/, Jenkinsfile, .circleci); there is no build to attest provenance for.
  • D37 Vulnerability-disclosure Policy — No vulnerability-disclosure policy file found (SECURITY.md/.markdown/.rst/.txt at root or under .github/.forgejo/.gitea/docs, .well-known/security.txt). A coordinated-disclosure policy may live off-repo, so this is not evidenced rather than failed.
  • D38 OSV Dependency Vulnerabilities — Scanner failed to run — not a clean result
  • D39 IL Efficiency — The target did not build, so no IL was available to measure.
  • D40 Network Egress Confinement — No Kubernetes/orchestration workloads found in the repository manifests; network egress policy is a cluster-native control that may live at the platform/firewall layer, so there is nothing to assess here.
  • D41 Kernel & Syscall Confinement — No Kubernetes/orchestration workloads found in the repository manifests; seccomp/AppArmor/SELinux confinement is a workload-level control, so there is nothing to assess here.
  • D42 Runtime Threat Enforcement — No Kubernetes/orchestration workloads found in the repository manifests; runtime threat-detection and admission-control policy are cluster-level controls, so there is nothing to assess here.
  • D7 Architectural Integrity — no checkable ADRs and no dependency cycles — architectural integrity not assessed
  • D8 Code Coverage — Coverage not measured
  • DM1 Domain Modelling — not scored — this repository shows none of the 3 signals this check looks for
  • ED1 Event-Driven — applicable but not scored (2 of 3 signals for this style — below the bar we score at): 13 event handler(s); a message-bus package
  • ED5 Idempotency — no mutating command handlers or message consumers detected — idempotency check not applicable
  • ES1 Event Sourcing — not scored — this repository shows only 1 of the 3 signals this check looks for (an event-store package (Marten/EventStore))
  • P12 CI test-gate honesty — Reported, not scored — and nothing was matched here. The coverage check applies to any stack, but the checks for excluded tests, skipped tests and sleep-based synchronisation currently recognise only some ecosystems' test-runner idioms, so on a repository built with another stack the zeros below mean 'not checked', not 'clean'.
  • P2 Observability — This repo is a library, not a deployed service — it has no process to operate, so production observability (structured logging, tracing/metrics, health checks) is N/A. A library may log via an injected ILogger, but the absence of operational telemetry is not a defect here. If it grows a host (web API, worker), the dimension reactivates.
  • P5 DR & Backup — not evidenced — repo shows no backup/RTO/RPO controls; absence of evidence is not evidence of a working control
  • P7 Outbound HTTP resilience — not applicable — this isn't a service/API/worker
  • P8 Schema migrations — no EF Core usage detected
  • P9 Domain vs controller coverage — no coverage report found on disk — produce a coverage report in a standard format (Cobertura — `dotnet test --collect:"XPlat Code Coverage"` with a `coverlet.collector` PackageReference) into the repo working tree before the scan — a CI step is the usual place, since the artefact is commonly gitignored, or wire coverage collection into CI, to enable this cross-layer check
  • S1 Web-Security Posture — No web surface detected in the analyzed source — no HTTP API or web-UI project (no controllers/minimal-API endpoints, no Razor/Blazor views) and no web middleware (HTTPS redirection, HSTS, security headers, cookies). Transport security, security headers, secure cookies, CSRF/input-validation and middleware-order controls are therefore N/A here — this is a library/CLI/worker, not a web app. Crypto hygiene was still checked and found nothing to flag. If this codebase becomes web-facing, the dimension reactivates automatically.
  • SC1 Supply-chain hygiene — Advisory — this card reports evidence and never carries a score, so there is nothing missing here.
  • X6 Hand-rolled structured-format parsing — Reported, not scored — this card publishes what it found rather than grading it. Its content is the findings and the key metric above.
  • X7 Silent fallback defaults — Reported, not scored — this card publishes what it found rather than grading it. Its content is the findings and the key metric above.

Appendix A — Findings (grouped)

The findings behind the scores, grouped by severity, then by dimension and kind. The high-severity issues are enumerated in full below; items per group are capped at 25 with any overflow stated explicitly per group, never silently truncated. The complete machine-readable list of every finding (all severities) is the companion findings.md in this report's bundle.

Issue — 1 finding(s)
D17 · Explicit Debt · NoWarnInCsproj · ×1
  • NoWarnInCsproj Directory.Build.props:34 — 1591 — this warning is switched off for the WHOLE project, in every file it builds, including code written years from now: nothing at the call site records that the rule was ever silenced, so the next reader has no reason to look here. Fix what the rule is reporting and drop the code from the list, or — if some occurrences really are legitimate — narrow the suppression to those sites and give each one its reason, so the rule keeps protecting the rest of the project.
Warning — 33 finding(s)
D19 · Documentation Quality · Low XML-doc coverage · ×20
  • Low XML-doc coverage: Orleankka Source/Orleankka/Orleankka.csproj — Orleankka: 17 % XML-doc coverage (57/341).
  • Low XML-doc coverage: Demo.App Samples/CSharp/Demo/Demo.App/Demo.App.csproj — Demo.App: 0 % XML-doc coverage (0/55).
  • Low XML-doc coverage: Reentrant Samples/CSharp/Reentrant/Reentrant.csproj — Reentrant: 0 % XML-doc coverage (0/12).
  • Low XML-doc coverage: Idiomatic Samples/CSharp/EventSourcing/Idiomatic/Idiomatic.csproj — Idiomatic: 0 % XML-doc coverage (0/100).
  • Low XML-doc coverage: GES Samples/CSharp/EventSourcing/Persistence/GES/GES.csproj — GES: 0 % XML-doc coverage (0/43).
  • Low XML-doc coverage: Streamstone Samples/CSharp/EventSourcing/Persistence/Streamstone/Streamstone.csproj — Streamstone: 0 % XML-doc coverage (0/47).
  • Low XML-doc coverage: Chat.Client Samples/CSharp/Streams/Chat.Client/Chat.Client.csproj — Chat.Client: 0 % XML-doc coverage (0/6).
  • Low XML-doc coverage: Chat.Server Samples/CSharp/Streams/Chat.Server/Chat.Server.csproj — Chat.Server: 0 % XML-doc coverage (0/1).
  • Low XML-doc coverage: Chat.Server Samples/CSharp/Observers/Chat.Server/Chat.Server.csproj — Chat.Server: 0 % XML-doc coverage (0/4).
  • Low XML-doc coverage: Chat.Client Samples/CSharp/Observers/Chat.Client/Chat.Client.csproj — Chat.Client: 0 % XML-doc coverage (0/4).
  • Low XML-doc coverage: Chat.Shared Samples/CSharp/Observers/Chat.Shared/Chat.Shared.csproj — Chat.Shared: 0 % XML-doc coverage (0/12).
  • Low XML-doc coverage: Orleankka.TestKit Source/Orleankka.TestKit/Orleankka.TestKit.csproj — Orleankka.TestKit: 0 % XML-doc coverage (0/186).
  • Low XML-doc coverage: Chat.Shared Samples/CSharp/Streams/Chat.Shared/Chat.Shared.csproj — Chat.Shared: 0 % XML-doc coverage (0/11).
  • Low XML-doc coverage: Orleankka.Runtime Source/Orleankka.Runtime/Orleankka.Runtime.csproj — Orleankka.Runtime: 21 % XML-doc coverage (42/197).
  • Low XML-doc coverage: HelloWorld Samples/CSharp/HelloWorld/HelloWorld.csproj — HelloWorld: 0 % XML-doc coverage (0/6).
  • Low XML-doc coverage: Lightbulb Samples/CSharp/FSM/Lightbulb/Lightbulb.csproj — Lightbulb: 0 % XML-doc coverage (0/11).
  • Low XML-doc coverage: ProcessManager Samples/CSharp/FSM/ProcessManager/ProcessManager.csproj — ProcessManager: 0 % XML-doc coverage (0/46).
  • Low XML-doc coverage: Orleankka.Legacy.Runtime Source/Orleankka.Legacy.Runtime/Orleankka.Legacy.Runtime.csproj — Orleankka.Legacy.Runtime: 0 % XML-doc coverage (0/110).
  • Low XML-doc coverage: Orleankka.Client Source/Orleankka.Client/Orleankka.Client.csproj — Orleankka.Client: 0 % XML-doc coverage (0/3).
  • Low XML-doc coverage: Orleankka.Http.AspNetCore Source/Orleankka.Http.AspNetCore/Orleankka.Http.AspNetCore.csproj — Orleankka.Http.AspNetCore: 0 % XML-doc coverage (0/4).
D17 · Explicit Debt · BareSuppressMessage · ×3
  • BareSuppressMessage Source/Orleankka/ActorRef.cs:92 — SuppressMessage — the suppression records no reason: either it carries no justification argument at all, or one that states nothing a reader can weigh ("OK", "By design"). A suppression is a decision somebody made, and without the reason the next reader cannot tell a considered exception from an unexamined one, so it is never revisited. Write what makes this site legitimately different — the invariant that holds, the framework contract that forces the shape — or remove the suppression and fix what it hides.
  • BareSuppressMessage Source/Orleankka/ClientEndpoint.cs:84 — SuppressMessage — the suppression records no reason: either it carries no justification argument at all, or one that states nothing a reader can weigh ("OK", "By design"). A suppression is a decision somebody made, and without the reason the next reader cannot tell a considered exception from an unexamined one, so it is never revisited. Write what makes this site legitimately different — the invariant that holds, the framework contract that forces the shape — or remove the suppression and fix what it hides.
  • BareSuppressMessage Tests/Orleankka.Tests/Features/Actor_behaviors/Switchable_behaviors.cs:189 — SuppressMessage — the suppression records no reason: either it carries no justification argument at all, or one that states nothing a reader can weigh ("OK", "By design"). A suppression is a decision somebody made, and without the reason the next reader cannot tell a considered exception from an unexamined one, so it is never revisited. Write what makes this site legitimately different — the invariant that holds, the framework contract that forces the shape — or remove the suppression and fix what it hides.
D10 · Test Quality · Skipped test · ×1
  • Skipped test: Flushes_state_after_every_successful_search Samples/CSharp/Demo/Demo.App.Tests/TopicFixture.cs:97 — Skipped — FIX
D16 · Bus Factor · dormant codebase · ×1
  • dormant codebase — no living knowledge left to concentrate — All 18 significant source file(s) were last meaningfully changed so long ago that no living knowledge remains — nothing since has been substantial enough to re-establish ownership (a broad, mechanical sweep that touches many files shallowly does not count, and neither does no activity at all). There is no concentration to measure, so the bus factor is not scored. This is not a clean bill: nobody currently holds working knowledge of this code (see D34 Knowledge Freshness).
D17 · Explicit Debt · CommentedOutCode · ×1
  • CommentedOutCode Samples/CSharp/Demo/Demo.App.Tests/TopicFixture.cs:113 — 3 consecutive commented-code lines
D2 · Cognitive Complexity · ReferencedAssemblyHelper.AddFromDependencyContext (cognitive 17) · ×1
  • ReferencedAssemblyHelper.AddFromDependencyContext (cognitive 17) Source/Orleankka/ReferencedAssemblyHelper.cs:93 — ReferencedAssemblyHelper.AddFromDependencyContext has cognitive complexity 17 (threshold 15). To reduce it, split the body into named stages: move each independent step or branch into its own named function so the body reads as a short sequence of named calls rather than one long body.
D3 · God Classes · TooManyMethods · ×1
  • TooManyMethods: ActorBehavior Source/Orleankka.Legacy.Runtime/Behaviors/ActorBehavior.cs:0 — TooManyMethods — 212 significant lines (blank, comment-only and punctuation-only lines excluded), 38 methods. To reduce it, group the members that share the same data into a smaller type of their own and delegate to it, so no single type carries every responsibility.
D35 · Change Coupling · Change coupling · ×1
  • Change coupling: ActivationService.cs ↔ TimerService.cs Source/Orleankka.Runtime/Services/ActivationService.cs — `Source/Orleankka.Runtime/Services/ActivationService.cs` and `Source/Orleankka.Runtime/Services/TimerService.cs` change together 67% of the time (10 of the 15 commits that touched the less-changed of the two, renames followed). They sit in the same directory, and in this ecosystem sibling files there normally share one namespace/package — so a direct reference between them needs no import and this pass cannot see whether one exists. Read the pair before acting: if one file only DECLARES what the other consumes (a constants/types file beside its user), the co-change is definitional and the question is whether the split earns its keep; if they duplicate structure, extract the common part into a shared function or type they both call; if neither holds, the coupling is hidden and worth breaking.
D4 · Code Duplication · Duplicated block (13 lines × 2) · ×1
  • Duplicated block (13 lines × 2) Samples/CSharp/Streams/Chat.Client/Program.cs:19 — Samples/CSharp/Streams/Chat.Client/Program.cs:19-31 | Samples/CSharp/Observers/Chat.Client/Program.cs:23-36 — the copies span different directories, so extracting a shared function means choosing where it lives: put it somewhere both call sites can already reach — a location they all depend on today, or a new shared one if there is none — and call it from each site; until then, every change has to be made twice. Read the line range as the matched WINDOW rather than a finished unit: at `Samples/CSharp/Streams/Chat.Client/Program.cs:19` it does not close everything it opens, so those exact lines cannot be lifted as they stand — widen the region to the smallest complete statement or declaration that contains it, and extract that.
D4 · Code Duplication · Duplicated block (12 lines × 2) · ×1
  • Duplicated block (12 lines × 2) Samples/CSharp/EventSourcing/Idiomatic/Program.cs:33 — Samples/CSharp/EventSourcing/Idiomatic/Program.cs:33-44 | Samples/CSharp/EventSourcing/Persistence/GES/Program.cs:43-54 — the copies span different directories, so extracting a shared function means choosing where it lives: put it somewhere both call sites can already reach — a location they all depend on today, or a new shared one if there is none — and call it from each site; until then, every change has to be made twice.
D4 · Code Duplication · Duplicated block (9 lines × 2) · ×1
  • Duplicated block (9 lines × 2) Source/Orleankka.Runtime/Dispatcher.cs:392 — Source/Orleankka.Runtime/Dispatcher.cs:392-400 | Source/Orleankka.Runtime/Dispatcher.cs:428-436 — both copies are in the same file, so extract the block into one function there and call it from each site — the copies drift apart the first time only one of them is edited.
D8 · Code Coverage · Coverage not measured · ×1
  • Coverage not measured — The test suite couldn't be built/run in-image and no coverage report is committed, so line coverage was not measured — and it is EXCLUDED from the score rather than scored on a LoC-ratio proxy. No coverage collector was found in your CI either, so there is no existing report to hand us: add a coverage collector to your test run and commit (or publish) its Cobertura/OpenCover/lcov output anywhere in the repo, or make the suite runnable in-image, and real coverage will be measured.
Recommendation — 8 finding(s)
D18 · Solution Shape · Thin analysable surface across projects · ×1
  • Thin analysable surface across projects — 5 project(s) carry only a thin slice of real code (e.g. `Orleankka.Client` with 22 significant line(s)). The mean analysable-surface weight is 92 %, lowering Solution Shape by about 0.63 point(s). Consolidate thin projects or grow them into substantial, well-scoped assemblies.
D19 · Documentation Quality · The README mentions Orleankka's YouTube references and a slide link but does not cite any source material or include links to the actual documentation (e.g. features page) that it claims to be based on. · ×1
  • The README mentions Orleankka's YouTube references and a slide link but does not cite any source material or include links to the actual documentation (e.g. features page) that it claims to be based on. README.md — Add a short 'References' section listing each cited resource so readers can verify the content.
D19 · Documentation Quality · The README is largely feature-driven and install-focused, with no dedicated Examples or Usage section for the core message-based API. · ×1
  • The README is largely feature-driven and install-focused, with no dedicated Examples or Usage section for the core message-based API. README.md — Add an 'Examples' section showing a minimal client call that demonstrates the zero-overhead message-send model.
D23 · Boundary Type-Coupling · Bounded contexts not declared · ×1
  • Bounded contexts not declared — At 8165 LoC spread over 23 projects the codebase is large and multi-module, so explicit bounded contexts are needed. Name this codebase's bounded contexts (≥2 module groups, e.g. per subsystem) so cross-boundary type coupling can be assessed. Declare them in `.codehealth/config.yaml` at the repository root (create it if absent), mapping each context name to the module-path or namespace prefixes that belong to it — e.g. `architecture:` → `contexts:` → `Billing: ["src/billing", "Acme.Billing"]`, `Catalog: ["src/catalog", "Acme.Catalog"]`.
D24 · Comment Value · redundant comment · ×1
  • redundant comment Samples/CSharp/Demo/Demo.App.Tests/TopicFixture.cs:82 — "Rethrows_unknown_exceptions, above `await`: 'arrange'" —
D29 · Static Analysis (SAST) · Low · ×1
  • Low: stacktrace-disclosure Samples/CSharp/FSM/ProcessManager/Startup.cs:17 — Stacktrace information is displayed in a non-Development environment. Accidentally disclosing sensitive stack trace information in a production environment aids an attacker in reconnaissance and information gathering. This is a semgrep security-AUDIT rule: it reports that a sensitive construct is present, not that it is exploitable here. Confirm whether this site handles untrusted input or is reachable across a trust boundary — and apply the change where it is; where the construct is required by the platform or protocol it calls into, and carries no untrusted data (a syscall/FFI shim, a build- or debug-gated tool, a fixed local surface), record the review and leave the code as it is.
D34 · Knowledge Freshness · Dormant codebase · ×1
  • Dormant codebase — 26 of 26 significant files have no living knowledge — the codebase as a whole is dormant, not 26 separate risks. Re-engage owners or document before change.
D38 · OSV Dependency Vulnerabilities · Scanner failed to run · ×1
  • Scanner failed to run — not a clean result — osv-scanner exited 128 with no findings — the advisory database was likely unreachable. The scanner exited non-zero and produced no findings (typically the advisory DB was unreachable), so this is reported as a measurement gap rather than a clean pass.
Info — 2 finding(s)
D10 · Test Quality · Skipped (documented) · ×1
  • Skipped (documented): When_actor_received_reentrant_message_via_Stream Tests/Orleankka.Tests/Features/Reentrant_messages.cs:225 — Skipped with a documented reason — a deferral, not lazy debt: Reentrancy is ignored for streams
D22 · Internal API Consistency · No exposed public API · ×1
  • No exposed public API — No intentionally-exposed types (IsPackable or .Contracts) to evaluate.

Appendix B — Reproduction & audit trail

Every external tool invocation behind a deep-scan dimension — the tool, its captured version, the exact command, how many findings it yielded, and a link to the retained raw output. To reproduce any finding: check out the same commit and run the command shown (repo-relative — never an absolute scratch path). The complete raw scanner output is retained verbatim under artifacts/raw/ (indexed in artifacts/raw/index.json); per-invocation exit codes and wall-clock durations are in sidecar.json — kept out of this table so the rendered report stays byte-identical across runs of the same commit.

DimensionToolVersionCommandFindingsRaw output
D28 · Secrets (history)gitleaksgitleaks detect --no-banner --report-format json --report-path /dev/stdout --exit-code 0 --source .0artifacts/raw/gitleaks-history.json
D29 · Static Analysis (SAST)semgrepsemgrep --config /opt/semgrep-rules/security-audit.yml --config /opt/semgrep-rules/owasp-top-ten.yml --json --quiet --timeout 0 --metrics off .1artifacts/raw/semgrep.json
D30 · Dependency Vulnerabilitiesdotnetdotnet: not applicable — the solution did not restore on the analyzer's .NET SDK (an SDK/target-framework/restore mismatch, common for an older codebase), so there was no restored dependency graph to scan for NuGet CVEs — excluded rather than scored; re-run on an SDK that can restore this solution0
D31 · IaC & Container Securitytrivytrivy: not applicable — No Infrastructure-as-Code or container manifests found (Dockerfile, Terraform, Kubernetes/Helm, CloudFormation); nothing to scan.0
D32 · Data Compliance (PII/GDPR)semgrepsemgrep: not applicable — No PII/GDPR-handling patterns detected (p/gdpr ruleset) — no data-compliance surface to assess.0
D33 · JS/npm Dependency Vulnerabilitiestrivytrivy fs --scanners vuln --format json --quiet --severity CRITICAL,HIGH,MEDIUM,LOW --skip-dirs **/bin/** --skip-dirs **/obj/** . --skip-db-update0
D36 · Supply-chain Provenance & Signingprovenanceprovenance: not applicable — No CI/build pipeline found (.github/.forgejo/.gitea workflows, .gitlab-ci.yml, azure-pipelines*.yml, .pipelines/, .vsts-ci/, Jenkinsfile, .circleci); there is no build to attest provenance for.0
D37 · Vulnerability-disclosure Policydisclosuredisclosure: not applicable — No vulnerability-disclosure policy file found (SECURITY.md/.markdown/.rst/.txt at root or under .github/.forgejo/.gitea/docs, .well-known/security.txt). A coordinated-disclosure policy may live off-repo, so this is not evidenced rather than failed.0
D38 · OSV Dependency Vulnerabilitiesosv-scannerosv-scanner --format json --recursive .0
D40 · Network Egress Confinementruntime-hardeningruntime-hardening: not applicable — No Kubernetes/orchestration workloads found in the repository manifests; network egress policy is a cluster-native control that may live at the platform/firewall layer, so there is nothing to assess here.0
D41 · Kernel & Syscall Confinementruntime-hardeningruntime-hardening: not applicable — No Kubernetes/orchestration workloads found in the repository manifests; seccomp/AppArmor/SELinux confinement is a workload-level control, so there is nothing to assess here.0
D42 · Runtime Threat Enforcementruntime-hardeningruntime-hardening: not applicable — No Kubernetes/orchestration workloads found in the repository manifests; runtime threat-detection and admission-control policy are cluster-level controls, so there is nothing to assess here.0

Run 019fc848-4990-7cee-9185-bda59b5a9b5a · every finding is also locatable in findings.md, and the complete scoring record (with exit codes + durations) in sidecar.json.

Downloadable artifacts

Machine-readable and reproducible from this commit + frozen rubric — drop them straight into a contract appendix, a CRA dossier, or a downstream SCA / VEX tool.

⬇ Findings, MITRE CWE-tagged .sarif⬇ Health changelog .md