Executive summary
Read through the Production lens — the standard calibration. *Green* means good enough to run in production. The score is absolute and comparable across repos.
dotnet/fsharp is sound in substance but carries real gaps (56%). It is not in crisis, but the issues below raise the cost of changing it — friction its consumers ultimately inherit.
It is strongest in Code Health (100%) — the code is clean and low-risk to change. Architecture (91%) is solid too.
The area that most needs attention is Security (34%) — exposure to security and compliance incidents is elevated. Readiness (69%) is the next concern — releases are harder to depend on — versioning, release notes and dependency hygiene are thin, so consumers can't easily tell what changed or trust an upgrade.
Leadership focus, highest impact first: 20 High finding(s) (Static Analysis (SAST)); Automate the release in CI (Deployment & Rollback); 1 No artifact signing finding(s) in Supply-chain Provenance &… (Supply-chain Provenance & Signing).
For scale: Medium (~42,707 production lines); rebuilding it from scratch would take roughly ~4.4 person-years (~2–9 engineers). Approximate, ±~30%.
It builds on a genuinely strong Code Health foundation (100%); the priorities above are the highest-leverage way to bring the rest up to that level.
Raise Security 34 → 70 (the Healthy floor) ⇒ headline 56 → ~73.
Rebuild cost & value ~ Modeled — €210,000–€1,100,000
| Cost to rebuild | €210,000–€1,100,000 |
| Domain complexity | Standard |
| Quality factor | 0.8× (at 56% quality) |
| Size & shape | Medium · 37% boilerplate · 18% straight-line · 45% branching logic |
This codebase represents roughly ~4.4 person-years of build effort (about ~€640,000 to rebuild). Its weakest lens is Security at 34% — the part of that asset most exposed by the findings below.
Top priorities
Diagnosis — what's actually going on
Architecture — bounded-context dependency graph
At a glance — Code Health
At a glance — Architecture
At a glance — Maturity
At a glance — Readiness
At a glance — Security
Security & Compliance — OWASP Top-10 mapping
| OWASP category | Findings | Severity |
|---|---|---|
| A03:2021 — Injection | 20 | High / Critical |
Roadmap
Begin by resolving the 20 high-priority static analysis findings, focusing first on commands.yml, check_release_notes.yml, and repository_lockdown_check.yml. Next, implement automated release and rollback capabilities in the CI pipeline to ensure deployments are repeatable and reversible. Finally, address the three supply-chain gaps by enabling artifact signing, establishing build provenance, and pinning build actions to specific versions.
| Do this | Helps | Effort | Dimension |
|---|---|---|---|
| Resolve the 20 High finding(s) in Static Analysis (SAST) — start with commands.yml (7), check_release_notes.yml (5), repository_lockdown_check.yml (4). | +15.3 pts | Medium | Static Analysis (SAST) |
| Resolve the 1 No artifact signing finding(s) in Supply-chain Provenance & Signing. | +3.9 pts | Low | Supply-chain Provenance & Signing |
| Resolve the 1 No build provenance finding(s) in Supply-chain Provenance & Signing. | +3.9 pts | Low | Supply-chain Provenance & Signing |
| Resolve the 1 Unpinned build actions finding(s) in Supply-chain Provenance & Signing. | +3.9 pts | Low | Supply-chain Provenance & Signing |
| Resolve the 1 No ADRs found finding(s) in ADR Quality. | +3.0 pts | Low | ADR Quality |
| Automate the release in CI — a deploy stage for a service (Helm/Kubernetes manifests or an equivalent rollout), or a tag-triggered publish job for an artifact — so releases are repeatable and reversible. | +4.6 pts | Medium | Deployment & Rollback |
| Add a 'Testing' section to the root README — how to run the test suite. | +3.0 pts | Medium | Documentation (README) |
| Start an ADR log (docs/adr/) recording significant decisions and their rationale. | +3.0 pts | Medium | Architecture documentation |
File quality
| File | Score | Band | Worst signal |
|---|---|---|---|
| .github/workflows/commands.yml | 4.4 | Mixed | Static Analysis (SAST): High: github-actions-mutable-action-tag |
| .github/workflows/check_release_notes.yml | 4.6 | Mixed | Static Analysis (SAST): High: github-actions-mutable-action-tag |
| .github/workflows/repository_lockdown_check.yml | 4.8 | Mixed | Static Analysis (SAST): High: github-actions-mutable-action-tag |
| .github/workflows/add_to_project.yml | 5.8 | Mixed | Static Analysis (SAST): High: github-actions-mutable-action-tag |
| .github/workflows/copilot-setup-steps.yml | 7.2 | Mixed | Static Analysis (SAST): High: github-actions-mutable-action-tag |
| .github/workflows/skill-validation.yml | 7.2 | Mixed | Static Analysis (SAST): High: github-actions-mutable-action-tag |
| docs/fcs/filesystem.fsx | 7.4 | Mixed | Change Coupling: Change coupling: filesystem.fsx ↔ tokenizer.fsx |
| buildtools/fslex/Arg.fs | 7.8 | Mixed | Code Duplication: Duplicated block (17 lines × 2) |
| buildtools/fslex/fslexdriver.fs | 7.8 | Mixed | Code Duplication: Duplicated block (10 lines × 2) |
| buildtools/fslex/fslexlex.fs | 7.8 | Mixed | Code Duplication: Duplicated block (7 lines × 2) |
| vsintegration/src/FSharp.Editor/Hints/Hints.fs | 7.8 | Mixed | Change Coupling: Change coupling: Hints.fs ↔ LanguageService.fs |
| buildtools/fslex/Lexing.fsi | 8.5 | Near-clean | Code Duplication: Duplicated block (44 lines × 2) |
| buildtools/fslex/Parsing.fs | 8.5 | Near-clean | Code Duplication: Duplicated block (37 lines × 2) |
| buildtools/fslex/Parsing.fsi | 8.5 | Near-clean | Code Duplication: Duplicated block (32 lines × 2) |
| buildtools/fslex/Lexing.fs | 8.5 | Near-clean | Code Duplication: Duplicated block (22 lines × 2) |
| buildtools/fslex/Arg.fsi | 8.5 | Near-clean | Code Duplication: Duplicated block (20 lines × 2) |
| .github/skills/fsharp-diagnostics/server/Server.fs | 8.5 | Near-clean | Code Duplication: Duplicated block (12 lines × 2) |
| buildtools/fsyacc/fsyaccast.fs | 8.5 | Near-clean | Code Duplication: Duplicated block (5 lines × 2) |
| docs/fcs/interactive.fsx | 8.5 | Near-clean | Change Coupling: Change coupling: interactive.fsx ↔ untypedtree.fsx |
| vsintegration/src/FSharp.Editor/Diagnostics/SimplifyNameDiagnosticAnalyzer.fs | 8.5 | Near-clean | Change Coupling: Change coupling: SimplifyNameDiagnosticAnalyzer.fs ↔ UnusedDeclarationsAnalyzer.fs |
Methodology & how to trust this report
Watchdog is a deep, periodic assessment — run each sprint, monthly, or quarterly, taking the time to go wider and deeper than a quick check and surfacing in one coherent report what you'd otherwise piece together from a dozen separate tools. It scores deterministically: the same commit yields the same score, every run. 20 of 22 evaluated dimensions are computed purely by tools and static analysis (confidence 1.0); 2 documentation/naming judgement(s) are LLM-assisted and labelled advisory. Overall confidence is 0.4 — the weighted average across measured dimensions; it falls as more of the score leans on LLM-assisted judgement and rises when it's fully tool-backed.
What we checked — 22 dimensions across the health lenses
- Can you open the finding? Real findings cite a repo-relative file and line you can open at the cited line — never an absolute scratch path. Here, 43 of 58 do; the remainder are repo-wide signals — a dimension-level measurement, not a single line.
- Is there a tool behind the number? Every score below names the method that produced it — Roslyn, git, a scanner, or (for a handful of documentation/naming dimensions) an LLM labelled sampled · advisory — not a narrative.
- Does re-running give the same result? Run it again on the same commit and the score — and this report, byte for byte — is identical. A report whose numbers move between runs is describing the run, not the code.
Tools & methods
| Method | Backs | Version | Evaluator |
|---|---|---|---|
| Roslyn static analysis | Complexity, cohesion, coupling, dead code, API surface, layering | 5.3.0 | ✓ deterministic |
| Native secret scanner | Hardcoded secrets / credentials | 1.0.0 | ✓ deterministic |
| jscpd | Code duplication | — | ✓ deterministic |
| Coverage (coverlet / dotnet-coverage) | Line & branch coverage | 10.0.302 | ✓ deterministic |
| NuGet / dotnet | Outdated, vulnerable & deprecated dependencies | 10.0.302 | ✓ deterministic |
| git / LibGit2Sharp | Churn hotspots, knowledge concentration, history | 2.43.0 · 0.31.0 | ✓ deterministic |
| gitleaks · semgrep · trivy · checkov | Secrets in history, SAST, CVEs, IaC & container, PII / GDPR | 1.86.0 · 0.69.3 | ✓ deterministic |
| LLM (sampled · advisory) | Documentation quality, ADR conformance, naming — sampled over a bounded sample; advisory, never a deterministic measurement | Local LLM | ◐ LLM · sampled · advisory |
Run transparency — what happened this run
- D18 Solution Shape — evaluation did not complete — Dimension evaluation failed — excluded from the score.
- D30 Dependency Vulnerabilities — scanner not present in this environment — The backing tool was not installed where this scan ran, so this dimension was not scored. Install the tool (or run in the hosted environment, where it is always present) for a graded result.
- D31 IaC & Container Security — scanner not present in this environment — The backing tool was not installed where this scan ran, so this dimension was not scored. Install the tool (or run in the hosted environment, where it is always present) for a graded result.
- D32 Data Compliance (PII/GDPR) — scanner not present in this environment — The backing tool was not installed where this scan ran, so this dimension was not scored. Install the tool (or run in the hosted environment, where it is always present) for a graded result.
- D33 JS/npm Dependency Vulnerabilities — scanner not present in this environment — The backing tool was not installed where this scan ran, so this dimension was not scored. Install the tool (or run in the hosted environment, where it is always present) for a graded result.
- D37 Vulnerability-disclosure Policy — scanner not present in this environment — The backing tool was not installed where this scan ran, so this dimension was not scored. Install the tool (or run in the hosted environment, where it is always present) for a graded result.
- D38 OSV Dependency Vulnerabilities — scanner not present in this environment — The backing tool was not installed where this scan ran, so this dimension was not scored. Install the tool (or run in the hosted environment, where it is always present) for a graded result.
- D40 Network Egress Confinement — scanner not present in this environment — The backing tool was not installed where this scan ran, so this dimension was not scored. Install the tool (or run in the hosted environment, where it is always present) for a graded result.
- D41 Kernel & Syscall Confinement — scanner not present in this environment — The backing tool was not installed where this scan ran, so this dimension was not scored. Install the tool (or run in the hosted environment, where it is always present) for a graded result.
- D42 Runtime Threat Enforcement — scanner not present in this environment — The backing tool was not installed where this scan ran, so this dimension was not scored. Install the tool (or run in the hosted environment, where it is always present) for a graded result.
Limitations & what we did not check
Watchdog assesses the repository exactly as committed, and only the repository. By design it does not reach outside the source tree: the live cloud account, the running CI/CD pipeline, the host's branch-protection and approval rules, the production configuration, or a restore actually exercised against a backup are all out of scope. That boundary is a feature, not a gap — a repo-relative, deterministic scan re-runs identically on any commit and every finding opens at a real file and line, where a live audit can neither be reproduced nor traced. The visible consequence is that controls which leave no in-repo evidence are reported as "not evidenced" and excluded from the score rather than awarded a number a static scan cannot justify.
Per-dimension blind spots
- D4 Code Duplication: Duplication is token-similarity (jscpd) — it finds copy-paste, not semantic duplication expressed differently. Committed machine-written code (EF migration scaffolds, *.Designer.cs, model snapshots) is EXCLUDED — its repetition is the tool's, not the team's — so the score reflects hand-written duplication only; the generated footprint is reported separately under Solution Shape.
- D5 Coupling: Coupling is measured between projects/assemblies — runtime coupling through DI, reflection, messaging or shared databases is invisible to a static reference graph.
- D13 Secret Scanning: Secret detection is signature- and entropy-based on the current tree — a secret that does not match a known pattern, or one already rotated, will not be flagged (a clean scan is "nothing matched", not "no secrets exist").
- D14 License Compliance: License compatibility is checked against declared package metadata and a policy — mislabelled or missing license metadata, and obligations that depend on how you distribute, are not resolved here.
- D16 Bus Factor: Bus-factor is a time-decayed model of commit attribution (who has recently, repeatedly worked a file), not comprehension — pairing, review and reading-without-committing spread knowledge it can't see; bot commits and shared accounts still distort it.
- D19 Documentation Quality: Documentation quality is judged by an LLM over a bounded sample of docs — it reads what is written, not whether the docs match the running system, and it is advisory, not a measurement.
- D20 ADR Quality: ADR quality is an LLM read of the decision records present — it cannot know about decisions made and never recorded, and its verdict is sampled and advisory.
- D21 Naming Consistency: Naming quality is an LLM judgement over a bounded sample — it assesses clarity/consistency of the names it sees, not domain-correctness, and is advisory.
- D28 Secrets (history): Secret-history scanning sweeps the git log for known patterns — a secret that predates the available history, or never matched a signature, is not found (clean means "nothing matched in the history we can see").
- D29 Static Analysis (SAST): SAST findings are pattern-based (semgrep) — it finds classes of bug it has rules for; logic flaws, auth/authorization gaps and issues needing runtime context are out of reach (and clean means "no rule matched").
- D35 Change Coupling: Change coupling is co-change in COMMITS — files split across separate commits, or coupled only through a shared config/build step, read as uncoupled, and a sweeping commit (rename/format) is excluded so it doesn't couple everything. It shows that files change together, not WHY: a high coupling can be a healthy cohesive pair as readily as a hidden leak.
- M4 Documentation accuracy: Onboarding quality is an LLM read of the docs/setup present — it cannot run the onboarding or measure how long a real new joiner takes; the verdict is sampled and advisory.
- P4 Deployment & Rollback: Approval/branch-protection rules live in repository settings the scan cannot see — only their in-repo evidence (config files, workflows) is checked, so a control enforced purely in the host's settings reads as "not evidenced".
- P6 Release Hygiene: Rollback/observability controls are inferred from repo artefacts (pipelines, dashboards-as-code) — controls configured in external tooling, with no in-repo trace, cannot be credited.
The LLM boundary
Dimensions
D4 · Code Duplication
13 duplicated block group(s) detected.
D5 · Coupling
40 projects, 0 dependency cycle(s), 0 unstable depended-on project(s).
What to do
- Enforce Coupling in CI to reach Verified (currently Documented). — Hardens enforcement from Documented toward Prevented — provenance only; does not change the score.
D13 · Secret Scanning
Secret scan ran and found no leaked secrets.
D14 · License Compliance
0 of 1 packages use a banned license.
D16 · Bus Factor
10 source file(s) have their living knowledge concentrated in one author (≥90% of recent, decayed contribution). The largest is src/Compiler/TypedTree/TypedTreeOps.Remap.fs.
D19 · Documentation Quality
The documentation is clear and complete for an open-source project hosting F# compiler, core library, editor tools, and related test infrastructure. The README gives a strong 'Why do we test' rationale plus goals (standardized framework, discoverable tests, cross-platform builds), and the dedicated tests/README explains testing strategy, categorization by type/test category, and justifications for xUnit over alternatives like NUnit.
What to do
- Resolve the 1 The README is a single-file 'Why do we test' doc with no concrete… finding(s) in Documentation Quality — start with README.md. — One of this dimension's main actionable groups (1 recommendation-level).
D20 · ADR Quality
No architecture decision records were found.
What to do
- Resolve the 1 No ADRs found finding(s) in ADR Quality. — One of this dimension's main actionable groups (1 recommendation-level).
D21 · Naming Consistency
0 naming inconsistencies across 0 sampled symbols.
D28 · Secrets (history)
gitleaks scanned the full history AND the current working tree and found no secrets.
D29 · Static Analysis (SAST)
20 finding(s): 0 critical, 20 high, 0 medium, 0 low.
What to do
- Resolve the 20 High finding(s) in Static Analysis (SAST) — start with commands.yml (7), check_release_notes.yml (5), repository_lockdown_check.yml (4). — One of this dimension's main actionable groups (20 issue-level).
D35 · Change Coupling
Strongest change-coupling: filesystem.fsx↔tokenizer.fsx 70%; interactive.fsx↔untypedtree.fsx 67%; filesystem.fsx↔untypedtree.fsx 62%
D36 · Supply-chain Provenance & Signing
0/4 supply-chain integrity signals present (provenance, signing, SBOM, pinned actions).
What to do
- Resolve the 1 Unpinned build actions finding(s) in Supply-chain Provenance & Signing. — One of this dimension's main actionable groups (1 warning-level).
- Resolve the 1 No build provenance finding(s) in Supply-chain Provenance & Signing. — One of this dimension's main actionable groups (1 recommendation-level).
- Resolve the 1 No artifact signing finding(s) in Supply-chain Provenance & Signing. — One of this dimension's main actionable groups (1 recommendation-level).
Frontend & cross-cutting dimensions
AX3 · Project dependency cycles
AX4 · Dependency direction
M1 · Documentation (README)
What to do
- Add a 'Testing' section to the root README — how to run the test suite.
- Add an 'Architecture' / 'How it works' section to the root README — the high-level shape.
M2 · Architecture documentation
- No Architecture Decision Records found — decisions aren't captured for future maintainers.
What to do
- Start an ADR log (docs/adr/) recording significant decisions and their rationale.
M3 · Folder & project structure
M4 · Documentation accuracy
P1 · CI/CD gates
P3 · Security & performance tooling
- <NuGetAudit>false</NuGetAudit> in MSBuild suppresses NuGet's vulnerability audit project-wide. — Directory.Build.props:4
What to do
- Add gitleaks/trufflehog in CI to block PRs that introduce committed secrets.
P4 · Deployment & Rollback
- No release automation was found in CI — neither a deploy stage (Helm/Kubernetes/compose manifests, an orchestrated rollout) nor a publish job that ships the built artifact. Releases appear to be run by hand, which is slower, less repeatable and harder to reverse.
What to do
- Automate the release in CI — a deploy stage for a service (Helm/Kubernetes manifests or an equivalent rollout), or a tag-triggered publish job for an artifact — so releases are repeatable and reversible.
P6 · Release Hygiene
Reference — by lens
| Lens | Score | Rating | Impact |
|---|---|---|---|
| Code Health | 100% | Exemplary | Strongest area. |
| Architecture | 91% | Exemplary | Solid. |
| Maturity | 75% | Strong | Solid. |
| Readiness | 69% | Adequate — gated by P4 | Capped at Fair by a Critical contributor — resolve it before relying on this lens. |
| Security | 34% | Weak — gated by D29, D36 | Capped at Fair by a Critical contributor — resolve it before relying on this lens. |
Not included — 73 check(s) not relevant to this codebase
- AC1 Text alternatives — No web markup found — accessibility is not applicable to this repository.
- AC2 Forms & labels — No web markup found — accessibility is not applicable to this repository.
- AC3 Page structure — No web markup found — accessibility is not applicable to this repository.
- AC4 Keyboard semantics — No web markup found — accessibility is not applicable to this repository.
- AC5 ARIA correctness — No web markup found — accessibility is not applicable to this repository.
- AC6 Visual & motion safety — No web markup found — accessibility is not applicable to this repository.
- AC7 A11y enforcement — No web markup found — accessibility is not applicable to this repository.
- AX1 Captive dependencies — no DI registrations detected
- AX10 Code composition — not assessed — code composition is computed by ROLE over the .NET document set and none was loaded for this repository, because it is written in another language or the solution failed to load. This is a gap in the analyzer, not a finding about this repository
- AX2 Stateful singletons — no singleton implementations detected
- AX5 Architecture & structure — not assessed — architecture style/structure is computed from the .NET project graph (projects, types, namespaces) and no such graph was loaded for this repository, because it is written in another language or the solution failed to load. This is a gap in the analyzer, not a finding about this repository
- AX6 Interface segregation — not assessed — interface segregation is computed over the .NET type surface and none was loaded for this repository, because it is written in another language or the solution failed to load. This is a gap in the analyzer, not a finding about this repository
- AX7 Slice cohesion — not applicable — not a vertical-slice architecture
- AX8 Test isolation — no test/production split to check
- AX9 CQS / query purity — no CQRS query handlers detected — query purity is not applicable to this codebase
- AXB2 Runtime readiness — no data
- C1 Data Protection — Not assessed: these personal data controls are read from C# source (attributes, middleware, entity/column names, guard methods) and no C# source was loaded for this repository — because it is written in another language, or the solution failed to load. Absence of a .NET idiom is NOT evidence that this repository lacks personal data controls: it may implement them entirely in its own ecosystem. This is a gap in the analyzer's language coverage, not a finding about this repository.
- C2 Access Controls — Not assessed: these authorization controls are read from C# source (attributes, middleware, entity/column names, guard methods) and no C# source was loaded for this repository — because it is written in another language, or the solution failed to load. Absence of a .NET idiom is NOT evidence that this repository lacks authorization controls: it may implement them entirely in its own ecosystem. This is a gap in the analyzer's language coverage, not a finding about this repository.
- C3 Audit Trail — Not assessed: these audit controls are read from C# source (attributes, middleware, entity/column names, guard methods) and no C# source was loaded for this repository — because it is written in another language, or the solution failed to load. Absence of a .NET idiom is NOT evidence that this repository lacks audit controls: it may implement them entirely in its own ecosystem. This is a gap in the analyzer's language coverage, not a finding about this repository.
- C4 Data Retention — Not assessed: these retention controls are read from C# source (attributes, middleware, entity/column names, guard methods) and no C# source was loaded for this repository — because it is written in another language, or the solution failed to load. Absence of a .NET idiom is NOT evidence that this repository lacks retention controls: it may implement them entirely in its own ecosystem. This is a gap in the analyzer's language coverage, not a finding about this repository.
- C5 Data-Subject Rights — Not assessed: these data-subject rights controls are read from C# source (attributes, middleware, entity/column names, guard methods) and no C# source was loaded for this repository — because it is written in another language, or the solution failed to load. Absence of a .NET idiom is NOT evidence that this repository lacks data-subject rights controls: it may implement them entirely in its own ecosystem. This is a gap in the analyzer's language coverage, not a finding about this repository.
- D1 Cyclomatic Complexity — Most of this repository's production source (.cs, .fs, .py, .vb) had no cyclomatic complexity computed for it, so cyclomatic complexity was not measured — whatever else was read (first-party JavaScript assets, a script in another language) is not this repository's complexity. Not scored: the solution failed to load, or the language model was unavailable, or it exposed no method bodies the complexity pass could read. This is a gap in the analysis run, not a finding about this repository.
- D10 Test Quality — ~457367 lines of test source are present (.fs, .vb, .ps1) but the test-quality collector reads C# only, so skipped/assertion-free tests couldn't be counted. Not scored — this is a gap in the analyzer, not a finding about this repository.
- D11 Test Reliability — Test reliability not included
- D12 Dependency Hygiene — Dependency hygiene not measured — this repository's dependencies are not NuGet
- D15 Churn × Complexity Hotspots — complexity unreadable for .cs, .fs, .py, .vb — churn × complexity hotspots could not be measured
- D17 Explicit Debt — the C# workspace loaded 0 projects, so explicit-debt density could not be measured
- D18 Solution Shape — Dimension evaluation failed
- D2 Cognitive Complexity — Most of this repository's production source (.cs, .fs, .py, .vb) had no cognitive complexity computed for it, so cognitive complexity was not measured — whatever else was read (first-party JavaScript assets, a script in another language) is not this repository's complexity. Not scored: the solution failed to load, or the language model was unavailable, or it exposed no method bodies the complexity pass could read. This is a gap in the analysis run, not a finding about this repository.
- D22 Internal API Consistency — No exposed public API
- D23 Boundary Type-Coupling — Production source is present (.cs, .fs, .py, .vb) but bounded contexts are resolved over the C#/VB project set, which exposed none, so context scope could not be assessed. Not scored — this is a gap in the analyzer, not a verdict about this repository. Declare architecture.contexts (≥2) in config to assess cross-boundary type coupling.
- D24 Comment Value — No inline comments to assess — comment value is not applicable here.
- D25 ADR Conformance — no ADRs to check
- D26 Project Cohesion — Project cohesion is assessed over the .NET project set; this target exposed no projects, so project size and spread could not be assessed. Not scored — this is a gap in the analyzer's reach, not a verdict about this repository.
- D27 Navigability — No calls could be sampled, so navigability was not assessed — tracing effort is measured over resolved call sites and this target exposed none. Not scored — this is a gap in the analyzer's reach, not a verdict about this repository.
- D3 God Classes — Most of this repository's production source (.cs, .fs, .py, .vb) was not read by god-class detection, so class size was not assessed for the languages that are the product — whatever else was read (another language's projects, first-party JavaScript assets) is not this repository's class size. Not scored — this is a gap in the analyzer, not a verdict about this repository.
- D30 Dependency Vulnerabilities — the solution did not restore on the analyzer's .NET SDK (an SDK/target-framework/restore mismatch, common for an older codebase), so there was no restored dependency graph to scan for NuGet CVEs — excluded rather than scored; re-run on an SDK that can restore this solution
- D31 IaC & Container Security — No Infrastructure-as-Code or container manifests found (Dockerfile, Terraform, Kubernetes/Helm, CloudFormation); nothing to scan.
- D32 Data Compliance (PII/GDPR) — No PII/GDPR ruleset is bundled (the public p/gdpr semgrep pack was retired) — data compliance is not assessed in this scan.
- D33 JS/npm Dependency Vulnerabilities — No JS/npm manifest or lockfile found outside bin/obj (package.json, package-lock.json, yarn.lock, pnpm-lock.yaml, bun.lockb); no JS dependencies to scan.
- D34 Knowledge Freshness — knowledge concentrated in recent work — freshness signal contradicted by repo activity
- D37 Vulnerability-disclosure Policy — No vulnerability-disclosure policy file found (SECURITY.md/.markdown/.rst/.txt at root or under .github/.forgejo/.gitea/docs, .well-known/security.txt). A coordinated-disclosure policy may live off-repo, so this is not evidenced rather than failed.
- D38 OSV Dependency Vulnerabilities — No JS/npm lockfile found outside bin/obj (package-lock.json, yarn.lock, pnpm-lock.yaml, bun.lockb); nothing for OSV to scan.
- D39 IL Efficiency — The target did not build, so no IL was available to measure.
- D40 Network Egress Confinement — No Kubernetes/orchestration workloads found in the repository manifests; network egress policy is a cluster-native control that may live at the platform/firewall layer, so there is nothing to assess here.
- D41 Kernel & Syscall Confinement — No Kubernetes/orchestration workloads found in the repository manifests; seccomp/AppArmor/SELinux confinement is a workload-level control, so there is nothing to assess here.
- D42 Runtime Threat Enforcement — No Kubernetes/orchestration workloads found in the repository manifests; runtime threat-detection and admission-control policy are cluster-level controls, so there is nothing to assess here.
- D6 Cohesion (LCOM4) — Cohesion (LCOM4) is measured over a C#/VB class graph, and this repository's production source is .fs, .py, which this pass does not read — so no class could be assessed. Not scored — this is a gap in the analyzer, not a finding about this repository.
- D7 Architectural Integrity — no checkable ADRs and no dependency cycles — architectural integrity not assessed
- D8 Code Coverage — Code Coverage not included (time budget)
- D9 Test Distribution — Tests outside the analyzed solution
- DM1 Domain Modelling — applicable but skipped (2/3 markers — below the conservative bar): 40 value object(s); 1 domain event(s)
- ED1 Event-Driven — not run — 0/3 markers found
- ED5 Idempotency — no mutating command handlers or message consumers detected — idempotency check not applicable
- ES1 Event Sourcing — not run — 0/3 markers found
- GD1 Unfinished & placeholder code — no source files
- IC1 Incompleteness & stubs — no C# methods found
- P12 CI test-gate honesty — no data
- P2 Observability — Observability was not assessed: this check reads .NET source (ILogger/Serilog, OpenTelemetry, health checks) and no such source was loaded for this repository — because it is written in another language, or because the solution failed to load. Absence of a .NET logging idiom is NOT evidence that this repo lacks structured logging (it may log through its own ecosystem's logger). This is a gap in the analyzer, not a finding about this repository.
- P5 DR & Backup — not evidenced — repo shows no backup/RTO/RPO controls; absence of evidence is not evidence of a working control
- P7 Outbound HTTP resilience — not applicable — this isn't a service/API/worker
- P8 Schema migrations — no EF Core usage detected
- P9 Domain vs controller coverage — no coverage report found on disk — commit a coverage report in a standard format (Cobertura — `dotnet test --collect:"XPlat Code Coverage"` with a `coverlet.collector` PackageReference (.NET: C#, VB.NET and F# alike), lcov — `swift test --enable-code-coverage` or `xcodebuild -enableCodeCoverage YES` then `xcrun llvm-cov export -format=lcov` (Swift/Xcode), `cargo llvm-cov --lcov`, `go test -coverprofile`, `rebar3 do eunit --cover, cover` or covertool (Erlang/BEAM), `flutter test --coverage` or `dart test --coverage=coverage` then `dart run coverage:format_coverage --lcov` (Dart/Flutter), `sbt clean coverage test coverageReport` via sbt-scoverage (Scala/sbt), jest/nyc, JaCoCo/Cobertura XML, coverage.py … most ecosystems' coverage tools can emit one) anywhere in the repo, or wire coverage collection into CI, to enable this cross-layer check
- PF1 Benchmark discipline — Performance was not assessed: this lens reads .NET source (allocation-aware APIs — Span/Memory, ArrayPool/ObjectPool, stackalloc — and a BenchmarkDotNet suite) and no such source was loaded for this repository, because it is written in another language or the solution failed to load. This is a gap in the analyzer, not a finding about this repository — in particular it is NOT a statement that this repo is unpackaged or performance-careless.
- PF2 Allocation hygiene — Performance was not assessed: this lens reads .NET source (allocation-aware APIs — Span/Memory, ArrayPool/ObjectPool, stackalloc — and a BenchmarkDotNet suite) and no such source was loaded for this repository, because it is written in another language or the solution failed to load. This is a gap in the analyzer, not a finding about this repository — in particular it is NOT a statement that this repo is unpackaged or performance-careless.
- PF3 Async & latency hygiene — Performance was not assessed: this lens reads .NET source (allocation-aware APIs — Span/Memory, ArrayPool/ObjectPool, stackalloc — and a BenchmarkDotNet suite) and no such source was loaded for this repository, because it is written in another language or the solution failed to load. This is a gap in the analyzer, not a finding about this repository — in particular it is NOT a statement that this repo is unpackaged or performance-careless.
- S1 Web-Security Posture — Not assessed: these web-security controls are read from C# source (attributes, middleware, entity/column names, guard methods) and no C# source was loaded for this repository — because it is written in another language, or the solution failed to load. Absence of a .NET idiom is NOT evidence that this repository lacks web-security controls: it may implement them entirely in its own ecosystem. This is a gap in the analyzer's language coverage, not a finding about this repository.
- SC1 Supply-chain hygiene — no data
- X1 Async correctness — no C# methods found
- X2 Cancellation propagation — no C# methods found
- X3 Exception handling — no C# methods found
- X4 Structured logging — no C# methods found
- X5 Nullable reference types — no NRT-eligible projects
Appendix A — Findings (grouped)
Issue — 21 finding(s)
- High: github-actions-mutable-action-tag .github/workflows/add_to_project.yml:37
- High: github-actions-mutable-action-tag .github/workflows/add_to_project.yml:50
- High: github-actions-mutable-action-tag .github/workflows/check_release_notes.yml:21
- High: github-actions-mutable-action-tag .github/workflows/check_release_notes.yml:32
- High: github-actions-mutable-action-tag .github/workflows/check_release_notes.yml:246
- High: github-actions-mutable-action-tag .github/workflows/check_release_notes.yml:255
- High: github-actions-mutable-action-tag .github/workflows/check_release_notes.yml:269
- High: github-actions-mutable-action-tag .github/workflows/commands.yml:18
- High: github-actions-mutable-action-tag .github/workflows/commands.yml:71
- High: github-actions-mutable-action-tag .github/workflows/commands.yml:79
- High: github-actions-mutable-action-tag .github/workflows/commands.yml:88
- High: github-actions-mutable-action-tag .github/workflows/commands.yml:120
- High: github-actions-mutable-action-tag .github/workflows/commands.yml:136
- High: github-actions-mutable-action-tag .github/workflows/commands.yml:144
- High: github-actions-mutable-action-tag .github/workflows/copilot-setup-steps.yml:18
- High: github-actions-mutable-action-tag .github/workflows/repository_lockdown_check.yml:29
- High: github-actions-mutable-action-tag .github/workflows/repository_lockdown_check.yml:38
- High: github-actions-mutable-action-tag .github/workflows/repository_lockdown_check.yml:53
- High: github-actions-mutable-action-tag .github/workflows/repository_lockdown_check.yml:68
- High: github-actions-mutable-action-tag .github/workflows/skill-validation.yml:30
- Dimension evaluation failed
Warning — 24 finding(s)
- Change coupling: filesystem.fsx ↔ tokenizer.fsx docs/fcs/filesystem.fsx
- Change coupling: interactive.fsx ↔ untypedtree.fsx docs/fcs/interactive.fsx
- Change coupling: filesystem.fsx ↔ untypedtree.fsx docs/fcs/filesystem.fsx
- Change coupling: filesystem.fsx ↔ interactive.fsx docs/fcs/filesystem.fsx
- Change coupling: SimplifyNameDiagnosticAnalyzer.fs ↔ UnusedDeclarationsAnalyzer.fs vsintegration/src/FSharp.Editor/Diagnostics/SimplifyNameDiagnosticAnalyzer.fs
- Change coupling: UnusedDeclarationsAnalyzer.fs ↔ UnusedOpensDiagnosticAnalyzer.fs vsintegration/src/FSharp.Editor/Diagnostics/UnusedDeclarationsAnalyzer.fs
- Change coupling: BraceMatchingService.fs ↔ FSharpProjectOptionsManager.fs vsintegration/src/FSharp.Editor/Formatting/BraceMatchingService.fs
- Change coupling: Hints.fs ↔ LanguageService.fs vsintegration/src/FSharp.Editor/Hints/Hints.fs
- Change coupling: Hints.fs ↔ EditorOptions.fs vsintegration/src/FSharp.Editor/Hints/Hints.fs
- Duplicated block (7 lines × 2) buildtools/fslex/fslexlex.fs:23
- Duplicated block (7 lines × 2) buildtools/fslex/fslexlex.fs:344
- Unpinned build actions
- Duplicated block (44 lines × 2) buildtools/fslex/Lexing.fsi:10
- Duplicated block (37 lines × 2) buildtools/fslex/Parsing.fs:412
- Duplicated block (32 lines × 2) buildtools/fslex/Parsing.fsi:39
- Duplicated block (22 lines × 2) buildtools/fslex/Lexing.fs:73
- Duplicated block (20 lines × 2) buildtools/fslex/Arg.fsi:14
- Duplicated block (17 lines × 2) buildtools/fslex/Arg.fs:65
- Duplicated block (15 lines × 2) buildtools/fslex/Arg.fs:18
- Duplicated block (12 lines × 2) .github/skills/fsharp-diagnostics/server/Server.fs:135
- Duplicated block (10 lines × 2) buildtools/fslex/fslexdriver.fs:134
- Duplicated block (9 lines × 2) buildtools/fslex/fslexdriver.fs:73
- Duplicated block (5 lines × 2) buildtools/fsyacc/fsyaccast.fs:313
- Tests outside the analyzed solution
Recommendation — 11 finding(s)
- Test reliability not included
- complexity unreadable for .cs, .fs, .py, .vb — churn × complexity hotspots could not be measured
- Off-boarding risk: anonymized user #1
- Further sole-owners (lower concentration)
- The README is a single-file 'Why do we test' doc with no concrete guidance on how to contribute new tests or run existing ones. README.md
- No ADRs found
- knowledge concentrated in recent work — freshness signal contradicted by repo activity
- No build provenance
- No artifact signing
- No SBOM
- Code Coverage not included (time budget)
Info — 2 finding(s)
- Dependency hygiene not measured — this repository's dependencies are not NuGet
- No exposed public API
Appendix B — Reproduction & audit trail
| Dimension | Tool | Version | Command | Findings | Raw output |
|---|---|---|---|---|---|
| D28 · Secrets (history) | gitleaks | — | gitleaks detect --no-banner --report-format json --report-path /dev/stdout --exit-code 0 --source . | 0 | artifacts/raw/gitleaks-history.json |
| D29 · Static Analysis (SAST) | semgrep | — | semgrep --config /opt/semgrep-rules/security-audit.yml --config /opt/semgrep-rules/owasp-top-ten.yml --json --quiet --timeout 0 --metrics off . | 20 | artifacts/raw/semgrep.json |
| D30 · Dependency Vulnerabilities | dotnet | — | dotnet: not applicable — the solution did not restore on the analyzer's .NET SDK (an SDK/target-framework/restore mismatch, common for an older codebase), so there was no restored dependency graph to scan for NuGet CVEs — excluded rather than scored; re-run on an SDK that can restore this solution | 0 | — |
| D31 · IaC & Container Security | trivy | — | trivy: not applicable — No Infrastructure-as-Code or container manifests found (Dockerfile, Terraform, Kubernetes/Helm, CloudFormation); nothing to scan. | 0 | — |
| D32 · Data Compliance (PII/GDPR) | semgrep | — | semgrep: not applicable — No PII/GDPR ruleset is bundled (the public p/gdpr semgrep pack was retired) — data compliance is not assessed in this scan. | 0 | — |
| D33 · JS/npm Dependency Vulnerabilities | trivy | — | trivy: not applicable — No JS/npm manifest or lockfile found outside bin/obj (package.json, package-lock.json, yarn.lock, pnpm-lock.yaml, bun.lockb); no JS dependencies to scan. | 0 | — |
| D37 · Vulnerability-disclosure Policy | disclosure | — | disclosure: not applicable — No vulnerability-disclosure policy file found (SECURITY.md/.markdown/.rst/.txt at root or under .github/.forgejo/.gitea/docs, .well-known/security.txt). A coordinated-disclosure policy may live off-repo, so this is not evidenced rather than failed. | 0 | — |
| D38 · OSV Dependency Vulnerabilities | osv-scanner | — | osv-scanner: not applicable — No JS/npm lockfile found outside bin/obj (package-lock.json, yarn.lock, pnpm-lock.yaml, bun.lockb); nothing for OSV to scan. | 0 | — |
| D40 · Network Egress Confinement | runtime-hardening | — | runtime-hardening: not applicable — No Kubernetes/orchestration workloads found in the repository manifests; network egress policy is a cluster-native control that may live at the platform/firewall layer, so there is nothing to assess here. | 0 | — |
| D41 · Kernel & Syscall Confinement | runtime-hardening | — | runtime-hardening: not applicable — No Kubernetes/orchestration workloads found in the repository manifests; seccomp/AppArmor/SELinux confinement is a workload-level control, so there is nothing to assess here. | 0 | — |
| D42 · Runtime Threat Enforcement | runtime-hardening | — | runtime-hardening: not applicable — No Kubernetes/orchestration workloads found in the repository manifests; runtime threat-detection and admission-control policy are cluster-level controls, so there is nothing to assess here. | 0 | — |