Every claim on this site is one of four kinds, and this page shows where each kind comes from: code that was run, a repository that was read, documentation that was read on a stated date, or the author's own report. If a page says something that is not traceable to one of these, that is a defect; the About page explains the label convention.
What was run#
All examples are standard-library Python 3.14, run on 2026-11-20 with no network, no API key and no model call. Where a model would act, a scripted stand-in plays its part.
| Example | Command | Result on 2026-11-20 |
|---|---|---|
| A assembly line | cd examples/a-assembly-line && python3 -m unittest discover -s tests -t . | 14 tests OK; two runs give byte-identical manifests |
| B algorithm unit factory | same, in examples/b-algorithm-factory | 32 tests OK; Python, Node v26.3.1 and Java 23.0.1 agree on all 10 shared fixture cases |
| C insurance service factory | same, in examples/c-insurance-service, then python3 ci_checks.py | 50 tests OK; four CI gates pass |
| D factory supervisor | same, in examples/d-supervisor, then sh check_repro.sh | 21 tests OK; resume after a crash writes nothing twice |
| Batch simulator and cost model | same, in examples/sim | tests OK; JavaScript port equal on every parity vector |
| WatchAlgo inventory adapter | python3 examples/watchalgo-adapter/inventory.py (read-only) | counts in the evidence summary below |
The labs re-run the same logic in the browser; node scripts/test_factory_core.mjs checks that the JavaScript gives the same results as the Python on every recorded vector. Simulator values are hypothetical and labelled "simulated, illustrative" wherever they appear.
Not run here, and said so on the pages that show them: Pydantic, Jakarta Bean Validation, Pact, Testcontainers, the CI products, the workflow engines, LangGraph, the Claude Agent SDK, Claude Code and Codex. Their samples are "documented shape; not run here", written from their documentation read on the date below.
The WatchAlgo evidence, in brief#
The WatchAlgo repositories were read with read-only commands on 2026-11-20 and nothing in them was changed. The full matrix, with every path and commit, is docs/EVIDENCE.md in this site's repository; the chapters cite the same paths.
| Claim | Observed in the repository | Reported by the author |
|---|---|---|
| Problem count | 3,246 well-formed wa-NNNNNN folders with a problem.json; one more, empty folder named by an unexpanded shell expression | 3,246 implemented problems |
| Solutions and visualizations | 2,773 units with solution.json; 2,380 with visualization.json; all 2,380 complete units have three flavors and three languages | descriptions, solutions and visualizations for all of them |
| Three flavors | narrative styles technical, fun, spiritual; code separately in JavaScript, Python and Java | three flavors |
| Specialized agents per station | queue pipeline scripts and commit messages describe solution and visualization tasks run by command-line agent workers, verified after each task | specialized agents handled station responsibilities |
| 30+ hour runs | the September supervisor log spans 62 hours, with two productive windows of roughly a day each; checkpoint commits every 30 minutes; account usage-limit messages, not context windows, end the runs | 30+ hour sessions until token limits required intervention |
| Telemetry | no per-session token, cost or duration telemetry was found | (none claimed) |
Time spans between log lines or commits are not measurements of how long an agent worked. The WatchAlgo chapter explains each row.
Outside sources and the date they were read#
Every source below was read on 2026-11-20 on its official site. A second, independent reader re-fetched every surprising item (renames, deprecations, new versions) the same day: 85 confirmed, 3 corrected, 2 not checked and not used. Per-page claims are logged in docs/facts/<page>.md.
| Subject | Kind | Official source |
|---|---|---|
| Agentic Engineering (Martin Fowler) | article | martinfowler.com |
| Harness engineering for coding agent users | article | martinfowler.com |
| Humans and Agents in Software Engineering Loops | article | martinfowler.com |
| Structured-Prompt-Driven Development | article | martinfowler.com |
| Platforms white paper (CNCF TAG App Delivery) | guideline | tag-app-delivery.cncf.io |
| Software product lines (Carnegie Mellon SEI) | guideline | sei.cmu.edu |
| Architecture decision records | pattern | adr.github.io |
| Backstage software templates | open-source project | backstage.io |
| Cookiecutter | open-source project | cookiecutter.readthedocs.io |
| Yeoman | open-source project | yeoman.io |
| GitHub Actions | product | docs.github.com |
| GitLab CI/CD | product | docs.gitlab.com |
| Jenkins Pipeline | open-source project | jenkins.io |
| Temporal | open-source project | docs.temporal.io |
| Argo Workflows | open-source project | argo-workflows.readthedocs.io |
| Prefect | open-source project | prefect.io |
| Dagster | open-source project | dagster.io |
| LangGraph | open-source project | docs.langchain.com |
| Claude Agent SDK | product | code.claude.com |
| Claude Code | product | code.claude.com |
| Codex | product | learn.chatgpt.com |
| OpenAPI | specification | spec.openapis.org |
| JSON Schema | specification | json-schema.org |
| Pydantic | open-source project | pydantic.dev |
| Jakarta Validation | specification | jakarta.ee |
| Pact | open-source project | docs.pact.io |
| Testcontainers | open-source project | testcontainers.com |
| SLSA | specification | slsa.dev |
| in-toto | specification | in-toto.io |
| Sigstore | open-source project | docs.sigstore.dev |
| SPDX and CycloneDX | standard | spdx.dev, cyclonedx.org |
| NIST SSDF | guideline | csrc.nist.gov |
| OWASP GenAI Security Project | guideline | genai.owasp.org |
| OpenTelemetry | open-source project | opentelemetry.io |
| DORA metrics | guideline | dora.dev |
Facts that could not be verified#
These are worded on the pages as unverified, or left out.
| Item | Why |
|---|---|
| The ISO status of SPDX | iso.org refused automated reading; the pages cite SPDX's own announcement only |
| Default retry values in Dagster and Prefect; LangGraph's default durability mode | the documentation read here does not say |
| Codex install commands and default approval policy | not reached on the pages read |
Parts of the Claude Code hooks page, the Jakarta Validation Validator signatures, the Jenkins input step | pages too long to read in full; nothing from the unread parts is stated |
| Authors and date of the CNCF platforms white paper | the page shows neither |
| How the 3,246 WatchAlgo problem statements were generated | no record was found in any repository or history |
| Token use, cost and duration of WatchAlgo sessions | no telemetry exists; the author's estimates are labelled as estimates |
| Who reviewed WatchAlgo content | the review files found are model-written reviews; no human review record was found |