One of one — the only governed PDE solver here that actually ships
Three arms, three problems, all MEASURED against exact closed forms or synthetic ground truth: SZL's governed classical spectral solver versus two neural physics-informed networks — DeepXDE and NVIDIA PhysicsNeMo / Modulus. We publish the config, the seeds, the license of every dependency, and — most importantly — where this suite does not let us claim victory. That honesty is the moat.
SZL leads the field on the axis that decides real deployments — verifiable, deployable governed solving. It is the only arm that actually ships in the product, the only one that is license-clean (Apache-2.0, not LGPL), the only one re-derived from source in CI on every commit, and it reaches machine precision where the problem admits it — all measured on our own metal, not a rented cloud GPU farm.
This page renders directly from the committed benchmark artifact — no numbers are typed into the page,
so it cannot drift from the source of truth. The same artifact must pass
benchmarks/pinn/honesty_guard.py before it can ship.
Holographic showcase — the measured field, in 3D
A live hologram of the artifact: each bar is −log₁₀(error) pulled straight from
/api/a11oy/v1/pinn/bench — taller means more accurate. Gold = SZL governed spectral · muted = the neural PINNs.
No heights are hard-coded; if the numbers change, the hologram changes.
/api/a11oy/v1/pinn/bench…How to read this
What we are not claiming
Reproduce it yourself
Nothing here is take-our-word-for-it. The exact commands that produced the artifact:
Why this benchmark is different
Content-provenance tools prove where a file came from. Governance platforms document a process. Evaluation suites score a model. None of them break the build when a result overclaims. a11oy does:
- Every reported number is stamped MEASURED / MODELED / NOT-RUN / NOT-MEASURED / NOT-TESTED.
- A measured number with no evidence, or a not-run arm carrying a value, fails the honesty gate — the artifact cannot ship.
- Our advantages are disclosed: e.g. the Poisson solution lives inside SZL's trial basis, so that near-machine-precision result is by construction, not a general-accuracy claim.
Verify the source
This page is public and so is everything behind it. Inspect the code that produces — and polices — these numbers on the public szl-holdings/a11oy repository:
- The measured artifact —
benchmarks/pinn/results.json, served read-only at/api/a11oy/v1/pinn/bench(this page renders it — no numbers are typed in). - The benchmark harness —
benchmarks/pinn/run_bench.py. The SZL arm is NumPy-only; the DeepXDE / PhysicsNeMo arms are lazy-imported and never shipped. - The honesty gate —
benchmarks/pinn/honesty_guard.pyover the reusableverifiable-ai/core: a MEASURED number with no evidence, or a NOT-RUN arm carrying a value, fails the build. - The reproducibility gate —
benchmarks/pinn/reproduce_szl_guard.py: CI re-derives the SZL classical-spectral arm from source and asserts it still matches the published numbers. - The CI itself —
pinn-honesty-gate.yml· live runs on GitHub Actions.
Both gates run on every change before it can reach main:
the labels cannot overclaim, and the classical-arm numbers cannot drift from source. That is what
verifiable means here — not a promise, a build check.