LDC-E1316 — A test that asserts nothing
For LLMs5 sections
What it means
Section titled “What it means”A test that asks a question but checks no answer always passes — and
therefore proves nothing. The question runs, the result fields come
back, and nobody reads them. The compiler refuses the vacuous test
rather than counting a free pass: an evaluate without expect
addresses result fields nobody asked to verify.
The repair is to assert what the question must produce. Every evaluation step deserves at least one expectation; a step nobody checks is a step the suite could delete without noticing.
Example
Section titled “Example”{"argv": ["lower-test", "$ROOT/test.lawtest"], "files": {"test.lawtest": "language \"law.core\" version \"0.2\";\npackage demo.diagnostics version \"0.1.0\";\nnamespace \"urn:law:demo:diagnostics\";\n\nrelation sunny() kind institutional;\n\ntest \"vacuous\" {\n given {\n context {\n legal_time @2026-08-26;\n }\n }\n\n evaluate truth(sunny());\n}\n"}, "expect": "LDC-E1316"}{"argv": ["lower-test", "$ROOT/test.lawtest"], "files": {"test.lawtest": "language \"law.core\" version \"0.2\";\npackage demo.diagnostics version \"0.1.0\";\nnamespace \"urn:law:demo:diagnostics\";\n\nrelation sunny() kind institutional;\n\ntest \"vacuous\" {\n given {\n context {\n legal_time @2026-08-26;\n }\n }\n\n evaluate truth(sunny());\n\n expect evaluation_status == COMPUTED;\n}\n"}, "expect": null}Documentation for Arxo. Writings — blog.arxo.io.
Anonymous visit counts on stats.arxo.io, no cookies.