open/llm-ingestion-okf
1
0
Fork 0
Code Issues Releases 4 Activity

test(fixtures): the STS fixtures and fixture codes are fictitious

Browse source 
Three STS fixtures still carried the section titles and labels of one real
reference document, and three identifiers were copies of its codes with a
letter or a word swapped. They now describe an invented kitchen counter and
cookbook series: the titles, labels and descriptions of sts-identity.xml,
sts-inherit.xml and sts-empty-label.xml, the P350/P351 document codes, the
99-0001 delivery prefix and chapter 7 of the image and accounting corpora.
Generated fixtures are regenerated and the witness inventory's per-document
totals are identical before and after; only names and text move.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Kjell Tore Guttormsen 2026-09-23 14:50:44 +02:00
commit 88cf67f12e
65 changed files with 396 additions and 390 deletions
Download patch file Download diff file Expand all files Collapse all files

2
tests/fixtures/accounting/corpus/bilde.rtf vendored
View file

@ -1 +1 @@
{\rtf1\ansi\deff0{\fonttbl{\f0 Times New Roman;}}\pard Figur 84-1 viser prinsippet.\par\pard{\pict\pngblip\picw16\pich16 89504e470d0a1a0a}\par}
{\rtf1\ansi\deff0{\fonttbl{\f0 Times New Roman;}}\pard Figur 7-1 viser prinsippet.\par\pard{\pict\pngblip\picw16\pich16 89504e470d0a1a0a}\par}

6
tests/fixtures/accounting/corpus/figur.html vendored
View file

@ -1,10 +1,10 @@
<!DOCTYPE html>
<html lang="no">
<head><title>Figur 84-1</title></head>
<head><title>Figur 7-1</title></head>
<body>
<h1>Figur 84-1</h1>
<h1>Figur 7-1</h1>
<p>Prinsippet for hevetidsklasser.</p>
<img src="graphics/figur-84-1.png" alt="Prinsippskisse">
<img src="graphics/figur-7-1.png" alt="Prinsippskisse">
<table><tr><th>Klasse</th><th>Avvik</th></tr><tr><td>A</td><td>5 min</td></tr></table>
<ul><li>Klasse A</li><li>Klasse B</li></ul>
</body>

0
tests/fixtures/accounting/corpus/graphics/figur-84-1.png → tests/fixtures/accounting/corpus/graphics/figur-7-1.png vendored
View file

Side by side Swipe Overlay

Before

Width:  |  Height:  |  Size: 94 B

After

Width:  |  Height:  |  Size: 94 B

Before After
Before After

0
tests/fixtures/accounting/corpus/graphics/tabell-84-2.png → tests/fixtures/accounting/corpus/graphics/tabell-7-2.png vendored
View file

Side by side Swipe Overlay

Before

Width:  |  Height:  |  Size: 122 B

After

Width:  |  Height:  |  Size: 122 B

Before After
Before After

BIN
tests/fixtures/accounting/corpus/kapittel-7-notat.docx vendored Normal file
View file

Binary file not shown.

0
tests/fixtures/accounting/corpus/kapittel-84-presentasjon.pptx → tests/fixtures/accounting/corpus/kapittel-7-presentasjon.pptx vendored
View file

18
tests/fixtures/accounting/corpus/kapittel-7-sts.xml vendored Normal file
View file

@ -0,0 +1,18 @@
<?xml version="1.0" encoding="UTF-8"?>
<standard xmlns:xlink="http://www.w3.org/1999/xlink">
<front><std-ident><doc-number>P350</doc-number></std-ident></front>
<body>
<sec>
<label>7</label>
<title>Brød og boller</title>
<sec>
<label>7.1</label>
<title>Hevetider</title>
<p>Hevetidsklasse er gitt i tabell 7-2.</p>
<graphic xlink:href="graphics/tabell-7-2.png"/>
<p>Figur 7-1 viser prinsippet.</p>
<graphic xlink:href="figur-7-1.png"/>
</sec>
</sec>
</body>
</standard>

BIN
tests/fixtures/accounting/corpus/kapittel-84-tabell.pdf → tests/fixtures/accounting/corpus/kapittel-7-tabell.pdf vendored
View file

Binary file not shown.

14
tests/fixtures/accounting/corpus/kapittel-7-web.html vendored Normal file
View file

@ -0,0 +1,14 @@
<!doctype html>
<html><head><title>Kapittel 7</title></head>
<body>
<h1>7 Brød og boller</h1>
<p>Hevetidsklasse for de enkelte deigtyper er gitt i tabell 7-2.</p>
<img src="graphics/tabell-7-2.png" alt="Tabell 7-2 Hevetidsklasser">
<p>Figuren under viser prinsippet.</p>
<figure>
<img src="graphics/figur-7-1.png" alt="Figur 7-1 Prinsippskisse">
<figcaption>Figur 7-1 Prinsippskisse</figcaption>
</figure>
<p>Og en som ligger et annet sted:</p>
<img src="https://example.invalid/ekstern.png" alt="Ekstern figur">
</body></html>

BIN
tests/fixtures/accounting/corpus/kapittel-84-notat.docx vendored
View file

Binary file not shown.

18
tests/fixtures/accounting/corpus/kapittel-84-sts.xml vendored
View file

@ -1,18 +0,0 @@
<?xml version="1.0" encoding="UTF-8"?>
<standard xmlns:xlink="http://www.w3.org/1999/xlink">
<front><std-ident><doc-number>P761</doc-number></std-ident></front>
<body>
<sec>
<label>84</label>
<title>Brød og boller</title>
<sec>
<label>84.1</label>
<title>Hevetider</title>
<p>Hevetidsklasse er gitt i tabell 84-2.</p>
<graphic xlink:href="graphics/tabell-84-2.png"/>
<p>Figur 84-1 viser prinsippet.</p>
<graphic xlink:href="figur-84-1.png"/>
</sec>
</sec>
</body>
</standard>

14
tests/fixtures/accounting/corpus/kapittel-84-web.html vendored
View file

@ -1,14 +0,0 @@
<!doctype html>
<html><head><title>Kapittel 84</title></head>
<body>
<h1>84 Brød og boller</h1>
<p>Hevetidsklasse for de enkelte deigtyper er gitt i tabell 84-2.</p>
<img src="graphics/tabell-84-2.png" alt="Tabell 84-2 Hevetidsklasser">
<p>Figuren under viser prinsippet.</p>
<figure>
<img src="graphics/figur-84-1.png" alt="Figur 84-1 Prinsippskisse">
<figcaption>Figur 84-1 Prinsippskisse</figcaption>
</figure>
<p>Og en som ligger et annet sted:</p>
<img src="https://example.invalid/ekstern.png" alt="Ekstern figur">
</body></html>

BIN
tests/fixtures/accounting/corpus/liste-og-bilde.odt vendored
View file

Binary file not shown.

4
tests/fixtures/accounting/corpus/mengder.csv vendored
View file

@ -1,3 +1,3 @@
Post,Mengde,Enhet
84.1,120,m3
84.2,45,m2
7.1,120,m3
7.2,45,m2

1 Post Mengde Enhet
2 84.1 7.1 120 m3
3 84.2 7.2 45 m2

2
tests/fixtures/accounting/corpus/notat.md vendored
View file

@ -11,7 +11,7 @@ Vask skjer to ganger i året.
| Øverst | 6 mnd |
| Nederst | 12 mnd |
![Figur 1 Vaskeplan](graphics/tabell-84-2.png)
![Figur 1 Vaskeplan](graphics/tabell-7-2.png)
```bash
# ikke en overskrift

BIN
tests/fixtures/accounting/corpus/notater-og-skjult.pptx vendored
View file

Binary file not shown.

2
tests/fixtures/accounting/corpus/side.htm vendored
View file

@ -3,7 +3,7 @@
<body>
<h1>Ovnen</h1>
<p>Steketemperaturen er 145 grader.</p>
<img src="graphics/tabell-84-2.png" alt="Hyllekart">
<img src="graphics/tabell-7-2.png" alt="Hyllekart">
<h2>Hyller</h2>
<ul><li>Øverst</li><li>Nederst</li></ul>
<table><tr><th>Hylle</th><th>Temperatur</th></tr><tr><td>Øverst</td><td>180 C</td></tr></table>

4
tests/fixtures/accounting/corpus/sts-rikt.xml vendored
View file

@ -1,11 +1,11 @@
<standard>
<front><std-ident><doc-number>P762</doc-number><year>2025</year></std-ident></front>
<front><std-ident><doc-number>P351</doc-number><year>2025</year></std-ident></front>
<body>
<sec><label>85</label><title>Bakeplater</title>
<p>Platen skal ha jevn varme etter <mixed-citation>EKS 1234-1:2030</mixed-citation>.</p>
<p>Kravet regnes som <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mi>T</mml:mi><mml:mo>&lt;</mml:mo><mml:mn>2</mml:mn></mml:math>.</p>
<fig><label>Figur 85-1</label><caption><p>Maalepunkter langs bakeplaten.</p></caption>
<graphic xlink:href="figur-84-1.png" xmlns:xlink="http://www.w3.org/1999/xlink"/></fig>
<graphic xlink:href="figur-7-1.png" xmlns:xlink="http://www.w3.org/1999/xlink"/></fig>
<table-wrap><label>Tabell 85-1</label>
<table><tr><th>Klasse</th><th>T</th></tr><tr><td>1</td><td>1,5</td></tr></table>
</table-wrap>

112
tests/fixtures/accounting/inventory.json vendored
View file

@ -22,7 +22,7 @@
],
"paragraph": [
[
"Figur 84-1 viser prinsippet."
"Figur 7-1 viser prinsippet."
],
[]
],
@ -42,8 +42,8 @@
"images": [
{
"kind": "local",
"ref": "graphics/figur-84-1.png",
"target": "graphics/figur-84-1.png"
"ref": "graphics/figur-7-1.png",
"target": "graphics/figur-7-1.png"
}
],
"suffix": ".html",
@ -64,7 +64,7 @@
],
"heading": [
[
"Figur 84-1"
"Figur 7-1"
]
],
"image": [
@ -94,7 +94,7 @@
},
"witness": "html.parser"
},
"kapittel-84-notat.docx": {
"kapittel-7-notat.docx": {
"elements": {
"cell": 0,
"comment": 0,
@ -127,7 +127,7 @@
],
"paragraph": [
[
"Hevetidsklasse er gitt i tabell 84-2."
"Hevetidsklasse er gitt i tabell 7-2."
],
[
"Etter tabellen kommer steketidene."
@ -138,7 +138,7 @@
},
"witness": "docx zip xml"
},
"kapittel-84-presentasjon.pptx": {
"kapittel-7-presentasjon.pptx": {
"elements": {
"cell": 0,
"hidden_slide": 0,
@ -179,7 +179,7 @@
},
"witness": "pptx zip xml"
},
"kapittel-84-sts.xml": {
"kapittel-7-sts.xml": {
"elements": {
"cell": 0,
"citation": 0,
@ -199,13 +199,13 @@
"images": [
{
"kind": "local",
"ref": "graphics/tabell-84-2.png",
"target": "graphics/tabell-84-2.png"
"ref": "graphics/tabell-7-2.png",
"target": "graphics/tabell-7-2.png"
},
{
"kind": "local",
"ref": "figur-84-1.png",
"target": "graphics/figur-84-1.png"
"ref": "figur-7-1.png",
"target": "graphics/figur-7-1.png"
}
],
"suffix": ".xml",
@ -223,34 +223,34 @@
"math": [],
"paragraph": [
[
"Hevetidsklasse er gitt i tabell 84-2."
"Hevetidsklasse er gitt i tabell 7-2."
],
[
"Figur 84-1 viser prinsippet."
"Figur 7-1 viser prinsippet."
]
],
"section": [
[
"84.1",
"7.1",
"Hevetider",
"Hevetidsklasse er gitt i tabell 84-2.",
"Figur 84-1 viser prinsippet."
"Hevetidsklasse er gitt i tabell 7-2.",
"Figur 7-1 viser prinsippet."
],
[
"84",
"7",
"Brød og boller",
"84.1",
"7.1",
"Hevetider",
"Hevetidsklasse er gitt i tabell 84-2.",
"Figur 84-1 viser prinsippet."
"Hevetidsklasse er gitt i tabell 7-2.",
"Figur 7-1 viser prinsippet."
]
],
"section_label": [
[
"84"
"7"
],
[
"84.1"
"7.1"
]
],
"table": [],
@ -266,7 +266,7 @@
},
"witness": "xml.etree"
},
"kapittel-84-tabell.pdf": {
"kapittel-7-tabell.pdf": {
"elements": {
"image": 2,
"page": 1
@ -291,13 +291,13 @@
],
"page": [
[
"Hevetidsklasse er gitt i tabell 84-2"
"Hevetidsklasse er gitt i tabell 7-2"
]
]
},
"witness": "pdfplumber objects"
},
"kapittel-84-web.html": {
"kapittel-7-web.html": {
"elements": {
"cell": 0,
"heading": 1,
@ -309,13 +309,13 @@
"images": [
{
"kind": "local",
"ref": "graphics/tabell-84-2.png",
"target": "graphics/tabell-84-2.png"
"ref": "graphics/tabell-7-2.png",
"target": "graphics/tabell-7-2.png"
},
{
"kind": "local",
"ref": "graphics/figur-84-1.png",
"target": "graphics/figur-84-1.png"
"ref": "graphics/figur-7-1.png",
"target": "graphics/figur-7-1.png"
},
{
"kind": "remote",
@ -328,7 +328,7 @@
"cell": [],
"heading": [
[
"84 Brød og boller"
"7 Brød og boller"
]
],
"image": [
@ -339,7 +339,7 @@
"list_item": [],
"paragraph": [
[
"Hevetidsklasse for de enkelte deigtyper er gitt i tabell 84-2."
"Hevetidsklasse for de enkelte deigtyper er gitt i tabell 7-2."
],
[
"Figuren under viser prinsippet."
@ -1047,7 +1047,7 @@
"texts": {
"cell": [
[
"84.1"
"7.1"
],
[
"120"
@ -1056,7 +1056,7 @@
"m3"
],
[
"84.2"
"7.2"
],
[
"45"
@ -1078,12 +1078,12 @@
],
"row": [
[
"84.1",
"7.1",
"120",
"m3"
],
[
"84.2",
"7.2",
"45",
"m2"
]
@ -1103,8 +1103,8 @@
"images": [
{
"kind": "local",
"ref": "graphics/tabell-84-2.png",
"target": "graphics/tabell-84-2.png"
"ref": "graphics/tabell-7-2.png",
"target": "graphics/tabell-7-2.png"
}
],
"suffix": ".md",
@ -1170,13 +1170,13 @@
"Post"
],
[
"84.1"
"7.1"
],
[
"Post"
],
[
"84.1"
"7.1"
]
],
"hidden_slide": [
@ -1184,7 +1184,7 @@
"Utgaatt lysbilde",
"Ikke vis dette.",
"Post",
"84.1"
"7.1"
]
],
"image": [],
@ -1203,25 +1203,25 @@
],
"slide": [
[
"Kapittel 84 Boller",
"Kapittel 7 Boller",
"Hevetider er gitt i tabell.",
"Post",
"84.1"
"7.1"
]
],
"table": [
[
"Post",
"84.1"
"7.1"
],
[
"Post",
"84.1"
"7.1"
]
],
"title": [
[
"Kapittel 84 Boller"
"Kapittel 7 Boller"
],
[
"Utgaatt lysbilde"
@ -1429,8 +1429,8 @@
"images": [
{
"kind": "local",
"ref": "graphics/tabell-84-2.png",
"target": "graphics/tabell-84-2.png"
"ref": "graphics/tabell-7-2.png",
"target": "graphics/tabell-7-2.png"
}
],
"suffix": ".htm",
@ -1586,8 +1586,8 @@
"images": [
{
"kind": "local",
"ref": "figur-84-1.png",
"target": "graphics/figur-84-1.png"
"ref": "figur-7-1.png",
"target": "graphics/figur-7-1.png"
}
],
"suffix": ".xml",
@ -1795,18 +1795,18 @@
}
},
"files": {
"graphics/figur-84-1.png": {
"graphics/figur-7-1.png": {
"pointed_at_by": [
"figur.html",
"kapittel-84-sts.xml",
"kapittel-84-web.html",
"kapittel-7-sts.xml",
"kapittel-7-web.html",
"sts-rikt.xml"
]
},
"graphics/tabell-84-2.png": {
"graphics/tabell-7-2.png": {
"pointed_at_by": [
"kapittel-84-sts.xml",
"kapittel-84-web.html",
"kapittel-7-sts.xml",
"kapittel-7-web.html",
"notat.md",
"side.htm"
]

18
tests/fixtures/accounting/make_accounting_fixtures.py vendored
View file

@ -124,7 +124,7 @@ def _slide(title: str, body: str, *, hidden: bool = False) -> str:
+ 'uri="http://schemas.openxmlformats.org/drawingml/2006/table">'
+ "<a:tbl><a:tr>"
+ "<a:tc><a:txBody><a:p><a:r><a:t>Post</a:t></a:r></a:p></a:txBody></a:tc>"
+ "<a:tc><a:txBody><a:p><a:r><a:t>84.1</a:t></a:r></a:p></a:txBody></a:tc>"
+ "<a:tc><a:txBody><a:p><a:r><a:t>7.1</a:t></a:r></a:p></a:txBody></a:tc>"
+ "</a:tr></a:tbl></a:graphicData></a:graphic></p:graphicFrame>"
+ "</p:spTree></p:cSld></p:sld>"
)
@ -164,7 +164,7 @@ _PPTX_PARTS: dict[str, str | bytes] = {
+ f"<p:presentation {_P}><p:sldIdLst>"
+ '<p:sldId id="256" r:id="rId1"/><p:sldId id="257" r:id="rId2"/>'
+ "</p:sldIdLst></p:presentation>",
"ppt/slides/slide1.xml": _slide("Kapittel 84 Boller", "Hevetider er gitt i tabell."),
"ppt/slides/slide1.xml": _slide("Kapittel 7 Boller", "Hevetider er gitt i tabell."),
"ppt/slides/slide2.xml": _slide("Utgaatt lysbilde", "Ikke vis dette.", hidden=True),
"ppt/notesSlides/notesSlide1.xml": _XML
+ f"<p:notes {_P} {_A}><p:cSld><p:spTree><p:sp><p:txBody>"
@ -272,7 +272,7 @@ _ODT_PARTS: dict[str, str | bytes] = {
+ "<text:list><text:list-item><text:p>Kant</text:p></text:list-item>"
+ "<text:list-item><text:p>Flate</text:p></text:list-item></text:list>"
+ "<text:p>Se figuren under."
+ '<draw:frame><draw:image xlink:href="graphics/figur-84-1.png"/></draw:frame></text:p>'
+ '<draw:frame><draw:image xlink:href="graphics/figur-7-1.png"/></draw:frame></text:p>'
+ "<office:annotation><text:p>Sjekk denne mot Q400 foer utsendelse.</text:p>"
+ "</office:annotation>"
+ "<table:table><table:table-row>"
@ -294,7 +294,7 @@ _ODT_PARTS: dict[str, str | bytes] = {
_RTF = (
r"{\rtf1\ansi\deff0{\fonttbl{\f0 Times New Roman;}}"
r"\pard Figur 84-1 viser prinsippet.\par"
r"\pard Figur 7-1 viser prinsippet.\par"
r"\pard{\pict\pngblip\picw16\pich16 89504e470d0a1a0a}\par"
"}"
)
@ -304,11 +304,11 @@ _RTF = (
_HTML = """<!DOCTYPE html>
<html lang="no">
<head><title>Figur 84-1</title></head>
<head><title>Figur 7-1</title></head>
<body>
<h1>Figur 84-1</h1>
<h1>Figur 7-1</h1>
<p>Prinsippet for hevetidsklasser.</p>
<img src="graphics/figur-84-1.png" alt="Prinsippskisse">
<img src="graphics/figur-7-1.png" alt="Prinsippskisse">
<table><tr><th>Klasse</th><th>Avvik</th></tr><tr><td>A</td><td>5 min</td></tr></table>
<ul><li>Klasse A</li><li>Klasse B</li></ul>
</body>
@ -319,13 +319,13 @@ _HTML = """<!DOCTYPE html>
# --- sts: a citation, a formula, a figure with a caption, a table, a footnote -
_STS = """<standard>
<front><std-ident><doc-number>P762</doc-number><year>2025</year></std-ident></front>
<front><std-ident><doc-number>P351</doc-number><year>2025</year></std-ident></front>
<body>
<sec><label>85</label><title>Bakeplater</title>
<p>Platen skal ha jevn varme etter <mixed-citation>EKS 1234-1:2030</mixed-citation>.</p>
<p>Kravet regnes som <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mi>T</mml:mi><mml:mo>&lt;</mml:mo><mml:mn>2</mml:mn></mml:math>.</p>
<fig><label>Figur 85-1</label><caption><p>Maalepunkter langs bakeplaten.</p></caption>
<graphic xlink:href="figur-84-1.png" xmlns:xlink="http://www.w3.org/1999/xlink"/></fig>
<graphic xlink:href="figur-7-1.png" xmlns:xlink="http://www.w3.org/1999/xlink"/></fig>
<table-wrap><label>Tabell 85-1</label>
<table><tr><th>Klasse</th><th>T</th></tr><tr><td>1</td><td>1,5</td></tr></table>
</table-wrap>