feat(coverage): coverage script parsing files from ported_from markers

[winsvega]

🗒️ Description

add new fill plugin that prints information from ported_from marker

uv run fill --show-ported-from tests/
uv run fill --show-ported-from --links-as-filled tests/

🔗 Related Issues

#1631

✅ Checklist

• All: Set appropriate labels for the changes.
• All: Considered squashing commits to improve commit history.
• All: Added an entry to CHANGELOG.md.
• All: Considered updating the online docs in the ./docs/ directory.
• Tests: All converted JSON/YML tests from ethereum/tests have been added to converted-ethereum-tests.txt.
• Tests: A PR with removal of converted JSON/YML tests from ethereum/tests have been opened.
• Tests: Included the type and version of evm t8n tool used to locally execute test cases: e.g., ref with commit hash or geth 1.13.1-stable-3f40e65.
• Tests: Ran mkdocs serve locally and verified the auto-generated docs for new tests in the Test Case Reference are correctly formatted.
• Tests: For PRs implementing a missed test case, update the post-mortem document to add an entry the list.

[danceratopz]

Awesome, that you got this working, but I'm not sure a standalone script is the right approach.

I would suggest to make this part of a pytest plugin, as pytest understands its marker structure and can easily extract the information.

A plugin has the advantage that you filter tests that you collect information from using pytest's standard features.

I got Claude to draft out a plugin here:
https://claude.ai/public/artifacts/129340aa-c28a-4318-8a8a-a25d97699a76

[winsvega]

this PR also includes coverage check on tests that we didn't do.
the lost coverage in instrinsic test. original test used to trigger oog on sstore operation which it now does not.
likely was a bug in original test. because intrinsic gas calculation verify if transaction fails or not,

[danceratopz]

Looking really nice! I added a couple of changes to exit fill early if we're running with a ported_tests option, so that we don't write an html report and create an unnecessary output directory.

Just one comment below.

[danceratopz]

Example:

[marioevz]

Awesome improvement 🚀

LGTM, just the comment regarding the help output of the fill by Dan and we could merge.

[marioevz]

❤️

[danceratopz]

LGTM, thanks @winsvega!