New Folder: Issue-Tracker

[HoshinoTented]

Proposal

An Issue Tracker tracks newly created issues with a specific format, automatically runs the code, and compares the outputs.

• Run the code if the issue is created with a specific format
• Track the issue state (re-run with newer aya) when branch main is updated.
• Maybe force re-run by some mechanism.

Issue Format

• An issue that enables Issue Tracker should start with <!-- ISSUE TRACKER ENABLE -->
• Paragraph with text like Aya version: xx.xx, a <!-- AYA VERSION --> can be useful to locate it.
• Paragraph with text like foo.aya and a following aya code block between <!-- BEGIN FILES --> and <!-- END FILES -->

Implementation

We can parse such issue by either parsing the markdown or using regexp. I believe regexp will be easier for the version part, but not for the code part.
For Github Actions, issue tracker will run once when an issue is created, and it may add some labels so that another workflow can recognize it.
issue tracker will also run for each labeled issue when branch main is updated. We also need a small script to setup aya, this can be a prototype of our aya-up.

Some Problem

Issue Tracker provides arbitrary code execution, but Aya is pure for now. Also, there are existing solutions like online code running.