Skip to content

Conversation

@overlookmotel
Copy link
Member

@overlookmotel overlookmotel commented Dec 23, 2025

Add a script for testing failing conformance test cases. This is what I've been using to get Claude to diagnose the cause of test failures. I thought it'd be useful to commit it, so others can use it too if bug reports arise, or they want to tackle some of the remaining problems.

@github-actions github-actions bot added A-linter Area - Linter A-cli Area - CLI A-linter-plugins Area - Linter JS plugins C-test Category - Testing. Code is missing test cases, or a PR is adding them labels Dec 23, 2025
Copy link
Member Author

overlookmotel commented Dec 23, 2025


How to use the Graphite Merge Queue

Add either label to this PR to merge it via the merge queue:

  • 0-merge - adds this PR to the back of the merge queue
  • hotfix - for urgent hot fixes, skip the queue and merge this PR next

You must have a Graphite account in order to use the merge queue. Sign up using this link.

An organization admin has enabled the Graphite Merge Queue in this repository.

Please do not merge from GitHub as this will restart CI on PRs being processed by the merge queue.

This stack of pull requests is managed by Graphite. Learn more about stacking.

@overlookmotel overlookmotel marked this pull request as ready for review December 23, 2025 02:49
Copilot AI review requested due to automatic review settings December 23, 2025 02:49
@overlookmotel
Copy link
Member Author

@camc314 I think this stack is ready to merge, but it looks like CodSpeed have broken us somehow. Can I please leave it to you to merge once the CodSpeed problem is solved?

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds a debugging script (tester.ts) to help investigate failing conformance test cases by running them with both ESLint and Oxlint side-by-side. The script is designed to be used interactively, allowing developers to add console logging to ESLint rule implementations to understand differences in behavior.

Key Changes:

  • Adds a new standalone testing script that runs individual test cases through both ESLint's and Oxlint's RuleTester implementations
  • Includes detailed inline documentation/instructions for how to use the script, targeted at AI assistants helping with debugging
  • Sets up simple pass-through describe/it functions to bypass the conformance test framework's capture mechanism

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@graphite-app graphite-app bot force-pushed the om/12-22-fix_linter_plugins_set_up_global_scope_correctly branch from 5be63ec to a54c849 Compare December 23, 2025 10:47
@graphite-app graphite-app bot force-pushed the om/12-20-test_linter_plugins_add_script_for_investigating_failing_conformance_test_cases branch from d6c586a to 015a771 Compare December 23, 2025 10:48
@graphite-app graphite-app bot changed the base branch from om/12-22-fix_linter_plugins_set_up_global_scope_correctly to graphite-base/17296 December 23, 2025 11:01
@graphite-app graphite-app bot force-pushed the om/12-20-test_linter_plugins_add_script_for_investigating_failing_conformance_test_cases branch from 015a771 to fdf44b4 Compare December 23, 2025 11:12
@graphite-app graphite-app bot force-pushed the graphite-base/17296 branch from a54c849 to 7eaa660 Compare December 23, 2025 11:12
@graphite-app graphite-app bot changed the base branch from graphite-base/17296 to main December 23, 2025 11:13
@graphite-app graphite-app bot force-pushed the om/12-20-test_linter_plugins_add_script_for_investigating_failing_conformance_test_cases branch from fdf44b4 to ee94d09 Compare December 23, 2025 11:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-cli Area - CLI A-linter Area - Linter A-linter-plugins Area - Linter JS plugins C-test Category - Testing. Code is missing test cases, or a PR is adding them

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants