Skip to content

[GenAI] Add support for org.apache.maven.surefire:surefire-booter:2.22.2 using gpt-5.5#6717

Closed
vjovanov wants to merge 12 commits into
masterfrom
ai/vjovanov/add-lib-support-org.apache.maven.surefire-surefire-booter-2.22.2
Closed

[GenAI] Add support for org.apache.maven.surefire:surefire-booter:2.22.2 using gpt-5.5#6717
vjovanov wants to merge 12 commits into
masterfrom
ai/vjovanov/add-lib-support-org.apache.maven.surefire-surefire-booter-2.22.2

Conversation

@vjovanov

@vjovanov vjovanov commented May 9, 2026

Copy link
Copy Markdown
Member

What does this PR do?

Fixes: #2427

This PR introduces tests and metadata for org.apache.maven.surefire:surefire-booter:2.22.2, enabling support for this library.

Summary:

  • Strategy: dynamic_access_main_sources_pi_gpt-5.5
  • Agent: pi
  • Model: gpt-5.5
  • Input tokens: 209003
  • Cached input tokens: 2514944
  • Output tokens: 27803
  • Metadata entries: 9
  • Test-only metadata entries: 3
  • Iterations: 8
  • Library coverage percentage: 9.89
  • Generated lines of code: 346
  • Tested library lines of code: 929

Metadata/dynamic-access evidence

  • Covered dynamic-access calls: 29
  • Metadata entries: 9
  • These counts are different dimensions: covered dynamic-access calls count observed call sites, while metadata entries count generated reachability-config items. Depending on the access type, a single metadata rule can cover multiple observed call sites, or no shipped rule may be required when the covered access does not target fixed library-owned metadata.
  • Generated metadata rules:
    • when org.apache.maven.surefire.shade.org.apache.commons.lang3.ClassUtils is reached, make example.missing.DoesNotExist available for reflection
    • when org.apache.maven.surefire.shade.org.apache.commons.lang3.ObjectUtils is reached, make int[] available for reflection
    • when org.apache.maven.surefire.shade.org.apache.commons.lang3.ClassUtils is reached, make java.lang.StackTraceElement[] available for reflection
    • when org.apache.maven.surefire.shade.org.apache.commons.lang3.ClassUtils is reached, make java.lang.String available for reflection
    • when org.apache.maven.surefire.shade.org.apache.commons.lang3.ArrayUtils is reached, make java.lang.String[] available for reflection
    • when org.apache.maven.surefire.shade.org.apache.commons.lang3.builder.CompareToBuilder is reached, make java.lang.reflect.Field[] available for reflection
    • when org.apache.maven.surefire.shade.org.apache.commons.lang3.ClassUtils is reached, make java.lang.reflect.Method[] available for reflection
    • when org.apache.maven.surefire.shade.org.apache.commons.lang3.builder.CompareToBuilder is reached, make org.apache.maven.surefire.shade.org.apache.commons.lang3.builder.CompareToBuilder available for reflection
  • Use the call-site and metadata-rule lists together to review whether the observed dynamic-access paths are explained by the generated reachability metadata.

Metadata Forge

  • Forge monitored branch: origin/master
  • Forge branch: master
  • Forge commit hash: 1d658aec479e42ffeee1d7af0efb454d6dc6e676

Stats from stats/<groupId>/<artifactId>/<metadata-version>/stats.json:

Dynamic access coverage:

  • Overall: 29/29 covered calls (100.00%)
  • Reflection: 29/29 covered calls (100.00%)

Library coverage:

  • Instruction: 3439/39138 (8.79%)
  • Line: 929/9394 (9.89%)
  • Method: 169/1896 (8.91%)

Local CI Verification

  • Status: success
  • Commands run: 20
  • Fixup attempts: 0

@vjovanov vjovanov added library-new-request Request for supporting a new library, or updating the existing one. GenAI PRs produced by generative AI labels May 9, 2026

@jormundur00 jormundur00 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Covered dynamic-access calls (29) are more than 75% higher than the reported metadata entry total (9 library + 3 test-only). Please investigate the mismatch and refresh the PR summary/evidence before merge.

@jormundur00 jormundur00 added the human-intervention Requires manual follow-up because automated dynamic-access coverage remained too low label May 9, 2026
@jormundur00

Copy link
Copy Markdown
Member

Closing this human-intervention PR and returning the linked issue to Todo.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

GenAI PRs produced by generative AI human-intervention Requires manual follow-up because automated dynamic-access coverage remained too low library-new-request Request for supporting a new library, or updating the existing one.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Support for org.apache.maven.surefire:surefire-booter:2.22.2

2 participants