Research of existing implementations by language

[Relequestual]

Problem: We do not know which languages have high quality implementations.

While members of the core team / TSC (not yet formally formed) have implementaitons in different languages, we do not know if we have "high quality" implemenations in all major languages.

Having high quality implementaitons in all major languages would improve the ecosystem. If we can identify gaps in implementations, we could then target resources to support specific languages or implementations. Overall, this would improve our ecosystem.

This item is just about the research and report, and not about making any actions or decisoions as a result of such a report.

• Decide on a list of ~10-15 programming languages or environments to assess (by some combination of popularity, TIOBE, recent publicity, commonality of use for API-adjacent or data validation-adjacent use cases, etc.)
• Compare this list against the JSON Schema implementations page
  • Confirm this page seems correct for the programming language by searching independently for JSON Schema implementations in GitHub search, Google, etc.
  • Extract a crude "health" metric of how good support for JSON Schema is in the language based on version availability, maturity of the implementation, activity of development in the implementation and compliance with the specification (time boxed to not be fully in depth)
    • does it fail some very large number of tests
    • does it support recent versions of JSON Schema
    • does it have recent releases
    • does it have recent commits
    • does it have open security warnings
    • does its maintainer consider it production-ready (or explicitly the reverse)
    • how many open issues and pull requests does it have
    • does it implement many/all/some of the interfaces from Identify a list of critical interfaces that implementations should have and empower implementers with better resources #408
  • Document languages which are popular but which are deficient in their JSON Schema support
• Update any out of date information on the implementations page on the website
• Write a blog post report for general consumptions about the method, findings, and resulting insights. (And maybe potential future work)

Assessed as high impact/low effort during our collaborators summit 2023.

[Julian]

(A brief task list is now in the issue description!)

[gregsdennis]

Have we decided on what "high quality implementation" means?

I suspect some of the results of #408 (interfaces) will be part of that definition.

[Relequestual]

Could a work product of this include a published report? Target readership being technical leads and senior leadership.

[benjagm]

As peer the last OCWM #429:
@Julian it would be great if we add action items to this plan to describe what is our understanding of high quality implementations.

[Julian]

Hey! Can you guys fill me in on what was meant by

describe what is our understanding of high quality implementations.

Are you saying something more elaborate than the task in the description? I.e.

Extract a crude "health" metric of how good support for JSON Schema is in the language based on version availability, maturity of the implementation, activity of development in the implementation and compliance with the specification (time boxed to not be fully in depth)

[Relequestual]

I think that's it, yeah. Maybe you'd think of that as a "further research" task, and so out of scope. And maybe you're right. I think we were expecting to see something less crude and more specific in terms of criteria that can be reported on a regular basis. Something we can later use to demonstrate the developing maturity of the ecosystem.

[gregsdennis]

Yeah that's pretty much it. The question came up in the last call, and scanning the issue, I didn't see anything, so I commented. Then @benjagm posted the same question as a meeting update.