[FR]: Opik Optimizer UI Best Score should/could be set by SDK

[vincentkoc]

Proposal summary

When we are running multiple optimizations like with GEPA, it uses a pareto front which has an eval with holdout / validation so scores improve internally. Sometimes the "best" score in the SDK !== to the UI. and sometimes we might not want just the highest score.

We should be able to control from the SDK (if we wish) which trial is the "best". Example of an issue.

Motivation

Fine grain control to ensure SDK is matching results in the UI. As well as custom scores metrics with weighted outcomes might not always be the highest score we want.

[andrescrz]

Hi @vincentkoc,

Thank you for your feature request! We appreciate your feedback and will look into it. We'll keep you updated as we review and consider the suggestion.

Best regards