Add a new custom router scheduler plugin : presto-plan-checker-router-plugin#25035
Conversation
be00ae3 to
a67d074
Compare
1be19aa to
88029b1
Compare
f8261fc to
0037958
Compare
presto-plan-checker-router-plugin
30c7707 to
da3c6c3
Compare
presto-plan-checker-router-pluginpresto-plan-checker-router-plugin
9b38509
|
Thanks @steveburnett , made the changes, can you PTAL? |
Thanks for updating the link! Could you change the section heading |
@steveburnett Done, thanks ! |
I'm sorry if I was unclear! We've added a new section heading |
@steveburnett My bad, I misread your suggestion , I have moved it to |
aditi-pandit
left a comment
There was a problem hiding this comment.
Thanks @pdabre12.
We need to investigate these failures the e2e test failures but I don't think they are related to this work https://github.com/prestodb/presto/actions/runs/15566344717/job/43839187753?pr=25035
Yes, these failures were seen earlier too: https://github.com/prestodb/presto/actions/runs/15566813960/job/43833560154 |
Description
Add a new custom router scheduler plugin :
presto-plan-checker-router-plugin.Motivation and Context
This change introduces a custom router plugin designed to facilitate the seamless migration from Java-based clusters to native C++ clusters in production environments. The plugin acts as an intermediary between two routers - one pointing to a group of native (C++) clusters and the other to a group of Java clusters.
The plugin uses a
StatementClientto send each incoming request to a sidecar-enabled plan checker cluster. Based on the response from the sidecar, the plugin determines the routing part:QueryErrorfield populated to indicate the failure.Impact
This dynamic routing mechanism allows users to gradually migrate workloads from Java to native C++ with minimal risk and without manual intervention. Additionally , it allows users to retain full control over scheduling in both the native and the Java routers.
Test Plan
Test cases included, more e2e tests need to be added.
Contributor checklist
Release Notes
Please follow release notes guidelines and fill in the release notes below.