lws

LeaderWorkerSet API Example

This example is dedicated to LeaderWorkerSet API.

Instructions

Generate the Kubernetes architecture diagrams for LeaderWorkerSet API and its examples:

$ ./generate.sh

Generated architecture diagrams

Architecture diagram for the vLLM example with GPU:

Architecture diagram for the vLLM example with TPU:

Architecture diagram for the TensorRT-LLM example:

Architecture diagram for the llama.cpp example:

Architecture diagram for the SGLang example:

Architecture diagram for the Saxml example:

Architecture diagram for LeaderWorkerSet operator: