v0.0.0b14
What's Changed
- Add comments by @yunfeng-scale in #250
- Fix vllm docker tensor paralllel by @yunfeng-scale in #254
- Increase liveness timeout for main container by @yunfeng-scale in #255
- Mark batch jobs as not safe to evict by @saiatmakuri in #256
- removing timezone tzinfo in favor of utc by @ian-scale in #257
- invalid CSV input returns InvalidRequestException by @ian-scale in #258
- bumping image tag by @ian-scale in #262
- Integrate LightLLM by @yunfeng-scale in #273
- removing datadog interfaces logging by @ian-scale in #275
- Ianmacleod/vllm by default by @ian-scale in #274
- update docs by @ian-scale in #276
- Ianmacleod/add model delete by @ian-scale in #261
- fixing cacher, tested in prod version of cacher deployment in k8s and… by @ian-scale in #278
- Ianmacleod/fix cacher by @ian-scale in #279
- add vllm to inference framework enum by @ian-scale in #280
- Ianmacleod/update client enum with lightllm by @ian-scale in #281
- Some fixes for endpoints by @yunfeng-scale in #283
- Add actual pytests to integration tests by @phil-scale in #227
Full Changelog: v0.0.0beta13...v0.0.0beta14