Search results

Endpoint marked ready before model is fully loaded

Status: Open.

#138 In aws/sagemaker-inference-toolkit;

· juliuscoburger opened on Dec 19, 2024

Is streaming supported?

Status: Open.

#137 In aws/sagemaker-inference-toolkit;

· inf3rnus opened on Mar 22, 2024

Add support for downloading inference script and code (entry_point) from s3

Status: Open.

#136 In aws/sagemaker-inference-toolkit;

· urirosenberg opened on Jan 21, 2024

Triton container documentation implies py38

Status: Open.

#134 In aws/sagemaker-inference-toolkit;

· david-waterworth opened on Nov 17, 2023

psutil 5.9.6 seems to be throwing ZombieProcess when retrieving the mms process

Status: Open.

#132 In aws/sagemaker-inference-toolkit;

· charlietruong-wk opened on Oct 23, 2023

Enhancing Multi-Model Server Logging Support - JSON Format Integration

Status: Open.

#131 In aws/sagemaker-inference-toolkit;

· ViliamSerecun opened on Jul 25, 2023

Tensorflow Inference toolkit

Status: Open.

#128 In aws/sagemaker-inference-toolkit;

· vincentvic opened on Jun 13, 2023

Support for parquet encoder and decoder

Status: Open.

#127 In aws/sagemaker-inference-toolkit;

· lorenzwalthert opened on Jun 13, 2023

Support user-defined batch inference logic

Status: Open.

#123 In aws/sagemaker-inference-toolkit;

· dgcnz opened on Apr 26, 2023

Document default_pre_model_fn and default_model_warmup_fn

Status: Open.

#117 In aws/sagemaker-inference-toolkit;

· l3ku opened on Oct 21, 2022

stop_server function

Status: Open.

#116 In aws/sagemaker-inference-toolkit;

· Duncan-Haywood opened on Oct 18, 2022

Long Model Loading times in Multimodel Server

Status: Open.

#113 In aws/sagemaker-inference-toolkit;

· AlexRaschl opened on Sep 26, 2022