Skip to content

Commit 4bb5522

Browse files
committed
Move back to generate for ping
1 parent 166e570 commit 4bb5522

File tree

1 file changed

+1
-1
lines changed
  • src/sagemaker/serve/model_server/tgi

1 file changed

+1
-1
lines changed

src/sagemaker/serve/model_server/tgi/server.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -74,7 +74,7 @@ def _invoke_tgi_serving(self, request: object, content_type: str, accept: str):
7474
"""Placeholder docstring"""
7575
try:
7676
response = requests.post(
77-
f"http://{get_docker_host()}:8080/invocations",
77+
f"http://{get_docker_host()}:8080/generate",
7878
data=request,
7979
headers={"Content-Type": content_type, "Accept": accept},
8080
timeout=600,

0 commit comments

Comments
 (0)