[BUG]: NeMo LLM based pipelines are hanging

[dagardner-nv]

Version

25.06

Which installation method(s) does this occur on?

No response

Describe the bug.

The openai pipelines are running as expected.

Minimum reproducible example

python examples/llm/main.py --log_level=debug completion pipeline --llm_service=NemoLLM

Relevant log output

Click here to see error details

[Paste the error here, it will be hidden by default]

Full env printout

Click here to see environment details

[Paste the results of print_env.sh here, it will be hidden by default]

Other/Misc.

No response

Code of Conduct

• I agree to follow Morpheus' Code of Conduct
• I have searched the open bugs and have found no duplicates for this bug report

[dagardner-nv]

Apparently the produce has been end-of-life'd, in favor of build.nvidia.com, and those models conform to the OpenAI API.