Skip to content

Issues: xorbitsai/inference

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

162 Open 2,045 Closed
162 Open 2,045 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

升级到1.7.0.post1，使用sglang挂载大模型到H100时报错undefined symbol: gpu
#3657 opened Jun 17, 2025 by Mephistopheles1166
1 of 3 tasks
v1.x
2
1.7.0.post1版本加载 Qwen3-Embedding-4B 模型报错
#3655 opened Jun 17, 2025 by zryowen123
1 of 3 tasks
v1.x
1
Docker运行V1.7.0，在GPU部署Qwen3-Reranker-0.6B，实际运行在了CPU上？ gpu
#3654 opened Jun 17, 2025 by SharkSyl
1 of 3 tasks
v1.x
2
VLLMEmbeddingModel可以传入vllm启动参数，如--dtype feature
#3653 opened Jun 17, 2025 by zhangjiekui v1.x
1
升级到了v1.7.0.post1，无法使用SGLang拉起Qwen3-32B-GPTQ-INT8 gpu
#3652 opened Jun 17, 2025 by dlluckboy
1 of 3 tasks
v1.x
xinference cluster based on docker - No connection adapters were found gpu
#3651 opened Jun 17, 2025 by Bruce-ysy v1.x
1
Qwen3-Reranker-4B报错：{"detail":"[address=0.0.0.0:41591, pid=307] unsupported operand type(s) for -: 'NoneType' and 'int'"} gpu
#3650 opened Jun 17, 2025 by Rickkkkkkkkkk
1 of 3 tasks
v1.x
@yiboyasss
7
支持分类模型zero-shot-classification feature
#3649 opened Jun 17, 2025 by smileyboy2019 v1.x
1
希望能新增QwenLong-L1-32B系列的支持 feature
#3648 opened Jun 17, 2025 by rexjm v1.x
Qwen3: enable_thinking: false still returns <think> tags feature
#3647 opened Jun 16, 2025 by caiyuanhangDicp v1.x
@qinxuye
5
昇腾卡不支持Qwen3-embedding feature gpu
#3646 opened Jun 16, 2025 by wjs19960722 v1.x
2
Qwen3-Reranker-8B运行异常：unsupported operand type(s) for -: 'NoneType' and 'int'" gpu
#3644 opened Jun 16, 2025 by 143heyan
1 of 3 tasks
v1.x
使用vllm和cpu启动bge-m3模型报错 gpu
#3643 opened Jun 16, 2025 by StephenZKCurry
1 of 3 tasks
v1.x
Qwen3-Embedding-8B和Qwen3-Reranker-8B报错
#3641 opened Jun 16, 2025 by noahachao
1 of 3 tasks
v1.x
4
The /v1/models/families API returns incomplete data. feature
#3639 opened Jun 16, 2025 by yiboyasss v1.x
bge-m3多文本嵌入显存异常问题 gpu
#3636 opened Jun 16, 2025 by Havedream6
1 of 3 tasks
v1.x
3
流式tool_call返回体缺index字段，不完全符合openai接口规范 gpu
#3634 opened Jun 14, 2025 by gemo12123
3 tasks
v1.x
@amumu96
2
Server error: 500 - [address=127.0.0.1:23197, pid=80799] [Errno 2] No such file or directory: 'uv'报错
#3633 opened Jun 14, 2025 by noahachao
1 of 3 tasks
v1.x
1
Docker image run fail with error message "ImportError: cannot import name 'TypeVarTuple' from 'typing_extensions'" gpu
#3626 opened Jun 13, 2025 by huangchuchuan
1 of 3 tasks
v1.x
1
add AI/ML API as provider feature
#3621 opened Jun 12, 2025 by OctavianTheI v1.x
1
Qwen3的function_call工具调用报错
#3619 opened Jun 12, 2025 by daydayup-zyn
1 of 3 tasks
v1.x
6
xinference 加载 FLUX.1-dev gguf 量化模型时 默认加载了全量模型 gpu
#3618 opened Jun 12, 2025 by dennyZK
1 of 3 tasks
v1.x
2
Prompt超出2078个字数 会导致输出2个<think>开始标签，100%复现
#3616 opened Jun 12, 2025 by XiaoCC
1 of 3 tasks
v1.x
2
命令行launch模型，显示100%，但在list里找不到
#3613 opened Jun 12, 2025 by Royhuiy v1.x
1
Rerank module need support multi engine feature
#3612 opened Jun 12, 2025 by pengjunfeng11 v1.x
ProTip! What’s not been updated in a month: updated:<2025-05-17.