Gemma 3 still unsupported? #1239
Description
System Info
Environment/Platform
- Website/web-app
- Browser extension
- Server-side (e.g., Node.js, Deno, Bun)
- Desktop app (e.g., Electron)
- Other (e.g., VSCode extension)
Description
Hello. I try to use onnx-community/gemma-3-1b-it-ONNX with [email protected]
Get error:
Error loading model: Error: Unsupported model type: gemma3_text
at AutoModelForCausalLM.from_pretrained (models.js:7367:1)
Reproduction
// Create a text generation pipeline
const generator = await pipeline(
"text-generation",
"onnx-community/gemma-3-1b-it-ONNX",
{ dtype: "q4" },
);
// Define the list of messages
const messages = [
{ role: "system", content: "You are a helpful assistant." },
{ role: "user", content: "Write me a poem about Machine Learning." },
];
// Generate a response
const output = await generator(messages, { max_new_tokens: 512, do_sample: false });
console.log(output[0].generated_text.at(-1).content);