Search results

fix(generate.py): add mock FlexDecoding test integration for speculative pipeline verification

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

meta-pytorch/gpt-fastnumber 235

#235 In meta-pytorch/gpt-fast;

· Shraman123 opened on Nov 12, 2025

Support generation tasks for eval.py

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

meta-pytorch/gpt-fastnumber 206

#206 In meta-pytorch/gpt-fast;

· mostafaelhoushi opened on Oct 4, 2024

add huggingface-hub

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

meta-pytorch/gpt-fastnumber 205

#205 In meta-pytorch/gpt-fast;

· kunschg opened on Oct 3, 2024

update README.md

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

meta-pytorch/gpt-fastnumber 204

#204 In meta-pytorch/gpt-fast;

· kunschg opened on Oct 3, 2024

feat: add Llama-3.2-[1B/3B] support

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

meta-pytorch/gpt-fastnumber 203

#203 In meta-pytorch/gpt-fast;

· stillmatic opened on Oct 1, 2024

Add Phi-3-mini-4k-instruct bfloat16/int8

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

meta-pytorch/gpt-fastnumber 195

#195 In meta-pytorch/gpt-fast;

· makaveli10 opened on Aug 20, 2024

int4 quantization cpu fix

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

meta-pytorch/gpt-fastnumber 193

#193 In meta-pytorch/gpt-fast;

· likholat opened on Aug 1, 2024

flex_attention ver.

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

meta-pytorch/gpt-fastnumber 192

#192 In meta-pytorch/gpt-fast;

· joydddd opened on Jul 30, 2024

Update sdpa function with enable_gqa=True

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

meta-pytorch/gpt-fastnumber 191

#191 In meta-pytorch/gpt-fast;

· jainapurva opened on Jul 13, 2024

Decouple int4 weight with serialized format

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

meta-pytorch/gpt-fastnumber 187

#187 In meta-pytorch/gpt-fast;

· yanbing-j opened on Jul 2, 2024

[WIP] Use DTensor-based tensor parallel

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

meta-pytorch/gpt-fastnumber 180

#180 In meta-pytorch/gpt-fast;

· kwen2501 opened on Jun 12, 2024

[example] Add support for DBRX

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

meta-pytorch/gpt-fastnumber 174

#174 In meta-pytorch/gpt-fast;

· yanboliang opened on May 7, 2024