Search results

[FT] showing count in Markdown summary table

feature/enhancementNew feature/requestNew feature/request

good first issueGood for newcomersGood for newcomers

Status: Open.

Feature

#804 In huggingface/lighteval;

· jamesbraza opened on Jun 9, 2025

[FT] Add tests for nanotron

feature/enhancementNew feature/requestNew feature/request

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

ignore-for-releasewill be ignored when doing release notewill be ignored when doing release note

Status: Open.

Feature

#765 In huggingface/lighteval;

· NathanHB opened on May 21, 2025

[BUG] incorrect type hints such as <code>callable</code>

bugSomething isn't workingSomething isn't working

documentationImprovements or additions to documentationImprovements or additions to documentation

feature/enhancementNew feature/requestNew feature/request

Status: Open.

Bug

#759 In huggingface/lighteval;

· jamesbraza opened on May 21, 2025

[FT] <code>lighteval file</code> eval backend to work with stored JSONL/CSV files

feature/enhancementNew feature/requestNew feature/request

Status: Open.

Feature

#750 In huggingface/lighteval;

· jamesbraza opened on May 20, 2025

[FT] add <code>py.typed</code> so <code>lighteval</code> can work with type checkers

documentationImprovements or additions to documentationImprovements or additions to documentation

feature/enhancementNew feature/requestNew feature/request

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

Feature

#749 In huggingface/lighteval;

· jamesbraza opened on May 20, 2025

[FT] allow <code>httpx&gt;0.27</code>

feature/enhancementNew feature/requestNew feature/request

ignore-for-releasewill be ignored when doing release notewill be ignored when doing release note

Status: Open.

Feature

#747 In huggingface/lighteval;

· jamesbraza opened on May 19, 2025

[FT] Manage script and language in the Language enum

feature/enhancementNew feature/requestNew feature/request

good first issueGood for newcomersGood for newcomers

Status: Open.

Feature

#745 In huggingface/lighteval;

· clefourrier opened on May 19, 2025

[FT] Load entire benchmark (data + spec) from the hub

feature/enhancementNew feature/requestNew feature/request

Status: Open.

Feature

#735 In huggingface/lighteval;

· NathanHB opened on May 16, 2025

[FT] Add tests for <code>VLLMModel</code> base methods

feature/enhancementNew feature/requestNew feature/request

good first issueGood for newcomersGood for newcomers

Status: Open.

Feature

#724 In huggingface/lighteval;

· NathanHB opened on May 15, 2025

[FT] Continuous batching for transformers

feature/enhancementNew feature/requestNew feature/request

Status: Open.

Feature

#723 In huggingface/lighteval;

· NathanHB opened on May 15, 2025

[FT] Support evaluations with tool use

feature/enhancementNew feature/requestNew feature/request

Status: Open.

Feature

#719 In huggingface/lighteval;

· ercbot opened on May 15, 2025

[FT] Improve Documentation and Examples

documentationImprovements or additions to documentationImprovements or additions to documentation

feature/enhancementNew feature/requestNew feature/request

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

Bug

#682 In huggingface/lighteval;

· ashim-mahara opened on Apr 21, 2025