You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
TorchTune is a native-PyTorch library. While we provide integrations with the surrounding ecosystem (eg: HuggingFace Datasets, EluetherAI Eval Harness), all of the core functionality is written in PyTorch.
185
+
TorchTune is a native-PyTorch library. While we provide integrations with the surrounding ecosystem (eg: Hugging Face Datasets, EluetherAI Eval Harness), all of the core functionality is written in PyTorch.
Copy file name to clipboardExpand all lines: docs/source/examples/first_finetune_tutorial.rst
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -25,13 +25,13 @@ job using TorchTune.
25
25
Downloading a model
26
26
-------------------
27
27
First, you need to download a model. TorchTune's supports an integration
28
-
with the `HuggingFace Hub <https://huggingface.co/docs/hub/en/index>`_ - a collection of the latest and greatest model weights.
28
+
with the `Hugging Face Hub <https://huggingface.co/docs/hub/en/index>`_ - a collection of the latest and greatest model weights.
29
29
30
30
For this tutorial, you're going to use the `Llama2 model from Meta <https://llama.meta.com/>`_. Llama2 is a "gated model",
31
31
meaning that you need to be granted access in order to download the weights. Follow `these instructions <https://huggingface.co/meta-llama>`_ on the official Meta page
32
-
hosted on HuggingFace to complete this process. (This should take less than 5 minutes.)
32
+
hosted on Hugging Face to complete this process. (This should take less than 5 minutes.)
33
33
34
-
Once you have authorization, you will need to authenticate with HuggingFace Hub. The easiest way to do so is to provide an
34
+
Once you have authorization, you will need to authenticate with Hugging Face Hub. The easiest way to do so is to provide an
35
35
access token to the download script. You can find your token `here <https://huggingface.co/settings/tokens>`_.
Copy file name to clipboardExpand all lines: docs/source/overview.rst
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -22,7 +22,7 @@ TorchTune provides:
22
22
- Modular native-PyTorch implementations of popular LLMs
23
23
- Interoperability with popular model zoos through checkpoint-conversion utilities
24
24
- Training recipes for a variety of fine-tuning techniques
25
-
- Integration with `HuggingFace Datasets <https://huggingface.co/docs/datasets/en/index>`_ for training and `EleutherAI's Eval <https://github.com/EleutherAI/lm-evaluation-harness>`_ Harness for evaluation
25
+
- Integration with `Hugging Face Datasets <https://huggingface.co/docs/datasets/en/index>`_ for training and `EleutherAI's Eval <https://github.com/EleutherAI/lm-evaluation-harness>`_ Harness for evaluation
26
26
- Support for distributed training using `FSDP <https://pytorch.org/docs/stable/fsdp.html>`_
27
27
- Yaml configs for easily configuring training runs
TorchTune is a native-PyTorch library. While we provide integrations with the surrounding ecosystem (eg: HuggingFace Datasets, EluetherAI Eval Harness), all of the core functionality is written in PyTorch.
58
+
TorchTune is a native-PyTorch library. While we provide integrations with the surrounding ecosystem (eg: Hugging Face Datasets, EluetherAI Eval Harness), all of the core functionality is written in PyTorch.
"system": "You are an AI assistant. User will you give you a task. Your goal is to complete the task as faithfully as you can. While performing the task think step-by-step and justify your steps.", # noqa: B950
0 commit comments