File tree Expand file tree Collapse file tree 3 files changed +3
-3
lines changed
tests/torchtune/models/mistral/scripts Expand file tree Collapse file tree 3 files changed +3
-3
lines changed Original file line number Diff line number Diff line change @@ -34,7 +34,7 @@ def mistral(
3434 rope_base : int = 10_000 ,
3535) -> TransformerDecoder :
3636 """
37- Build the decoder assoicated with the mistral model. This includes:
37+ Build the decoder associated with the mistral model. This includes:
3838 - Token embeddings
3939 - num_layers number of TransformerDecoderLayer blocks
4040 - RMS Norm layer applied to the output of the transformer
Original file line number Diff line number Diff line change @@ -52,7 +52,7 @@ def llama2(
5252 norm_eps : float = 1e-5 ,
5353) -> TransformerDecoder :
5454 """
55- Build the decoder assoicated with the Llama2 model. This includes:
55+ Build the decoder associated with the Llama2 model. This includes:
5656 - Token embeddings
5757 - num_layers number of TransformerDecoderLayer blocks
5858 - RMS Norm layer applied to the output of the transformer
Original file line number Diff line number Diff line change @@ -47,7 +47,7 @@ def mistral(
4747 rope_base : int = 10_000 ,
4848) -> TransformerDecoder :
4949 """
50- Build the decoder assoicated with the mistral model. This includes:
50+ Build the decoder associated with the mistral model. This includes:
5151 - Token embeddings
5252 - num_layers number of TransformerDecoderLayer blocks
5353 - RMS Norm layer applied to the output of the transformer
You can’t perform that action at this time.
0 commit comments