Skip to content

Releases: mudler/LocalAI

v2.7.0

29 Jan 09:13
@mudler mudler
v2.7.0
abd678e
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v2.7.0

This release adds support to the transformer backend for LLM as well!

For now instance you can run codellama-7b with transformers with:

docker run -ti -p 8080:8080 --gpus all localai/localai:v2.7.0-cublas-cuda12 codellama-7b

In the quickstart there are more examples available https://localai.io/basics/getting_started/#running-models.

Note: As llama.cpp is ongoing with changes that could possible cause breakage, this release does not includes changes from ggml-org/llama.cpp#5138 (the future versions will).

What's Changed

Bug fixes 🐛

  • fix(paths): automatically create paths by @mudler in #1650

Exciting New Features 🎉

  • feat(transformers): support also text generation by @mudler in #1630
  • transformers: correctly load automodels by @mudler in #1643
  • feat(startup): fetch model definition remotely by @mudler in #1654

👒 Dependencies

Other Changes

Full Changelog: v2.6.1...v2.6.2

Contributors

mudler and localai-bot
Loading

v2.6.1

23 Jan 17:22
@mudler mudler
v2.6.1
d5d82ba
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v2.6.1

This is a patch release containing bug-fixes around parallel request support with llama.cpp models.

What's Changed

Bug fixes 🐛

  • fix(llama.cpp): Enable parallel requests by @tauven in #1616
  • fix(llama.cpp): enable cont batching when parallel is set by @mudler in #1622

Exciting New Features 🎉

  • feat(grpc): backend SPI pluggable in embedding mode by @coyzeng in #1621

👒 Dependencies

Other Changes

New Contributors

Full Changelog: v2.6.0...v2.6.1

Contributors

tauven, mudler, and 2 other contributors
Loading

v2.6.0

20 Jan 17:34
@mudler mudler
v2.6.0
06cd9ef
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v2.6.0

What's Changed

Bug fixes 🐛

  • move BUILD_GRPC_FOR_BACKEND_LLAMA logic to makefile: errors in this section now immediately fail the build by @dionysius in #1576
  • prepend built binaries in PATH for BUILD_GRPC_FOR_BACKEND_LLAMA by @dionysius in #1593

Exciting New Features 🎉

  • minor: replace shell pwd in Makefile with CURDIR for better windows compatibility by @dionysius in #1571
  • Makefile: allow to build without GRPC_BACKENDS by @mudler in #1607
  • feat: 🐍 add mamba support by @mudler in #1589
  • feat(extra-backends): Improvements, adding mamba example by @mudler in #1618

👒 Dependencies

Other Changes

New Contributors

Full Changelog: v2.5.1...v2.6.0

Contributors

dionysius, mudler, and 3 other contributors
Loading

v2.5.1

09 Jan 08:00
@mudler mudler
v2.5.1
5309da4
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v2.5.1

Patch release to create /build/models in the container images.

What's Changed

Other Changes

Full Changelog: v2.5.0...v2.5.1

Contributors

localai-bot
Loading

v2.5.0

08 Jan 13:55
@mudler mudler
v2.5.0
574fa67
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v2.5.0

What's Changed

This release adds more embedded models, and shrink image sizes.

You can run now phi-2 ( see here for the full list ) locally by starting localai with:

docker run -ti -p 8080:8080 localai/localai:v2.5.0-ffmpeg-core phi-2

LocalAI accepts now as argument a list of short-hands models and/or URLs pointing to valid yaml file. A popular way to host those files are Github gists.

For instance, you can run llava, by starting local-ai with:

docker run -ti -p 8080:8080 localai/localai:v2.5.0-ffmpeg-core https://raw.githubusercontent.com/mudler/LocalAI/master/embedded/models/llava.yaml

Exciting New Features 🎉

  • feat: more embedded models, coqui fixes, add model usage and description by @mudler in #1556

👒 Dependencies

  • deps(conda): use transformers-env with vllm,exllama(2) by @mudler in #1554
  • deps(conda): use transformers environment with autogptq by @mudler in #1555
  • ⬆️ Update ggerganov/llama.cpp by @localai-bot in #1558

Other Changes

Full Changelog: v2.4.1...v2.5.0

Contributors

mudler and localai-bot
Loading

v2.4.1

06 Jan 00:05
@mudler mudler
v2.4.1
ce724a7
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v2.4.1

What's Changed

Exciting New Features 🎉

  • feat: embedded model configurations, add popular model examples, refactoring by @mudler in #1532

Other Changes

Full Changelog: v2.4.0...v2.4.1

Contributors

mudler and localai-bot
Loading

v2.4.0

04 Jan 16:30
@mudler mudler
v2.4.0
bcf0244
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v2.4.0

What's Changed

Bug fixes 🐛

  • fix(entrypoint): cd to backend dir before start by @mudler in #1530
  • fix(diffusers): add omegaconf dependency by @mudler in #1540

Exciting New Features 🎉

👒 Dependencies

Other Changes

Full Changelog: v2.3.1...v2.4.0

Contributors

mudler and localai-bot
Loading

v2.3.1

30 Dec 14:38
@mudler mudler
v2.3.1
a95bb05
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v2.3.1

What's Changed

Bug fixes 🐛

  • Fix: Set proper Homebrew install location for x86 Macs by @cnatale in #1510
  • fix(download): correctly check for not found error by @mudler in #1514

👒 Dependencies

Other Changes

New Contributors

Full Changelog: v2.3.0...v2.3.1

Contributors

cnatale, mudler, and 2 other contributors
Loading

v2.3.0

29 Dec 19:01
@mudler mudler
v2.3.0
9723c3c
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v2.3.0

What's Changed

Bug fixes 🐛

Exciting New Features 🎉

👒 Dependencies

Other Changes

New Contributors

Full Changelog: v2.2.0...v2.3.0

Contributors

M0Rf30, sozercan, and 5 other contributors
Loading

v2.2.0

21 Dec 16:48
@mudler mudler
v2.2.0
9ae47d3
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.
Compare
Choose a tag to compare
v2.2.0

What's Changed

This release brings updates to the backends and includes a fix for recompilation of LocalAI with go-rwkv (#1473). To note, it also tries to reduce the image size by allowing some backends (transformers-based) to share the same environment.

With this release inline templates and models as URLs are supported, for example:

name: mixtral

parameters:
  model: https://huggingface.co/TheBloke/Mixtral-8x7B-v0.1-GGUF/resolve/main/mixtral-8x7b-v0.1.Q2_K.gguf
# or huggingface://TheBloke/Mixtral-8x7B-v0.1-GGUF/mixtral-8x7b-v0.1.Q2_K.gguf@main
template:
  completion: |
            Complete the following: {{.Input}}

Exciting New Features 🎉

  • docs: automatically track latest versions by @mudler in #1451
  • feat: inline templates and accept URLs in models by @mudler in #1452
  • feat(conda): share envs with transformer-based backends by @mudler in #1465

👒 Dependencies

Other Changes

Full Changelog: v2.1.0...v2.2.0

Contributors

mudler, lunamidori5, and localai-bot
Loading