Skip to content

Conversation

@lonestriker
Copy link
Contributor

Add oobabooga/text-generation-webui support as an LLM. Currently, supports using text-generation-webui's non-streaming API interface. Allows users who already have text-gen running to use the same models with langchain.

Before submitting

Simple usage, similar to existing LLM supported:

from langchain.llms import TextGen
llm = TextGen(model_url = "http://localhost:5000")

Who can review?

@hwchase17 - project lead

Copy link
Contributor

@hwchase17 hwchase17 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lets add an example notebook as well

@lonestriker
Copy link
Contributor Author

lets add an example notebook as well

Thanks for the review. I've fixed the Black formatting and have added an example notebook.

@lonestriker lonestriker requested a review from hwchase17 June 12, 2023 20:32
@lonestriker
Copy link
Contributor Author

Can a maintainer kick off the workflows? I believe I've fixed the previous errors.

@lonestriker
Copy link
Contributor Author

@hwchase17 can you help kick off the workflows for this PR? I believe I've fixed up all of the errors.

Copy link
Contributor

@hwchase17 hwchase17 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks reasonable, thanks!

@vercel
Copy link

vercel bot commented Jun 16, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
langchain ❌ Failed (Inspect) Jun 16, 2023 6:27am

@vercel vercel bot temporarily deployed to Preview June 16, 2023 06:27 Inactive
@hwchase17 hwchase17 merged commit 6f36f0f into langchain-ai:master Jun 17, 2023
This was referenced Jun 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants