Skip to main content

Run ANY LLM Using Cloud GPU and TextGen WebUI (aka OobaBooga)

In this video, I'll show you how to use RunPod.io to quickly and inexpensively spin up top-of-the-line GPUs so you can run any large language model. It's super easy, and you can run even the largest models such as Guanaco 65b. This also includes a tutorial on Text Generation WebUI (aka OobaBooga), which is like Automatic1111 but for LLMs. Basically, an open-source interface for your LLM.

Enjoy 🙂

Follow me on Twitter 🧠 –
Subscribe to my Substack 🗞️ –
Become a Patron 🔥 –
Join the Discord 💬 –

Links:
Runpod –
Runpod The Bloke Template –
HuggingFace –
Guanaco Model –
TextGen WebUI –

Leave a Reply

Your email address will not be published. Required fields are marked *