July 31, 2024 - UbiOps - AI model serving, orchestration & training

Deploy your model

Deploy Llama 3.1 8B Instruct on UbiOps

July 31, 2024 / July 31, 2024 by [email protected]

In this guide, we’ll take you through the release of the new update from MetaAI. This update saw changes to the existing Llama 3 8B & 70B models, while also releasing a new model with 405B parameters (Llama 3.1 405B). We’ll also deploy a quantized version of the Llama 3.1 8B Instruct model to UbiOps. […]

Tagged

deploy llama3.1 llm