Deploy your model

September 19, 2024 / September 19, 2024 by UbiOps

In this guide, we will take you through the newly released Phi-3.5 Small Language Models (SLMs). Which saw updates to Microsoft’s two existing Phi 3 SLMs: Phi-3.5-mini & Phi-3.5-vision, and the release of a new Phi model: the Phi-3.5 Mixture-of-Experts (MoE). We’ll also deploy the newly updated Phi-3.5-mini-instruct to UbiOps using UbiOps’s Command Line Interface […]

Read more »

Functionality Technology

September 17, 2024 / September 17, 2024 by UbiOps

In a linkedin post by Fergal Mcgovern in May, he tries to explain why around 83% of enterprise CIOs plan to place some workloads on-premise instead of on-cloud. Let’s briefly explain what we mean when we say on-cloud and on-premise: On-cloud storage is when data is stored in data centers operated by third parties which […]

Read more »

Technology UbiOps

September 4, 2024 / September 4, 2024 by UbiOps

Artificial intelligence (AI) has the potential to significantly improve efficiency in the medical field. However, as the healthcare sector has very sensitive data, organizations and regulators need to make sure that the technology they employ is safe and effective.  In healthcare, data is very personal and contains a lot of sensitive data about the patient. […]

Read more »

Functionality Technology

August 29, 2024 / August 29, 2024 by UbiOps

Machine learning operations (MLOps) involve a set of techniques and principles aimed at the design, development, deployment, and maintenance of machine learning models for production use. The purpose of MLOps is to establish a clear set of guidelines to simplify the complex process of bringing a model into production. You can also learn more about […]

Read more »

Deploy your model Functionality

August 23, 2024 / August 23, 2024 by UbiOps

In recent times we’ve seen that open-source LLMs like Mixtral and Llama are starting to rival the performance of some proprietary LLMs. One of the things to consider when working with open-source models though is that they do not come ready to go for every use case out of the box, like the lack of […]

Read more »

Deploy your model

July 31, 2024 / July 31, 2024 by UbiOps

In this guide, we’ll take you through the release of the new update from MetaAI. This update saw changes to the existing Llama 3 8B & 70B models, while also releasing a new model with 405B parameters (Llama 3.1 405B). We’ll also deploy a quantized version of the  Llama 3.1 8B Instruct model to UbiOps. […]

Read more »

Functionality Review product

July 12, 2024 / July 12, 2024 by UbiOps

What UbiOps delivers more than standard Model Serving Platforms? Model serving is the process of providing access to production-level models for end-users or applications. Meaning that they will be deployed for internal or external usage . In most cases, such as with UbiOps, they will be available via a REST API. This stage is very […]

Read more »

Product update Technology

July 11, 2024 / July 11, 2024 by UbiOps

On the 11th of July 2024 we have released new functionality and made improvements to our UbiOps SaaS product. An overview of the changes is given below.   Python client library version for this release: 4.5.0 CLI version for this release: 2.22.0 https://www.youtube.com/watch?v=jiM9JWMakCQ   More information about active instances To provide more information on what’s […]

Read more »

Collaborations

June 27, 2024 / June 27, 2024 by UbiOps

June, 27.06.2024 Amsterdam UbiOps, an AI serving and orchestration platform, has partnered with NEBUL, Modern HPC solutions provider and an official NVIDIA Partner for NVIDIA DGX, GPU and Supercomputing Cloud in Europe. UbiOps’ solution is now listed in NEBUL’s starter packs and is included in their core Sovereign-Hybrid Cloud offering. This strategic collaboration and joint […]

Read more »

Functionality

June 21, 2024 / June 21, 2024 by UbiOps

Multi-model routing is a process of linking multiple AI models together. The routing can either be done in series or in parallel, meaning that you use a router to send prompts to specific models. Example of a simple multi-model route Multi-modal routing can have various sorts of benefits. It enables you to have smaller and […]

Read more »

Collaborations

June 20, 2024 / June 20, 2024 by UbiOps

How UbiOps and Arize help you stay in control LLMs are all the rage at the moment, and the APIs of closed source models like GPT-4 have made it easier than ever to leverage the power of AI. However, for a lot of regulated industries these closed source models are not an option. Luckily there […]

Read more »

Deploy your model UbiOps

June 7, 2024 / June 7, 2024 by UbiOps

When Mistral released their Mistral 7B v0.2 model it was claimed to be the most powerful 7B Large Language Model (LLM) at that time. Now Mistral has released a new version, called Mistral 7B v0.3. The new version of Mistral 7B builds further on the success of the previous version. The model has an increased […]

Read more »