[Webinar] Generative AI for corporate use - Fine tuning foundation models

October 5, 2023
11:30 am
Online event
webinar
Organiser
Guest speakers
Michiel De Koninck
Machine Learning Engineer and LLM specialist

Foundation models like ChatGPT and Stable Diffusion are large, pretrained AI models which, out of the box, come with amazing capabilities in terms of text and image generation. To be truly useful in a corporate context, however, they need to be further constrained and guided. 

For text, the retrieval augmented generation (RAG) architecture has been the most common method of using these pre-trained models to ground them on the most relevant, up-to-date information and provide accurate answers in a corporate context. This type of setup feeds selected chunks of data to the foundation model via the prompt, without touching the model itself.

The last couple of months has seen more intensive efforts in the re-training or fine tuning of the foundation models itself. In this approach a dataset composed of company specific data and/or public data is assembled and used to adjust the model parameters slightly to better perform the specific task at hand.

     

In our next ML6 webinar we will be sharing our perspective on the benefits and hurdles of the fine tuning approach and provide you with practical guidelines on how to get started.

Don't miss this opportunity to stay up to date on the fast moving domain of Generative AI. Register today to reserve your spot!