Teaching small language models a thing or two

Learn about finetuning small language models for specific tasks using limited data, exploring how this approach can efficiently power agentic workflows.

Overview

I will be presenting our efforts in finetuning a range of small language models (SLMs) for both fun and useful use-cases. I shall go through the pipeline of how to finetune SLMs with limited data and why this might be the future.

Tech stack