Compose and Dragons: Tiny Language Models in Action

Explore how tiny language models can create engaging NPCs and game masters, debunking myths about their capabilities for generative AI systems.

Overview

Let’s debunk some beliefs about (very) small LLMs, those that make less than 4b of parameters. We often hear:
They are useless and do not know how to do anything, they know nothing, they are bad at calling (so no MCP)

This is partly wrong, and we can fix the rest and build generative AI systems with these very small models.

Among other things, we will see how to create NPCs with a personality, a master dungeon that will manage your movements, fights… and allow you to talk to this or that NPC …

Video

Transcript

Generated 3 months ago

Summary

Generating a talk summary...

View full transcript

Speaker 0: If I try the 9 1, I can stop the presentation. Speaker 1: So I'm using the So this is the map. Wow. Wow. Wow. Yeah. Speaker 1: That is not it. So the map, is fixed. You can select the number of all. The generation of And we have an evil boss. So it's like the NBC agents, but at the end, you have to ask you have to give the boss some answers. Speaker 1: It's Spanx, and to be able to exit the dungeon. And Okay. So I'm only using small models and local models. You cannot see all the it's all the 2 call device server. Yeah. Speaker 1: This property. This I was sure I was in the other room, but I don't know. I want to speak with 1 of the n NTP. So go twice. Okay. Speaker 1: So sure. I tried to speak. I think I fed my demonstration. No. Yeah. Speaker 1: So now, I'm using another right chance. Switch Speaker 2: to Speaker 1: yes. But it is more. Okay. Correctly your model, but, I choose higher condensation. So I lose some Yes. Speaker 1: Procedure. Accuracy. Yeah. Perfect. But at the end, even on my machine, and with the garage and with the I'm using a new model, Speaker 2: Thank you very much. And last but not least, before Okay. Why Sebastian, figure out how to do that? If you wanna know more information about the talks, you can click on the presenters page. And there, you will have a view project page link. Speaker 2: So right here with all of the information, all of the technologies that he's using, all the related projects that he might have. Oh. He's right. Speaker 1: Crazy. Okay. I'm good to go now? You're good to go. Okay. Speaker 1: Awesome. Where I oh, I probably need to share my screen as well. No? No. It's fine. Speaker 1: That's going pretty interesting.

Links

Tech stack