About this session
Not every feature needs a frontier model and a network round trip. Amara demonstrates quantised models running on a laptop, a phone and a €60 single-board computer, with honest numbers for latency, quality and battery. A practical introduction for anyone who wants private, offline AI features.
What you'll take away
- How to pick a model size for a given task and device
- What quantisation costs you in quality, measured
- A starter setup you can run on the laptop you brought