AI Inference in the Real World: From Kubernetes to the Far Edge

AI workloads don’t all belong on the same model, hardware, or infrastructure.

For our 13th AI Native Netherlands meetup, Christian Melendez from AWS will look at when smaller models and CPUs make more sense than defaulting to large GPU-backed LLMs.

William Rizzo from Mirantis will take that question to the far edge: running LLM inference on immutable, disconnected clusters where connectivity is unreliable and remote access can’t be assumed.

Together, the talks explore one practical question:

What should run where, on what hardware, and how do you keep it reliable in production?

A huge thank you to our friends at AWS for hosting us at their Amsterdam office. Food and drinks will be provided!