But the flip side is possibly 1000+ tok/s on a SOTA model, which would be game changing.
Could make sense for datacentres or enterprise, but I don't think we'll be getting SOTA Game Boy carts this decade.
But the flip side is possibly 1000+ tok/s on a SOTA model, which would be game changing.
Could make sense for datacentres or enterprise, but I don't think we'll be getting SOTA Game Boy carts this decade.