Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Does a mid-session provider switch result in loading the entire context into the new model, inflating session cost?

I don't think I understand the token/cost implications of this feature



Its nice if you used local, but needed å beefier modell, or more context Window. It will eat input tokens, but you do that all the time unless you have input caching.


Yes you pay a big burst right after switching. After that, everything is cached and it's smooth sailing.




Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: