I don’t understand how Gemini’s 128k token limit works in Google AI Plus 🤔

Hey,

I started playing around with Gemini and bought the AI Plus plan that supposedly has a 128k token context window.

What I don’t get is how the tokens are counted there.

I uploaded a few books as PDFs into a Gemini Gem – in total around 600 pages (some of them are just images). Then I created a chat inside that Gem.

I was 100% sure I’d go over the token limit, because I assumed the tokens from all the uploaded material would just add up.

But I asked it some control questions, and it really looks like it loaded the entire books and didn’t cut anything out.

Do you understand what’s going on here?

Am I missing something about how Gemini handles tokens/context?

Leave a Reply