What are tokens in terms of money and limits?
Essence
Models don't read and write letters or words but tokens: chunks of text. Tokens are at once the unit of price (the API charges per million tokens), the unit of limits (subscriptions and rate limits are counted in them) and the unit of context window size. Understanding where tokens come from explains why one agent session costs pennies while another eats your daily limit.
The rest of this answer, with code and interview follow-ups, is in the DevPrep app.
Read the full answer in DevPrep