# \[Feature Request\] (Local) token counter as implemented with Xenova/the-tokenizer-playground

**URL:** <https://forum.cursor.com/t/feature-request-local-token-counter-as-implemented-with-xenova-the-tokenizer-playground/5344>\
**Category:** Feature Requests\
**Created:** [May 28, 2024, 12:12pm UTC](https://forum.cursor.com/t/feature-request-local-token-counter-as-implemented-with-xenova-the-tokenizer-playground/5344 "2024-05-28T12:12:44Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![ssmits](https://avatars.discourse-cdn.com/v4/letter/s/aca169/32.png) [@ssmits](https://forum.cursor.com/u/ssmits)\
**Post date:** [May 28, 2024, 12:12pm UTC](https://forum.cursor.com/t/feature-request-local-token-counter-as-implemented-with-xenova-the-tokenizer-playground/5344/1 "2024-05-28T12:12:44Z")

</div>

Implementing a toggle to add a token counter based on the model and corresponding context window would be amazing (for the Pro subscription).  
The space can be found here, have not looked into how it exactly works:

> **[The Tokenizer Playground - a Hugging Face Space by Xenova](https://huggingface.co/spaces/Xenova/the-tokenizer-playground)**
>
> Experiment with and compare different tokenizers

---

<div class="post-metadata">

**Author:** ![DarkLight](https://avatars.discourse-cdn.com/v4/letter/d/b9bd4f/32.png) [@DarkLight](https://forum.cursor.com/u/DarkLight)\
**Post date:** [August 28, 2024, 3:48pm UTC](https://forum.cursor.com/t/feature-request-local-token-counter-as-implemented-with-xenova-the-tokenizer-playground/5344/2 "2024-08-28T15:48:06Z")

</div>

This is a great idea

---

<div class="post-metadata">

**Author:** ![litecode](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/litecode/32/2966_2.png) [@litecode](https://forum.cursor.com/u/litecode)\
**Post date:** [August 28, 2024, 5:19pm UTC](https://forum.cursor.com/t/feature-request-local-token-counter-as-implemented-with-xenova-the-tokenizer-playground/5344/3 "2024-08-28T17:19:50Z")

</div>

I just came across this topic, after I had posted something similar, just linking for reference:

> [@Display number of tokens in current chat](https://forum.cursor.com/t/display-number-of-tokens-in-current-chat/6972):
>
> I am not sure if this information is easily available, but I just noticed that when mentioning files with the @ feature in Ctrl + L in Long Context Chat mode, there is a handy feature that displays the token length of the file next to the file name. That is very cool. It made me wonder if it would be possible to display the cumulative token length of the chat somewhere - i.e. where the value was updated as the chat progressed, just to see how large the chat was actually getting. In case it ma…

---

<div class="post-metadata">

**Author:** ![system](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/system/32/99069_2.png) [@system](https://forum.cursor.com/u/system)\
**Post date:** [June 18, 2026, 10:14am UTC](https://forum.cursor.com/t/feature-request-local-token-counter-as-implemented-with-xenova-the-tokenizer-playground/5344/4 "2026-06-18T10:14:59Z")

</div>

Closed on June 18, 2026, 10:14am UTC