How to use TOON to reduce your token usage by 60%
SMRTR summary
Token-Oriented Object Notation (TOON), a new serialization format designed specifically for large language models, reduces token usage by 30-60% compared to JSON by declaring field names once instead of repeating them for each object in uniform arrays. The format works best with tabular data containing many similar objects, though it has limitations with deeply nested or irregular data structures and requires teaching LLMs the format through examples.
SMRTR provides this summary for quick context. The original article belongs to Daily.dev.
Read the original article