LLM now decides which new categories should be added to persistent cache
for future mailbox runs vs temporary (run-only) categories.
ENHANCED LLM REVIEW:
- New field: "cache_worthy" (true/false) for each "new" category
- LLM judges: "Is this category useful across different mailboxes?"
- Examples:
- "Customer Support" → cache_worthy: true (universal)
- "Project X Updates" → cache_worthy: false (mailbox-specific)
CACHE EVOLUTION:
- cache_worthy=true → Added to persistent cache for future runs
- cache_worthy=false → Used for current run only, not cached
- First run (empty cache) → All categories treated as cache-worthy
- LLM reasoning logged for transparency
INTELLIGENT GROWTH:
- Cache grows organically with high-quality, reusable categories
- Prevents pollution with mailbox-specific categories
- Maintains cross-mailbox consistency while allowing natural evolution
- LLM balances: consistency (snap existing) vs expansion (add worthy)
SINGLE LLM CALL EFFICIENCY:
- Same ~4 second LLM call now handles:
1. Snap vs new decision
2. Cache persistence decision
3. Reasoning for both
- No additional overhead for cache evolution
Result: Cache evolves intelligently over time, collecting universally
useful categories while filtering out temporary/specific ones.