Fast ML-Only Workflow Analysis

flowchart TD
    Start([New Mailbox: 10k emails]) --> Check{Model exists?}
    Check -->|No| Calibration[CALIBRATION PHASE
~20 minutes]
    Check -->|Yes| LoadModel[Load existing model]

    Calibration --> Sample[Sample 300 emails]
    Sample --> Discovery[LLM Category Discovery
15 batches × 20 emails
~5 minutes]
    Discovery --> Consolidate[Consolidate categories
LLM call
~5 seconds]
    Consolidate --> Label[Label 300 samples]
    Label --> Extract[Feature extraction]
    Extract --> Train[Train LightGBM
~5 seconds]
    Train --> SaveModel[Save new model]

    SaveModel --> Classify[CLASSIFICATION PHASE]
    LoadModel --> Classify

    Classify --> Loop{For each email}
    Loop --> Embed[Generate embedding
~0.02 sec]
    Embed --> TFIDF[TF-IDF features
~0.001 sec]
    TFIDF --> Predict[ML Prediction
~0.003 sec]
    Predict --> Threshold{Confidence?}
    Threshold -->|High| MLDone[ML result]
    Threshold -->|Low| LLMFallback[LLM fallback
~4 sec]
    MLDone --> Next{More?}
    LLMFallback --> Next
    Next -->|Yes| Loop
    Next -->|No| Done[Results]

    style Calibration fill:#ff6b6b
    style Discovery fill:#ff6b6b
    style LLMFallback fill:#ff6b6b
    style MLDone fill:#4ec9b0

flowchart TD
    Start([New Mailbox: 10k emails]) --> LoadModel[Load pre-trained model
Categories: 11 known
~0.5 seconds]

    LoadModel --> OptionalCheck{Verify categories?}
    OptionalCheck -->|Yes| QuickVerify[Single LLM call
Sample 10-20 emails
Check category match
~20 seconds]
    OptionalCheck -->|Skip| StartClassify

    QuickVerify --> MatchCheck{Categories match?}
    MatchCheck -->|Yes| StartClassify[START CLASSIFICATION]
    MatchCheck -->|No| Warn[Warning: Category mismatch
Continue anyway]
    Warn --> StartClassify

    StartClassify --> Loop{For each email}
    Loop --> Embed[Generate embedding
all-minilm:l6-v2
384 dimensions
~0.02 sec]

    Embed --> TFIDF[TF-IDF features
~0.001 sec]
    TFIDF --> Combine[Combine features
Embedding + TF-IDF vector]

    Combine --> Predict[LightGBM prediction
~0.003 sec]
    Predict --> Result[Category + confidence
NO threshold check
NO LLM fallback]

    Result --> Next{More emails?}
    Next -->|Yes| Loop
    Next -->|No| Done[10k emails classified
Total time: ~4 minutes]

    style QuickVerify fill:#ffd93d
    style Result fill:#4ec9b0
    style Done fill:#4ec9b0

flowchart TD
    Start([New Mailbox]) --> LoadModel[Load trained model
11 categories known]

    LoadModel --> Sample[Sample 10-20 emails
Quick random sample
~0.1 seconds]

    Sample --> BuildPrompt[Build verification prompt
Show trained categories
Show sample emails]

    BuildPrompt --> LLMCall[Single LLM call
~20 seconds
Task: Are these categories
appropriate for this mailbox?]

    LLMCall --> Parse[Parse response
Expected: Yes/No + suggestions]

    Parse --> Decision{Response?}
    Decision -->|"Good match"| Proceed[Proceed with ML-only]
    Decision -->|"Poor match"| Options{User choice}

    Options -->|Continue anyway| Proceed
    Options -->|Full calibration| Calibrate[Run full calibration
Discover new categories]
    Options -->|Abort| Stop[Stop - manual review]

    Proceed --> FastML[Fast ML Classification
10k emails in 4 minutes]

    style LLMCall fill:#ffd93d
    style FastML fill:#4ec9b0
    style Calibrate fill:#ff6b6b