Skip to content

Content Moderation — Detailed#

flowchart TB
  subgraph Inputs
    TXT[Text posts]
    IMG[Images]
    VID[Videos]
    LIVE[Live streams]
    AUD[Audio]
  end

  subgraph ML[ML classifiers]
    NSFW([NSFW image])
    VIOL[Violence]
    HATE[Hate speech]
    SPAM[Spam]
    CHILD[CSAM hash match]
    COPY[Copyright fingerprint]
    DEEPF[Deepfake detection]
    OCR([OCR text])
    ASR[Audio transcription]
  end

  subgraph Hashes
    PD[PhotoDNA hash]
    PERC[Perceptual hash dedup]
    MEDIA_GRAPH[Known-bad media graph]
  end

  subgraph Policy
    RULE[Policy / rules]
    GEO[Region-specific laws]
    AGE[Age gating]
  end

  subgraph Queue
    HIGH[[High-priority queue]]
    MED[Medium]
    LOW[Low]
    SLA[SLA tracking]
  end

  subgraph Human[Human review]
    MOD[Moderators]
    TOOL[Mod tooling]
    TRAIN[Training + welfare]
    ESC[Escalation]
  end

  subgraph Actions
    REMOVE
    LIMIT[Reduce reach]
    LABEL[Warn label]
    BAN[Ban / strike]
    LEGAL[Legal hold / reporting]
  end

  subgraph Loop
    APPEAL([User appeal])
    FEED[Decision feedback into ML]
    AUDIT[Audit log + transparency report]
  end

  Inputs --> ML --> Policy --> Queue --> Human --> Actions
  Hashes --> ML
  Loop --- Actions

    classDef client fill:#dbeafe,stroke:#1e40af,stroke-width:1px,color:#0f172a;
    classDef edge fill:#cffafe,stroke:#0e7490,stroke-width:1px,color:#0f172a;
    classDef service fill:#fef3c7,stroke:#92400e,stroke-width:1px,color:#0f172a;
    classDef datastore fill:#fee2e2,stroke:#991b1b,stroke-width:1px,color:#0f172a;
    classDef cache fill:#fed7aa,stroke:#9a3412,stroke-width:1px,color:#0f172a;
    classDef queue fill:#ede9fe,stroke:#5b21b6,stroke-width:1px,color:#0f172a;
    classDef compute fill:#d1fae5,stroke:#065f46,stroke-width:1px,color:#0f172a;
    classDef storage fill:#e5e7eb,stroke:#374151,stroke-width:1px,color:#0f172a;
    classDef external fill:#fce7f3,stroke:#9d174d,stroke-width:1px,color:#0f172a;
    classDef obs fill:#f3e8ff,stroke:#6b21a8,stroke-width:1px,color:#0f172a;
    class APPEAL client;
    class TXT,IMG,VID,LIVE,AUD,VIOL,HATE,SPAM,CHILD,COPY,DEEPF,ASR,PD,PERC,MEDIA_GRAPH,RULE,GEO,AGE,MED,LOW,SLA,MOD,TOOL,TRAIN,ESC,LIMIT,LABEL,BAN,LEGAL,FEED service;
    class HIGH queue;
    class NSFW,OCR compute;
    class AUDIT obs;

Glossary & fundamentals#

Concept What it is Fundamentals
Probabilistic structures perceptual hash, MinHash probabilistic-data-structures
Pub/Sub media events into pipeline pub-sub-pattern
Idempotency safe retries idempotency-retries
CDC decisions feed search/index change-data-capture
Observability SLA + appeal SLOs observability