Abdul Samad SiddiquiSenior AI Engineer · Karachi

Blog topic

System design

Caching, consistency and the backend that keeps AI products standing.

  1. Diagram of two cursors sending labeled insert and delete operation strips across dashed lines to a central sequencer that orders and transforms them.

    Collaborative editing works because changes become operations

    Last-write-wins and locking both fail for real-time text collaboration. The fix is turning every keystroke into an operation the server can order and transform, here's how, and what it isn't.

  2. Three side-by-side technical diagrams showing cache penetration, cache stampede and cache avalanche as distinct failure paths from client to origin database.

    Three Redis failures that look similar until production

    Cache penetration, stampede and avalanche all look like "Redis fell over," but each has a different cause and a different fix. Here's how to tell them apart.

  3. Three labelled cache drawers for application data, prompt prefixes, and final responses, connected to a simple language model pipeline.

    The three caches in a production LLM system

    Application data, repeated prompt prefixes, and final answers behave differently. Treating them as one cache creates stale replies and hides the real cost of an AI product.