Pinterest Uses Event Time Watermarks to Finalize Petabyte Scale Data Partitions

  1. Home
  2. Blog

Posted on Mon Oct 19 2026 | 8:07 pm

Pinterest has introduced event time-based partition finalization for its database ingestion framework. The mechanism uses Apache Flink to track event time and Apache Iceberg metadata to publish a non-regressing watermark, helping downstream jobs determine when continuously ingested CDC data is sufficiently complete for processing.

Read More →


Search
Categories
Side Widget
You can put anything you want inside of these side widgets. They are easy to use, and feature the new Bootstrap 4 card containers!