Articles by tag: etl-pipeline

MV in ClickHouse: data loss and control

Analysis of risks of materialized views in ClickHouse: schema errors, block insert, monitoring system.query_views_log. How to avoid losses in production. Practical code examples.

API WB Ozon: handling 429 and 50x errors

Learn to reliably collect data from Wildberries and Ozon API without failures. Retry logic, daily batching, monitoring. Code examples for middle/senior dev.