Articles by tag: data-engineering

Three Data Aggregation Errors in BI Systems

Learn why BI systems lie: mathematical errors in averaging, count distinct, and snapshot metrics. How to build analytics without distortions.

ClickHouse Materialized Views: Nuances and Solutions

How MV Works in ClickHouse? Critical Differences from Classical DBMS, UPDATE/DELETE Limitations and Best Practices. Learn How to Avoid Design Errors.

Declarative Data Pipeline in Spark | Classes and Decorators

How to Build a Maintainable Data Pipeline Using Classes and Decorators in Python. Implementation on Spark for Data Engineering Projects. Read the Guide.

Vibe-coding in hiring data engineers: AI signs

How to recognize AI generation in data engineers' test tasks. Interview adaptation, types of vibe-coders and market degradation. Practical tips for hiring mid-levels — read the experience.

AWS DEA-C01: how to pass without cloud experience

Preparation for AWS Data Engineer Associate: Dojo, Anki, Udemy resources. Passing experience with 805/1000. ETL, Glue, Athena — key topics. Start systematically for certification.

ArchDB: modular DB schemas as code

Explore declarative DB modeling in ArchDB: templates, packages, generated fields. Speed up development, eliminate duplicates. Examples for PostgreSQL over 2500+ characters.

Iceberg Optimization: sorting and deletion vectors

Configuring write order, statistics, and vectorized deletion in Apache Iceberg. Speed up queries, reduce load on storage. For data engineers.

Big Data Courses 2026: Data Engineering Overview

Comparison of 6 Big Data and Data Engineering courses: from zero to middle. ETL, Spark, Kafka, Yandex Cloud. Choose a program by level and format for a career in 2026. Sign up now.

Parquet in Python: reading, writing and optimization

Practical guide for data engineers: how to read Parquet with filtering, write with explicit schema, use dictionary encoding and partitioning. Works in production.

Streaming Data Processing on Elixir: Architecture and Implementation

Get to grips with the architecture of streaming data processing on Elixir: from node classification to simulator implementation and integration. Learn more!

ETL Architecture: asapBI, Trino, Spark, Airflow for data engineers

How asapBI combines Trino, Spark, and Airflow into a single interface for ETL processes. Code autogeneration, orchestration, and Open Source solutions for data engineers.