Data Lake Architecture

Understands data lake zone architecture (raw, curated, consumption). Queries data from curated layers using SQL and dbt models. Follows team conventions for partitioning, file formats, and naming standards.

Understands medallion architecture principles (bronze/silver/gold). Ingests data into raw landing zones using batch loaders and schema registries. Follows established patterns for Parquet/ORC file layout and catalog metadata.

Independently builds analytics data products on top of data lake layers using dbt and Spark SQL. Optimizes query performance through intelligent partitioning and Z-ordering. Ensures data quality with Great Expectations checks at zone boundaries.

Independently designs ETL pipelines across data lake zones with schema evolution support. Optimizes storage costs using lifecycle policies, compaction, and tiered storage. Implements data quality gates between medallion layers with automated validation.

Architects data systems with Data Lake Architecture. Optimizes for big data. Implements data governance and quality frameworks.

Designs data architecture with Data Lake Architecture. Optimizes for big data. Implements data governance and quality frameworks.

Defines the data lake architecture for the analytics platform: medallion approach (bronze/silver/gold), storage format selection (Parquet, Delta, Iceberg). Implements partitioning and retention standards for cost optimization.

Defines data lake standards: zone architecture (bronze/silver/gold), file formats, partition strategies. Implements access control and data classification. Coordinates between data producers and consumers.

Architects the enterprise lakehouse: Delta Lake/Iceberg as open table format, integration with dbt for transformations, unified governance. Defines the strategy for combining data lake and warehouse for different analytical workloads.

Designs data lakehouse architecture: unified storage layer, query engine federation (Trino/Spark), governance framework. Defines when lakehouse vs traditional DWH vs data mesh.