These skills do not affect the main grade but show the breadth of your profile.
AI Coding Assistants
▼
Getting started with LLM assistants to accelerate analytics engineering work. Understands how to use ChatGPT and Claude for generating SQL queries, writing dbt models, and data analysis.
Effectively uses LLMs for analytics engineering tasks — SQL optimization, dbt test generation, and model documentation. Applies AI assistants for data exploration and prototyping analytics pipelines.
Develops the strategy for using AI tools in the analytics team, standardizes approaches to LLM-assisted development. Trains engineers on effectively applying ChatGPT and Claude for improved data work productivity.
Getting started with Cursor IDE's AI capabilities for improving analytics development productivity. Understands SQL auto-completion, dbt model generation, and contextual search for data projects.
Effectively uses Cursor IDE to accelerate analytics development — generating SQL queries, dbt tests, and documentation. Configures AI context for proper operation with dbt projects, Jinja templates, and analytics patterns.
Establishes Cursor IDE usage standards for the analytics team, configures shared settings for dbt projects. Trains engineers on effectively using AI tools to improve quality and speed of analytics development.
Uses GitHub Copilot to accelerate writing basic SQL queries and dbt models. Accepts suggestions for typical staging transformations: column renaming, type casting, basic JOINs. Verifies generated SQL before committing.
Effectively applies Copilot for writing dbt models and tests: prompts context through comments, uses inline suggestions for window functions and CTEs. Generates YAML documentation and schema tests with AI auto-completion.
Defines standards for using AI tools in the analytics engineering team: guidelines for Copilot in dbt projects, review processes for AI-generated SQL. Implements AI-assisted documentation and testing of analytical models.
Algorithms & Data Structures
▼
Understands basic algorithmic concepts for analytics: simple SQL aggregation operations, basic sorting and grouping strategies, data deduplication approaches. Follows team guidance on query optimization and transformation algorithm selection.
Independently applies algorithmic thinking in analytics: evaluates query execution plan efficiency, selects appropriate aggregation strategies for large datasets, understands partitioning algorithm impact on performance. Analyzes complexity of data transformation operations.
Evaluates computational complexity of SQL transformations and dbt models on large data volumes. Optimizes aggregation algorithms and window functions in analytical queries. Implements query plan profiling practices in the data warehouse.
Defines the analytics platform performance optimization strategy. Architects approaches for processing petabyte datasets: incremental models, approximate algorithms (HyperLogLog for distinct count), materialized views for heavy aggregations.
Understands basic data structures for analytics engineering: SQL table schemas, dbt model source/ref relationships, staging layer data formats. Follows team conventions for organizing dbt project structure and data transformation queries.
Independently selects appropriate data structures for analytics: dimensional modeling for warehouse schemas, CTEs for complex SQL transformations, staging/mart layer organization in dbt. Understands trade-offs between normalization levels for analytical query performance.
Defines data modeling standards in dbt: choosing between nested structures and normalized tables, ARRAY/MAP types in analytical queries. Reviews data structure decisions in the context of BI dashboard performance.
Application Security
▼
Getting familiar with major OWASP vulnerabilities and their impact on analytics system security. Understands SQL injection risks and unauthorized access to analytical data and dashboards.
Applies OWASP recommendations to protect analytics pipelines and dashboards from common vulnerabilities. Implements input validation, parameterized queries, and proper access management for analytics resources.
Establishes the analytics platform security policy based on OWASP recommendations. Coordinates security reviews of analytics pipelines and ensures data protection compliance across all processing stages.
Getting familiar with secure coding principles for developing analytical pipelines. Understands risks of storing credentials in code, the need for SQL parameterization, and basic protection of sensitive data.
Applies secure coding practices in analytics pipelines — managing secrets through vault, parameterized queries, and PII masking. Implements audit logging for tracking access to sensitive data.
Establishes secure coding standards for the analytics team, including data classification and access control policies. Organizes security reviews of analytics pipelines and trains developers on defensive data engineering.
Caching
▼
Uses Redis at a basic level in dbt. Performs simple tasks using ready-made templates. Understands basic concepts and follows team practices.
Independently implements tasks with Redis in dbt. Understands internals and optimizes performance. Writes tests using dbt test.
Defines the analytics platform caching strategy: Redis for hot metrics and KPIs, invalidation policies on model recalculation. Implements caching at the semantic layer for accelerating BI queries.
Architects the analytics caching infrastructure: multi-tier caching (warehouse result cache, application cache, CDN for embedded dashboards). Defines cache consistency strategy for incremental data updates.
CI/CD
▼
Runs dbt commands through GitHub Actions: dbt run, dbt test in pull requests. Understands basic workflow file structure and reads CI logs for debugging model errors.
Configures CI/CD for dbt projects: sqlfluff lint on PR, slim CI with dbt run --select state:modified+, automated dbt tests. Configures dbt package and target caching for pipeline acceleration.
Defines CI/CD standards for organizational analytics projects: reusable workflows for dbt, automated data quality gates, cost estimation in PRs. Implements a GitOps approach for managing warehouse resources and permissions.
Clean Code & Refactoring
▼
Understands basic code quality principles for SQL and dbt model development. Follows team SQL style guide and dbt project conventions. Writes simple, readable data transformation queries with proper naming. Accepts code review feedback on query organization and documentation.
Independently applies code quality practices in analytics engineering. Writes well-structured dbt models with clear naming and documentation. Understands trade-offs between query performance and code readability in SQL. Reviews data transformation code for correctness and maintainability.
Establishes dbt project quality standards: sqlfluff for SQL linting, pre-commit hooks for YAML validation, mandatory dbt tests in CI/CD. Implements code review processes focused on model performance and readability.
Cloud Providers
▼
Works with basic AWS services for analytics: S3 for raw data storage, Redshift/Athena for SQL queries. Understands IAM roles for data access and basic data lake structure.
Configures AWS infrastructure for analytics tasks: S3 buckets with lifecycle policies for raw/processed data, Glue for cataloging, Athena for ad-hoc analytics. Integrates dbt with Redshift/Athena via profiles.
Defines the AWS strategy for organizational analytics: choosing between Redshift and Athena for different workloads, cost management through reserved capacity and serverless. Implements tagging and cost allocation for analytics resources.
Code Review
▼
Participates in code review of dbt models: checks naming conventions, presence of tests and documentation. Leaves constructive comments on SQL style and YAML configuration structure. Learns from senior colleagues' feedback.
Conducts quality code reviews of dbt models: verifies transformation business logic, correctness of JOINs and window functions, SQL performance. Validates incremental logic and snapshot configurations. Pays attention to edge cases.
Defines code review standards for analytics engineering: checklists for dbt PRs (model, tests, docs, performance), automated checks in CI, review SLA. Builds a culture of quality through constructive feedback and knowledge sharing.
Concurrency & Parallelism
▼
Studies asynchronous programming basics for parallel loading and processing of analytical data. Understands async/await concepts, promises, and their application in ETL scripts and data pipelines.
Implements asynchronous data processing in analytics pipelines — parallel loading from multiple sources and concurrent transformations. Applies async patterns to optimize ETL task execution speed.
Defines asynchronous data processing standards for the analytics platform, including concurrency patterns and error handling. Trains the team on effectively using async patterns for accelerating analytics pipelines.
Studies multithreading and parallel computing basics for accelerating analytical data processing. Understands thread, process, and basic synchronization primitive concepts when working with large datasets.
Implements parallel data processing in analytics pipelines — concurrent loading from sources and parallel transformations. Applies multiprocessing for accelerating Python ETL and understands GIL limitations.
Defines parallel data processing standards for the analytics platform, including partitioning strategies and error handling. Trains the team on safe parallel programming to accelerate analytical tasks.
Containerization
▼
Uses Docker to run local development environments: dbt connected to dev warehouse, PostgreSQL for testing. Understands Dockerfile and docker-compose for the analytics stack. Works with pre-built dbt images.
Creates Docker images for analytics tools: dbt with custom packages, Python scripts for data extraction, sqlfluff for CI. Configures docker-compose for local testing of the full analytics pipeline.
Defines containerization standards for the analytics stack: base images for dbt projects, templates for data extraction jobs, security policies for images. Implements a container registry and versioning for analytics tools.
Database Optimization
▼
Understands indexing principles and their impact on analytical query speed. Reads query execution plans and identifies when indexes are used. Creates simple B-tree indexes based on senior colleagues' recommendations.
Analyzes query execution plans to determine necessary indexes in data sources. Creates composite indexes for typical analytical patterns: date filtering + dimension. Understands the trade-off between read and write speed.
Defines indexing standards for the analytics platform. Implements automated query performance monitoring and optimization recommendations. Trains the team on reading query plans in the warehouse context.
Architects the platform-level data access optimization strategy: automatic clustering, search optimization in Snowflake, BI Engine in BigQuery. Defines cost-based optimization approaches for analytical queries.
Distributed Tracing
▼
Studies OpenTelemetry basics for monitoring analytical pipelines and ETL processes. Understands trace and metric concepts for tracking analytics task execution and diagnosing issues.
Instruments analytics pipelines with OpenTelemetry for tracing ETL processes from source to warehouse. Configures metrics for task duration, data volumes, and error rates for analytics services.
Defines instrumentation standards for analytics services via OpenTelemetry, including semantic conventions for data operations. Implements an observability-driven approach to ETL process optimization and data quality monitoring.
Git & Workflows
▼
Uses Git for dbt project work: cloning, creating feature branches, basic commits. Understands gitflow for dbt: feature branch → pull request → merge to main. Works with .gitignore for target/ and dbt_packages/.
Effectively uses Git in dbt development: atomic commits per model/model group, rebase for clean history, cherry-pick for production hotfixes. Resolves merge conflicts in SQL models and YAML configurations.
Defines version control standards for the analytics organization: mono-repo vs multi-repo for dbt projects, semantic versioning for dbt packages, release management. Implements Git-based governance for production models.
GraphQL
▼
Studies GraphQL basics and its application for creating analytics APIs. Understands concepts of queries, mutations, and schema-first approach for providing analytical data to consumers.
Implements GraphQL APIs for analytics data access with flexible filtering and aggregation. Designs schemas for analytical entities with pagination, nested resolvers, and N+1 query optimization against the warehouse.
Defines GraphQL API standards for the analytics platform, including naming conventions and metric/dimension patterns. Coordinates development of a unified data API for providing analytical data to all organizational consumers.
Integration Testing
▼
Understands basics of integration testing for data pipeline stages. Writes simple tests verifying data transformations between source systems and warehouse tables. Follows team testing guidelines for ETL/ELT job validation.
Conducts integration tests of dbt models: verifying connectivity between layers (staging → intermediate → marts), validating referential integrity, testing full data pass through the pipeline.
Defines integration testing standards: dbt source freshness checks, cross-model consistency tests, automated BI dashboard validation. Implements contract testing between data producers and analytical models.
Kubernetes & Orchestration
▼
Studies basic Kubernetes concepts to understand analytics service infrastructure. Understands the role of container orchestration for deploying Airflow, dbt, and analytics APIs in production.
Deploys analytics services in Kubernetes — Airflow workers, dbt jobs, and APIs for analytics data access. Configures CronJobs for regular ETL tasks and resource limits for optimal cluster utilization.
Defines the analytics platform orchestration strategy in Kubernetes, standardizes analytics service deployment. Implements GitOps for infrastructure management and ensures ETL process reliability in containerized environments.
Logging
▼
Understands dbt run logs: interprets warnings and errors during model execution. Uses dbt log output for diagnosing SQL transformation errors. Monitors test results in the CI/CD pipeline.
Configures structured logging for the analytics pipeline: dbt artifacts (manifest.json, run_results.json) for monitoring, custom logging in Python scripts for data extraction. Creates alerts based on dbt test results.
Defines observability standards for the analytics platform: dashboards for dbt pipeline health, SLA monitoring for data freshness and quality. Implements incident management processes for data quality issues with structured runbooks.
Metrics & Monitoring
▼
Studies monitoring basics with Prometheus and Grafana for tracking analytical pipeline health. Understands metric and alert concepts as applied to ETL processes and data warehouses.
Configures analytics pipeline monitoring in Prometheus — ETL duration metrics, processed data volumes, and load errors. Creates Grafana dashboards for tracking data freshness and analytics platform SLA.
Defines the analytics platform monitoring strategy, standardizes data quality and performance metrics. Implements a data-driven approach to ETL process optimization based on Prometheus and Grafana monitoring.
Networking
▼
Studies networking protocol basics needed for analytics systems — HTTP, TCP, DNS. Understands basic networking principles between ETL tools and data sources.
Applies networking knowledge to configure reliable analytics pipeline interaction with data sources. Understands firewall rules, VPN tunnels, and SSH connections for secure access to database sources.
Defines network standards for the analytics platform, including secure source connections and data environment isolation. Coordinates network architecture with infrastructure teams to ensure required throughput.
OOP & Design Patterns
▼
Getting familiar with main design patterns applicable to analytics engineering — Factory, Strategy, Observer. Understands how patterns help organize data pipeline and transformation code.
Applies design patterns in analytics systems — Strategy for transformation selection, Factory for connector creation, Pipeline for processing chains. Structures dbt project code using template patterns.
Defines a design pattern catalog for the analytics platform, trains the team on applying them in data engineering. Establishes best practices for using patterns to build maintainable and testable analytics systems.
Getting familiar with object-oriented programming basics for structuring analytical code. Understands encapsulation, inheritance, and polymorphism concepts as applied to organizing data models and transformations.
Applies OOP principles for creating reusable analytics components — transformer classes, validators, and data connectors. Uses SOLID principles for organizing dbt model code and analytics pipelines.
Defines standards for applying OOP principles in analytics development, ensuring code modularity and testability. Establishes architectural patterns for the analytics engineering team balancing simplicity and extensibility.
Prompt Engineering
▼
Formulates basic prompts for ChatGPT/Claude when writing SQL queries and dbt models. Describes the data schema and desired result to get correct SQL. Uses AI to understand unfamiliar SQL patterns.
Composes effective prompts for analytics tasks: describing data model context, few-shot examples for the team's SQL style. Uses AI for refactoring dbt models, writing tests, and generating model documentation.
Defines the prompt engineering strategy for the analytics engineering team: a prompt library for modeling, testing, and documentation. Implements AI-powered code review for dbt models with custom prompts for best practice verification.
Relational Databases
▼
Writes basic SELECT queries on PostgreSQL for extracting data from staging tables. Understands data types, JOINs, and GROUP BY for simple analytical tasks. Uses pgAdmin or DBeaver for exploring database structure.
Creates complex analytical queries with CTEs, window functions, and subqueries in PostgreSQL. Uses EXPLAIN ANALYZE for profiling queries on large tables. Works with PostgreSQL-specific types: JSONB, ARRAY, INTERVAL.
Defines the PostgreSQL usage strategy in the analytics stack: read replicas for BI queries, materialized views for intermediate aggregations. Implements naming and schema documentation standards for the data catalog.
Architects PostgreSQL's role in the analytics platform: as an operational datastore, as a metadata backend for tools (Airflow, dbt). Defines the data migration strategy from PostgreSQL to the analytical warehouse.
REST API
▼
Understands REST API principles for integrating with external data sources. Uses Python requests/httpx for extracting data from APIs into staging models. Understands HTTP methods, status codes, and pagination.
Designs reliable pipelines for extracting data from REST APIs: handling pagination, rate limiting, retry logic. Creates dbt sources from API data via intermediate staging tables. Documents API dependencies in the data catalog.
Defines API integration standards for the analytics stack: choosing between custom extractors and managed tools (Fivetran, Airbyte), SLA for API data freshness. Implements data contracts for internal APIs as analytics sources.
System Design
▼
Studies basic system design principles applied to analytical platforms. Understands scalability, partitioning concepts, and differences between OLTP and OLAP architectures for analytical systems.
Architects analytics pipeline considering data volumes, update frequency, and freshness requirements. Selects patterns for data warehouse organization — star schema, medallion architecture, ELT vs ETL.
Defines architectural principles for the analytics platform, including data lakehouse, streaming, and semantic layer. Leads system design to enable business user self-service and analytics scalability.
Type Systems
▼
Studies typing basics and their importance for analytics code reliability. Understands the difference between typed and untyped approaches, uses type annotations in Python for data pipelines.
Applies strict typing in analytics pipelines through Pydantic, dataclasses, and typed DataFrames. Uses schema validation for data contracts between sources, transformations, and consumers.
Defines typing standards for the analytics platform, including data contracts and schema governance. Ensures type consistency between ETL pipelines, warehouse, and analytics APIs for data reliability.
Unit Testing
▼
Understands basic unit testing for analytics code: dbt test fundamentals, simple data quality assertions, schema test setup. Follows team practices for testing SQL transformations and data model constraints.
Writes dbt unit tests to verify transformation business logic: fixed input data, expected results. Tests edge cases in SQL models: NULL handling, boundary dates, division by zero in metrics.
Defines analytical model testing standards: mandatory test coverage for the mart layer, automated regression suites for KPI metrics. Implements test environments with representative data samples for model validation.