What a Senior } should know

Applies algorithmic thinking to data analysis: efficient aggregation algorithms for large datasets, sampling algorithms for representative subset selection, ranking algorithms for comparative analysis. Designs efficient data processing pipelines considering computational complexity of statistical operations.

Designs code quality standards for analytical codebases: SQL style guides, notebook organization patterns, reproducible analysis frameworks. Refactors ad-hoc queries into modular, documented, version-controlled analytics pipelines. Establishes review practices for statistical methodology and data visualization code.

Selects optimal data structures for analytical workloads: pandas DataFrames with appropriate dtypes for memory efficiency, hierarchical indices for multi-dimensional analysis, pivot table structures for cross-tabulation. Optimizes data frame operations with vectorized operations and chunked processing. Designs efficient data schemas for reproducible analytical workflows.

Designs Elasticsearch/OpenSearch solutions for analytical workloads: complex aggregation queries, cross-cluster search for distributed datasets, and custom analyzers for text mining. Optimizes for analytical query patterns and large-scale data exploration.

Builds data exploration and visualization backends using Flask and Streamlit. Optimizes API endpoints serving aggregated metrics for executive dashboards. Chooses frameworks suited for interactive data apps with embedded charts. Mentors analysts on building web-based reporting tools.

Designs Redis caching architectures for analytics platforms — query result caching for dashboard acceleration, materialized aggregation caching for complex reports, and session-based filter state management. Optimizes Redis memory for large analytical result sets. Mentors team on caching strategies balancing data freshness with dashboard performance.

Designs optimal table schemas and query strategies for complex analytical workloads in ClickHouse. Masters advanced window functions with custom frames for sophisticated time-series analysis. Implements efficient large-scale cohort analysis pipelines using materialized views, projections, and bitmap functions for billion-row datasets.

Designs complex analytical data models for cross-domain analysis with optimized query patterns. Implements advanced modeling techniques: bridge tables, factless facts, and accumulating snapshots. Mentors analysts on modeling best practices and schema evolution.

Designs indexing architecture for enterprise analytical platforms: partitioned table indexes, materialized view indexing strategies, and index management for data lake query engines (Presto, Trino). Implements automated index recommendation systems based on query workload analysis. Optimizes index strategies for mixed OLTP/OLAP workloads.

Designs reusable analytical SQL frameworks with parameterized CTEs, recursive queries, and advanced window functions for complex statistical analysis in MySQL. Builds self-service data extraction layers with documented views and stored procedures that enable non-technical stakeholders. Optimizes MySQL for analytical workloads by configuring buffer pools, sort buffers, and temp table settings.

Designs PostgreSQL architecture for analytics teams: optimizes query performance for complex multi-dimensional analysis, implements advanced indexing strategies for analytical workloads, configures materialized view refresh strategies for near-real-time reporting. Mentors analysts on SQL performance optimization and data modeling best practices.

Designs query architecture for analytical platforms: query federation across heterogeneous data sources, adaptive query execution for varying data volumes, and automated query optimization recommendation systems. Implements query performance governance with SLA targets. Creates analytical query patterns library and optimization training materials. Mentors team on advanced query engineering.

Designs comprehensive API documentation architecture for data analytics platforms and self-service data access. Defines documentation standards for data query APIs including performance guidelines, data governance annotations, and usage analytics. Establishes automated documentation generation for data catalog and analytical pipeline APIs.

Designs API architecture for analytics data access: efficient data API patterns for dashboards, pagination optimization for large result sets, API caching strategies for frequently queried data. Defines API contracts for analytics pipelines. Mentors team on API-based data access patterns.

Designs Airflow pipeline architecture for complex analytical workflows with cross-dataset dependencies. Implements data lineage tracking and audit logging. Optimizes DAG performance for large-scale analytical data processing.

Designs scalable dashboard architecture for advanced statistical visualization and cross-functional cohort analysis. Optimizes for big data sources with incremental refresh and materialized views. Implements data governance ensuring metric consistency across A/B test and analytics dashboards.

Designs data catalog strategy for analytical domain. Implements automated data profiling and anomaly detection for catalog entries. Builds discovery workflows that accelerate analyst onboarding and cross-team data collaboration.

Designs data contract framework for analytical domain ensuring cross-team data consistency. Implements contract testing automation and drift detection. Mentors analysts on contract-driven development and data quality ownership.

Designs data lineage strategy for analytical domain with column-level tracking and automated documentation. Implements lineage-driven data quality monitoring and root cause analysis workflows. Mentors analysts on lineage-first development practices.

Designs data quality architecture using Great Expectations, dbt, and custom frameworks. Implements observability with anomaly detection and root-cause analysis. Establishes data contracts between producer and consumer teams. Drives governance and SLA definitions for analytical datasets.

Leads analytical schema design across business domains, establishing patterns for fact and dimension table construction. Optimizes complex warehouse queries by redesigning underlying schemas and advising on partitioning strategies. Serves as the bridge between data engineering and business teams, translating analytical needs into warehouse architecture requirements.

Designs dbt transformation architecture for complex analytical domains. Implements advanced patterns: unit testing, contract enforcement, and version-controlled schema evolution. Mentors analysts on dbt best practices and efficient SQL transformation design.

Designs data processing architecture for analytical platforms: distributed data pipelines integrating Pandas/Polars with Spark/Dask, automated data quality monitoring, and self-service analytics data preparation. Implements data governance with schema evolution and backward compatibility. Creates organizational data transformation standards and reusable library. Mentors team on performance optimization.

Architects complex ETL workflows for cross-functional analytical datasets. Designs cohort extraction frameworks, builds self-service data cleaning pipelines, and optimizes transformation logic for large-scale ad-hoc analytical workloads.

Has deep expertise in scikit-learn model interpretability using permutation_importance and SHAP integration for executive reporting. Designs automated analytical pipelines with custom transformers for recurring BI tasks. Mentors analysts on avoiding data leakage and proper holdout strategies.

Designs experiment tracking standards for analytics teams: builds reusable templates for A/B tests and causal analyses, integrates tracking with BI dashboards for stakeholder visibility, and mentors analysts on maintaining auditable experiment histories

Has deep expertise in applying ChatGPT/Claude for advanced analytics workflows. Designs AI-assisted pipelines for automated EDA, hypothesis generation, and natural language reporting. Optimizes prompt engineering for complex statistical analysis tasks and mentors team on critical evaluation of AI-generated analytical insights.

Designs GitHub Copilot adoption strategies for analytics teams: optimizes prompt engineering for data analysis and visualization code, implements validation for AI-generated statistical computations, measures impact on analysis workflow efficiency. Mentors analysts on critical evaluation of AI-assisted analytical code.

Creates production-grade prompt systems for automated data pipelines with error handling and validation loops. Designs prompt evaluation benchmarks using domain-specific datasets and expert annotations. Mentors analysts on advanced techniques: chain-of-thought for complex calculations, retrieval-augmented generation for context-heavy analysis.

Designs observability strategy for analytics infrastructure with Prometheus & Grafana: implements monitoring for data transformation pipelines, defines SLI/SLO for analytical data quality and query performance, conducts post-mortems for processing failures. Mentors team on metric-based analytical infrastructure monitoring.

Designs observability strategy for data analytics infrastructure: implements tracing for data transformation pipelines, defines SLI/SLO for analytical data quality and latency, conducts post-mortems for data processing failures. Mentors team on log analysis for complex data quality investigations.

Designs code review processes for analytics: SQL review standards with performance focus, statistical methodology review checklists, data pipeline review gates. Mentors team on reviewing analytical code for reproducibility and correctness.

Designs Git workflows for analytics teams: implements branching strategies for collaborative notebook development, optimizes conflict resolution for shared analytical assets, configures automated validation for data transformation scripts. Mentors analysts on advanced Git practices for reproducible analysis pipelines.