Defines algorithmic standards for test automation team: test prioritization algorithm criteria, parallel execution scheduling strategies, test data generation algorithm evaluation. Conducts reviews of algorithmic decisions in test framework performance.
Roles · QA Automation Engineer · Lead
What a Lead } should know
37 core skills, 54 in total. Expectations per skill, and what changes at the next level.
This page lists what a Lead } is expected to know and do, skill by skill. Core skills are the ones a manager and peers assess in a review cycle; the rest count only in self-assessment. Main areas: Programming Fundamentals, Backend Development, Database Management.
Core skills for a Lead
Grouped by area. The label on the right is the expected depth: Awareness, Working, Advanced or Expert.
Programming Fundamentals · 6
Defines async programming standards for test automation team: parallel test execution architecture guidelines, async test environment provisioning reviews, concurrent result collection patterns. Establishes best practices for async patterns in test infrastructure.
Defines code quality standards for test automation team: framework architecture decisions, page object conventions, test data management strategies. Conducts reviews of test suite design and CI integration. Establishes quality gates for test reliability and maintainability.
Defines data structure standards for test automation team: test data model conventions, fixture generation patterns, result aggregation structures. Conducts reviews of test framework data architecture. Establishes team guidelines for efficient test data management in parallel execution.
Defines design pattern standards for QA automation teams: establishes architectural review practices for test framework patterns, creates guidelines for pattern selection in test infrastructure design, conducts training on patterns for maintainable and extensible test architectures.
Defines OOP/SOLID standards for test automation team: Page Object Model architecture guidelines, test framework interface contracts, fixture/factory class design patterns. Conducts reviews of test code OOP decisions for maintainability and parallel execution support.
Backend Development · 2
Defines architectural decisions for Node.js Frameworks at the product level. Establishes standards. Conducts design reviews and determines technical roadmap.
Defines architectural decisions for Python Web Frameworks at the product level. Establishes standards. Conducts design reviews and determines technical roadmap.
Database Management · 1
Defines PostgreSQL testing strategy for QA teams: establishes standards for database test fixtures and test data management, designs test infrastructure architecture for database-dependent testing, drives adoption of database testing best practices across QA teams.
API & Integration · 4
Defines API strategy at the product level. Establishes design standards. Conducts API design reviews. Coordinates cross-team API interaction.
Defines API testing strategy and tooling standards across the organization. Evaluates and adopts API testing platforms (Postman, REST Assured, Karate, Pact). Drives API-first testing culture with contract-driven development and automated quality gates in CI/CD. Coordinates cross-team API integration testing, establishes SLAs for API reliability, and mentors senior engineers on testing architecture decisions.
Defines GraphQL API testing strategy across the product ecosystem. Establishes quality standards for schema evolution, federation testing, and cross-service contract verification. Conducts API design reviews from a testability perspective and coordinates cross-team GraphQL testing infrastructure.
Defines API testing strategy at product level: API contract testing standards, API performance testing governance, API test infrastructure policies. Conducts API test architecture reviews and establishes API quality assurance processes.
Cloud & Infrastructure · 3
Defines AWS infrastructure strategy for organization-wide test automation platforms. Establishes IaC standards for ephemeral test environment provisioning and CI/CD infrastructure. Conducts architecture reviews of test infrastructure patterns and drives FinOps optimization for testing compute resources.
Defines Docker infrastructure strategy for test automation: containerized test grid standards, parallel execution orchestration governance, test environment provisioning policies. Conducts architecture reviews for test infrastructure containerization and optimizes FinOps for CI/CD test resources.
Defines Kubernetes infrastructure strategy for organization-wide test automation platforms. Establishes IaC standards for ephemeral test environment provisioning and test infrastructure scaling. Conducts architecture reviews of test cluster configurations and optimizes FinOps for testing compute resources.
DevOps & CI/CD · 2
Defines DevOps strategy for QA teams: establishes CI/CD standards for test infrastructure, implements platform engineering approaches for test execution environments, drives adoption of continuous testing practices across development teams.
Defines DevOps strategy with GitLab CI/CD Advanced. Establishes CI/CD standards. Implements platform engineering approaches.
Testing & QA · 13
Defines testing strategy at the product level. Establishes quality assurance standards. Implements shift-left testing culture.
Defines E2E testing strategy at the product level: coverage requirements, CI integration standards, and quality gates. Establishes E2E testing COE practices across teams. Drives adoption of shift-left testing culture and automated quality gates. Creates testing infrastructure standards for distributed E2E test execution.
Defines integration testing strategy across the entire product ecosystem spanning dozens of microservices and external integrations. Establishes quality standards for service contract verification, API versioning, and cross-team integration boundaries. Implements shift-left testing culture with consumer-driven contracts and automated compatibility gates in deployment pipelines.
Defines load testing strategy at the product level. Establishes performance testing standards, quality gates for production deployments, and capacity planning processes. Drives adoption of shift-left performance testing culture. Creates load testing infrastructure standards for distributed test execution across teams.
Defines testing strategy at the product level. Establishes quality assurance standards. Implements shift-left testing culture.
Defines property-based testing strategy at the product level for quality assurance. Establishes standards for property specification, generator libraries, and coverage metrics. Implements shift-left testing culture by embedding property-based verification early in the development lifecycle.
Defines security testing strategy at the product level. Establishes automated security testing standards, quality gates, and DevSecOps integration requirements. Drives adoption of security testing as part of every team's CI/CD pipeline. Creates security testing infrastructure and tooling standards across the organization.
Defines testing strategy at the product level: BDD/TDD standards, quality assurance metrics, and shift-left testing culture across teams. Establishes BDD scenario libraries as living documentation for product behavior. Drives adoption of behavior-driven development as a collaboration tool between business, QA, and development. Creates testing COE (center of excellence) practices.
Defines testing strategy at the product level. Establishes quality assurance standards. Implements shift-left testing culture.
Defines testing strategy at the product level. Establishes quality assurance standards. Implements shift-left testing culture.
Defines testing strategy at the product level. Establishes quality assurance standards. Implements shift-left testing culture.
Defines testing strategy at the product level. Establishes quality assurance standards. Implements shift-left testing culture.
Defines testing strategy at product level for test infrastructure: test framework architecture standards, test reliability and flakiness governance, intelligent test selection frameworks. Establishes shift-left testing culture with automated quality gates across all testing layers.
AI-Assisted Development · 2
Defines the strategic roadmap for AI-powered test automation across the organization, evaluating emerging tools and establishing governance for AI-generated test assets. Builds centers of excellence for AI testing practices, training teams on effective use of generative testing tools while maintaining test reliability and determinism standards.
Defines GitHub Copilot strategy for QA teams: establishes guidelines for AI-assisted test development, designs quality standards for AI-generated test code, drives Copilot adoption with focus on test coverage effectiveness and maintenance costs.
Observability & Monitoring · 2
Defines observability strategy for QA infrastructure with Prometheus & Grafana: establishes SLO-based approach for test pipeline reliability, coordinates test infrastructure incident management, optimizes MTTD/MTTR for test environment failures.
Defines observability strategy for QA infrastructure: establishes SLO-based approach for test pipeline reliability, coordinates incident management for test environment issues, optimizes MTTD/MTTR for test infrastructure failures through improved monitoring and alerting.
Version Control & Collaboration · 2
Defines code review strategy for test automation team: test code review standards, test architecture review governance, test reliability review practices. Establishes review culture for test code maintainability and quality.
Defines Git strategy for QA teams: establishes branching standards for test suite management aligned with release engineering, designs code review workflows for test automation code, drives adoption of Git best practices for test infrastructure as code.
Additional skills
Not assessed by the team, but part of the self-assessment and the development plan.
What changes at Principal
0 skills get a higher expectation or become core when moving from Lead to Principal. The biggest jumps first.
} in the open competency matrix: 54 skills across 5 levels. The matrix is free for individuals and stays free.