Establishes algorithm-level performance budgets: latency SLA per endpoint, throughput targets. Reviews load test scenarios for algorithmic efficiency.
Roles · Performance Testing Engineer · Lead
What a Lead } should know
41 core skills, 56 in total. Expectations per skill, and what changes at the next level.
This page lists what a Lead } is expected to know and do, skill by skill. Core skills are the ones a manager and peers assess in a review cycle; the rest count only in self-assessment. Main areas: Programming Fundamentals, Backend Development, Database Management.
Core skills for a Lead
Grouped by area. The label on the right is the expected depth: Awareness, Working, Advanced or Expert.
Programming Fundamentals · 6
Defines async standards: concurrent virtual users, async data collection, parallel test execution. Implements best practices for non-blocking test scripts.
Establishes quality standards for test scripts: code review, version control, reusable libraries. Implements CI for test script validation. Defines naming conventions and documentation.
Defines data standards for performance testing: structured test results (time-series), correlation data models, metric aggregation structures. Reviews test script efficiency.
Defines concurrency standards for load generation: thread vs coroutine models, connection pool management, shared state handling. Implements best practices for concurrent test execution.
Defines code standards for performance tests: modular test scripts, reusable components (Page Objects for load tests), abstract base classes for different protocols.
Backend Development · 1
Defines tooling strategy: Python for Locust/custom tools, FastAPI for reporting API. Chooses between Python and Go/Java for high-throughput load generators.
Database Management · 3
Defines indexing performance standards: mandatory analysis during performance testing, index efficiency metrics, review process for index changes.
Defines DB performance standards: baseline metrics, regression thresholds, mandatory profiling. Coordinates performance testing with the DBA team.
Defines query performance standards: SLA per query type, mandatory profiling during load tests, automated regression alerting.
API & Integration · 2
Defines performance tooling standards: tool selection criteria, team training, shared libraries. Implements a performance testing CoE (Center of Excellence).
Defines API performance standards: mandatory performance testing per endpoint, SLA definitions, regression gates in CI. Coordinates performance requirements with product.
Cloud & Infrastructure · 3
Defines cloud standards for performance testing: infrastructure provisioning, cost management, environment consistency. Implements infrastructure-as-code.
Defines container standards for performance testing: test agent images, resource guidelines, environment provisioning. Implements container-based test infrastructure.
Defines K8s standards for performance: test environment templates, resource policies, scheduling. Coordinates shared test infrastructure.
DevOps & CI/CD · 1
Defines CI performance standards: mandatory performance gates, threshold management, reporting. Implements continuous performance testing.
Testing & QA · 6
Defines chaos + performance standards: performance degradation testing during failures, resilience testing under load. Implements GameDays for performance failures.
Defines E2E performance standards: mandatory scenarios, SLA per user journey, environment requirements. Coordinates cross-team testing.
Defines load testing standards: test types (baseline, capacity, spike, soak), mandatory tests per release, reporting requirements. Builds a load testing CoE.
Defines test data standards: data volume requirements, freshness, provisioning automation. Coordinates data management for performance testing.
Defines environment standards: sizing requirements, isolation policies, provisioning automation. Coordinates shared test infrastructure across teams.
Defines performance testing pyramid standards: required tests per level, automation ratios, execution frequency. Implements shift-left performance testing.
AI-Assisted Development · 1
Adopts AI in the performance team: automated test script generation, AI-assisted result analysis, bottleneck prediction. Evaluates ML for anomaly detection.
Observability & Monitoring · 6
Defines APM strategy for performance: tool selection (Datadog/New Relic/Dynatrace), integration with load testing, automated bottleneck detection. Implements APM for continuous performance.
Defines custom metrics standards for performance: mandatory instrumentation, naming conventions, cardinality budget. Implements a performance metrics catalog.
Defines log-based performance standards: mandatory performance fields, analysis templates, retention for historical comparison.
Defines OTel performance standards: mandatory spans, performance-relevant attributes, trace analysis procedures. Implements trace-driven performance debugging.
Defines performance metrics standards: mandatory metrics, dashboard templates, threshold management. Implements SLO-based performance monitoring.
Defines performance logging standards: mandatory timing fields, log-based SLI calculation, analysis procedures.
Version Control & Collaboration · 2
Builds review culture: test script quality checklist, review SLA, automated checks. Trains the team on best practices.
Builds Git workflow for the performance team: branching model, review requirements, CODEOWNERS for critical test scenarios.
Performance Engineering · 10
Defines benchmarking standards: tool selection criteria, execution procedures, result interpretation guidelines. Implements benchmark-driven development.
Defines CPU profiling standards: mandatory profiling during load tests, analysis procedures, optimization tracking. Implements always-on profiling.
Defines DB performance standards: SLA per query type, mandatory testing per schema change, baseline management. Coordinates with the DBA team.
Defines I/O profiling standards: mandatory I/O metrics during load tests, baseline requirements, analysis templates.
Defines latency standards: budgets per endpoint, regression policy, optimization tracking. Implements latency-driven development practices.
Defines memory profiling standards: mandatory soak tests, GC monitoring, memory budget per service. Implements automated leak detection.
Defines Network Profiling strategy at team/product level. Establishes standards and best practices. Conducts reviews.
Defines performance budget standards: mandatory budgets per service, review process, exception handling. Coordinates budget allocation with product and engineering.
Defines resource optimization and FinOps strategy for performance engineering teams. Establishes cost-efficiency benchmarks and automated resource monitoring standards. Conducts architecture reviews focused on infrastructure cost and scalability.
Defines throughput standards: capacity targets, scaling efficiency metrics, cost budgets. Coordinates capacity planning with infrastructure.
Additional skills
Not assessed by the team, but part of the self-assessment and the development plan.
What changes at Principal
0 skills get a higher expectation or become core when moving from Lead to Principal. The biggest jumps first.
} in the open competency matrix: 56 skills across 5 levels. The matrix is free for individuals and stays free.