Select your current position
Pick a role and level — we'll show the growth path, skills and gap analysis.
Development path
Junior
0-2 years
Responsibility: Completing tasks under the guidance of senior colleagues. Learning the codebase, standards, and team processes. Writing code to spec, fixing simple bugs, writing tests.
Key skills:
Middle
2-5 years
Responsibility: Independently developing features from decomposition to deployment. Participating in code review. Optimizing performance. Mentoring junior developers. Taking part in architecture discussions.
Key skills:
Senior
5-8 years
Responsibility: Designing the architecture of components and services. Solving complex technical problems. Managing technical debt. Code review as a quality gatekeeper. Mentoring middle developers. Choosing technologies for new tasks.
Key skills:
Lead / Staff
7-12 years
Responsibility: Technical leadership of a team or area. Designing system architecture. Coordinating with other teams. Establishing standards and best practices. Participating in hiring. Planning the technical roadmap.
Key skills:
Principal
10+ years
Responsibility: Technical strategy at the company or domain level. Cross-organizational influence. Solving systemic business problems through technology. Mentoring lead engineers. Publicly representing the company.
Key skills:
Gap analysis: skills to develop
To reach the next level you'll need to develop:
Independently builds agent systems using LangChain, LangGraph, and custom orchestration code with advanced tool integration and state management. Implements agent architectures including ReAct, plan-and-execute, and reflection patterns with configurable retry logic and error recovery. Evaluates and benchmarks framework performance for specific tasks — comparing agent strategies by accuracy, token usage, latency, and reliability under diverse input distributions.
Independently develops AI agent systems with custom tool implementations, conversation state management, and multi-turn reasoning capabilities. Implements agent reliability patterns including retry with backoff, tool call validation, output verification loops, and graceful fallback to simpler strategies. Builds evaluation harnesses for agent systems measuring task completion, tool efficiency, cost per interaction, and safety boundary compliance across diverse input scenarios.
Independently trains and fine-tunes models with PyTorch: configures learning rate schedules, regularization, and data augmentation. Understands gradient flow in transformer architectures.
Independently designs embedding pipelines: model selection (OpenAI, Cohere, BGE), chunking strategies, and metadata filtering. Configures Pinecone/Weaviate for production workloads with recall optimization.
Independently optimizes GPU utilization for LLM: mixed precision (FP16/BF16), memory management, CUDA stream optimization. Profiles GPU workloads using nvidia-smi and PyTorch profiler.
Independently implements alignment pipelines: preference dataset preparation, Constitutional AI prompts, DPO training. Evaluates alignment quality through human evaluation and automated benchmarks.
Independently conducts LLM fine-tuning: LoRA/QLoRA, instruction dataset preparation, hyperparameter tuning. Monitors training via W&B, evaluates results on held-out datasets.
Implements MCP servers with dynamic tool registration, streaming responses, and context management. Optimizes tool descriptions for LLM comprehension and handles multi-turn tool-use conversations.
Independently solves NLP tasks using LLM: text classification, NER, summarization, translation. Compares LLM approaches with classical methods, selects the optimal one for the task.
Independently develops complex prompt templates: structured output, tool use, multi-step reasoning. Conducts systematic prompt optimization with A/B testing and quality metrics.
Independently develops production-ready prompts: structured output parsing, error recovery prompts, multi-turn dialog management. Applies systematic approach to prompt design and testing.
Independently develops in Python for LLM projects: async/await for API calls, dataclasses for configurations, generators for data streaming. Writes unit tests and uses type hints.
Independently designs production RAG: advanced chunking, hybrid retrieval, re-ranking. Configures metadata filtering, conversation history, and source attribution. Evaluates quality via RAGAS.
Implements advanced RAG patterns: query decomposition, hypothetical document embeddings (HyDE), and multi-index retrieval. Optimizes chunk size and overlap for domain-specific corpora and evaluates retrieval quality with RAGAS metrics.
Independently implements RLHF pipelines: preference data collection, reward model training, PPO training with trl library. Applies DPO as an alternative to PPO for more stable training.
Independently designs and implements Server-Sent Events and Streaming. Understands best practices and patterns. Writes API documentation and tests.
Independently develops with PyTorch for LLM: custom datasets, training loops, mixed precision (torch.amp). Uses Hugging Face Accelerate for multi-GPU training and inference.
Applies transfer learning techniques for LLM adaptation: LoRA, QLoRA, and prompt tuning. Fine-tunes foundation models on domain-specific corpora. Evaluates catastrophic forgetting and optimizes training efficiency.
Independently configures vLLM for production: tensor parallelism, quantization (AWQ/GPTQ), GPU memory management. Optimizes throughput by tuning batch size and scheduling parameters.
Independently analyzes and modifies Transformer architectures: RoPE, ALiBi, GQA, SwiGLU. Understands architectural differences between GPT, LLaMA, Mistral and their impact on performance.
Independently analyzes and modifies neural network architectures for LLM tasks: adapter layers, custom attention patterns, mixture of experts. Implements architectural modifications in PyTorch.
Independently implements safety pipelines: input/output filtering, guardrails (NeMo Guardrails, Guardrails AI), red-teaming. Configures content moderation and PII detection for production LLM.
Independently administers vector databases in production: Pinecone, Weaviate, Qdrant. Configures indexes (HNSW, IVF), optimizes recall vs latency, manages collections and metadata.
Independently deploys LLM to production: configures vLLM with continuous batching, quantization (GPTQ/AWQ), and health checks. Implements monitoring of latency, throughput, and error rates.
Independently plans scaling strategies: compute budget calculation using scaling laws, model size vs data size selection. Optimizes training and inference costs for 7B-13B parameter models.
Independently designs evaluation pipelines: custom benchmarks, domain-specific eval sets, human evaluation protocols. Compares models across multiple metrics for production decision-making.
Independently configures distributed training with DeepSpeed ZeRO and FSDP. Configures data parallel, pipeline parallel, and tensor parallel for models up to 7B parameters on GPU clusters.
Independently works with LLM tokenization: analyzes token distribution, optimizes input length, handles special tokens. Trains custom tokenizers on domain-specific corpora.