Roles · LLM Engineer · Junior

What a Junior } should know

5 core skills, 80 in total. Expectations per skill, and what changes at the next level.

This page lists what a Junior } is expected to know and do, skill by skill. Core skills are the ones a manager and peers assess in a review cycle; the rest count only in self-assessment. Main areas: Machine Learning & AI, AI-Assisted Development.

5core skills
75additional skills
2skill areas
0%at Advanced or Expert
Assess myself as Junior Full role matrix

Core skills for a Junior

Grouped by area. The label on the right is the expected depth: Awareness, Working, Advanced or Expert.

Machine Learning & AI · 3

LLM Evaluation Awareness

Knows basic LLM evaluation metrics: perplexity, BLEU, ROUGE. Runs standard benchmarks (MMLU, HellaSwag) under mentor guidance and interprets basic results.

LLM Fine-tuning Awareness

Knows LLM fine-tuning basics: full fine-tuning vs LoRA, instruction-tuning data format. Runs basic fine-tuning of a small model via Hugging Face Trainer under mentor guidance.

Vector Databases Awareness

Knows vector database basics: what is vector index, ANN search, distance metrics. Works with ChromaDB or Faiss for storing and searching embeddings in simple RAG applications.

AI-Assisted Development · 2

ChatGPT / Claude Awareness

Knows main ChatGPT and Claude API capabilities: request formats, temperature/top_p parameters. Uses API for simple text generation and classification tasks under mentor guidance.

Knows prompt engineering basics for internal use: system prompts, formatting instructions, output constraints. Creates basic prompts for LLM system components under mentor guidance.

Additional skills

Not assessed by the team, but part of the self-assessment and the development plan.

AI Agent FrameworksAI Agents for DevelopmentAlgorithms & ComplexityAPI DocumentationAsync ProgrammingAWSCode Quality & RefactoringCode ReviewCursor IDEData StructuresDatabase IndexingDeep LearningDesign PatternsDistributed TrainingDockerElasticsearch / OpenSearchEmbeddings & Vector DBExperiment TrackingGit AdvancedGitHub Actions / GitLab CIGitHub CopilotGPU ProgrammingGraphQL DesigngRPC & Protocol BuffersIntegration TestingKubernetes CoreKubernetes OrchestrationLLM AlignmentLLM ApplicationsLLM DeploymentLLM Prompt EngineeringLLM SafetyLLM ScalingML DeploymentML Experiment TrackingML Model EvaluationML PipelinesMLflowModel Context Protocol (MCP)Model MonitoringModel ServingMultithreadingNatural Language ProcessingNetwork FundamentalsNeural Network ArchitecturesOOP & SOLID PrinciplesOpenTelemetryOWASP & Application SecurityPandas / PolarsPostgreSQLPrometheus & GrafanaPython ProgrammingPython Web FrameworksPyTorchRAGRAG ArchitectureRedisREST API DesignRLHF TechniquesS3 / Object StorageSecure Coding PracticesServer-Sent Events & StreamingStructured LoggingSystem Design FundamentalsTask QueuesTensorFlow / PyTorchTerraformTokenizationTransfer LearningTransformer ArchitectureTransformers & NLPType Safety & Type SystemsUnit TestingUnit TestingvLLM Inference

What changes at Mid-level

80 skills get a higher expectation or become core when moving from Junior to Mid-level. The biggest jumps first.

See the Mid-level page →
Run this with your whole team
Self-assessment plus manager and peer reviews against the same matrix, gap analysis and next-level readiness for every engineer. Team Pro is free for 14 days; individual tools stay free forever.
Start a team trial (14 days free) Send to my manager

} in the open competency matrix: 80 skills across 5 levels. The matrix is free for individuals and stays free.