Knows basic LLM evaluation metrics: perplexity, BLEU, ROUGE. Runs standard benchmarks (MMLU, HellaSwag) under mentor guidance and interprets basic results.
Roles · LLM Engineer · Junior
What a Junior } should know
5 core skills, 80 in total. Expectations per skill, and what changes at the next level.
This page lists what a Junior } is expected to know and do, skill by skill. Core skills are the ones a manager and peers assess in a review cycle; the rest count only in self-assessment. Main areas: Machine Learning & AI, AI-Assisted Development.
Core skills for a Junior
Grouped by area. The label on the right is the expected depth: Awareness, Working, Advanced or Expert.
Machine Learning & AI · 3
Knows LLM fine-tuning basics: full fine-tuning vs LoRA, instruction-tuning data format. Runs basic fine-tuning of a small model via Hugging Face Trainer under mentor guidance.
Knows vector database basics: what is vector index, ANN search, distance metrics. Works with ChromaDB or Faiss for storing and searching embeddings in simple RAG applications.
AI-Assisted Development · 2
Knows main ChatGPT and Claude API capabilities: request formats, temperature/top_p parameters. Uses API for simple text generation and classification tasks under mentor guidance.
Knows prompt engineering basics for internal use: system prompts, formatting instructions, output constraints. Creates basic prompts for LLM system components under mentor guidance.
Additional skills
Not assessed by the team, but part of the self-assessment and the development plan.
What changes at Mid-level
80 skills get a higher expectation or become core when moving from Junior to Mid-level. The biggest jumps first.
- ChatGPT / Claude: Awareness → Working
- LLM Evaluation: Awareness → Working
- LLM Fine-tuning: Awareness → Working
- Prompt Engineering for Code: Awareness → Working
- Vector Databases: Awareness → Working
- AI Agent Frameworks: Awareness → Working
- AI Agents for Development: Awareness → Working
- Algorithms & Complexity: Awareness → Working
- API Documentation: Awareness → Working
- Async Programming: Awareness → Working
} in the open competency matrix: 80 skills across 5 levels. The matrix is free for individuals and stays free.