技能档案

ML Experiment Tracking

此技能定义了各角色和级别的期望。

Machine Learning & AI MLOps

角色数

包含此技能的角色

级别数

结构化成长路径

必要要求

其余 10 个可选

Machine Learning & AI

MLOps

2026/2/22

选择当前级别并对比期望。下方卡片显示晋升所需掌握的内容。

各级别期望

表格展示从初级到首席的技能深度变化。点击行查看详情。

角色	必要性	描述
Data Scientist		Uses MLflow or W&B for basic experiment tracking: logging parameters, metrics, and artifacts. Structures experiments by projects, compares runs via UI. Saves models with metadata for reproducibility.
LLM Engineer		Knows experiment tracking basics: logging metrics, parameters, artifacts. Uses W&B or MLflow for tracking LLM training runs and fine-tuning experiments.

角色	必要性	描述
Data Scientist		Independently builds experiment tracking workflow for ML projects. Integrates MLflow/W&B with training pipelines for automatic logging. Configures artifact storage, model registry, and experiment tags for work organization.
LLM Engineer		Independently organizes experiment tracking for LLM projects: structured projects in W&B, run comparison, hyperparameter sweeps. Versions datasets and model checkpoints.

角色	必要性	描述
Data Scientist		Designs enterprise experiment tracking infrastructure. Integrates tracking with CI/CD, automated model promotion, and deployment. Configures multi-team collaboration, access control, and experiment governance for large-scale data science work.
LLM Engineer		Designs experiment tracking infrastructure for the LLM team: custom dashboards, automated reporting, CI/CD integration. Ensures reproducibility for all training and evaluation experiments.

角色	必要性	描述
Data Scientist		Defines experiment management standards for the data science team. Establishes experiment review processes, knowledge sharing, and best practices. Coordinates experiment platform development and integration with ML infrastructure.
LLM Engineer		Defines experiment tracking standards for the LLM team. Establishes guidelines for experiment organization, naming conventions, and mandatory logging. Integrates tracking with model registry.

角色	必要性	描述
Data Scientist		Shapes experiment management platform strategy for the organization. Defines enterprise requirements: compliance, audit trail, cost management. Evaluates tools (MLflow, W&B, Neptune, Vertex AI) and shapes long-term platform roadmap.
LLM Engineer		Shapes enterprise experiment tracking platform. Defines approaches to centralized tracking for multiple teams, cost management, and compliance with audit requirements for ML experiments.

Junior 2 要求

Data Scientist

Uses MLflow or W&B for basic experiment tracking: logging parameters, metrics, and artifacts. Structures experiments by projects, compares runs via UI. Saves models with metadata for reproducibility.
LLM Engineer

Knows experiment tracking basics: logging metrics, parameters, artifacts. Uses W&B or MLflow for tracking LLM training runs and fine-tuning experiments.

Middle 2 要求

Data Scientist

Independently builds experiment tracking workflow for ML projects. Integrates MLflow/W&B with training pipelines for automatic logging. Configures artifact storage, model registry, and experiment tags for work organization.
LLM Engineer

Independently organizes experiment tracking for LLM projects: structured projects in W&B, run comparison, hyperparameter sweeps. Versions datasets and model checkpoints.

Senior 2 要求

Data Scientist

Designs enterprise experiment tracking infrastructure. Integrates tracking with CI/CD, automated model promotion, and deployment. Configures multi-team collaboration, access control, and experiment governance for large-scale data science work.
LLM Engineer

Designs experiment tracking infrastructure for the LLM team: custom dashboards, automated reporting, CI/CD integration. Ensures reproducibility for all training and evaluation experiments.

Lead / Staff 2 要求

Data Scientist

Defines experiment management standards for the data science team. Establishes experiment review processes, knowledge sharing, and best practices. Coordinates experiment platform development and integration with ML infrastructure.
LLM Engineer

Defines experiment tracking standards for the LLM team. Establishes guidelines for experiment organization, naming conventions, and mandatory logging. Integrates tracking with model registry.

Principal 2 要求

Data Scientist

Shapes experiment management platform strategy for the organization. Defines enterprise requirements: compliance, audit trail, cost management. Evaluates tools (MLflow, W&B, Neptune, Vertex AI) and shapes long-term platform roadmap.
LLM Engineer

Shapes enterprise experiment tracking platform. Defines approaches to centralized tracking for multiple teams, cost management, and compliance with audit requirements for ML experiments.

👁 关注 ✏️ 建议修改

正在加载评论...