Bump mlflow from 2.12.1 to 3.6.0 #13

dependabot · 2025-11-24T12:45:47Z

Bumps mlflow from 2.12.1 to 3.6.0.

Release notes

v3.6.0

MLflow 3.6.0 includes several major features and improvements for AI Observability, Experiment UI, Agent Evaluation and Deployment.

🔗 Full OpenTelemetry Support in OSS Server: MLflow now offers comprehensive OpenTelemetry integration, allowing you to ingest OpenTelemetry traces into MLflow and use both SDK seamlessly together. (#18540, #18532, #18357, @B-Step62, @serena-ruan)

💬 Session-level View in Trace UI: New chat sessions tab provides a dedicated view for organizing and analyzing related traces at the session level, making it easier to track conversational workflows. (#18594, @daniellok-db)

🧭 New experiment tab bar: The experiment tab navigation bar has been moved from the top of the page to the left side. As MLflow continues to grow, this layout provides more room to add new tabs while keeping everything easy to find. (#18594, @daniellok-db)

🚀 New Supported Frameworks in TypeScript Tracing SDK: Auto-tracing support for Vercel AI SDK, Gemini, Anthropic, Mastra in TypeScript, expanding MLflow's observability capabilities across popular JavaScript/TypeScript frameworks. (#18402, @B-Step62)

💰 Tracking Judge Cost and Traces: Comprehensive tracking of LLM judge evaluation costs and traces, providing visibility into evaluation expenses and performance with automatic cost calculation and rendering. (#18481, #18484, @B-Step62)

⚙️ Agent Server: New agent server infrastructure for managing and deploying scoring agents with enhanced orchestration capabilities. (#18596, @bbqiu)

Breaking changes:

Deprecate pmdarima, promptflow, diviner flavors (#18597, #18577, @copilot-swe-agent)

Drop numbering suffix (_1, _2, ...) from span names (#18531, @serena-ruan)

Features

[Evaluation] Support structured outputs in make_judge (#18529, @TomeHirata)

[Evaluation] Agent-as-a-judge support for default Databricks endpoint (#18709, @smoorjani)

[Evaluation] Frontend adjustments for handle judge traces (#18485, @B-Step62)

[Evaluation] Record judge traces (#18484, @B-Step62)

[Evaluation] [ML-57683] Add search_traces tool for agentic judge (#18228, @dbrx-euirim)

[Evaluation] Record and render LLM judge cost (#18481, @B-Step62)

[Evaluation] Add support for profile usage in Databricks Agents dataset API operat… (#18431, @BenWilson2)

[Evaluation] Add description property to Scorer interface (#18383, @alkispoly-db)

[Evaluation] Add mlflow scorers register-llm-judge CLI command (#18330, @alkispoly-db)

[Evaluation] Allow passing empty scorer list for manual result comparison (#18265, @B-Step62)

[Evaluation] Add CLI command to list registered scorers by experiment (#18255, @alkispoly-db)

[Evaluation] Log assessments to DSPy eval traces (#18136, @B-Step62)

[Evaluation] Add mlflow traces eval CLI command (#18069, @alkispoly-db)

[Tracing] Add documentation for new tracing integrations (Otel) (#18691, @B-Step62)

[Tracing] Display trace metadata (#18609, @B-Step62)

[Tracing] Support automatically tracking session ID for LangGraph (#18608, @B-Step62)

[Tracing / Tracking] Add RLIKE operator support for trace search (#18591, @serena-ruan)

[Tracing] Attributes translation for OTel clients (#18532, @serena-ruan)

[Tracing] [Vercel #3] Implement auto-tracing logic for Vercel AI SDK (#18402, @B-Step62)

[Tracing] Minor clean up for the trace summary view (#18436, @B-Step62)

[Tracing] Support search by span details for traces in OSS MLflow server (#17918, @serena-ruan)

[UI] UI: Support filtering by span content / type / name (#18683, @dbczumar)

[UI] Add chat sessions tab (#18594, @daniellok-db)

[UI] Child Parent Link (#17248, @joelrobin18)

[Tracking] Make Pytorch lightning autologging support logging model signature (#18510, @WeichenXu123)

[Tracking] Add support for using the same DB for tracking and auth (#18384, @BenWilson2)

[Tracking] Job backend: Support creating virtual python environment for job execution (#18111, @WeichenXu123)

[Model Registry / Tracking] Add deprecation warnings for filesystem backends (#18524, @harupy)

[Model Registry] Allow for skipping pip installation while packing environment for model serving (#18448, @juntai-zheng)

[Models] Support Langchain 1.x (#18490, @BenWilson2)

[Models] Use UBJSON format as default for XGBoost models (#18420, @harupy)

[Scoring] Introduce Agent Server (#18596, @bbqiu)

[Deployment] Add configuration option for long-running deployments client requests (#18363, @BenWilson2)

[Gateway] Make Openai provider supporting streamed function calling response (#18367, @WeichenXu123)

... (truncated)

Changelog

Sourced from mlflow's changelog.

3.6.0 (2025-11-07)

MLflow 3.6.0 includes several major features and improvements for AI Observability, Experiment UI, Agent Evaluation and Deployment.

🔗 Full OpenTelemetry Support in OSS Server: MLflow now offers comprehensive OpenTelemetry integration, allowing you to ingest OpenTelemetry traces into MLflow and use both SDK seamlessly together. (#18540, #18532, #18357, @B-Step62, @serena-ruan)

💬 Session-level View in Trace UI: New chat sessions tab provides a dedicated view for organizing and analyzing related traces at the session level, making it easier to track conversational workflows. (#18594, @daniellok-db)

🧭 New experiment tab bar: The experiment tab navigation bar has been moved from the top of the page to the left side. As MLflow continues to grow, this layout provides more room to add new tabs while keeping everything easy to find. (#18594, @daniellok-db)

🚀 New Supported Frameworks in TypeScript Tracing SDK: Auto-tracing support for Vercel AI SDK, Gemini, Anthropic, Mastra in TypeScript, expanding MLflow's observability capabilities across popular JavaScript/TypeScript frameworks. (#18402, @B-Step62)

💰 Tracking Judge Cost and Traces: Comprehensive tracking of LLM judge evaluation costs and traces, providing visibility into evaluation expenses and performance with automatic cost calculation and rendering. (#18481, #18484, @B-Step62)

⚙️ Agent Server: New agent server infrastructure for managing and deploying scoring agents with enhanced orchestration capabilities. (#18596, @bbqiu)

Breaking changes:

Deprecate pmdarima, promptflow, diviner flavors (#18597, #18577, @copilot-swe-agent)

Drop numbering suffix (_1, _2, ...) from span names (#18531, @serena-ruan)

Features:

[Tracing] Add RLIKE operator support for trace search (#18591, @serena-ruan)

[Tracing] Attributes translation for OpenTelemetry clients (#18532, @serena-ruan)

[Tracing] Implement auto-tracing logic for Vercel AI SDK (#18402, @B-Step62)

[Tracing] Anthropic Typescript SDK (#18189, @joelrobin18)

[Tracing] Support search by span details for traces in OSS MLflow server (#17918, @serena-ruan)

[Tracing] Minor clean up for the trace summary view (#18436, @B-Step62)

[Tracing] Log assessments to DSPy eval traces (#18136, @B-Step62)

[Tracking] Add support for using the same DB for tracking and auth (#18384, @BenWilson2)

[Tracking] Make Pytorch lightning autologging support logging model signature (#18510, @WeichenXu123)

[Tracking] Make mlflow.pytorch pyfunc loader supporting pytorch forecasting model (#18428, @WeichenXu123)

[Tracking] Job backend: Support creating virtual python environment for job execution (#18111, @WeichenXu123)

[Evaluation] Add search_traces tool for agentic judge (#18228, @dbrx-euirim)

[Evaluation] Record and render LLM judge cost (#18481, @B-Step62)

[Evaluation] Frontend adjustments for handle judge traces (#18485, @B-Step62)

[Evaluation] Record judge traces (#18484, @B-Step62)

[Evaluation] Add support for profile usage in Databricks Agents dataset API operat… (#18431, @BenWilson2)

[Evaluation] Add mlflow traces eval CLI command (#18069, @alkispoly-db)

[Evaluation] Add mlflow scorers register-llm-judge CLI command (#18330, @alkispoly-db)

[Evaluation] Add description property to Scorer interface (#18383, @alkispoly-db)

[Evaluation] Allow passing empty scorer list for manual result comparison (#18265, @B-Step62)

[Scoring] Introduce Agent Server (#18596, @bbqiu)

[UI] Add chat sessions tab (#18594, @daniellok-db)

[UI] Child Parent Link (#17248, @joelrobin18)

[Models] Use UBJSON format as default for XGBoost models (#18420, @harupy)

[Models] Support Langchain 1.x (#18490, @BenWilson2)

[Model Registry] Add deprecation warnings for filesystem backends (#18524, @harupy)

[Model Registry] Allow for skipping pip installation while packing environment for model serving (#18448, @juntai-zheng)

[Gateway] Add configuration option for long-running deployments client requests (#18363, @BenWilson2)

[Gateway] Make Openai, Anthropic, Gemini provider supporting streamed function calling response (#18367, #18328, #18294, @WeichenXu123)

[Gateway] Add traffic route to multiple endpoints (#18064, @WeichenXu123)

[Docs] Add Sticky Header to CodeBlock in MLflow/DOCS Code Examples (#18508, @PavithraNelluri)

[Build / Evaluation] Add CLI command to list registered scorers by experiment (#18255, @alkispoly-db)

... (truncated)

Commits

d7e0aa6 Run python3 dev/update_mlflow_versions.py pre-release ... (#18738)
def0e3c revert conflict override
fe6a898 Add telemetry tracking for AI command usage (#18595)
286d06d Refactor Judge utils (#18622)
cc27fe7 Don't require structured outputs for make_judge (#18643)
8b900fa Support structured outputs in make_judge (#18529)
4640b2e Add chat conversion for Otel GenAI Semconv (#18731)
1fe2182 Fix eval result button link (#18667)
cc87812 Add FireworksAI to Model Providers Tracing Integrations (#18678)
547de48 Search traces docs update (#18687)
Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR
@dependabot recreate will recreate this PR, overwriting any edits that have been made to it
@dependabot merge will merge this PR after your CI passes on it
@dependabot squash and merge will squash and merge this PR after your CI passes on it
@dependabot cancel merge will cancel a previously requested merge and block automerging
@dependabot reopen will reopen this PR if it is closed
@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
@dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Bumps [mlflow](https://github.com/mlflow/mlflow) from 2.12.1 to 3.6.0. - [Release notes](https://github.com/mlflow/mlflow/releases) - [Changelog](https://github.com/mlflow/mlflow/blob/master/CHANGELOG.md) - [Commits](mlflow/mlflow@v2.12.1...v3.6.0) --- updated-dependencies: - dependency-name: mlflow dependency-version: 3.6.0 dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>

dependabot bot added dependencies Pull requests that update a dependency file python Pull requests that update python code labels Nov 24, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Bump mlflow from 2.12.1 to 3.6.0 #13

Bump mlflow from 2.12.1 to 3.6.0 #13

Uh oh!

dependabot bot commented on behalf of github Nov 24, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Bump mlflow from 2.12.1 to 3.6.0 #13

Are you sure you want to change the base?

Bump mlflow from 2.12.1 to 3.6.0 #13

Uh oh!

Conversation

dependabot bot commented on behalf of github Nov 24, 2025

v3.6.0

Features

3.6.0 (2025-11-07)

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant