deps(deps-dev): bump benchee from 1.4.0 to 1.5.0

[dependabot]

Bumps benchee from 1.4.0 to 1.5.0.

Release notes

Sourced from benchee's releases.

1.5.0 (2025-10-21)

Finally max_sample_size is here to alleviate a variety of woes resulting from gathering too many samples! Also finally, Benchee lets you exclude outliers!

Features (User Facing)

• Introduce max_sample_size which guides how many samples will be gathered at most for a given scenario. This avoids a variety of issues when scenarios gather too many samples (memory consumption, statistics taking long to calculate, formatters hanging/not working). Defaults to 1_000_000, setting it to nil gathers unlimited samples again (behavior before this version).
• Introduce exclude_outliers option which when set to true will automatically exclude outliers from the samples gathered. Especially important for run time, you can remove samples caused by garbage collection or external factors. Defaults to false. Shout out to @​NickNeck who implemented this long wished for feature over in Statistex.
• Display input_name entries in Livebook/Table.Reader protocol. Thanks @​madlep!

Bugfixes (User Facing)

• fixed a bug where if times were supplied as 0 instead of 0.0 we'd sometimes gather a single measurement
• elixir 1.19 compilation warnings have been fixed

Features (Plugins)

• The %Benchee.Statistics{} struct now comes with values to accompany the outlier exclusion feature:
  • outliers - if outlier exclusion was enabled, may include any samples of outliers that were found, empty list otherwise
  • lower_outlier_bound - value below which values are considered an outlier
  • upper_outlier_bound - value above which values are considered an outlier

Changelog

Sourced from benchee's changelog.

1.5.0 (2025-10-21)

Finally max_sample_size is here to alleviate a variety of woes resulting from gathering too many samples! Also finally, Benchee lets you exclude outliers!

Features (User Facing)

• Introduce max_sample_size which guides how many samples will be gathered at most for a given scenario. This avoids a variety of issues when scenarios gather too many samples (memory consumption, statistics taking long to calculate, formatters hanging/not working). Defaults to 1_000_000, setting it to nil gathers unlimited samples again (behavior before this version).
• Introduce exclude_outliers option which when set to true will automatically exclude outliers from the samples gathered. Especially important for run time, you can remove samples caused by garbage collection or external factors. Defaults to false. Shout out to @​NickNeck who implemented this long wished for feature over in Statistex.
• Display input_name entries in Livebook/Table.Reader protocol. Thanks @​madlep!

Bugfixes (User Facing)

• fixed a bug where if times were supplied as 0 instead of 0.0 we'd sometimes gather a single measurement
• elixir 1.19 compilation warnings have been fixed

Features (Plugins)

• The %Benchee.Statistics{} struct now comes with values to accompany the outlier exclusion feature:
  • outliers - if outlier exclusion was enabled, may include any samples of outliers that were found, empty list otherwise
  • lower_outlier_bound - value below which values are considered an outlier
  • upper_outlier_bound - value above which values are considered an outlier

Commits

• 95c4808 prep 1.5.0 release
• 0edd4ca run type checks and lints on newest elixir & erlang
• f11ca4b Also ignore formatters from duplicated code for now, fixing them is... a long...
• bdbdeb0 Exclude tests from duplicated code check
• 38913ca Use fully released elixir 1.19 in CI
• 60d5dcd Add changelog entry for Table.Reader fix
• 56ff581 Fix scenario typo
• 376a981 Actually use name instead of job_name, which my past self says is the cor...
• ad343fe Be more explicit about no_input handling
• c05fcb3 include input_name in Table.Reader fields
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot]

Assignees

The following users could not be added as assignees: @maintainers. Either the username does not exist or it does not have the correct permissions to be added as an assignee.

Labels

The following labels could not be found: dependencies, elixir. Please create them before Dependabot can add them to a pull request.

Please fix the above issues or remove invalid values from dependabot.yml.

[coveralls]

Pull Request Test Coverage Report for Build a05fa8ad5d0aca6491f48e716bba4308155e4e3a-PR-10

Details

• 0 of 0 changed or added relevant lines in 0 files are covered.
• No unchanged relevant lines lost coverage.
• Overall coverage remained the same at 69.1%

---

Totals
Change from base Build eca3a0fda44edae444d30a81ddb4fdc8f43e0bf1:	0.0%
Covered Lines:	530
Relevant Lines:	767

---

💛 - Coveralls