v0.6.3

Bugfix release.

What's Changed

• BUG,MAINT: Depend on build by @HaoZeke in #1387

Full Changelog: v0.6.2...v0.6.3

v0.6.2

Changelog

0.6.2 (2024-02-12)

New Features

• Partially skipped benchmarks will still have their results displayed.
  (#1351)
• asv will now correctly prepare all the build backend dependencies
  into base_requirements and the default build_command has been
  modified to allow fetching from PyPI. (#1377)

Bug Fixes

• The asv package no longer prepends the script execution directory
  unconditionally. Now we check for and remove the path only if it
  matches the directory that the runner script resides in. (#1346)
• The bdist wheels no longer include benchmarks and test. (#1349)
• The mamba plugin works correctly for newer versions (>=1.5) of
  libmambapy (#1372)
• The mamba plugin respects the MAMBARC environment if set, taking
  channels and channel priority from the file in the environment
  variable. (#1373)
• Fixed a bug where matrix requirements were dropped if an environment
  file was specified. (#1373)
• conda-forge is no longer a default channel for mamba. (#1373)

Other Changes and Additions

• asv now depends on virtualenv (#1379)

Github Generated Log

What's Changed

• BUG: Remove prepended entry from sys.path by @ngnpope in #1346
• Handle partially-skipped benchmarks by @ianthomas23 in #1351
• BUG: build/include only asv in bdist by @vishwin in #1349
• MAINT: fix instances of get in mamba plugin by @hmaarrfk in #1357
• MAINT: Do not always add dependencies section to update conda environment file by @hmaarrfk in #1359
• Remove asv dev from docs by @CodyCBakerPhD in #1371
• Improve error message when environment not found by @dstansby in #1369
• CI: Test on min/max supported ranges of python versions by @dstansby in #1366
• DOC: Remove mentions of Python 2.7 by @dstansby in #1367
• MAINT: Vendor mamba.api by @HaoZeke in #1372
• BUG: Add MAMBARC support to mamba by @HaoZeke in #1373
• MAINT: Finalize rename to main by @HaoZeke in #1375
• DOC : added default_benchmark_timeout in using.rst (proposal) by @Schefflera-Arboricola in #1376
• ENH,MAINT: Add towncrier by @HaoZeke in #1378
• MAINT: Unconditionally depend on virtualenv by @HaoZeke in #1379
• MAINT,DOC: pip and network connectivity defaults by @HaoZeke in #1377

New Contributors

• @ngnpope made their first contribution in #1346
• @ianthomas23 made their first contribution in #1351
• @vishwin made their first contribution in #1349
• @CodyCBakerPhD made their first contribution in #1371
• @Schefflera-Arboricola made their first contribution in #1376

Full Changelog: v0.6.1...v0.6.2

v0.6.1

Changelog

0.6.1 (2023-09-11)

New Features

API Changes

Bug Fixes

• Fixed handling of pip dependencies in environment.yml files for the mamba plugin (#1326)
• Removed the need for explicit pip+ in asv.config.json matrix requirements for virtualenv
• asv will now use conda_environment_file if it exists (#1325)

Other Changes and Additions

• Made asv timestamps via datetime Python 3.12 compatible (#1331)
• Provided asv[virtualenv] as an installable target
• Switched to using Github Actions exclusively for Windows and Linux

0.6.0 (2023-08-20)

New Features

• Internal use of asv_runner, allowing custom benchmark types (#1287)
• Added benchmark skipping capabilities using new decorators skip_benchmark_if and skip_params_if (#1309)
• Benchmarks can be skipped during execution by raising SkipNotImplemented (#1307)
• Introduced default_benchmark_timeout in the configuration object and via -a timeout=NUMBER (#1308)
• Settable ASV_RUNNER_PATH for testing newer versions of asv_runner (#1312)

API Changes

• Removed asv dev in favor of using asv run with appropriate arguments (#1200)
• Removed --strict option from asv run and asv continuous, which now always return non-zero exit status if any benchmark fails

Bug Fixes

• Fixed install_timeout for conda (#1310)
• Fixed handling of local pip matrix (#1312)
• Fixed deadlock when using mamba with an environment file (#1300)
• Corrected environment file usage with mamba and recognized default environment.yml (#1303)

Other Changes and Additions

• Both mamba and conda now use environment.yml if it exists
• virtualenv now requires packaging due to distutils deprecations
• Wheels are now built for CPython versions 3.8, 3.9, 3.10, 3.11

Github Generated Log

What's Changed

• Fix PEP-8 violations reported by flake8 on asv folder by @LucyJimenez in #988
• Post 0.5.1 release changes (version update and new version changelog) by @datapythonista in #1016
• Fix PEP-8 violations reported by flake8 on asv/step_detect.py by @LucyJimenez in #1006
• Replace six.string_types and six.text_type by str by @LucyJimenez in #1009
• Fix PEP-8 violations reported by flake8 on asv/util.py by @LucyJimenez in #1007
• Fix PEP-8 violations reported by flake8 on test/benchmark folder by @LucyJimenez in #1000
• Fix flake8 violations by @dorothykiz1 in #1018
• Changes required to set minimum Python version to 3.7 by @LucyJimenez in #1025
• Fix all flake8 violations in the test/ directory by @dorothykiz1 in #1021
• Replace six.iter* to python 3 equivalent by @dorothykiz1 in #1024
• Fix flake8 violations by @dorothykiz1 in #1029
• Add pytest to CI by @LucyJimenez in #1032
• Run pytest with different Python versions in GitHub actions by @LucyJimenez in #1033
• Remove __future __module reference and imports by @dorothykiz1 in #1045
• Remove object base class from class declaration by @dorothykiz1 in #1046
• Remove py2 encoding declaration by @dorothykiz1 in #1048
• Remove six import and replace all with python 3 equivalent by @dorothykiz1 in #1047
• remove imports from future module by @mariamadronah in #1050
• remove imports from future module1 by @mariamadronah in #1051
• remove imports from future module2 by @mariamadronah in #1052
• remove imports from future module3 by @mariamadronah in #1053
• Remove imports from future module4 by @mariamadronah in #1054
• Remove py2 encoding declaration by @Tushcathy in #1055
• remove the # -- coding: utf-8 -- by @mariamadronah in #1056
• remove the # -- coding: utf-8 -- by @mariamadronah in #1057
• Contribution7 by @mariamadronah in #1059
• Remove six library by @Leenkiz in #1058
• CLN: use shutil terminal size by @fangchenli in #1049
• Fix flake8 errors in some files in asv/ directory by @dorothykiz1 in #1067
• CLN: Remove unused six imports by @datapythonista in #1070
• CLN: Remove object parent class, only needed in py2 by @datapythonista in #1069
• Remove python2 six functionality by @dorothykiz1 in #1072
• Fix flake8 issues on asv/commands folder by @LucyJimenez in #1078
• Fix flake8 issues on asv/commands folder by @LucyJimenez in #1080
• Fix flake8 issues on asv/commands/check.py by @LucyJimenez in #1081
• Remove PY2 six from test/test_console.py file by @dorothykiz1 in #1079
• Fix flake8 violations for all files in the asv/plugins/ directory by @LucyJimenez in #1088
• Add flake8 dependencies to requirements-dev.txt file by @dorothykiz1 in #1084
• Replace format() function with PY3 fstrings by @dorothykiz1 in #1087
• Fix flake8 issues on asv/commands/run.py by @LucyJimenez in #1082
• Fix Flake8 violations for files in the test/ directory by @LucyJimenez in #1091
• Fix Flake8 violations for files in the test/ directory by @LucyJimenez in #1093
• Fix flake8 violations for all files in the benchmarks/ directory by @LucyJimenez in #1098
• Minor changes for #1065 and #1044 by @LucyJimenez in #1089
• Move example-results fixture to conftest.py file by @dorothykiz1 in #1100
• Add existing_env_conf() fixture to conftest.py by @dorothykiz1 in #1108
• Add basic_conf() and basic_conf_with_subdir() fixtures to conftest.py by @dorothykiz1 in #1109
• Add example_results() fixture to conftest.py file by @dorothykiz1 in #1110
• CLN: clean stats tests by @fangchenli in #1112
• CI: test pypy by @fangchenli in #1111
• Move test/test_web fixture to conftest.py by @dorothykiz1 in #1116
• Move all test/tools.py fixtures to conftest.py file by @dorothykiz1 in #1114
• BLD: move metadata to setup.cfg, use PEP 517, install asv in CI by @fangchenli in #1118
• CI: Fixes to CI (add more verbosity, fix Windows and environment errors) by @datapythonista in #1071
• Add isort by @datapythonista in #1120
• Move test_benchmarks.py and test_workflow.py fixtures to conftest.py file by @dorothykiz1 in #1121
• Fix Flake8 violations for files in the test/test_web.py by @LucyJimenez in #1105
• Add a job to build the docs on CI by @LucyJimenez in #1107
• CLN: clean setup.py, remove py.test command by @fangchenli in #1113
• Move test/test_show.py fixture to conftest.py by @dorothykiz1 in #1122
• Replace format() function with f-strings on asv/runner.py by @LucyJimenez in #1128
• CLN: Remove py2 compat in extension by @fangchenli in #1125
• Fix Flake8 violations for files in the test/ directory by @LucyJimenez in #1096
• BLD: use setuptools-scm for versioning by @fangchenli in #1134
• Replace format() function with f-strings on asv/console.py by @LucyJimenez in #1127
• Move fixture from test/test_step_detect.py file by @dorothykiz1 in #1131
• Move fixture from test/test_publish.py file by @dorothykiz1 in #1132
• TST/DEPS: monkeypatch stdin, remove six from deps by @fangchenli in #1136
  ...

v0.5.1

Prepare for 0.5.1 release (#1014)

v0.5

Prepare for 0.5 release (#1012)

v0.4.2

• Do not supply --no-site-packages to virtualenv, as it is on by default and no longer supported. (#917)

v0.4.1

• Change wheel installation default command to chdir away from build directory instead of --force-install. (#823)

v0.4

New features:

• asv check command for a quick check of benchmark suite validity. (#782)
• asv run HASHFILE:filename can read commit hashes to run from file or stdin (#768)
• --set-commit-hash option to asv run, which allows recording results from runs in "existing" environments not managed by asv (#794)
• --cpu-affinity option to asv run and others, to set CPU affinity (#769)
• "Hide legend" option in web UI (#807)
• pretty_source benchmark attribute for customizing source code shown (#810)
• Record number of cores in machine information (#761)

API Changes:

• Default timer changed from process_time() to timeit.default_timer() to fix resolution issues on Windows. Old behavior can be restored by setting Benchmark.timer = time.process_time (#780)

Bug Fixes:

• Fix pip command line in install_command (#806)
• Python 3.8 compatibility (#814)
• Minor fixes and improvements (#759, #764, #767, #772, #779, #783, #784, #787, #790, #795, #799, #804, #812, #813, #815, #816, #817, #818, #820)

v0.3.1

Minor bugfixes and improvements.

• Use measured uncertainties to weigh step detection. (#753)
• Detect also single-commit regressions, if significant. (#745)
• Use proper two-sample test when raw results available. (#754)
• Use a better regression "badness" measure. (#744)
• Display verbose command output immediately, not when command completes. (#747)
• Fix handling of benchmark suite import failures in forkserver and benchmark discovery. (#743, #742)
• Fix forkserver child process handling.
• In asv test suite, use dummy conda packages. (#738)
• Other minor fixes (#756, #750, #749, #746)

v0.3

Major release with several new features.

New Features

• Revised timing benchmarking. asv will display and record the median and interquartile ranges of timing measurement results. The information is also used by asv compare and asv continuous in determining what changes are significant. The asv run command has new options for collecting samples. Timing benchmarks have new benchmarking parameters for controlling how timing works, including processes attribute for collect data by running benchmarks in different sequential processes. The defaults are adjusted to obtain faster benchmarking. (#707, #698, #695, #689, #683, #665, #652, #575, #503, #493)
• Interleaved benchmark running. Timing benchmarks can be run in interleaved order via asv run --interleave-processes, to obtain better sampling over long-time background performance variations. (#697, #694, #647)
• Customization of build/install/uninstall commands. (#699)
• Launching benchmarks via a fork server (on Unix-based systems). Reduces the import time overheads in launching new benchmarks. Default on Linux. (#666, #709, #730)
• Benchmark versioning. Invalidate old benchmark results when benchmarks change, via a benchmark version attribute. User-configurable, by default based on source code. (#509)
• Setting benchmark attributes on command line, via --attribute. (#647)
• asv show command for displaying results on command line. (#711)
• Support for Conda channels. (#539)
• Provide ASV-specific environment variables to launched commands. (#624)
• Show branch/tag names in addition to commit hashes. (#705)
• Support for projects in repository subdirectories. (#611)
• Way to run specific parametrized benchmarks. (#593)
• Group benchmarks in the web benchmark grid (#557)
• Make the web interface URL addresses more copypasteable. (#608, #605, #580)
• Allow customizing benchmark display names (#484)
• Don't reinstall project if it is already installed (#708)

API Changes

• The goal_time attribute in timing benchmarks is removed (and now ignored). See documentation on how to tune timing benchmarks now.
• asv publish may ask you to run asv update once after upgrading, to regenerate benchmarks.json if asv run was not yet run.
• If you are using asv plugins, check their compatibility. The internal APIs in asv are not guaranteed to be backward compatible.

Bug Fixes

• Fixes in 0.2.1 and 0.2.2 are also included in 0.3.
• Make asv compare accept named commits (#704)
• Fix asv profile --python=same (#702)
• Make asv compare behave correctly with multiple machines/envs (#687)
• Avoid making too long result file names (#675)
• Fix saving profile data (#680)
• Ignore missing branches during benchmark discovery (#674)
• Perform benchmark discovery only when necessary (#568)
• Fix benchmark skipping to operate on a per-environment basis (#603)
• Allow putting asv.conf.json to benchmark suite directory (#717)
• Miscellaneous minor fixes (#735, #734, #733, #729, #728, #727, #726, #723, #721, #719, #718, #716, #715, #714, #713, #706, #701, #691, #688, #684, #682, #660, #634, #615, #600, #573, #556)

Other Changes and Additions

• www: display regressions separately, one per commit (#720)
• Internal changes. (#712, #700, #681, #663, #662, #637, #613, #606, #572)
• CI/etc changes. (#585, #570)
• Added internal debugging command asv.benchmarks (#685)
• Make tests not require network connection, except with Conda (#696)
• Drop support for end-of-lifed Python versions 2.6 & 3.2 & 3.3 (#548)