Lago v0.46

Hi All!

On behalf of the Lago team, I'm pleased to announce that a new release of Lago is available for download.

General Improvements:

• Lago available for fc29
• plugins: vm: Faster 'extract_paths' implementation - This algorithm offers
• drastic speedups when dealing with the collection of a large dataset
• utils: Added 'TemporaryDirectory' context mgr
• Extracted '_ssh' context manager from '_scp'
• out-format: Always print yaml in block style
• Set file permissions on lock files

Bug Fixes:

• Fix issue: no cpu_map.xml file on libvirt fc29
• Fix failure in runnung tox -e docs
• Replace lago-devel mail list to devel mail list
• Throw error if yum install failed in deploy.sh
• func-tests: Update Centos image to 7.6
• tests: Fix config tests for non-standard config
• Fix comparison between LogRecord and level
• Fix 'super' usage - First parameter must be the current class, not the parent
• Dump capabilities when unexpected error occurs
• Use get_closest_mark instead of get_marker
• doc req: exclude incompatible nbsphinx versions
• Remove erroneous call to hexdigest method
• version_manager: Support shallow git clones
• Fix installation doc - sudo and shell redirect

To upgrade using yum or dnf, simply run:
yum/dnf update lago
Installing with pip: please refer to the docs - https://lago.readthedocs.io/en/latest/Installation.html

Lago container:

docker pull lagoproject/lago
Resources
Lago Docs: http://lago.readthedocs.io/en/latest/
GitHub: https://github.com/lago-project/lago/
YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/
Pypi: https://pypi.python.org/pypi/lago
Docker Hub: https://hub.docker.com/r/lagoproject/lago/
Changelog: https://lago.readthedocs.io/en/latest/_static/ChangeLog.txt

As always, if you find any problems, please open an issue on the GitHub page.

Enjoy!

Galit

Lago v0.45

Hi All!

On behalf of the Lago team, I'm pleased to announce that a new release of Lago is available for download.

General Improvements

• Add support for IO threads and network multi-queue.
• Add Lago container image to Docker Hub.
• Multiple improvements to error reporting on the CLI.

Bug Fixes

• Fix SSH public key authentication on FC28.
• Locking of image/subnet store is failing due to a stale lock.
• On error thread stack information will be handled according to the log level.
• Docs - fixed explanation about required network configurations during installation.

Installing And Upgrading

To upgrade using yum or dnf, simply run:

yum/dnf update lago

Installing with pip: please refer to the docs - https://lago.readthedocs.io/en/latest/Installation.html

Lago container:

docker pull lagoproject/lago

Resources

Lago Docs: http://lago.readthedocs.io/en/latest/
GitHub: https://github.com/lago-project/lago/
YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/
Pypi: https://pypi.python.org/pypi/lago
Docker Hub: https://hub.docker.com/r/lagoproject/lago/
Changelog: https://lago.readthedocs.io/en/latest/_static/ChangeLog.txt

As always, if you find any problems, please open an issue on the GitHub page.

Enjoy!

Gal.

Lago v0.44

Hi All!

On behalf of the Lago team, I'm pleased to announce that a new release of Lago is available for download.

General Improvements

• Reduce the number of DHCP entries we add to Libvirt.
• Add an option to check if a VM provided by SSHVMProvider is running.
• Improve performance when checking for the state of a VM provided by LocalLibvirtVMProvider.
• Align state names with Libvirt's state names in LocalLibvirtVMProvider.

Bug Fixes

• Fix race condition in lago collect (try to use SCP even though the VM is down).
• Fix lago snapshot interactivly requires a password for sudo.

Packaging

• Add support for Fedora 28.

SDK

• No change.

Docs

• No change.

Automation

• No change.

Testing

• Update the test VM images.

Python 3 Compatibility

• No change.

Installing And Upgrading

To upgrade using yum or dnf, simply run:

yum/dnf update lago

Installing with pip: please refer to the docs - https://lago.readthedocs.io/en/latest/Installation.html

Resources

Lago Docs: http://lago.readthedocs.io/en/latest/
GitHub: https://github.com/lago-project/lago/
YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/
Pypi: https://pypi.python.org/pypi/lago
Changelog: https://lago.readthedocs.io/en/0.44/_static/ChangeLog.txt

As always, if you find any problems, please open an issue on the GitHub page.

Enjoy!

Gal.

Lago v0.43

Hi All!

On behalf of the Lago team, I'm pleased to announce that a new release of Lago is available for download.

General Improvements

• Add NUMA support.

Bug Fixes

• Allow creating an environment in an existing dir.

Packaging

• No change.

SDK

• Expose paths to internal objects such as the ssh key, lago log, etc...

Docs

• No change.

Automation

• No change.

Testing

• Update the test VM images.

Python 3 Compatibility

• No change.

Installing And Upgrading

To upgrade using yum or dnf, simply run:

yum/dnf update lago

Installing with pip: please refer to the docs - https://lago.readthedocs.io/en/latest/Installation.html

Resources

Lago Docs: http://lago.readthedocs.io/en/latest/
GitHub: https://github.com/lago-project/lago/
YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/
Pypi: https://pypi.python.org/pypi/lago
Changelog: http://lago.readthedocs.io/en/0.43/_static/ChangeLog.txt

As always, if you find any problems, please open an issue on the GitHub page.

Enjoy!

Gal.

Lago v0.42

Hi All!

On behalf of the Lago team, I'm pleased to announce that the new release of
Lago 0.42 is available for download.

General Improvements

• Added support for Fedora 27.
• Allow setting MTU per network.
• Ease CPU load when waiting for SSH connection in lago deploy.

Bug Fixes

• Added signal handling. A Proper cleanup will be done when sending SIGTERM/SIGHUP to lago.

Packaging

• No change.

SDK

• Added a new method for getting all the IPs of a VM in a specific network.

Docs

• Improved troubleshooting docs.

Automation

• Use yapf version 0.20.

Testing

• SDK functional - Test that VM is defined and running.

Python 3 Compatibility

• No change.

Installing And Upgrading

To upgrade using yum or dnf, simply run:

yum/dnf update lago

Installing with pip: please refer to the docs - https://lago.readthedocs.io/en/latest/Installation.html

Resources

Lago Docs: http://lago.readthedocs.io/en/latest/
GitHub: https://github.com/lago-project/lago/
YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/
Pypi: https://pypi.python.org/pypi/lago
OST Docs: http://ovirt-system-tests.readthedocs.io/en/latest/
Changelog: http://lago.readthedocs.io/en/0.42/_static/ChangeLog.txt

As always, if you find any problems, please open an issue on the GitHub page.

Enjoy!

Gal.

Lago v0.41

Hi All!

On behalf of the Lago team, I'm pleased to announce that the new release of
Lago 0.41 is available for download.

This release is focused on bug fixes.

General Improvements

1. Release subnet leases when destroying an environment.
2. Raise an informative message when qemu doesn't have the necessary permissions
   to access a disk.
3. Drop warning when lago group doesn't exist.

Bug Fixes

1. Fixed lago list command which lists all the prefixes in a given Workdir.
2. Print warning when failing to load plugins.
3. guestfs: Fixed a bug where the exception would not be re-raised after max
   attempts exceeded to remount.

Packaging

SDK

Docs

1. Added installation guide for Ubuntu.
2. Added docs for Lago's repo metadata format.

Testing

1. Added fc26 to SDK functional tests.
2. mock: Don't install the rpm of packages which are installed later by pip.

Python 3 Compatibility

1. Use backported Python 3 super method.

Installing And Upgrading

To upgrade using yum or dnf, simply run:

yum/dnf update lago

Installing with pip: please refer to the docs - https://lago.readthedocs.io/en/latest/Installation.html

Resources

Lago Docs: http://lago.readthedocs.io/en/latest/
GitHub: https://github.com/lago-project/lago/
YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/
Pypi: https://pypi.python.org/pypi/lago
OST Docs: http://ovirt-system-tests.readthedocs.io/en/latest/
Changelog: http://lago.readthedocs.io/en/0.41/_static/ChangeLog.txt

As always, if you find any problems, please open an issue in the GitHub page.

Enjoy!

Gal.

Lago v0.40

Hi All!

On behalf of the Lago team, I'm pleased to announce that the new release of
Lago 0.40 is available for download.

This release is quite large, with a lot of new features and bug fixes.
I will mention the major changes, for the complete list, please refer to the changelog.

General Improvements

1. Start using Jinja 2 as the templating mechanism for creating virt-sysprep and
   libvirt specs.
2. Subnet module was refactored: meaningful exceptions were added, store range was
   increased, and it's now possible to acquire user defined subnets from the store.
3. Export: run the export process in parallel (can be disabled), allow to export iso file,
   Allow to specify in the init file which disks not to export.
4. libguestfs's python module is now optional (Note: without it, copying files from a VM without networking
   is not supported).

Bug Fixes

1. Allow using the same option multiple times in the Builders section.
2. Log collection - Fixed a bug where log collection will fail if the file/dir
   doesn't exist and ignore_nopath=True.
3. Don't fail when a user defined layered images is used.

Packaging

1. Lago stable and unstable versions are now available for installation from
   PyPi and PyPi test respectively.

SDK

1. Added the export command to the SDK.

Docs

1. Improved the installation docs.
2. Added docs about Lago builders (the ability to customize images during init).
3. Improved the networking docs.

Testing

1. Check the boot time of lago templates with systemd-analyze blame
2. Added unit tests for Subnets module.

Installing And Upgrading

To upgrade using yum or dnf, simply run:

yum/dnf update lago

Installing with pip: please refer to the docs - https://lago.readthedocs.io/en/latest/Installation.html

Resources

Lago Docs: http://lago.readthedocs.io/en/latest/
GitHub: https://github.com/lago-project/lago/
YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/
Pypi: https://pypi.python.org/pypi/lago
OST Docs: http://ovirt-system-tests.readthedocs.io/en/latest/
Changelog: http://lago.readthedocs.io/en/0.40/_static/ChangeLog.txt

As always, if you find any problems, please open an issue in the GitHub page.

Enjoy!

Gal.

Lago v0.39

On behalf of the Lago team, I'm pleased to announce the new release of Lago and Lago-ost-plugin:
Lago - v0.39
Lago-ost-plugin v0.41

This is the first release where we've separated Lago and lago-ost-plugin(aka ovirtlago) to different repositories, installation procedures should be the same. However, from now on the lago-ost-plugin will follow a different release cycle. It's repository can be found at [1], and docs at [2]. Note that 'lago-ost-plugin' requires Lago >= 0.39.

What's new

Lago

1. Improved Ansible inventory support. For more details see [3].
2. Lago SDK - Allows to run most CLI operations directly from Python. See [4] for the docs, and [5] for an example. This is mostly standardization of the already provided SDK.
3. Debian network support in bootstrap stage.

Lago Images

3 New images were added, please help in verifying them:

1. fc25-base
2. debian8-base
3. ubuntu16.04-base

There is a known issue with host name resolution after boot in debian, but it does not affect connectivity.

Tests/CI

1. Moved to tox to setup the virtualenv during the tests:
   • tox -e docs - builds the docs.
   • tox -e py27 - run unittests and linters.
   • tox -c tox-sdk.ini -- --stage check_patch/check_merged - to run the functional SDK tests
     for each stage(after you have installed lago - either in a nested virtualenv or from RPMs).
2. Added SDK functional tests:
   • Easy to run sanity check while developing, under tests/functional-sdk run:
     pytest -s -vvv --setup-show --stage check_patch test_sdk_sanity.py
3. Added multi-distro tests, which means prior to merging every Lago patch, we'll ensure the core images in templates.ovirt.org are functional with the new patch.
4. Added ansible functional tests on check-merged.

For the full changelog see [6].

Upgrading

To upgrade using yum or dnf, simply run:

yum/dnf update lago

Resources

Lago Docs: http://lago.readthedocs.io/en/latest/
GitHub: https://github.com/lago-project/lago/
YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/
OST Docs: http://ovirt-system-tests.readthedocs.io/en/latest/

As always, if you find any problems, please open an issue in the GitHub page.

Enjoy!

Nadav.

[1] https://github.com/lago-project/lago-ost-plugin
[2] http://lago-ost-plugin.readthedocs.io/en/latest/
[3] #544
[4] http://lago.readthedocs.io/en/stable/SDK.html
[5] https://github.com/lago-project/lago/blob/master/docs/examples/lago_sdk_one_vm_one_net.ipynb
[6] 0.38...0.39

Lago v0.38

Hi All,

On behalf of the Lago team, I'm pleased to announce Lago v0.38 is available!
This quick release is focused on improving lago-ovirt plugin.

Resources

Lago Docs: http://lago.readthedocs.io/en/latest/
GitHub: https://github.com/lago-project/lago/
YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/
OST Docs: http://ovirt-system-tests.readthedocs.io/en/latest/

Full Changelog:

• Thu Apr 27 2017 ovirt-infra infra-private@ovirt.org - 0.38.0
  c9f53d4: Merge pull request #525 from
  lago-project/do_not_export_dns_records
  047b8e5: Remove dns entries from exported init file

• Thu Apr 27 2017 ovirt-infra infra-private@ovirt.org - 0.37.3
  fcf0fcd: Merge pull request #520 from
  lago-project/improve_lago_ovirt_status
  5c86420: Improve lago ovirt status

• Thu Apr 27 2017 ovirt-infra infra-private@ovirt.org - 0.37.2
  c5687ae: Merge pull request #519 from
  lago-project/print_message_lago_ovirt_start
  9cf732e: Print informative message after "lago ovirt start"

• Thu Apr 27 2017 ovirt-infra infra-private@ovirt.org - 0.37.1
  4520202: Merge pull request #518 from nvgoldin/increase_start_vm_timeout
  33ca8c0: ovirtlago: reconfigure timeouts in 'lago ovirt start'

As always, if you find any problems, or willing to contribute, visit our GitHub page.

Enjoy!

Gal.

Lago v0.37

Hi all,
On behalf of the Lago team, I'm pleased to announce Lago v0.37 is available!

What's new

General

1. Allow running arbitrary 'virt-customize' commands on template
   disks, prior to boot-up, for example:

    disks:
      - build:
        - virt-customize:
            ssh-inject: ""
            mkdir: "/tmp/some_dir"
        template_name: el7.3-base
        type: template
        name: root
        dev: vda
        format: qcow2

Will create the directory /tmp/some_dir in the template disk and
inject Lago's generated ssh-keys to the root user. For a full list of
available commands please consult virt-customize docs[1], under
'Customization options' section.

2. Allow skipping the 'bootstrap' stage(virt-sysprep) per VM, by
   defining 'bootstrap: false' under the VM definition.

Libvirt

1. Use 'host-passthrough' as the default CPU mode.
2. Allow customizing CPU definitions, with 'cpu_custom' and
   'cpu_model' parameters, see [2] for more details.
3. Automatically add DHCP leases for none management networks.
4. Auto select management network if not defined.
5. Allow defining custom DNS records in management networks.
6. Restrict DNS configurations to management networks only.
7. Enforce one management network per VM.

ovirtlago

1. Export junit XML reports generated by nose with *.junit.xml suffix.
2. Add '--with-vms' option to 'lago ovirt start'.
3. Allow defining a custom CPU <-> Cluster level mapping file.

For the full commit-log, which also includes several bug-fixes, see [3].

Upgrading

To upgrade using yum or dnf, simply run:

yum/dnf update lago

Resources

Lago Docs: http://lago.readthedocs.io/en/latest/
GitHub: https://github.com/lago-project/lago/
YUM Repository: http://resources.ovirt.org/repos/lago/stable/0.0/rpm/
OST Docs: http://ovirt-system-tests.readthedocs.io/en/latest/

As always, if you find any problems, please open an issue in the GitHub page[4].

Enjoy!

Nadav.

[1] http://libguestfs.org/virt-customize.1.html
[2] http://lago.readthedocs.io/en/latest/LagoInitFile.html#domains-section
[3] 0.36...0.37
[4] https://github.com/lago-project/lago/issues/