Robotest 3.1.1

Robotest 3.1.1 fixes two regressions related to stale images.

Bug Fixes

• SLES 12 failures (#290) fixed by #293
• Debian 10 failures (#291) fixed by #292

Internal Changes

• Additionally, all other distro images (Ubuntu, RHEL, CentOS) were proactively updated. (#294, #295)

Robotest 3.1.0

Robotest 3.1.0 is a small feature release, including:

• RHEL/CentOS 8.4 support (#287)
• Two internal changes (#288, #289)

Robotest 3.0.0

Robotest 3.0.0 focuses on determinism and configurability, including the following changes:

Improvements:

• Robotest can now run in GCP projects other than kubeadm (#285)
• GCP network and subnets are now configurable (#285)
• The epel and gcloud rpm repos are removed during Centos and RHEL bootstrap for improved determinism. (#283)
• Internal changes including: dependency upgrades (#276), and release automation improvement (#275, #277)

Bug Fixes:

• AWS cli upgraded from v1 to v2 to remove system python dependence, allowing robotest to continue to run on old distros with python 2.7 (#280)

Breaking Changes:

• A project must be specified in the GCP config. (#285)

  project: $PROJECT_ID
  credentials: /robotest/config/creds.json

Users of the bundled run_suite.sh script get this for free via from the GCL_PROJECT_ID environment variable.

• The default robotest network/subnet changed from robotest/robotest to default/default for quicker setup when running in a single purpose GCP project. (#285)
• Pubsub publishing removed. (#285)

Robotest 2.2.2

Robotest 2.2.2 fixes Redhat and CentOS failures stemming from unneeded yum repos (#282)

Robotest 2.2.1

Robotest 2.2.1 hotfixes a regression caused by pip deprecating python 2 (#279), preventing tests from running on Debian, Ubuntu, and SLES.

Robotest 2.2.0

Robotest 2.2.0 includes the following changes:

• CentOS/RHEL 8.3 and 7.9 support.
• Log links now specify a timestamp! No more scrolling back from 'now' for old links.
• The 'suse' os is now 'sles' (suse is an backwards compatible alias for the time being).
• Distributions now offer more specificity: select redhat:8.2 or sles:12-sp5 instead of only readhat:8 or suse:12
• Integration with the new Google Cloud Logs Explorer
• Various internal changes (including go 1.15 and updated dependencies)

Robotest 2.1.1

Robotest 2.1.1 fixes a regression when running against Gravity 5.0.x (#262, #233)

Robotest 2.1.0

Robotest 2.1.0 includes the following changes:

• Suse12-SP5 is officially supported: "os": "suse:12" in test json.
• More current OS images for all GCE supported distros. Notably: centos and rhel have kernel version >= 3.10.0-1127 to avoid gravitational/gravity#1999
• A test specific installer_url will always pre-empt the installer_url specified in the provisioner config. This allows for per test installers, and as a side effect, testing upgrades away from the release under test!
• Numerous internal changes & improvements.

Robotest 2.1.0-rc.1

Release Candidate 1 for Robotest 2.1.

Robotest 2.0.0

Robotest 2.0.0.

Robotest 2.0.0 includes too many features to call out all individually. Key highlights since 1.0.0 include:

Provisioning Changes

• GCP support added.
• Amazon and Azure support deprecated, and are untested (and thus likely broken).

Test Changes

• Test with custom Gravity state directories
• Test against a variety of operating systems (Centos, Redhat, Debian, Suse, Ubuntu) and versions instead of only Ubuntu 16.04.
• Use a post-installer script to test air-gapped installs.
• A new shrink test scenario.
• Add -retries flag to limit (or increase) the number of times robotest will retry a test case.

Internal Changes

• Many, many bugfixes and logging improvements.
• Excellent intentions of returning to Semantic Versioning.