Cross-platform workers

[victorb]

Acceptance Criteria

• Tests can specify which platforms to run on and it's possible to run on:
  • Linux
  • OSX
  • Windows

Tasks

• Configuration for workers in SCM
• Deployed in production
  • Linux
  • OSX
  • Windows

Notes

• How to scale OSX workers?

Dependencies

Depends on #1

[ghost]

Let's call them workers ;)

[victorb]

@lgierth fixed, thanks :)

[Kubuxu]

Other platform worth including would be ARM and also 32bit linux.

[dignifiedquire]

agreed on ARM, though this means adding a full matrix of devices if done properly

[Kubuxu]

@dignifiedquire I proposed ARM here because we broke builds on ARM recently (same with 32bit linux) and we are currently supporting both of those architectures.

We can add more mobile platforms in future but for now I think that CI should cover what we are providing on dist.ipfs.io

[victorb]

Yeah, ARM as a architecture makes sense to support but going full out with a device farm (for what I'm guessing is for mobile tests) is too early at this point.

[dignifiedquire]

I meant that just supporting ARM means having multiple devices as they come in different versions plus you need a single device per worker given their somewhat limited power.

…

On 11. Oct 2017, 19:29 +0200, ᴠɪᴄᴛᴏʀ ʙᴊᴇʟᴋʜᴏʟᴍ ***@***.***>, wrote: Yeah, ARM as a architecture makes sense to support but going full out with a device farm (for what I'm guessing is for mobile tests) is too early at this point. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

[Kubuxu]

What I mean by ARM right now is ARMv7/v8 with Linux running (which is RPi and its clones, Scaleway and many of IoT.

[dignifiedquire]

I have two pis around which are entirely unused, which we could hook up.

…

On 11. Oct 2017, 20:00 +0200, Jakub Sztandera ***@***.***>, wrote: What I mean by ARM right now is ARMv7/v8 with Linux running (which is RPi and its clones, Scaleway and many of IoT. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

[victorb]

Thanks for the offer! Right now, focus is on the three major platforms, then we can start planning for how to support ARM, 32bit linux, FreeBSD and other fun platforms.

[victorb]

Depends on ipfs/aegir#159

[victorb]

Current status of this:

Managed to setup linux + windows workers via Terraform + AWS in a nice way. Doing some minor refactoring then will submit PR and later deploy it.

macOS workers are more difficult... Either set them up manually or integrate with something like vmware vSphere to create virtual workers on one or more hosts. MacStadium seems like a suitable hosts with support for this (and I've done smaller trials with hosted Mac Minis) or we go forward with #73 which can be used for virtual workers for any OS.

FYI: automating the setup of windows machines is a pita...

[victorb]

We're running cross-platform tests now!