@steipete performance in comparison to bare metal is ~10% worse which is acceptable. Stability of the VMs is very good. We had some issues in the past with CI plugin that orchestrates the anka cloud but Anka provides a great support with all kind of issues (even not related to anka itseld)
@steipete huh, definitely not :) it is way less, unfortunately I cannot expose the price, but if I remember correctly they provide discounts according to amount of cores you want to buy.
@steipete@martinjeret I actually never tried it, but installing anka binary has a checkbox of nested virtualization and according to their engineers it is possible to run docker inside anka VM with this option
@martinjeret@steipete yeah, nested virtualization is a problem. Anka supports it but the performance is not great, we use docker for Android stuff in our system while using Anka exclusively for iOS
@steipete so we had initial costs to buy max configuration mac minis + we have some costs of our internal it department to sometimes replace broken MacMinis, but overall maintenance is not that high, each mac mini has KVM switch, so we can reboot then while being in another country :)
@steipete we have 150 VMs, each VM uses 2 real cores (1core = 2 vcore). We didn't try bare metal, we moved from VMWare to Anka because of bad support. We've chosen a mixed solution, we host MacMinis and MacPros in our DC so it would be hard to calculate the costs
@steipete@basthomas@q231950 We run the first attempt again mocks. If mock failed we retry on Real BE within the same test run. We run tests by chunks, we have a DB and system that allow us to combine tests in equal parts. So each part will spawn a VM with iOS sim and run from 1 to 10 tests on it
@steipete@basthomas@q231950 Overall, I would say that even the fact that e2e tests are flaky on their own and require considerable amount of time to debug/react on BE changes, the thing works. We rely on the results for releasing our apps.
@steipete@basthomas@q231950 We run the tests in parallel, that reduces amount of time from 30h to 40-60 minutes. We use Calabash, the tests are as flaky as your test environment. We get lots of problems with broken/changed backend and/or poorly written tests or bad test data Management.
@steipete@BasThomas VMware ESXI 6.7 (the last version from April), seems to have problems with MacPros.. Our IT reported incompatibility (probably because of APFS)
DevOps Engineer (m/f/d) mobile focused | XING Jobs - https://t.co/EVkEzI2Dd1 I'm looking for a new team member. Contact me in case you are interested or you do know somebody who is.
Hey #AndroidDev! Today we open sourced one of our internal fastlane plugins to help you running android stuff on docker images. Check it out. It is super helpful and helps you to stabilize your test runs on your CI. Also it has an awesome name and logo :)
https://t.co/opF9mXDIvj