I'm searching for a framework for running system tests. The requirement are:

  • Able to manage provisioning to multiple physical machine
  • Able to manage provisioning to multiple virtual environments (AWS, Azure, etc)
  • Able to run tests on a given machine be it physical or virtual.
  • Not bound to a single language or platform. We wish to at least test against Linux, Windows at least.

Is there anything that meets those requirements?

Thank you!

2 Answers 2


Test Kitchen? Your requirements are huge and vague but it's probably your best bet.

  • Sorry for being vague. The product we want to test has components that span many platforms both physical and virtual and so we are searching for a framework that we can use to manage testing across those platforms.
    – X_Trust
    Jun 8, 2017 at 14:12
  • 1
    When you get to something that complex, the chances of finding something perfect off-the-shelf drops asymptotically to zero.
    – coderanger
    Jun 8, 2017 at 15:16
  • I can't imagine we're the only ones who are having this issue so I figure it was worth asking. Thank you for your feedback!
    – X_Trust
    Jun 8, 2017 at 15:50
  • The problem is "this issue" in the general case is very different from your specific mix of tools and environments.
    – coderanger
    Jun 8, 2017 at 17:19

So you are looking for a software which is resource agnostic

  • provision any resource type
  • configure any resource type
  • execute on any resource

I am biased but you can look at some job schedulers. We are currently using ProActive from Activeeon which should answer your needs but other may have similar behaviors.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.