Tutorial: Let’s build a Continuous Quality Assurance Strategy around your CI/CD pipeline
Building a Test Strategy in DevOps is not only about Test Automation, but how built-in-quality can be achieved in all steps of the SW development, within and outside of your CI/CD pipeline.
What is the goal of your testing? What quality aspects are more and what are less important for your domain? What are the major risks? What testing steps should be included in a Continuous Integration/Continuous Delivery pipeline, and where to focus with Exploratory Testing? How to utilize the new QA opportunities available by applying DevOps practices?
Don’t just string together existing manual processes! – in this tutorial, we will use simple, collaborative tools to design something better!
The interactive workshop will help teams to learn how QA is extended to the left and to the right in DevOps, how to design QA pipeline with simple cards and what other testing related activities to be agreed on, to have a full test strategy.
In this remote compliant, hands-on workshop for teams of 5-6 people, we will use MIRO as an interactive canvas, several digitized card games, as well as Sticky notes to identify parts of a Test Strategy and to design a CI/CD pipeline into its core. (however we do not use actual CI/CD tools as the technical implementation of the pipeline is not the scope here).
In case the workshop is delivered in real, we use Card Games as well as Sticky notes.
The format is a series of lectures and discussions to share the needed theory, and exercises to practice what we have learnt. Throughout the exercises, teams will build a full Test Strategy for preselected scenarios and contexts in breakout sessions, followed by presentations and discussions.
Presentation: How testing is evolving in DevOps
Can we be the same testers in a DevOps organization, as in the past? Is that enough if we know test automation, exploratory testing and many aspects of Shift Left, or are there any new aspects, concepts and techniques that a tester shall be aware of? In my presentation I would like to share my 20 years journey in testing, process improvement, service design and DevOps, focusing on how testing, quality assurance has evolved, and what are the areas a good test professional shall be aware of.
I will start with a quick recap on what is DevOps, describing the wall of confusion and the DevOps collaboration to break it. I will introduce the three ways of DevOps (Flow, Feedback, Learning and Experimentation), so we are able to discuss how the discussed testing techniques are helping each of these.
Then, as the main part of the talk, I will introduce what testing and QA activities we can do in each step of the Plan, Code, Build, Test, Deploy, Release, Operate, Monitor stages of a development value stream.
We start from the middle and Shift Left, and Shift Right, and then we shift even more to both directions, until we understand how these steps will create a continuous loop, connecting Monitoring to Planning.
For each stage I will represent testing activities, and techniques, some tools as example, as well as share what are the skills that a tester shall gather.
On the far left we will discuss about validation inside Design Thinking, and what techniques are used to bring us having BDD scenarios.
On the far right we will learn about Blue-Green deployment and Dark Launch is helping Quality Assurance, or how Canary Release and A/B testing can help with the Validation aspect of Design Thinking.
By closing the loop, we will see how Monitoring is bringing Learning to identify new Features and enhancements, thus how we can test a business hypothesis.