The Relevance of Built in Quality

With Valori we published a new eBook in the series on Digital transformation.

This publication is a follow up on the trend report that was released earlier this year. In this previous ebook we described disruptive trends and explained why organisations need to become adaptive.  In this second edition we focus on the development practises that companies embrace to do so.  In the first part we describe how Agile, DevOps,  CI/CD  and Scaling contribute to business agility. I believe it is a nice introduction for managers, stakeholders and  professionals that are not entirely familiar with these development practises.

The second part of the eBook deals with Built in Quality. We state that the concept of creating fast feedback loops crumbles when you cannot release frequently.  Without confidence in system quality, we cannot make quick adjustments and receive no feedback on the impact of implemented improvements. Built in Quality provides the confidence in the quality of the systems so that we dare to change them frequently and take them into production.   In the eBook we introduce the built in quality circle. It provides an overview of the steps in the development cycle and where errors can be prevented.

I am proud of my contribution to this eBook and hope you find it useful. You can download your free copy of Hoe word je wendbaar als organisatie? – Het belang van built in quality from the Valori site.

download button

Posted in Agile, Books, Built-In quality, DevOps, Scaling Agile, SCRUM | Tagged , , , , , , , , , | 2 Comments

How to Incorporate Testing in a SAFe Development Process.

I stumbled on an interesting webinar by on how to incorporate testing on the various levels in the SAFe framework. Wade Towles explains that Built-In quality is one of the Scaled Agile Framework’s (SAFe) four Core Values and a core principle of the Lean-Agile Mindset. In the webinar  he explains how to Incorporate Testing in a SAFe Development Process using Rational Quality Manger (RQM). Keeping track of what needs to be tested and how is critical for success, especially in regulated environments.

The webinar describes the relationship between requirements on epic, feature and story level (at approx 7:15 min) and shows how capability, feature plans and system demo plans are required to organise testing.

Wade states (at approx 8:30 min) that in order to have effective testing at team level the system team 0r the integration test team should write a PI testplan for the program with a child testplan for each feature in the PI. This Feature testplan ties together the tests done on each features

Likewise at System demo testplan is used at solution level (at approx 16:20 min). This plan can be made by a team of e.e. solution architects, Business architect of test engineers and looks for  successful completion at a solution level The focus of the System demo testplan is to test how the features work together rather than testing the individual features.

What I notice is that the testplan seems to be a collection of tests rather than a testplan that describes how the tests are organised. For me a testplan is often the later.  I guess we need both. I mis a mention on what should be a testplan to effectively align different parties and teams to collaborate on integration testing. But beside this omission, it is an interesting webinar, and I am glad more people start talking about embedding quality in scaled agile settings.


How to Incorporate Testing in a SAFe Development Process using Rational Quality Manager




Posted in Scaling Agile, Test management, Testing | Tagged , , , , , , , , , | Leave a comment

SIG on Quality in SAFe: Where should we put the quality responsibility?

Yesterday we had another of our Quality in SAFe meetings. The Special Interest Group is founded by TestNet and aims to define where quality and testing can be mounted into scaled agile organisations. Yesterday we had an interesting discussion on responsibilities. Where should we put the quality responsibility on team and release train level and how does this answer differ when moving from an informal to a highly regulated organisation. We discussed the roles of the productmanager and the RTE with respect to test management and QA. We talked about the function of the systems team and the CoE in providing guidelines and support.

If you are interested in joining these discussion. We meet regularly in regio Utrecht and love to hear your experience and ideas as well. Contact TestNet or Me (Derk-Jan).

Posted in Agile, Scaling Agile, Test management, testnet | Tagged , , , , , | Leave a comment

How do you unlock the power of Agile?

10 October the Agile Consortium will organise their annual conference in Doorn (the Netherlands). The theme of the conference is: Unleash! Balancing structure and Autonomy.

About the theme: Many organisations struggle with transforming into a flexible organisation. Some organisations have completely or partially reversed their Agile transformation and ask: Does the transformation to an agile organisation actually have the intended effects? The answer to this question can be confronting …On the other hand, we know of organisations where the transformation to an agile organisation is a success. Organizations where motivated employees and teams deliver the right value to a satisfied customer every day. How have these organisations succeeded? How do you unlock the power of Agile? This is the central question this year that the Agile Consortium’s annual congress wants to answer.

It promises to be a day full of interesting presentation and workshops. Mark 10 October in your calendar, and check the program. As the program is being made the website is updated in short iterations. Check out the preliminary  program on the conference website.


Posted in Agile, Conferences, DevOps | Tagged , , | Leave a comment

Full participation during the tutorial Test Management in Agile

On the 25 of May Jan Jaap Cannegieter (Squerist) and I hosted the Tutorial Test Management in Agile on the Agile Testing Days USA. It proved to be an interesting topic, with 40 people in the room it was the best visited tutorial of the conference.

During a full day we discussed the needs for agile test strategies and what role the test manager can take. During the day we collected and prioritized the activities that test managers do and compared them the needs of the stakeholders.

During our hands-on exercises the participants worked in small groups on single-team one-page test plans. We learned how to incorporate non-functional tests and how present the strategy in a visual way using a simple graphic of mind-map. Since we did this tutorial in Copenhagen last month, the quality in a scaled agile setting has become a valued topic on the agenda. So, we discussed how quality can be embedded in a multiple team setting.

In the last hour of the day, we looked at different roles that a test manager can take. We examined the benefits and activities for each role and shared our insights.

We were very pleased with the enthusiastic participation and the high level of discussions we had. We loved the feedback we got on the feedback form (nines and tens) and during the rest of the conference. Many come towards us to share how they valued the session.

See below an impression of the day:

If you are interested in our tutorial, feel free to contact me, of visit the Agile Testing Days in Potsdam later this year. We will host the training there as well.

Posted in Agile, Test management | Tagged , , , , , | Leave a comment

State of Testing Report 2019

The annual  state of testing report  is based on the contribution of about 1000 participants from 80 countries. They filled in the survey earlier this year and thus sharing  how they perceived their work and the testing profession.

PractiTest and TeaTimeWithTesters are happy to present the report. It’s the 6th edition already. It brings you a lot of data and numbers, and also clarifies trends that are relevant to everyone seeking a future in the QA world.

  • Have  a look at page 13, and see how CI/CD is getting more adopted.
  • See how the number of testers that don’t do automation goes down,
  • or look for the team challenges on page 25.
  • Check how people expect their career to  evolve on page 31

Just a few  of the highlights, Download it now and discover:

State of Testing Survey 2019

Posted in Testing | Tagged , , , , | Leave a comment

TestExpo Copenhagen

I just got back from Denmark where I contributed to the TestExpo 2019.

Wednesday Jan Jaap Cannegieter and I gave a tutorial on Test Management in Agile. With a group of 23 enthusiastic test managers we explored what task we perform, how these tasks relate to our mission as test manager and what various roles the test manager can have.

A large amount of time was spent on making one-page testplans for sprint and release level.  There were many questions on how we can embed quality in larger agile organisations.  Based on the questions we adapted the program a bit and shared our ideas on building quality into e.g. the SAFe frame work. Based on the eBook I wrote with Mette Bruhn-Pedersen, we had some great discussions. The Chief Quality Officer, that is introduced in the eBook,  even made into the next assignment.

During the Conference Jan Jaap gave an  interactive  session. Since the conference was held in the cinema, the STARWARS theme of “Dark side of test automation” was a close fit. During this  session we discussed the pitfalls of Test Automation and give some tips to stay away from the dark side.



Posted in Conferences, Testing | Tagged , , , , , , , , , , , | 1 Comment

The impact of AI on testing

Bits & Chips magazine published an article on Artificial intelligence. For this article I sat down with Rik Marselis from Sogeti, and together we had a good conversation about the changes and challenges of AI and testing.

AI is a popular topic these days. As companies are including it in their solutions and services, IT professionals are more likely to encounter AI and machine  learning in their daily work and experience the challenges it brings. We discussed

How AI can be used to:

  • automatically scan the system and run some tests
  • interpret the systems’ response
  • find patterns in the production data
  • learn how the system is being used
  • select the test to include in a regression testset
  • predict where error might occur
  • generate synthetic test data

Read the full article in Bits & chips or here:  Tea and coffee with Rik and Derk-Jan – The impact of AI on testing

Posted in Bits & Chips, Testing | Tagged , , , , , , , | Leave a comment

Bringing the DevOpsImprovement Game to Ibiza

This weekend Innspire and Fincalabs host the Agile Coaching Summit – Digital Innovation Camp on the beatiful island of Ibiza. I was thrilled to participate and did the Valori DevOpsImprovement game. We had great fun playing it and had a fruitfull debate afterwards.


Posted in Agile, Conferences, DevOps | Tagged , , , , | Leave a comment

Common sense or Agile Excellence? – A new workshop

Wednesday the Dutch Test Association is hosting its spring-conference in the NBC. We have a full day ahead of us filled with interesting talks and workshops on testing and quality. From Valori we contribute with two sessions

In the morning we start with a tutorial called  “Common sense or Agile Excellence?”. During this workshop Duco Geels, Feline Hermans and I will explore test strategies in a real life experiment:  Agile Evangelists and purist have a very clear picture of how agile development should go. Opposite the purists is a group of pragmatic test professionals. They do not see agile as the ultimate goal and do not approach the problems from the theory, but from their gut feeling or common sense. Sometimes these groups face each other. This is also the case during this session, where we will learn the differences and similarities between both approaches.

In the evening, Linda Dekker, Gerhard Kruiger, Roy Vennik, Jurgen Woen Tjoen Soen and Eric van der Mark will host a session on how testing can be kept out of the crumple zone. If the planning supports testing, the project is helped because feedback is given early, the quality improves and early insight is gained on risks and the effectiveness of the
test approach. It is therefore only logical that testers interfere with the planning of development such that they can start testing as quickly as possible. But is this in daily live the case…. often it is not….!

See more details about the event on the testnet site.

Posted in Agile, Testing, testnet | Tagged , , , , , , , , , | Leave a comment

It’s a pop-up Huddle!!

The Eurostar Huddle is going on tour! This month is will show up in Copenhagen, where it will pop up at TestExpo on May 23rd! Jan Jaap and I will be hosting a tutorial on Test Management in Agile there and a session on test automation.

But together with the #eurostarconf crew and Isabel Evans will sit down for a relaxed and informal couch session during the break. Hope you drop by and to say hi!

Posted in Conferences, EuroSTAR | Tagged , , , , | Leave a comment

DevOpsImprovement Game – Maximise business value without ignoring operational responsibilities

DevOps teams have to balance their work between three types of tasks. Development, Operational tasks and Improvements. Many DevOps teams (and that includes the PO) are struggling with balancing between the three types of work. Often Ops work uses up much of the time reducing the adaptivity of the business, while other teams focus heavily on new features and create too much technical debt.

To get a feel about this challenge we created a serious game, called the DevOpsImprovement Game. In this game teams experience how to have a maximum of business value in a sustainable way without ignoring operational responsibilities.

I have posted some impressions of the game before, but I proudly present DevOpsImprovement- The Video. 

Thanks Jana, Philip, Karlijn and Thomas for sharing your impression of the game

Posted in Agile, DevOps, Video | Tagged , , , , , , | Leave a comment

Keynote speaker on the Agile Testing Days – Woaauw!

The line-up of keynote speakers for the Agile Testing Days in Potsdam gave been announced. The grin on my face in the picture above is sincere; I am really happy to give a keynote.

Jan Jaap looks happy as well. We are combining forces to make it a story worthwhile. More details will follow in time due.

Posted in Agile, Agile Testing Days, Conferences | Tagged , , , | Leave a comment

New eBook series on the Digital Transformation


Proud to present the first edition of three eBooks on the Digital Transformation: Title “Why your organization will not survive the next 5 years, and how to avoid that.” In this first eBook I describe trends that force organizations to adapt their business model and invest in a flexible and adaptive development process. In this eBook I give some examples of disruptive changes and explain how this could impact organizations like yours….

You can download the eBook for free (if you leave behind a few details) on the Valori Website. Currently the publication is in Dutch, I am sorry for that.

download button

This first edition will be followed by two more eBooks….we are currently working on the 2nd edition that will describe what organizations do to become adaptive. To be Continued…


Posted in Books, Publications | Tagged , , , , , | Leave a comment

How to get more out of your User Acceptance Test- Article in AG Connect with Rene Ceelen

Together with Rene Ceelen I published an article in the AG Connect. Rene Ceelen is researcher on the Radboud Universiteit Nijmegen op de faculteit Institute for Computing and Information Sciences. He also runs TestMonitor, a consultancy company on ERP Testmanagement.

For this article we sat together and discussed the value of the User Acceptance Test (UAT) and defined some tips to empower the user to do great tests. We also discussed ways to improve the value of the UAT. It can be so much more than just some users playing around with the system.

We wrote the article in dutch, but if we get enough requests we’ll translate it to English. You can read it here: Gebruikers acceptatie testen blijven belangrijk.

Posted in Testing | Tagged , , , , , , , | Leave a comment