Monday 27 November 2017

Language is Still Hindering Testing and The Hiring of Testers

It's been a month now since I attended Test Bash Manchester. I heard two very powerful talks at that conference which have been swishing around in my brain for a while now. Both talks came from speakers that shared a desire to advance the craft of testing.

The first talk was by Martin Hynie (@vds4), currently Director of Test Engineering at Medidata. The second talk was by Michael Bolton (@michaelbolton) a tester, collaborator, coach, consultant, author and Twitter super star.

Martin's talk "The Lost Art of the Journeyman" and Michaels talk "Where do you want to go today? No more exploratory Testing" both invoked the same feeling in me. Change is still very much needed when we are talking about testing. Martin said that only by identifying entrenched beliefs can we find opportunities for change. He explained that one of these entrenched beliefs is what "testing" means. So to invoke change we need to approach from the same side as someone that doesn't understand testing.

Both speakers talked about testing being a craft. Martin went a step further and said that testing is not a commodity.

I still frequently see testing treated as a commodity by people which do not work as testers. I get embarrassed when people believe smart self directed testing is of equal value to scripted testing. It's also very hard being the person trying to explain that someone's beliefs around testing are hindering and causing damage to a project. The belief that all testing is equal is one of those entrenched beliefs Martin told us to be mindful of.

Michael Bolton sums this up on his blog where he says scripted testing is expensive, time consuming, leads to inattentional blindness. Separating the designing of a test script from its execution in turn lengthens and weakens the feedback loop.

Michael told us that scripted testing makes testers incompetent as they are not empowered to think.

The Word 'Empowered' Matters.

As someone doing self-directed testing without a test script it can be very easy to criticise testers that write and work from test scripts and test cases. I have worked with financial institutions which rely heavily on scripts. I have met and spoken face to face with testers that work in this scripted way. Seeing things from their point of view I discovered some of the constraints they have to work within. They are not empowered to throw the scripts away. Management want them to work in this way as it is easy (yet foolish) to measure testing with numbers and stats.

When I worked in the UK games industry, I was lucky that I was able to do testing without scripts, but I was still not empowered. I was stuck behind a wall with many Devs throwing any code they wanted over the wall at a small group of testers. If bugs got missed, that was the testers fault - not the fault of a dysfunctional way of working.

Michael spoke about how the definition of testing had been stolen from testers. Now testing meant something completely different to people outside of testing. He said that the testing community needs to steal the definition of testing back.

What is Your Definition of Testing?

I have recently started asking some of my developer friends the following question: 'What is your definition of testing?' Some of the answers have shocked me!

The first Dev I asked said 'testing is ensuring quality'. I had to try explain that this wasn't entirely true. Testing is an activity that evaluates something (which could be anything) to find problems that matter. The discovery of those problems could have very little to do with ensuring quality if no action is taken once they are discovered!

My challenge to other testers would be start asking people you work with for their definition of testing. Start getting a feeling for how closely your ideas of testing are aligned. Just because you are using the same language does not mean that you are talking about the same things. Do not make the mistake of assuming everyone's idea of testing is the same.

Michael wanted us to return to using the word testing (not exploratory testing - which he said was like calling a cauliflower a vegetarian cauliflower). Martin wanted us to change the language we use for describing testing and testers.

At an open space event on Saturday 28th October 2017 a diverse group of testers sat around a table and openly discussed the testing role. Specifically the language used to describe that role. One thing became very clear very quickly - The language and definition of testing are certainly not shared between testers and non-testers. Even some testers present had slightly conflicting ideas. We certainly have a lot more work to do in this area.

Patrick Prill (@TestPappy) said that he knows people called tester but what they are doing does not match the job ads. Recruiters are have a very hard time when it comes to describing job roles. Instead of hiring testers, maybe we should be hiring people with critical thinking skills. Maybe the best testers aren't actually testers yet?

At the open space gathering it became clear that recruiters can be blind to what testers do. Both Neil Younger(@norry_twitting) and Martin Hynie shared their experiences of pairing with a recruiter. Essentially working together to identify good/bad candidates and the reasons why. Both had positive outcomes from the experience of a recruiter and a tester pairing up and working together.

From my own experiences, observations and conversations I am aware that some skilled testers are still not getting hired. 'Manual tester' has become a dirty word used to devalue testers. I have heard some pretty crazy things this year. I was asked recently by a recruiter if I knew anyone suitable for an 'Automation Tester' position. I also met a manager I met that told me 'most of our testers are manual but they have been with us a long time so rather than replacing them we are going to to train them to be automated testers.'

The first thoughts that went through my head was what is an 'Automated Tester'? Automation is a development task. There is no such thing as automatic testing. Automation is dumb, it can not direct itself, it can not explore or think. Further to that, automation in testing should be the responsibility of the whole team, not a single specialist. By putting the responsibility of an automation project on the shoulders of just one person you are heading for disaster (see the term bus factor).

A Keyword CV Search is Simply Not Enough.

When hiring testers, a keyword search on a CV is simply not enough. This comes back to a need to realign the language we use to talk about testing in the context of 'that thing testers do'.

As well as starting conversations with people we work with about the definition of testing. I believe testers also need to start sharing information with recruiters. This was one of the reasons I was very keen to write and share an article with a recruitment blog. By sharing understanding and knowledge around testing skills and testing work with the very people that are trying to hire us, we not only make things easier for the people trying to hire, but we also make things better for people (like us testers) trying to get hired.

If my job suddenly switched from software tester to recruiter these are some of the things from my experience of testing and testers that I would take with me when trying to specifically recruit testers.

Stop filtering out testing candidates based on certifications.

ISEB/ISTQB really is not a good filter for testing candidates. When I surveyed 187 testers in 2016, only 48% had completed ISEB/ISTQB foundation certificate. I do not hold this ISEB/ISTQB qualification. Some of the brightest smartest testers I know also do not hold ISEB/ISTQB qualifications. There is a big difference between being able to learn answers to some multiple choice questions and test software. By demanding this qualification you will also probably alienate the kind of people you want to attract. Smart testers know these qualifications exist for profit to make money.

Everyone these days puts agile on a CV, this does not mean they are agile.

Better things to ask a candidate rather than looking for the 'agile' keyword:

  • Ask them about a time they changed their mind or changed course.
  • Ask about some experiments they have done within a team.
  • Ask about a time they collaborated or paired with another team member.
  • Ask how they eliminate wasteful testing documentation.

Acknowledge that there is no automated testing

There are no automated testers. Automation is its own development project and should be owned by the whole team. It is possible for someone that can automate (e.g. write code that checks things) to not understand what should be automated. Writing code is a different skill to being able to decide what that code should do.

Acknowledge that there is no manual testing.

There are no manual testers, there is only testing. Trying to divide testers into two groups of manual and automated is a big mistake. Please stop calling testers manual, we don't like it and it damages our craft. If instead of labels we focused on hiring candidates with the ability to think critically and solve problems everyone would be in a much better place.

This post was also published on the blog of Ronald James Digital & Tech Recruitment Agency

76 comments:

  1. The Midlands Testers' Meetups (https://midlandstesters.wordpress.com/) are sponsored by a recruitment agency; their representative openly says that he wants to find out what testers do so that the agency ups its game when it comes to recruiting testers for clients. Interestingly, word is going around the recruitment community as much as the testing one in the area, as recent meetups have attracted growing numbers of recruiters!

    I wrote a (lengthy) blog post on this subject where I put forward my vision of testers being akin to test pilots. A test pilot doesn't flip all the switches in a new aeroplane to see that the landing lights come on or the landing gear comes up; instead, they fly the aeroplane and explore the limits of its performance and review its suitability for purpose. (The post was meant for a general audience rather than one of testers: https://robertday154.wordpress.com/2017/11/15/probe-probare/)

    ReplyDelete
  2. Hiring people with "critical thinking skills" and little more just won't work for many of us; perhaps most of us. Sometimes we need people with skills that go beyond challenging assumptions or we could hire computer illiterate philosophy graduates and just train them up. My team is made up of Electrical engineers and software engineers - the testing skills I helped develop through training and coaching. Everybody on the course has attended the RST course, because it is a great shortcut, and all have ISTQB foundation, because it looks good to customers and helps equip testers with a common language. As I could deliver the ISTQB training there was little cost to the company in everybody gaining the qualification.

    Recruiters don't know the ins-and-outs of any industry they deal with; that's why they are recruiters and not developers or testers. We have to be very careful when wording ads to be as inclusive as possible - inclusive in terms of skills, but also ethnicity, sex, age and sexual orientation. Unfortunately, this means that recruiters send me CVs from people who are just not suitable. Too often I am sent CVs for people who simply work through scripts or who only "ask the developers" how to test a product. It's as if most of the industry is simply engaged in validating the developers' work; never challenging it, never questioning.

    ReplyDelete
  3. Hiring people with "critical thinking skills" and little more just won't work for many of us; perhaps most of us. Sometimes we need people with skills that go beyond challenging assumptions or we could hire computer illiterate philosophy graduates and just train them up. My team is made up of Electrical engineers and software engineers - the testing skills I helped develop through training and coaching. Everybody on the course has attended the RST course, because it is a great shortcut, and all have ISTQB foundation, because it looks good to customers and helps equip testers with a common language. As I could deliver the ISTQB training there was little cost to the company in everybody gaining the qualification.

    Recruiters don't know the ins-and-outs of any industry they deal with; that's why they are recruiters and not developers or testers. We have to be very careful when wording ads to be as inclusive as possible - inclusive in terms of skills, but also ethnicity, sex, age and sexual orientation. Unfortunately, this means that recruiters send me CVs from people who are just not suitable. Too often I am sent CVs for people who simply work through scripts or who only "ask the developers" how to test a product. It's as if most of the industry is simply engaged in validating the developers' work; never challenging it, never questioning.

    ReplyDelete
  4. Really nice topics you had discussed above. I am much impressed. Thank you for providing this nice information here. And if you are looking for the best game compatibility testing choose with our

    Mobile Game Testing Company

    Console Compliance Testing

    Game UI Testing Services

    Games Functionality Testing

    ReplyDelete
  5. I now these vaild information are very attractive and satisfactory.

    SEO company

    ReplyDelete
  6. Thank you for the nice article here. Really nice and keep update to explore more gaming tips and ideas.

    Software Testing Company

    QA Services

    Compatibility Testing Services

    ReplyDelete
  7. Thank you for sharing such valuable information and tips. This can give insights and inspirations for us; very helpful and informative! Would love to see more updates from you in the future.
    Selenium Training Chennai
    software testing selenium training
    selenium testing training in chennai
    cloud computing training centers in chennai
    cloud computing training institutes in chennai
    Best Institute for Cloud Computing in Chennai

    ReplyDelete
  8. Thanks for your interesting ideas.the informations in this blog is very much useful for me to improve my knowledge.
    german teaching courses in bangalore

    German courses in Anna Nagar
    German Training in T nagar

    ReplyDelete
  9. Whatever we gathered information from the blogs, we should implement that in practically then only we can understand that exact thing clearly, but it’s no need to do it, because you have explained the concepts very well. It was crystal clear, keep sharing..
    Digital Marketing Course in Chennai
    Digital Marketing Course
    Digital Marketing Training in Chennai
    Digital Marketing Training
    Digital marketing training institute in chennai

    ReplyDelete
  10. Outstanding blog thanks for sharing such wonderful blog with us ,after long time came across such knowlegeble blog. keep sharing such informative blog with us.
    Air Hostess Training in Chennai | Air Hostess Training Institute in Chennai | Air Hostess Academy in Chennai | Air Hostess Course in Chennai | Air Hostess Institute in Chennai

    ReplyDelete
  11. This blog is very much helpful to us. Thanks for your information

    Article submission sites
    Education

    ReplyDelete
  12. You have provided very nice information. Thanks for sharing. Learn more about Game Qa Services

    ReplyDelete
  13. Nice blog..! I really loved reading through this article. Thanks for sharing such an amazing post with us and keep blogging...Well written article Thank You for Sharing with Us | project management training in chennai | project management certification online | project management course online |

    ReplyDelete
  14. Good Topic in the present context of economic slow down. Testers should try to write effective test cases. I have seen testers were the same test scenario is covered in multiple test cases.

    mobile testing company

    ReplyDelete
  15. Your Are doing a great job. I would like to appreciate your work for good accuracy

    Blockchain course in Chennai

    ReplyDelete
  16. This comment has been removed by the author.

    ReplyDelete
  17. Great Article. Kindly share more article on testing.

    Automation Testing Service

    ReplyDelete
  18. Very Good Blog. Highly valuable information have been shared. Highly useful blog..Great information has been shared. We expect many more blogs from the author. Special thanks for sharing..
    SAP Training in Chennai | AWS Training in Chennai | Android Training in Chennai | Selenium Training in Chennai | Networking Training in Chennai

    ReplyDelete
  19. Empower your business with the latest EPOS system.
    Intelepos, where technology meets professionals. We craft the enterprise-level EPOS for Takeaways. Our intelligent
    EPOS system UK can run both online and offline. It can sync your data to the internet connection and restore it.
    We provide EPOS Software and hardware for Takeaways.
    EPOS For Takeaways
    EPOS System and software
    EPOS system Nottingham

    ReplyDelete
  20. Thanks for the post, its very interesting.
    If you want to know Top Software Testing Companies USA and Top Big Data Companies USA. DataWider has curated this list after broad research dependent on their client reviews, quality, loyalty, flexibility and capacity.

    ReplyDelete
  21. Taldeen is one of the best plastic manufacturing company in Saudi Arabia. They are manufacturing Handling Solutions Plastic products like Plastic Pallets and plastic crates. Here is the link of the product
    Handling Solutions
    Plastic Pallets
    Here is the details of best BSc Medical Imaging Technology Colleges in Bangalore. You can get the college details from the below link. BSc Medical Imaging Technology Course is one of the best demanding course in recent times in India
    BSc Medical Imaging Technology Colleges In Bangalore
    Christian College Bangalore providing BSc Medical Imaging Technology Course. Here is the link about the details of BSc Medical Imaging Technology. You can click the below link for more information about BSc Medical Imaging Technology.
    BSc Cardiac Care Technology Colleges In Bangalore
    Christian College Bangalore providing BSc Optometry Course. Here is the link about the details of BSc Optometry. You can click the below link for more information about BSc Optometry. BSc Optometry is one of the most demanding course in recent times.
    Optometry Colleges In Bangalore
    BBA Aviation course is the best (Most Demanded) management course in India. Here, Christian College Bangalore providing BBA Aviation course. You can get the details of Christian College BBA Aviation from the below mentioned link. If you are interested in BBA Aviation, just visit the below link to know about BBA Aviation.
    BBA Aviation Colleges In Bangalore
    GrueBleen is one of the Branding and Marketing agency Based in Riyadh- Saudi Arabia. The main functions of GrueBleen is Advertising, Branding, Marketing, Office Branding, Exhibition Management and Digital Marketing. Visit the below link to know more about GrueBleen Creative Club.
    Branding Agency Riyadh
    Marketing Agency Riyadh
    Agriculture Solutions – Taldeen is a plastic manufacturing company in Saudi Arabia. They are manufacturing agricultural plastic products like greenhouse cover and hay cover. Visit the below link to know more details
    Agriculture Solutions
    Greenhouse Cover
    Medical Imaging Technology – One of the most demanding allied health science course in recent times in India. Check out the details of Best BSc Medical Imaging Technology Colleges Details with the following link.
    BSc Medical Imaging Technology Colleges In Bangalore
    BSc Perfusion Technology – If you are looking to study BSc Perfusion Technology in Bangalore, just check out the following link. In that link you can get the details of Best BSc Medical Imaging Technology colleges in Bangalore
    BSc Perfusion Technology Colleges in Bangalore
    GrueBleen – One of the best social media marketing agency in Riyadh- Saudi Arabia. Visit here for the all service details of GrueBleen.
    Social Media Marketing Agency

    ReplyDelete
  22. This site truly has all of the information I wanted concerning this subject and didn’t know who to ask.
    Click here to get More information.

    ReplyDelete
  23. Nice informations. Thank you so much for sharing this information.
    python course in coimbatore

    data science course in coimbatore

    android training institutes in coimbatore

    amazon web services training in coimbatore

    big data training in coimbatore

    RPA Course in coimbatore

    artificial intelligence training in coimbatore

    ReplyDelete
  24. Nice article, keep sharing
    Forum.app
    Jobs
    Jedox

    ReplyDelete
  25. software testing company in India
    Thanks for sharing such a nice post .
    very useful information.
    please keep sharing.

    ReplyDelete
  26. software testing company in India
    software testing company in Hyderabad
    Thanks for sharing such a valuable information and tips with us.
    Great nd informative blog.
    keep sharing.

    ReplyDelete
  27. software testing company in India
    software testing company in Hyderabad
    Thanks for sharing such a valuable information and tips with us.
    Great and informative blog.
    keep sharing.

    ReplyDelete
  28. Cryptocurrency adalah media pertukaran yang digital, terenkripsi dan terdesentralisasi. Tidak seperti Dolar AS atau Euro, tidak ada otoritas pusat yang mengelola dan mempertahankan nilai mata uang kripto. Sebaliknya, tugas-tugas ini didistribusikan secara luas di antara pengguna mata uang kripto melalui internet., cek juga monero to rupiah dan markets ada pasar saham lain di seluruh dunia termasuk Bursa Efek London, serta Jepang, Hong Kong, Shanghai, India, Australia dan berbagai lokasi di seluruh Uni Eropa.

    ReplyDelete
  29. Good. I am really impressed with your writing talents and also with the layout on your weblog. Appreciate, Is this a paid subject matter or did you customize it yourself? Either way keep up the nice quality writing, it is rare to peer a nice weblog like this one nowadays. Thank you, check also virtual edge and event planning business books

    ReplyDelete
  30. The great website and information shared are also very appreciable. Tyler Ronan Jacket

    ReplyDelete
  31. Hi , Thank you so much for writing such an informational blog. If you are Searching for latest Jackets, Coats and Vests, for more info click on given link-Rip Wheeler Jacket

    ReplyDelete
  32. I was very impressed by this post, this site has always been pleasant news Thank you very much for such an interesting post, and I meet them more often then I visited this site. leather peacoat

    ReplyDelete
  33. Thank you for the nice article here. Really nice and keep update to explore more gaming tips and ideas.

    web development company in norwich
    SEO Companies in Norwich
    Web Design Norwich

    ReplyDelete
  34. Such an interesting article here.I was searching for something like that for quite a long time and at last I have found it here.penelope blossom coat

    ReplyDelete
  35. Get the answer for the query “ How To Get a Job in Infosys as a Fresher? ” with the real-time examples and best interview questions and answers from the best software training institute in Chennai, Infycle Technologies. Get the best software training and placement with the free demo and great offers, by calling +91-7504633633, +91-7502633633.

    ReplyDelete
  36. This comment has been removed by the author.

    ReplyDelete
  37. I always check this type of advisory post and I found your article which is related to my interest. This is a great way to increase knowledge for us. 창원출장아로마
    통영출장아로마
    거제출장아로마
    김천출장아로마
    문경출장아로마Thanks for sharing an article like this.

    ReplyDelete
  38. Hotspot shield makes your relationship free from every one of the issues. It can likewise secure a working client framework to identify if there should Hotspot Shield Elite Full Crack

    ReplyDelete