The Automation Trap
Quality Engineers: How to Stay Relevant?
Evolving Role of Quality Assurance in Today's Enterprise
DevOps and Role of QA
How We Sharpened the Edge of Our Approach to QA and Testing
Tanvi Gupta, Director of QA, Green Dot Corporation
From Traditional to Agile Software Development - Changing Culture,...
Wayland Jeong, VP & GM Hybrid Cloud Business, Software Defined and Cloud Group, Hewlett Packard Enterprise
Adopting a DevOps Culture as Part of a Traditional Company's...
Michelle DeCarlo, SVP, Head of Technology Engineering Enterprise Delivery Practices, Lincoln Financial Group
How to Go Fast and Not Get Buried in the Dust
Tanya Kravtsov, Director of QA, Audible
Thank you for Subscribing to CIO Applications Weekly Brief
Will Artificial Intelligence Take Over Quality Assurance or other Technology Jobs
By Yasar Sulaiman, Vice President, Head of Quality Assurance, Everest Reinsurance
It is without a doubt that Artificial intelligence is helping ordinary consumers in our everyday life, but the big question is what is the impact going to be on the jobs that were previously done by humans and especially of concern are the manufacturing and technology workers whose careers seem to be the most vulnerable.
This article will focus mainly on Software quality assurance/ Testing jobs and broadly on other technology workers (Software developers, support professionals, customer support representatives, and even project managers).
Before we understand the impact of artificial intelligence on Quality Assurance jobs, we need to know where we are in the AI journey. Regardless of how much hype there is around AI these days, AI is not a new concept. Ancient Greeks had myths about robots, while Chinese and Egyptians built automatons. However, modern AI finds its roots in the 1950s. The term “Artificial Intelligence” was coined in a conference at Dartmouth College in Hanover, New Hampshire, in 1956. British Mathematician and computer scientist created a test to assess if a machine is more intelligent than humans, and this test was most famously known as the Turing Test. We have seen many AI winters (periods where funding, research, and interest in AI dropped) since then, and here we are talking about it again that AI is ready to take over the world.
There is no standard way of measuring how far we have come along in terms of AI but here are rather simple stages of AI for our discussion-
• Artificial Narrow Intelligence (ANI)
• Artificial General Intelligence (AGI)
• Artificial Super Intelligence (ASI)
ANI is also called “Weak AI” is an AI that is programmed to perform a single task. They can perform a task in realtime, but they still work a specific data-set. Whether it is your smart speaker, weather app, or AI used in credit card fraud detection, they all are examples of Artificial Narrow Intelligence.
I will not delve deeper into AGI and ASI but only mention that AGI is a stage where AI can perform tasks that a normal human being is capable of. This type of AI is conscious, which weak AI is not. When it comes to ASI, it is a stage where AI will hypothetically surpass all human intelligence in all aspects, and we reach a stage called “Singularity” as per futurist “Ray Kurzweil.”
But all types of AI that we see around us are still Narrow AI or Weak AI, so we are still scratching the surface. There is much progress made, but an enormous amount of work is yet to be done for humankind to reach anywhere close to AGI and ASI, the kind of AI Elon Musk is worried about.
What is the impact on Software Quality Assurance:
Let’s come back to our topic on how do the advancements in AI affect jobs and, in particular, Quality Assurance jobs. Let me answer in two ways:
One- No, it is not very far in the future. AI and machine learning are already made its way into all aspects of tasks being performed by Testers and other technology workers. The software development process is evolving, and some tools have been helping software developers and QA professionals to predict the likelihood of defects, do automatic error handling, code refactoring, automatic test script creation, execution, and reporting defects.
Two- AI is not a monster that will take away these jobs, but if we plan it right it can be an enabler of creating more jobs and make lives of technology workers easier by taking away mundane manual tasks away from them while having them focus on more value-adding activities like user experience and further advancements of technology.
Being a technology profession myself, I will be focusing a lot on what we can do to keep ourselves relevant along with AI in the future.
As per the world economic forum, automation will displace 75 Million jobs by 2022; however, it will also create 133 million jobs, so a net addition of 58 million new jobs. How is that possible?
In my opinion, three things will happen:
1. Some jobs/ tasks will be eliminated entirely
2. Some jobs/ tasks will be transformed
3. Brand New jobs/ roles will be created (Thanks to AI)
Here are more details on trends and what I think will happen in terms of QA jobs in the next few years:
QA jobs that will be eliminated or greatly reduced:
• Manual testing: I don’t expect it to go away totally but it will be greatly reduced with AI incrementally doing more and more that was traditionally done manually.
• Manual Review: A lot of manual testing artifacts like test cases are reviewed manually, and this is a significant portion of what test leads and test managers spend their time on. I expect AI tools to take over some of these tasks at least partially very soon.
Grading at schools is becoming easier, fair, and more accurate, thanks to AI-led plagiarism checks
• Manual Estimation: Estimation for testing efforts continues to be a manual effort despite the use of tools for test management. This creates bottlenecks in Agile projects where things need to move quickly. I expect the use of AI tools to estimate the time required for testing quickly.
• Test Status Reporting: This is a necessary evil, and despite not many people reading these reports they have to be sent out. Much manual effort is required to create these status report and I expect that AI tools should be able to send reports and show intelligently what changed to the right stakeholders. There is much scope in this area not only for QA but the overall tech industry.
• Manual Documentation
• Repetition of Test in multiple browsers, device or environments
QA jobs that will be Transformed:
• Automation Testing: If I have to choose one area where AI will have the most significant impact, it will be automation testing. This will be an area that has already seen a huge transformation, but I expect this to continue evolving. AI can revolutionize automated testing making it more accessible to non-technical team members and reducing the amount of Maintenence activity that drastically reduced the ROI on automated testing.
• Security Testing: As we are making progress with making our applications and data more secure, so are hackers using the same technological advancements to exploit security vulnerabilities. Ensuring security cannot remain limited to regular scans or manual penetration testing. AI will make inroads in security testing to make it more diligent, robust, and create stronger protection. However, it should be noted that this will be a journey that we will continue to play catch on.
• Auditing and Compliance: Despite so much advancement made in software development processes and tools, auditing still seems to be a manually intensive task. AI can help dramatically in this area by making the process more automated and reliable reporting.
• Perception of Quality: As the pace of software development intensifies, tech-savvy people have more and more appetite to accept a Beta software than ever before. The idea that everything has to be perfect in terms of quality is shifting, and this will also translate into more emphasis on risk-based testing approaches.
New QA jobs that will be created:
• Test Strategist: Traditionally, we have Test Managers on the projects. With automation assisted with AI becoming a norm, I expect a new role of Test strategist tasked with determining where AI-assisted tools should be used and where human intervention is required. Since the adoption of AI will be a journey, this role will be crucial to help companies transform their QA operations.
• QA Data Scientist: I have already seen this happening; the vast amount of data available to QA teams needs to be harvested, analyzed and used to improve Quality Assurance. For us to make the best use of tools at our disposal, the QA data scientist will help us make decisions based on data and not gut feeling. Every QA team should have one data scientist on-board and we don’t have to wait even for AI; this just makes sense.
• AI Model Trainer: The requirements for these roles are already on the rise as more and more companies are taking on their own AI projects. What is noteworthy is how naturally QA professionals will be fit for this role. With the mindset of finding flaws in software QA, professionals can easily pivot on these roles and help make the AI model more robust and ready for real- world.
• AI Model Tester: This will be one of the most contested but crucial roles that will continue to define itself. There are a lot of open questions, and there is no straightforward answer on how to test an AI model. Do we use training data for testing or testing data for training? Nobody will still be fully confident because real-world data can be unexpected. Take for an example Microsoft twitter AI Bot TAI that had to be terminated within 16 hours of its launch because it started throwing racist twist and guess what it learned it from real Twitter users. So no matter how much effort Microsoft spent on training the model, the realworld corrupted it in hours.
• Crowd Testing for AI Models: There are so many examples of bias of creators or trainers getting introduced in the AI model, and that has an impact on real-world people. Be it an example of self-driving cars that are biased to the color of pedestrian’s skin or recruiting software’s AI model screen out women and minority groups. It only points to the importance of being inclusive when training the model. Crowd testing of AI models for this inclusion is not only recommended but might become a regulatory requirement as more biases are exposed.
• More jobs in the Regulatory Roles: We are still scratching the surface in terms of governments being prepared with the impact of AI interacting with the public everywhere. There are few regulations enacted but certainly will intensify, and more regulatory bodies will have to think about including AI’s impact on how to monitor them.
• More jobs in Security testing roles
• More jobs in testing Smart hardware: More and more hardware around us is using AI. From your robot vacuum to self-driving cars, from smartphone assistant to robotic pets. We are surrounded by AI-enabled hardware, and it will require testing.
Impact of AI on Global Economy:
Machine learning engineers are already one of the highestpaid professionals in the US, and job growth has been a staggering 344% in this field. There are many open positions for AI and Machine learning professionals where there are no qualified candidates available, making it one of the hottest jobs in the market. The scarcity of the candidates to fuel the future AI growth is contingent on re-skilling efforts. Many large companies have already begun working on re-training their employees. For example, Amazon is working on a plan to spend $700 Million to retrain 100,000 employees in the next six years. As per an IBM Survey on AI, 120 Million people will need re-training in the next three years alone due to an increase in automation and robotics around the globe.
We cannot ignore AI anymore. The situation can best be summed up from a famous quote from Paul Allen, the late cofounder of Microsoft: “The promise of artificial intelligence generally vastly outweighs the impact it could have on some jobs in the same way that, while the invention of the airplane negatively affected the railroad industry, it opened a much wider door to human progress.”
As per PWC global Artificial Intelligence survey, AI will contribute nearly $15.7 trillion to the economy by 2030, and it is expected to give a boost of 26% to the economy.
Technology professionals will have to be proactive and invest in learning to be relevant and not only survive but thrive in the future.
The danger of Bias with AI:
The danger of bias being introduced in the algorithm will become a significant issue in the future. Microsoft launched a bot for twitter in 2016, which had to be killed in 16 hours because it quickly started spitting racist tweets learning from humans.
As per a study done by the Georgia Institute of technology, there is a higher risk of an autonomous car running over someone with darker skin as the algorithm might not detect them as a pedestrian. These are direct results of unintentional bias entered in AI by the creators and AI model trainers.
These roadblocks in AI progress also brings new opportunities for Technology professionals, as we will see many openings for people who understand human psychology, AI model trainers who can help train the AI algorithm to remain unbiased, testers who can test the AI model, mathematicians who can help create the algorithms and much more.
AI is here, and it’s going to be part of our lives for a long time to come. This is an opportunity of our lifetimes, which will transform economies, make our lives easier, and bring more jobs for people who are prepared for it.
I will summarize with a final quote from Amit Ray’s book, Mindfulness Meditation for Corporate Leadership and Management:” As more and more artificial intelligence is entering into the world, more and more emotional intelligence must enter into leadership.”