Praveenkumar Prem

Great testers ensure its good AI

Session Speech

In the current digital world, Artificial intelligent solutions are defining the way we work, our communication, manufacturing, health management, interaction with banks. These already Intelligent applications are a challenge for testers like us to certify they are good as their behaviour is non-deterministic; even for the same input, can exhibit different behaviours on different runs. The key challenges I faced while testing AI centric applications is getting the right test date, identifying algorithms, predicting the expected outcome & behaviour of the system as intelligent applications are non-deterministic as they behave differently as and when they learn over time. 

I will talk about the challenges I faced with testing AI centric applications compared to traditionally built applications, share unique testing solutions and test strategies including Test objects, testing of Voice User Interface (VUI), testing of Chat-bots, Testing Augmented reality/virtual reality applications.
While it is extremely difficult to achieve a 100% test coverage, the techniques and best practices highlighted in my talk are aimed to assure that the AI applications achieve the defined acceptance criteria / DoD and confidence levels to make the application available for wide scale adoption.
In addition to technical testing, testers also need to evaluate the ethical implications of the AI system. This includes testing for fairness, transparency, and accountability, as well as ensuring that the system does not perpetuate bias or discrimination.
While Good people create good AI; Great testers ensure its good AI.