AQA Virtual Summit/MeetupsImportance of Test AutomationTypes of Automation Testing

Dr. Thomas M. Fehlmann – Autonomous Real-time Testing for Cyber-physical Products

Published 3 March 2022. Updated with a short answer, key takeaways and a FAQ; the talk text is unchanged. Published by Zapple.Tech, founded by the founders of CodeceptJS and Codeception, open-source testing frameworks.

Watch on YouTube
Short answer

In this talk, Dr. Thomas M. Fehlmann, a software quality management expert, presents autonomous real-time testing for cyber-physical products as a parallel activity to DevOps that builds confidence in such products. He covers model-based functional testing, user needs testing, and digital twins with Kubernetes.

Key takeaways
  • Why cyber-physical systems need a new testing principle
  • Model-based functional testing
  • User needs testing: privacy, security, emotional and business needs
  • Digital twins and Kubernetes
  • Compliance and testing as part of development, delivery and deployment

International software quality management expert Dr. Thomas Fellmann talks about software testing as an autonomous, parallel to DevOps activity, necessary for building confidence in cyber products.

Autonomous real-time testing is suitable for those ready to combine disciplines that are actually not so easy to combine.

Autonomous Testing

Testing cyber-physical systems is different from testing third-generation microprocessors. The reason is completely new work principles. For example, an autonomous car. Such a vehicle is updated every 10 days, connected to a smartphone and a cloud service, and learns new behavior. It is fundamentally different from old-fashioned software that works following the written code only.

ART lasts exactly as long as the cyber-physical system works. It can be launched anytime, anywhere, for a limited time, and individually.

Functional testing models

pasted-image-0

The relevance of automatic testing is explained by the number of necessary tests for systems of different generations. So, if third-generation software requires testing of 50,000 SPF, then for a complex system with intensive software, their number increases to 25 million. And such amount of tests cannot be written manually.

It’s the main reason why this type of testing is model-based. Dr. Fellmann is the author of a model for autonomous vehicle driving based on just 37 data movements. Thanks to this model, testing all the code is no longer necessary.

User Needs Testing

To perform this kind of testing, it is necessary to determine what your users want.

Target user values:

  • privacy;
  • security;
  • emotional needs;
  • business needs.

Knowing user preferences, you can consider them when creating your user stories, which must be covered by tests. It will help you test things critical for the clients.

Digital Twins and Kubernetes

pasted-image-0-1

Digital twin testing involves:

  • automatic execution;
  • good performance anytime and anywhere;
  • no need to test the physical original;
  • using Kubernetes Custom Resource.

The idea is that you track motion sensors and cameras, monitor reactions of mechanisms, and create a unique story for each system by providing each component with a digital twin.

Conclusion

Software compliance is highly valued by users. It is essential in medicine, autonomous vehicles, artificial intelligence, the Internet of things, and other cyber-physical systems. Therefore, testing becomes an integral part of product development, delivery, and deployment.

Questions about this talk

What is autonomous real-time testing?

Dr. Thomas M. Fehlmann describes it as testing that lasts exactly as long as the cyber-physical system works. It can be launched anytime, anywhere, for a limited time and individually, and it runs as an autonomous activity parallel to DevOps to build confidence in cyber-physical products.

Why is testing cyber-physical systems different?

Dr. Thomas M. Fehlmann uses an autonomous car as an example: it is updated every 10 days, connects to a smartphone and a cloud service, and learns new behavior. That is fundamentally different from old-fashioned software that follows only the written code, and the number of tests required grows far larger.

What is digital twin testing?

Dr. Thomas M. Fehlmann says digital twin testing involves automatic execution, good performance anytime and anywhere, no need to test the physical original, and Kubernetes Custom Resources. Each component gets a digital twin, so you can track sensors, cameras and mechanism reactions and build a unique story per system.

Request a QA audit quote

Tell us what you ship and what worries you.

What happens after you send this

  1. You send the form: your situation and what you need tested, then your name and work email.
  2. Within one business day, we reply with a suggested first step, its scope, timeline and a quote.
  • Fixed scope
  • You decide after each step
  • The tests live in your repository
  • An NDA signed before access

“They helped us to close the positions and consult our team how to proceed further. High-quality quick feedbacks with the deep checking of the required tasks, professional approach, great understanding of the company's technologies and product, detailed reports.”

Kristina Lavrentieva, Manager at keepgo.com, Israel
  • Rated 4.9 out of 5 on Clutch, from 7 client reviews
  • 42 completed test automation and infrastructure projects
  • Founded by the founders of CodeceptJS and Codeception, open-source testing frameworks

Request a QA audit quote

    What is closest to your situation?
    Optional. The product, the platforms, how often you release, what broke last.

    You decide after our reply whether to go ahead.

    Prefer to talk first? Book a call

    One-week QA audit · written report

    Request a QA audit quote