Detlef D Nauck (Chief Research Scientist for Data Science at BT Technology)
Dr Detlef Nauck is a Chief Research Scientist for Data Science with BT's Research and Innovation Division located at Adastral Park. Detlef has 30 years of experience in data analytics, machine learning, and AI. At BT, he is leading a group of international research scientists working on improving the use of Data Science. Detlef focuses on establishing best practices in Data Science for conducting analytics professionally and responsibly leading to new ways of analysing data for making better decisions. Part of his role is leading the initiative on the development and use of responsible and ethical AI in the company. Detlef is a computer scientist by training, a Visiting Professor at Bournemouth University and has published 3 books, over 120 papers, holds 10 patents and has 30 active patent applications.
Keynote Title: Test Driven Machine Learning and Model Factories
Abstract: Data Scientists and machine learning specialists are familiar with testing principles during the model building phase like cross-validation, but they are often unfamiliar with test-driven software engineering principles. While testing a learned model gives an idea how well it might perform on unseen data this is not sufficient for model deployment. Trying to learn from test driven software development practices we look across the machine learning life cycle to understand where we need to test and how this can be done. The testing of data, for example, is essential as it not only drives the machine learning phase itself, but it is paramount for producing reliable predictions after deployment. Testing the decisions made by a deployed machine learning model is equally important to understand if it delivers the expected business value. To operate test-driven machine learning in production we look at the concept of model factories. They add an orchestration layer that automates as much of the testing and model building as possible and supports governance.