Deakin University
Browse

File(s) under permanent embargo

Continuous validation for data analytics systems

Version 2 2024-06-06, 12:01
Version 1 2016-09-06, 19:28
conference contribution
posted on 2024-06-06, 12:01 authored by M Staples, L Zhu, JC Grundy
From a future history of 2025: Continuous development is common for build/test (continuous integration) and operations (devOps). This trend continues through the lifecycle, into what we call `devUsage': continuous usage validation. In addition to ensuring systems meet user needs, organisations continuously validate their legal and ethical use. The rise of end-user programming and multi-sided platforms exacerbate validation challenges. A separate trend isthe specialisation of software engineering for technical domains, including data analytics. This domain has specific validation challenges. We must validate the accuracy of sta- tistical models, but also whether they have illegal or unethical biases. Usage needs addressed by machine learning are sometimes not speci able in the traditional sense, and statistical models are often `black boxes'. We describe future research to investigate solutions to these devUsage challenges for data analytics systems. We will adapt risk management and governance frameworks previously used for soft- ware product qualities, use social network communities for input from aligned stakeholder groups, and perform cross-validation using autonomic experimentation, cyber-physical data streams, and online discursive feedback.

History

Pagination

769-773

Location

Austin, Texas

Start date

2016-05-14

End date

2016-05-22

ISBN-13

9781450342056

Language

eng

Publication classification

E Conference publication, E1 Full written paper - refereed

Copyright notice

2016, ACM

Title of proceedings

ICSE'16 : Proceedings of the 38th International Conference on Software Engineering Campanion

Event

Software Engineering Companion : Conference (38th: 2016 : Austin, Texas)

Publisher

ACM

Place of publication

New York, N.Y.