Humans, Machines, and Decision Responsibility

PROJECT SUMMARY

Businessman using cell phone on subway train

Humans, Machines, and Decision Responsibility

Focus Areas: News & Media, Social Services, Mobilities, Health
Research Program: Institutions, Machines
Status: Active

Automated decision-making provokes a range of anxieties around transparency, equality, and accountability. A key response has been the call to ‘re-humanise’ automated decisions, with the hope that human control of automated systems might defend human values from mindless technocracy. Regulation of automated decision-making and AI often embeds this form of human centrism by prescribing a ‘human in the loop’ and the need for automated decisions to be ‘explained’. These requirements are central elements of the risk-based approaches AI regulation currently in development.

Despite their intuitive appeal, empirical research is revealing the limitations and complexities of these approaches. AI explanations sometimes provide little that is useful for decision subjects or decision makers, and risk distracting from more meaningful interrogation of why decisions are made. A human in the loop sometimes functions as a rubber stamp for automated decisions, cleaving accountability away from the true sites of decision responsibility.

This project seeks to generate better understandings of the functions, capacities, and normative role of humans within automated decision systems. It will investigate the ways that automated systems ought to explain or be explained to humans within decision processes, and how elements of decision-making including processes, responsibility, authority, and what counts as a decision itself, are fragmented and redistributed between humans, machines, and organisations. The goal is to generate empirical knowledge of how automated systems, humans, and organisations interact in different contexts when making decisions, and to move past outdated understandings of decisions-making that are hindering effective governance of automation in new decision contexts.

RESEARCHERS

Jake Goldenfein

Dr Jake Goldenfein

Lead Investigator,
University of Melbourne

Learn more

ADM+S Associate Director Jean Burgess

Prof Jean Burgess

Chief Investigator,
QUT

Learn more

Paul Henman headshot

Prof Paul Henman

Chief Investigator,
University of Queensland

Learn more

ADM+S Chief Investigator Christopher Leckie

Prof Chris Leckie

Chief Investigator,
University of Melbourne

Learn more

Prof Flora Salim

Prof Flora Salim

Chief Investigator,
UNSW

Learn more

Distinguished Professor Julian Thomas

Prof Julian Thomas

Chief Investigator,
RMIT University

Learn more

Kim Weatherall

Prof Kim Weatherall

Chief Investigator,
University of Sydney

Learn more

Henry Fraser

Dr Henry Fraser

Research Fellow,
QUT

Learn more

Awais Hameed Khan profile image

Dr Awais Hameed Khan

Research Fellow,
UQ

Learn more

Christopher O'Neill

Dr Chris O’Neil

Research Fellow,
Monash University

Learn more

Ash Watson

Dr Ash Watson

Research Fellow,
UNSW

Learn more

Fan Yang

Dr Fan Yang

Research Fellow,
University of Melbourne

Learn more

Jenny Kennedy

Libby Young

PhD Student
University of Sydney

Learn more

Fabio Mattioli

Dr Fabio Mattioli

Affiliate
University of Melbourne

Learn more

Australian Digital Inclusion Index Project

PROJECT SUMMARY

Indigenous child on computer

Australian Digital Inclusion Index Project

Focus Areas: News & Media, Social Services, Mobilities, Health
Research Program: People
Status: Active

Digital inclusion is about ensuring that all Australians can access and use digital technologies effectively. We are experiencing an accelerating digital transformation in many aspects of economic and social life. Our premise is that everyone should have the opportunity to benefit from digital technologies: to manage their health, access education and services, participate in cultural activities, organise their finances, follow news and media, and connect with family, friends, and the wider world.

The Australian Digital Inclusion Index (ADII or “Index”) uses survey data to measure digital inclusion across three dimensions of Access, Affordability and Digital Ability. We explore how these dimensions vary across the country and across different social groups.

In partnership with Telstra and through biennial data collections presented through reports and data visualisation dashboards, the ADII is capturing and communicating the evolving state of digital inclusion in Australia. This is complemented by aligned sub-projects with local, state and federal government departments and community partners to drill down into specific digital inclusion challenges for social groups or geographical regions of interest.

A detailed measure of digital inclusion for Australia allows us to identify the critical barriers to inclusion. These may be related to accessing networks, the costs of devices or data, or skills and literacies. Through these measures, the Index shapes digital equity policy and initiatives, research, and practice to increase digital inclusion in Australia.

Visit the ADII website 

RESEARCHERS

Distinguished Professor Julian Thomas

Prof Julian Thomas

Chief Investigator,
RMIT University

Learn more

ADM+S Chief Investigator Anthony McCosker

Prof Anthony McCosker

Chief Investigator,
Swinburne University

Learn more

Jenny Kennedy

Dr Jenny Kennedy

Associate Investigator,
RMIT University

Learn more

Sharon Parkinson

Dr Sharon Parkinson

Associate Investigator,
Swinburne University

Learn more

Kieran Hegarty

Kieran Hegarty

Research Fellow,
RMIT University

Learn more

RESEARCHER SUPPORT

Lucy Valenta profile image

Lucy Valenta

Research Coordinator,
RMIT University

Learn more

PARTNERS

Telstra

Telstra

Visit website

Is Pricing Discriminatory: Testing Automated Decision-Making Systems in Online Insurance Markets

PROJECT SUMMARY

Is Pricing Discriminatory: Testing Automated Decision-Making Systems in Online Insurance Markets

Focus Areas: News & Media, Social Services, Mobilities, Health
Research Program: Data
Status: Active

Advances in data-driven and AI systems are driving significant transformation in the emerging insurance technology (insurtech) sector.

This project investigates the extent to which automated decision-making systems impact the provision of consumer insurance via pricing algorithms which may produce unfair outcomes for particular subsets of society by engaging in proxy and price discrimination.

RESEARCHERS

Kelly Lewis

Dr Kelly Lewis

Lead Investigator,
Monash University

Learn more

Mark Andrejevic

Prof Mark Andrejevic

Chief Investigator,
Monash University

Learn more

Daniel Angus

Prof Daniel Angus

Chief Investigator,
QUT

Learn more

Kim Weatherall

Prof Kim Weatherall

Chief Investigator,
University of Sydney

Learn more

Zofia Bednarz

Dr Zofia Bednarz

Associate Investigator,
University of Sydney

Learn more

Jathan Sadowski

Dr Jathan Sadowski

Associate Investigator,
Monash University

Learn more

ADM+S professional staff Abdul Obeid

Dr Abdul Obeid

Data Engineer,
QUT

Learn more

PARTNERS

CHOICE

Visit website

Consumer Policy Research Centre Logo

Consumer Policy Research Centre

Visit website

Automation and Public Space

PROJECT SUMMARY

LiDAR sensing concept

Automation and Public Space

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Data
Status:
 Active

From delivery drones to digital twins to crowd surveillance, automated decision-making technologies and practices are increasingly impacting public and shared space. This project investigates how automated decision-making systems impact public and shared space via sensors that produce actionable digital simulations, artefacts, and interfaces. Through a mixed methods approach, it will examine current and potential effects of automated decision-making on the form, use, and experience of public space.

Technological development in this area is undergoing rapid change. Delivery via autonomous drone requires sensor-driven navigation systems, but the data and models they produce about public space will likely lead to modulations of that space in response. In urban and environmental governance, ‘digital twins’ are increasingly to monitor environments in real-time, simulate the impact of potential changes, and even implement those changes directly. Technologies such as these are not only increasingly deployed in Australia, but are also invented, designed, and tested here too, often in proximity to defence and defence industries.

Understanding how tools of automated spatiality reconfigure environments and the role of policy and industry in their innovation and uptake will generate new knowledge about a critical point of convergence between public space, technology, defence, and industry with national significance, as well as implications for international jurisdictions facing similar changes and challenges.

Over 3 years commencing in 2022, the project aims to answer the following questions:
• How is space-making automated across different technologies and contexts? What logics, techniques and practices are shared? What are distinct to different contexts?
• How does automated spatiality lead to the reconfiguring of public space?
• How are digital infrastructures, such as unmanned traffic management systems for civilian airspace, imagined, organised, and regulated?
• How do policy settings, industrial demands, and defence priorities shape the development and application of technologies of automated spatiality?

RESEARCHERS

Michael Richardson

Assoc Prof Michael Richardson

Lead Investigator,
UNSW

Learn more

Mark Andrejevic

Prof Mark Andrejevic

Chief Investigator,
Monash University

Learn more

Jake Goldenfein

Dr Jake Goldenfein

Chief Investigator,
University of Melbourne

Learn more

ADM+S Chief Investigator Anthony McCosker

Prof Anthony McCosker

Chief Investigator,
Swinburne University

Learn more

Jathan Sadowski

Dr Jathan Sadowski

Associate Investigator,
Monash University

Learn more

Rowan Wilken

Assoc Prof Rowan Wilken

Associate Investigator,
RMIT University

Learn more

Kelly Lewis

Dr Kelly Lewis

Research Fellow,
Monash University

Learn more

Christopher O'Neill

Dr Chris O’Neill

Research Fellow,
Monash University

Learn more

Thao Phan

Dr Thao Phan

Research Fellow,
Monash University

Learn more

Zoe Horn

Zoe Horn

PhD Student,
Western Sydney University

Learn more

Lauren Kelly

Lauren Kelly

Student,
RMIT University

Learn more

Andrew Brooks

Dr Andrew Brooks

Affiliate,
UNSW

Learn more

PARTNERS

OVIC Logo

Office of the Victorian Information Commissioner

Learn more

Trauma-informed AI: Developing and testing a practical AI audit framework for use in social services

PROJECT SUMMARY

Woman's face with artificial intelligence graphic on right side

Trauma-informed AI: Developing and testing a practical AI audit framework for use in social services

Focus Areas: Social Services
Research Program: Machines
Status: Active

Artificial Intelligence (AI) is increasingly being used in the delivery of social services. While it offers opportunities for more efficient, effective and personalised service delivery, AI can also generate greater problems, reinforcing disadvantage, generating trauma or re-traumatising service users.

Conducted by a multi-disciplinary research team with extensive expertise in the intersection of social services and digital technology, this project seeks to co-design an innovative AI trauma-informed audit framework to assess the extent to which an AI’s decisions may generate new trauma or re-traumatise.

The value of a trauma-informed AI audit framework is not simply to assess digital technologies after they are built and in operation, but also to inform designs of digital technologies and digitally enabled social services from their inception.

It will be road-tested using multiple case studies of AI use in child/family services, domestic and family violence services, and social security/welfare payments.

RESEARCHERS

Paul Henman

Prof Paul Henman

Lead Investigator,
University of Queensland

Learn more

ADM+S Investigator Philip Gillingham

Dr Philip Gillingham

Associate Investigator,
University of Queensland

Learn more

Lyndal Sleep profile picture

Dr Lyndal Sleep

Affiliate,
Central Queensland University

Learn more

Suzanna Fay

Dr Suzanna Fay

Senior Lecturer,
University of Queensland

Learn more

PARTNERS

University of Notre Dame-IBM Tech Ethics Lab

University of Notre Dame-IBM Tech Ethics Lab

Visit website

Mapping automated decision-making tools in administrative decision-making in NSW

PROJECT SUMMARY

In motion people walking by office building

Mapping automated decision-making tools in administrative decision-making in NSW

Focus Areas: Social Services
Research Program: Institutions
Status: Active

The project is a partnership between ADM+S and the New South Wales Ombudsman to map and analyse the use of automated systems in state and local government sectors in New South Wales (NSW). The project follows from a ground-breaking report on the use of technology in government decision-making published by the NSW Ombudsman in 2022.

The project will first map where and how NSW state and local government agencies are using automated systems in administrative decision processes. This is the first attempt to undertake such a systematic mapping in any jurisdiction in Australia and one of the very few attempts across the world. This first stage, led by Prof Paul Henman, Chief Investigator at ADM+S, and Dr Lyndal Sleep, Research Fellow at ADM+S, will distribute questionnaires and conduct targeted interviews with NSW state and local government agencies; building on the work from the ‘Mapping ADM in Australian Social Services’ project which mapped the use of automated systems in social security settings in Australia.

The second part of the research will be led by ADM+S Chief Investigator Prof Kimberlee Weatherall, and ADM+S Research Fellow Dr José-Miguel Bello y Villarino, which will analyse the different systems planned and in use by NSW public authorities, and the key risks and issues that emerge.

Researchers from ADM+S and Macquarie University will contribute to different legal and technical elements of the project.

The NSW Ombudsman will table a report to NSW Parliament with the findings of the research by the end of 2023.

RESEARCHERS

Kimberlee Weatherall

Prof Kimberlee Weatherall

Chief Researcher, University of Sydney

Learn more

Paul Henman

Prof Paul Henman

Chief Researcher, UQ

Learn more

José-Miguel Bello y Villarino

Dr José-Miguel Bello y Villarino

Principal Researcher, University of Sydney

Learn more

Person icon

C. Allan

Principal Project Officer, NSW Ombudsman’s Office

Person icon

K. Whitworth

Senior Project Officer, NSW Ombudsman’s Office

Lyndal Sleep profile picture

Dr Lyndal Sleep

Associate Researcher,
Central Queensland University

Learn more

Jenny van der Arend

Dr Jenny van der Arend

Senior Research Assistant, UQ

Learn more

Jeffrey Chan

Assoc Prof Jeffrey Chan

Associate Researcher

Learn more

Terry Carney

Prof Terry Carney

Senior Researcher, University of Sydney

Learn more

Scarlet Wilcock

Dr Scarlet Wilcock

Associate Researcher, University of Sydney

Learn more

Rita Matulionyte

Dr Rita Matulionyte

Associate Researcher, Macquarie University

Learn more

Distinguished Professor Julian Thomas

Dist. Prof Julian Thomas

Advisory Board Member, RMIT University

Learn more

PARTNERS

NSW Ombudsman

Visit website

Risk, Rule-setters and Rule-takers: Regulatory approaches to risk in AI-supported and AI-automated decision-making for general welfare

PROJECT SUMMARY

Crowd in motion in busy precinct

Risk, Rule-setters and Rule-takers: Regulatory approaches to risk in AI-supported and AI-automated decision-making for general welfare

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Programs: Institutions
Status: Active

This project seeks to scope several approaches to deal with Automated Decision-Making and Decision-Support Systems-Related Risks (ADM/DSS RR) through norms and provide an evaluation of those approaches for their consideration in regulatory contexts.

The standpoint is to look at risk control of those systems beyond ethics or social principles and focus the discussion on the possible interventions from the regulator’s perspective.

The overarching questions and sub-questions guiding this project are:

  • What is risk in an ADM / DS System?
    – Is it possible to define it?
    – How is it different from technological risk?
    – How is it different from the concept of risk in
    management?
    – Are all “potential harms” risks of and ADM/DSS?
    – Is there a concept of risk usable for regulatory
    purposes?
  • What types of risks are common and which ones specific to ADM/DSS?
    – Due to the nature of the risk?
    – Due to the scale of the risk?
  • What is an acceptable risk:
    – From the point of view of society as a whole
    – From the point of view of the most vulnerable groups
    – From the point of view of the owner of the AI system
    – From the point of view of the users of the system
  • Can risk be separated from questions of liability/ responsibility or do they need to be regulated together?

RESEARCHERS

Kimberlee Weatherall

Prof Kimberlee Weatherall

Chief Investigator,
University of Sydney

Learn more

ADM+S Chief Investigator Nic Suzor

Prof Nicolas Suzor

Chief Investigator,
QUT

Learn more

José-Miguel Bello y Villarino

Dr José-Miguel Bello Villarino

Research Fellow,
University of Sydney

Learn more

Henry Fraser

Dr Henry Fraser

Research Fellow,
QUT

Learn more

PARTNERS

Gradient Institute logo

Gradient Institute

Learn more

Collateral Data: Automated Decision-Making and the Future of Credit in India

PROJECT SUMMARY

Young Indian woman looking at letter while using laptop

Collateral Data: Automated Decision-Making and the Future of Credit in India

Focus Areas: Social Services
Research Programs: People
Status: Active

This project aims to investigate the increasing use of automated decision-making systems in the provision of automated loans in India. These systems can use a potential borrower’s personal data (including call histories, location, contact lists) to create credit scores for people without formal credit histories. Hailed as a revolutionary step forward in financial inclusion on the one hand and decried as a dangerous invasion of privacy on the other, these new loan products have significant impacts.

Focusing on designers, regulators, and users of automated loans in India, the project asks how these products shape financial inclusion and socio-economic mobility at an everyday level. Through conducting interviews and collecting financial diaries the project aims to elucidate how these technologies are taken up and transform borrowers’ livelihoods and social networks.

Expected outcomes include detailed accounts of how automated financial services can exacerbate inequality even as they expand financial inclusion. Understanding these dynamics will be crucial not only for intervening in social inequality in India but also in regulating the adoption of similar practices of credit-scoring and loan distribution that are already starting to emerge in Australia. In providing a detailed picture of how ADM is changing the landscape of credit and economic inequality in a context where these tools have been widely adopted, the project seeks to provide critical foresight to regulators and industry actors in countries like Australia where data sharing, and alternative data are just beginning to be taken up in the financial sector.

RESEARCHERS

ADM+S Chief Investigator Heather Horst

Prof Heather Horst

Lead Investigator,
Western Sydney University

Learn more

Adam Sargent

Dr Adam Sargent

Research Fellow,
Western Sydney University

Learn more

Assessing Prospective Harms (vs Benefits) associated with ADM

PROJECT SUMMARY

Two people looking at computer screens

Assessing Prospective Harms (vs Benefits) associated with ADM

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Programs: Data, Machines, Institutions
Status: 
Completed

The project (which is now completed) was set up as a preliminary exercise in assessing prospective harms vs prospective benefits associated with ADM as a first step to amelioration. It took a two-pronged approach: firstly, focusing on individual and social harms/costs that may be associated with automated or semi-automated data processing (including collection, retention, dissemination, and other uses of data) – versus prospective benefits; and secondly, assessing the levels of risk of these harms ranging from nebulous to very significant (and acknowledging there may be
uncertain outcomes and uneven distributions). The overall aim was thus to have a fuller appreciation of harms and risks as a precursor to thinking practically about amelioration/mitigation of costs.

More specifically, the project was geared to questions of elaborating and understanding the range of prospective harms associated with loss of control over data processing for individuals, groups and society, and indeed the entirety of the living world, as a first step to finding solutions such as changes in law, or social practices, or business methods, or technologies (or some combination of these).

The principal activity of the project was to have a series of workshops planned, organised and hosted by the coordinators CI Richardson, AI Roberts and Postdoc Jiménez (with administrator Astari.Kusumawardani providing support). The workshops featured the work of diverse ADM+S CIs, AIs, Researchers and Affiliates and adopted an intense mode of interrogation and discussion along with suggestions. The aim was to assist ADMS personnel with the preparation of reports, books and scholarly articles (as well as share insights and ideas).

Topics and presenters in the workshop series included the following:
•March: Aitor Jiménez (Megan Richardson chair), Crimes of digital capitalism
•March: Ariadna Matamoros- Fernández, Rosalie Gillett, Anjalee de Silva (Aitor Jiménez chair), •Gendered harm
•April: José-Miguel Bello Villarino, Henry Fraser (Megan Richardson chair), Where residual risks reside: a comparative approach to AI risk management under the EU’s AI Act Proposal
•April: Jake Goldenfein (Megan Richardsonchair) How competing constructions of humans legitimize online advertising
•May: Simon Coghlan, Christine Parker (Andy Roberts, chair), A preliminary framework for understanding how ADM/AI technologies can harm non-human animals
•June: Lisa Archbold (Andy Roberts chair), Children’s developmental privacy
•July: Frank Pasquale/Jeannie Paterson (Megan Richardson chair: co-hosted with CAIDE), Automated grace: toward more humane benefits administration via AI
•August: James Meese (Megan Richardson chair), Regulating news recommendation: looking beyond harm
•September: Megan Richardson (Jeannie Paterson chair – co-hosted with CAIDE), Trust norms and data rights
•October: Ariadna Matamoros- Fernández, Louisa Bartolo, Luke Troynar (Aitor Jiménez chair), Addressing harmful humour as an online safety issue
•November: Damian Clifford (Megan Richardson chair), Data protection and (in)accuracy

RESEARCHERS

ADM+S Investigator Christine Parker

Prof Christine Parker

Lead Investigator,
University of Melbourne

Learn more

Jake Goldenfein

Dr Jake Goldenfein

Chief Investigator,
University of Melbourne

Learn more

Kim Weatherall

Prof Kim Weatherall

Chief Investigator,
University of Sydney

Learn more

Zofia Bednarz

Dr Zofia Bednarz

Associate Investigator,
University of Sydney

Learn more

Simon Coghlan

Dr Simon Coghlan

Associate Investigator,
University of Melbourne

Learn more

ADM+S Chief Investigator Andrew Kenyon

Prof Andrew Kenyon

Associate Investigator,
University of Melbourne

Learn more

Ariadna Matamoros Fernandez profile picture

Dr Ariadna Matamoros-Fernández

Associate Investigator,
QUT

Learn more

James Meese

Dr James Meese

Associate Investigator,
RMIT University

Learn more

Andrew Roberts

Prof Andrew Roberts

Associate Investigator,
University of Melbourne

Learn more

ADM+S Investigator Ivana Jurko

Ivana Jurko

Partner Investigator,
Red Cross Australia

Learn more

José-Miguel Bello y Villarino

Dr José-Miguel Bello Villarino

Research Fellow,
University of Sydney

Learn more

Anjalee de Silva

Dr Anjalee de Silva

Research Fellow,
University of Melbourne

Learn more

Henry Fraser

Dr Henry Fraser

Research Fellow,
QUT

Learn more

Dr Rosalie Gillett profile picture

Dr Rosalie Gillett

Research Fellow,
QUT

Learn more

Aitor Jiménez

Dr Aitor Jiménez

Research Fellow,
University of Melbourne

Learn more

Damian Clifford

Dr Damian Clifford

Affiliate,
ANU

Learn more

ADM+S Investigator Fiona Haines

Prof Fiona Haines

Affiliate,
University of Melbourne

Learn more

Kobi Leins

Dr Kobi Leins

Affiliate,
King’s College

Learn more

Jeannie Paterson

Prof Jeannie Paterson

Affiliate,
University of Melbourne

Learn more

ADM+S Chief Investigator Megan Richardson

Prof Megan Richardson

Affiliate,
University of Melbourne

Learn more

PARTNERS

OVIC Logo

Office of the Victorian Information Commissioner (OVIC)

Learn more

Data for Social Good: Non-profit sector data projects

PROJECT SUMMARY

Diverse group of people using digital devices

Data for Social Good: Non-profit sector data projects

Focus Area: Social Services
Research Program: Data
Status: Active

It is widely understood that the non-profit sector is at the frontline in addressing issues of social equity and inclusion. While the sector and the communities it serves stands to benefit greatly from the turn to data and analytics, it is often under-equipped.

This project draws on a range of social good data projects with non-profit organisations, including the Building Data Capability and Collaboration project, and provides a foundational methodology for the ADM+S Centre’s goals in reconfiguring data practices for responsible, ethical and inclusive ADM. It centres on a methodology of ‘collaborative data action’ that helps to build capability and improve data governance to produce data insights and innovation.

The open access Data for Social Good: Non-Profit Sector Data Projects book and associated workshops provide non-profit CEOs, managers, practitioners and board members with feasible strategies for getting into data analytics or assessing and building their organisation’s data capability. It also informs researchers as it reflects on where practice-embedded research has arrived and provides thoughts about future research directions.

BOOK

Data for Social Good - Front Cover

Data for social good: non-profit sector data projects

27 October 2022

Read on APO

RESEARCHERS

ADM+S Chief Investigator Anthony McCosker

Assoc Prof Anthony McCosker

Lead Investigator,
Swinburne University

Learn more

Kath Albury

Prof Kath Albury

Associate Investigator,
Swinburne University

Learn more

Jane Farmer

Prof Jane Farmer

Associate Investigator,
Swinburne University

Learn more

PARTNERS & COLLABORATING ORGANISATIONS

Australian Red Cross Logo

Australian Red Cross

Visit website

Bendigo Bank

Bendigo Bank

Visit website

Victorian Government

Department of Premier and Cabinet, Victorian Government

Visit website

Entertainment Assist

Entertainment Assist

Visit website

Good Cycles

Good Cycles

Visit website

Infoxchange

Infoxchange

Visit website

ReachOut

ReachOut

Visit website

Yooralla

Yooralla

Visit website

Public Interest Litigation for AI Accountability

PROJECT SUMMARY

Woman sitting down with laptop

Public Interest Litigation for AI Accountability

Focus Areas: News and Media, Health, Social Services, Transport and Mobilities
Research Program: Institutions
Status: Active

If you have been harmed by bad automated decision-making, from robots to loan assessments, what can you do to right the wrong? What can the law do to help you? A growing number of public controversies about discriminatory, unpredictable and dangerous automated decision-making has raised questions about the most effective methods of accountability.

Through qualitative interviews with stakeholders (including class action and pro bono lawyers), this project seeks to identify the opportunities, enablers and barriers for public interest litigation to promote accountability and fairness in automated decision-making.

RESEARCHERS

ADM+S Chief Investigator Nic Suzor

Prof Nicolas Suzor

Lead Investigator,
QUT

Learn more

Henry Fraser

Dr Henry Fraser

Research Fellow,
QUT

Learn more

Zahra Stardust profile picture

Dr Zahra Stardust

Research Fellow,
QUT

Learn more

Ecological Implications of Data Centres

PROJECT SUMMARY

Data centre

Ecological Implications of Data Centres

Focus Areas: News and Media, Transport and Mobility, Health, Social Services
Research Program: Institutions
Status: Active

The project seeks to understand how companies, public agencies and civil society address the environmental conditions and limitations facing the establishment and management of data centres and submarine cables in urban and coastal areas.

A central part of data centre management is heat management: servers produce heat, and as they are gathered in large numbers in close areas, temperatures rise raising the risk of fire. To overcome this, data centre operators have various techniques to cool down these facilities and avoid any risks of data loss caused by fires. Moreover, when landing, telecom subsea cables risk to damage the local biodiversity (especially marine plants).

Thus, this project will ask: what shapes the environmental impacts of data centres cooling infrastructures? What are the ecological implications involved with the landing of a telecom submarine cable or the creation of a new data centre? How are these ecological impacts made visible to stakeholders? To what extent do environmental assessments succeed in reconciling the various interests at stake (security of infrastructures, maritime trade, marine biodiversity) in the passage of a telecomunication cable? How do ecological and infrastructural vulnerabilities of both data centers and telecom submarine cables shape the world-wide interconnection of data at the heart of the digital economy?

In order to address this question, we will take as a case study the rapid growth of data centres and telecommunication subsea cables in Marseille (France), which is particularly interesting as this city is in a warm climate, making the issue of heat management more difficult there than in the north of Europe.

This project is conducted by ADM+S Research Fellow Dr Loup Cellard in collaboration with Dr Clément Marquet (Mines Paris).

RESEARCHERS

ADM+S Investigator Christine Parker

Prof Christine Parker

Lead Investigator,
University of Melbourne

Learn more

ADM+S Investigator Karen Yeung

Prof Karen Yeung

Partner Investigator,
University of Birmingham

Learn more

Loup Cellard

Dr Loup Cellard

Affiliate,
Datactivist Coop

Learn more

ADM+S Investigator Fiona Haines

Prof Fiona Haines

Affiliate,
University of Melbourne

Learn more

PARTNERS

Université de Technologie de Compiègne Logo

Université de Technologie de Compiègne

Learn more

University of Birmingham

Learn more

Transparent Machines: From Unpacking Bias to Actionable Explainability

PROJECT SUMMARY

Person typing on computer

Transparent Machines: From Unpacking Bias to Actionable Explainability

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Machines
Status: Active

ADMs, their software, algorithms, and models, are often designed as “black boxes” with little efforts placed on understanding how they work. This lack of understanding does not only impact the final users of ADMs, but also the stakeholders and the developers, who need to be accountable for the systems they are creating. This problem is often exacerbated by the inherent bias coming from the data from which the models are often trained on.

Further, the wide-spread usage of deep learning models has led to increasing number of minimally-interpretable models being used, as opposed to traditional models like decision trees, or even Bayesian and statistical machine learning models.

Explanations of models are also needed to reveal potential biases in the models themselves and assist with their debiasing.

This project aims to unpack the biases in models that may come from the underlying data, or biases in software (e.g. a simulation) that could be designed with a specific purpose and angle from the developers’ point-of-view. This project also aims to investigate techniques to generate diverse, robust and actionable explanations for a range of problems and data types and modality, from large-scale unstructured data, to highly varied sensor data and multimodal data. To this end, we look to generate counterfactual explanations that have a shared dependence on the data distribution and the local behaviour of the black-box model by level, and offer new metrics in order to measure the opportunity cost of choosing one counterfactual over another. We further aim to explore the intelligibility of different representations of explanations to diverse audiences through an online user study.

RESEARCHERS

ADM+S Investigator Flora Salim

Prof Flora Salim

Lead Investigator,
UNSW

Learn more

Daniel Angus

Prof Daniel Angus

Chief Investigator,
QUT

Learn more

ADM+S Chief Investigator Paul Henman

Prof Paul Henman

Chief Investigator,
University of Queensland

Learn more

ADM+S Chief Investigator Mark Sanderson

Prof Mark Sanderson

Chief Investigator,
RMIT University

Learn more

Jeffrey Chan

Dr Jeffrey Chan

Associate Investigator,
RMIT University

Learn more

ADM+S Chief Investigator Falk Scholer

Prof Falk Scholer

Associate Investigator,
RMIT University

Learn more

ADM+S Investigator Damiano Spina

Dr Damiano Spina

Associate Investigator,
RMIT University

Learn more

ADM+S Investigator Maarten de Rijke

Prof Maarten de Rijke

Partner Investigator,
University of Amsterdam

Learn more

Peibo Li

Peibo Li

PhD Student,
UNSW

Learn more

Edward Small

Edward Small

PhD Student,
RMIT University

Learn more

Kacper Sokol

Kacper Sokol

Affiliate,
ETH Zurich

Learn more

PARTNERS

University of Amsterdam logo

University of Amsterdam

Visit website

Governing ADM Use

PROJECT SUMMARY

Blurred people in busy precinct

Governing ADM Use

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Institutions
Status: Active

The Governing ADM Use Project was an ‘umbrella’ project designed to seed the work of the ADM+S Institutions program in the rapidly evolving area of ADM and AI regulation. The project conceives the challenge of governing ADM use as a multi layered network incorporating the regulation of the use of ADM by government authorities, the regulation by government of ADM use in the commercial and private sector, and the interaction of ADM-specific regulation and governance with a range of other areas of law, regulation and governance that impinge and interact (more or less directly) with the specific governance of ADM/AI.

This latter category extends from data and privacy regulation to competition and consumer protection and beyond to sector and problem specific areas of regulation such as energy regulation, worker health and safety, labour force regulation and importantly environmental and planning laws. This program of work has sought to understand the special role of law as well as broader influences on public and private sector ADM use, and how these change – or need to change – to respond to the impacts of automation. A particular feature of this program of work has been to expand our understanding of the eco-system of law and governance properly concerned with regulating ADM/AI to include how we govern the ecological impact of ADM/AI use.

RESEARCHERS

ADM+S Investigator Christine Parker

Prof Christine Parker

Lead Investigator,
University of Melbourne

Learn more

ADM+S Chief Investigator Megan Richardson

Prof Megan Richardson

Lead Investigator,
University of Melbourne

Learn more

Jake Goldenfein

Dr Jake Goldenfein

Chief Investigator,
University of Melbourne

Learn more

Kim Weatherall

Prof Kim Weatherall

Chief Investigator,
University of Sydney

Learn more

ADM+S Investigator Karen Yeung

Prof Karen Yeung

Partner Investigator,
University of Birmingham

Learn more

José-Miguel Bello y Villarino

Dr José-Miguel Bello y Villarino

Research Fellow,
University of Sydney

Learn more

Henry Fraser

Dr Henry Fraser

Research Fellow,
QUT

Learn more

Aitor Jiménez

Dr Aitor Jiménez

Research Fellow,
University of Melbourne

Learn more

Loup Cellard

Dr Loup Cellard

Affiliate,
Datactivist Coop

Learn more

ADM+S Investigator Fiona Haines

Prof Fiona Haines

Affiliate,
University of Melbourne

Learn more

Democratic Practices of Governance Given ADM

PROJECT SUMMARY

Busy street crossing aerial view

Democratic Practices of Governance Given ADM

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Institutions
Status: Active

This project examines possibilities for democratic practice, institutions and governance given automated decision-making (ADM). It focuses on challenges to and opportunities for liberal and democratic institutions and governance presented by ADM. The project aims to bridge analysis of ADM’s deployment across different domains with scholarly literature on republican and positive freedom, the rule of law and liberal democratic rights.

Overall, the project seeks to develop a theoretically rich analysis of democracy and freedom given ADM and apply the analysis to specific examples of current regulatory and democratic challenge.

RESEARCHERS

ADM+S Investigator Christine Parker

Prof Christine Parker

Lead Investigator,
University of Melbourne

Learn more

Mark Andrejevic

Prof Mark Andrejevic

Chief Investigator,
Monash University

Learn more

Jake Goldenfein

Dr Jake Goldenfein

Chief Investigator,
Melbourne University

Learn more

Distinguished Professor Julian Thomas

Prof Julian Thomas

Chief Investigator,
RMIT University

Learn more

ADM+S Investigator Sarah Erfani

Dr Sarah Erfani

Associate Investigator,
University of Melbourne

Learn more

Andrew Roberts

Prof Andrew Roberts

Associate Investigator,
University of Melbourne

Learn more

ADM+S Investigator Ivana Jurko

Ivana Jurko

Partner Investigator,
Red Cross Australia

Learn more

Anjalee de Silva

Dr Anjalee de Silva

Research Fellow,
University of Melbourne

Learn more

Aitor Jiménez

Dr Aitor Jiménez

Research Fellow,
University of Melbourne

Learn more

Chathurika Akurugoda

Chathurika Akurugoda

PhD Student,
University of Melbourne

Learn more

Lisa Archbold

Lisa Archbald

PhD Student,
University of Melbourne

Learn more

Phoebe Galbally

Phoebe Galbally

PhD Student,
University of Melbourne

Learn more

Avantik Tamta

Avantik Tamta

PhD Student,
University of Melbourne

Learn more

ADM+S Investigator Fiona Haines

Prof Fiona Haines

Affiliate,
University of Melbourne

Learn more

ADM+S Chief Investigator Megan Richardson

Prof Megan Richardson

Affiliate,
University of Melbourne

Learn more

The Coronavirus Impact

PROJECT SUMMARY

COVID19 Stay safe on mobile device

The Coronavirus Impact

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Data
Status:
 Active

This project focused on a publication output: a themed issue of the journal New Media & Society. Our theme proposal was accepted and the theme issue is in its final stages pre-publication. We are still waiting for comments on one article, but 10 articles have been accepted for publication by the journal and the introduction has been written. We are only waiting for the decision on the last outstanding article before submitting the complete package to the editors for final review. The entire issue ended up being written by Centre members.

The focus of the issue is on the range of roles played by automated decision making systems in the pandemic response. These range from the automated curation of news content to automated contact tracing and air quality management. Contributions came from all four focus areas of the Centre. The timeframe for the issue enabled the inclusion of articles that tracked the shift from pandemic to endemic and an analysis of the ways in which systems developed in response to the pandemic persisted or faded away.

RESEARCHERS

Mark Andrejevic

Prof Mark Andrejevic

Lead Investigator,
Monash University

Learn more

ADM+S Associate Director Jean Burgess

Prof Jean Burgess

Chief Investigator,
QUT

Learn more

ADM+S Chief Investigator Heather Horst

Prof Heather Horst

Chief Investigator,
Western Sydney University

Learn more

ADM+S Chief Investigator Sarah Pink

Prof Sarah Pink

Chief Investigator,
Monash University

Learn more

Gerard Goggin

Prof Gerard Goggin

Associate Investigator,
University of Sydney

Learn more

Ariadna Matamoros Fernandez profile picture

Prof Ariadna Matamoros-Fernandez

Associate Investigator,
QUT

Learn more

Christopher O'Neill

Assoc Prof Michael Richardson

Associate Investigator,
UNSW

Learn more

Rowan Wilken

Assoc Prof Rowan Wilken

Associate Investigator,
RMIT University

Learn more

Dr Silvia Montaña-Niño profile picture

Dr Silvia Montaña-Niño

Research Fellow,
QUT

Learn more

Christopher O'Neill

Dr Christopher O’Neil

Research Fellow,
Monash University

Learn more

Dr Silvia Montaña-Niño profile picture

Dr Georgia van Toorn

Research Fellow,
UNSW

Learn more

PARTNERS

Australian Red Cross Logo

Australian Red Cross

Visit website

OVIC Logo

Victorian Information Commissioner

Visit website

Data & Society Research Institute (US)

Visit website

Data mapping and ADM to advance humanitarian action and preparedness

PROJECT SUMMARY

Volunteer charity workers

Data mapping and ADM to advance humanitarian action and preparedness

Focus Areas: News & Media, Social Services
Research Program: Data
Status: Active

Humanitarian organisations and other NGOs are undergoing significant digital transformation. In a complicated digital media environment, new analytics capabilities can improve the role and effectiveness of organisations like Australian Red Cross in building community resilience, expanding volunteer networks, and informing rapid response. New models are needed for building data capability within communities prone to disaster and emergency. This includes community-driven practices for gathering useful open access data and local knowledge to aid and automate decision-making in disaster preparedness.

This project aimed to explore the potential of data partnerships and local community data capability for improving humanitarian preparedness and response to emergency situations. It contributes to developing new techniques for improving data-driven mapping of community strengths, knowledge and resilience. The work will improve advocacy and preparedness and enhance Red Cross’s data analytics capability as the organisation seeks to work with and empower local communities.

The project’s interim report, Mapping Community Resources for Disaster Preparedness: Humanitarian Data Capability and Automated Futures, sets out background knowledge about open data and mapping practices for disaster response, prediction and preparedness. Building on stakeholder workshops and international collaboration, the Mapping Community Resources report presents a model for community-oriented, open access and strengths-based data mapping capability.

RESEARCHERS

ADM+S Chief Investigator Anthony McCosker

Assoc Prof Anthony McCosker

Lead Investigator,
Swinburne University

Learn more

Daniel Angus

Prof Daniel Angus

Chief Investigator,
QUT

Learn more

Kath Albury

Prof Kath Albury

Associate Investigator,
Swinburne University

Learn more

Jane Farmer

Prof Jane Farmer

Associate Investigator,
Swinburne University

Learn more

Peter Kamstra

Dr Peter Kamstra

Associate Investigator,
Swinburne University

Learn more

Rowan Wilken

Assoc Prof Rowan Wilken

Associate Investigator,
RMIT University

Learn more

ADM+S Investigator Ivana Jurko

Ivana Jurko

Partner Investigator,
Red Cross Australia

Learn more

PARTNERS

Australian Red Cross Logo

Australian Red
Cross

Visit website

Everyday Data Cultures

PROJECT SUMMARY

Businessman using cell phone on subway train

Everyday Data Cultures

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Data
Status: Completed

This project explored the role of everyday data practices and literacies in automated decision-making. Its primary contribution is the novel conceptual framework of everyday data cultures, which is based on the cultural studies of everyday life. As well as a number of papers and public talks, it produced a co-authored monograph: Everyday Data Cultures (Polity Press, 2022).

Members of this team used this framework in subsequent research that sought to integrate everyday community experience into data projects with our partners in a variety of sectors across aspects of all four of the Centre’s focus areas. It will be used in future work within the Centre seeking to make sense of the impact and take-up of Generative AI in daily life – at home, at work, and in intimate relationships.

RESEARCHERS

ADM+S Associate Director Jean Burgess

Prof Jean Burgess

Lead Investigator,
QUT

Learn more

ADM+S Chief Investigator Anthony McCosker

Assoc Prof Anthony McCosker

Chief Investigator,
Swinburne University

Learn more

Rowan Wilken

Assoc Prof Rowan Wilken

Associate Investigator,
RMIT University

Learn more

Kath Albury

Prof Kath Albury

Associate Investigator,
Swinburne University

Learn more

Mapping ADM Across Sectors

PROJECT SUMMARY

Blurred crowd of people

Mapping ADM Across Sectors

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Programs: Data, Machines, Institutions, and People
Status: Active

ADM systems have the potential to greatly improve the overall quality of life in society, but they may also exacerbate social, political, and economic inequality. The role they play in reinforcing, reproducing, and reconfiguring power relations is, as recent events demonstrate, a key concern with respect to the deployment of automated decision making systems. When such systems are used to decide how benefits, resources, services, or information are allocated in society, they bear directly on the character and quality of life in that society. We are interested in both the potential benefits of the deployment of the technology and the potential harms. We do not treat such systems in the abstract, but are centrally concerned with the social, political, and economic relations in which they are embedded and which shape their deployment. A key question for the ADM+S Centre, in other words, is not just how best to design and deploy the technology, but what economic and political arrangements are most compatible with their fair, ethical, responsible, and democratic use.

The Social Issues in Automated Decision-Making report brings together material collected from discussions with leaders in the Centre’s focus areas and feedback from an international collection of experts in their respective domains. For each focus area we followed a similar methodology for canvassing key social issues. We started by discussing key social issues with Focus Area leaders and their teams. We then canvassed the academic literature, reports by industry groups and relevant independent organisations, and media coverage. For each area, we sought to identify key applications of ADM and the possible social benefits and harms with which they are associated. We also sought to identify continuities in these social issues both within and across the Centre’s main focus areas.

This is neither a final nor a definitive report. It marks the first step in the Centre’s ongoing social issues mapping project. The document will develop over time to reflect the insights that emerge from ongoing collaborations.

Read the report.

RESEARCHERS

Mark Andrejevic

Prof Mark Andrejevic

Lead Investigator,
Monash University

Learn more

Paul Henman

Prof Paul Henman

Chief Investigator,
University of Queensland

Learn more

ADM+S Investigator Ramon Lobato

Assoc Prof Ramon Lobato

Associate Investigator,
RMIT University

Learn more

Jathan Sadowski

Dr Jathan Sadowski

Associate Investigator,
Monash University

Learn more

Kelly Lewis

Dr Kelly Lewis

Research Fellow,
Monash University

Learn more

Christopher O'Neill

Dr Christopher O’Neil

Research Fellow,
Monash University

Learn more

Georgia Van Toorn

Dr Georgia van Toorn

Research Fellow,
UNSW

Learn more

Ash Watson

Dr Ash Watson

Research Fellow,
UNSW

Learn more

Vaughan Wozniak-O'Connor

Dr Vaughan Wozniak-O’Connor

Research Fellow,
UNSW

Learn more

Daniel Binns

Dr Daniel Binns

Affiliate,
RMIT University

Learn more

Lyndal Sleep profile picture

Dr Lyndal Sleep

Affiliate,
Central Queensland University

Learn more

PARTNERS

OVIC Logo

Office of the Victorian Information Commissioner

Learn more

Australian Red Cross Logo

Australian Red Cross

Learn more

Diverse Experiences of ADM: Design, Curation and Use

PROJECT SUMMARY

Research Materials

Diverse Experiences of ADM: Design, Curation and Use

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: People
Status: Active

The ‘Diverse Experiences of ADM’ is the overarching thematic title for a collection of studies that examine the social, cultural and ethical dimensions of how people understand and experience ADM and other new and emerging technologies. This project explores how members of diverse communities shape existing, emerging and future practices of ADM in an effort to understand and develop equitable futures. Several studies address disabled people’s lived experiences of ADM and other emerging technologies and what services they would like to see introduced to better support their care and wellbeing. Others look at health technology startups and the thinking behind developers’ visions of future technologies and identify how health and medical technologies are portrayed in Australian industry websites and news reports. One strand addresses gender, sexual health and digital contraception technologies.

Digital mental health is also a focus of some of the studies conducted in this project. There is a strong emphasis on using participatory, experimental, creative and arts-based methods to conduct research and to engage in community research translation and engagement, including artworks, zines and exhibitions. There is also a more-than-human orientation across this project, identifying the entanglements of humans not only with digital devices, software and data but with other animals and living things and the physical elements of the ecosystems in which these technologies are imagined, developed, promoted, used or resisted.

RESEARCHERS

ADM+S Chief Investigator Heather Horst

Prof Heather Horst

Lead Investigator,
Western Sydney University

Learn more

Prof Deborah Lupton

Lead Investigator,
UNSW

Learn more

Sarah Pink

Prof Sarah Pink

Lead Investigator,
Monash University

Learn more

Jackie Leach Scully profile picture

Prof Jackie Leach Scully

Chief Investigator,
UNSW

Learn more

Georgia Van Toorn

Dr Georgia van Toorn

Research Fellow,
UNSW

Learn more

Ash Watson

Dr Ash Watson

Research Fellow,
UNSW

Learn more

Vaughan Wozniak-O'Connor

Dr Vaughan Wozniak-O’Connor

Research Fellow,
UNSW

Learn more

Cecily Klim

Cecily Klim

PhD Student,
UNSW

Learn more

Megan Rose

Dr Megan Rose

PhD Student,
UNSW

Learn more

Jacinthe Flore

Dr Jacinthe Flore

Affiliate,
University of Melbourne

Learn more

PARTNERS AND COLLABORATING ORGANISATIONS

Consumer Health Forum of Australia Logo

Consumers Health Forum of Australia

Visit website

Health Consumers NSW

Health Consumers NSW

Visit website

Data Ethics, Rights, and Markets

PROJECT SUMMARY

Blurred people moving

Data Ethics, Rights, and Markets

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Data
Status: Active

The goal of this project is to contribute to the theoretical “backbone” of the ADM+S Centre and help synthesise the findings from projects in different focus areas and research programs through the creation of an historically informed theoretical overview to the social issues associated with the rise of automated decision-making (ADM).

The project supplements the descriptive mapping project (typologies and taxonomies of ADM) with an issue mapping project that connects directly with the core social concerns of the Centre: fairness, ethics, inclusion, and effectiveness.

RESEARCHERS

Distinguished Professor Julian Thomas

Prof Julian Thomas

Lead Investigator,
RMIT University

Learn more

ADM+S Associate Director Jean Burgess

Prof Jean Burgess

Chief Investigator,
QUT

Learn more

Axel Bruns, Chief Investigator with the ADM+S Centre

Prof Axel Bruns

Chief Investigator,
QUT

Learn more

Jake Goldenfein

Dr Jake Goldenfein

Chief Investigator,
University of Melbourne

Learn more

Paul Henman

Prof Paul Henman

Chief Investigator,
University of Queensland

Learn more

ADM+S Chief Investigator Anthony McCosker

Assoc Prof Anthony McCosker

Chief Investigator,
Swinburne University

Learn more

ADM+S Investigator Christine Parker

Prof Christine Parker

Chief Investigator,
University of Melbourne

Learn more

Sarah Pink

Prof Sarah Pink

Chief Investigator,
Monash University

Learn more

ADM+S Chief Investigator Mark Sanderson

Prof Mark Sanderson

Chief Investigator,
RMIT University

Learn more

Kimberlee Weatherall

Prof Kimberlee Weatherall

Chief Investigator,
University of Sydney

Learn more

ADM+S Chief Investigator Megan Richardson

Prof Megan Richardson

Affiliate,
University of Melbourne

Learn more

PARTNERS

Australian Red Cross Logo

Australian Red Cross

Visit website

Data & Society Research Institute (US)

Visit website

OVIC Logo

Victorian Information Commissioner

Visit website

Mapping ADM Machines in Australia and Asia-Pacific

PROJECT SUMMARY

People walking in city centre

Mapping ADM Machines in Australia and Asia-Pacific

Focus Area: Social Services
Research Program: Machines
Status: Completed

This project aimed to map ADM machines in Social Services in Australia and the Asia Pacific to provide foundational empirical and conceptual knowledge of ADM in social services beyond Europe and North America, and into the Asia-Pacific region. Viewing ADM as an assemblage of data systems and decision-making in social-political context, this project built a knowledge base about what ADM systems are being used in social services delivery in Australia and the Asia Pacific, and how they are used, and who is affected by this.

Based on a conceptual definitions and framework of ADM systems, this project provided a detailed mapping of ADM systems used in social services in Australia, worked with academics across the Asia-Pacific to map ADM systems used in social services in their countries, and conducted a countermapping of ADM in social services in Australia. Data was collected via webscraping of government websites and reports and major and specialist IT media outlets to build a detailed history and understanding of each ADM system identified, supplemented by interviews with developers and user stakeholders.

Major outputs included the Mapping ADM systems in Australian Social Services report, as well as presentations in national and international conferences, webinars, and journal articles in leading journals, including Qualitative Inquiry.

Major benefits of this project include:
• Improved public understanding of what ADM systems are being used in social services in Australia and the Asia Pacific
• Increased focus by public institutions, like the NSW Ombudsman, to monitor and map what ADMs are being used in governmental decision-making to improve transparency
• Attention by major players, like IBM, on the way ADM systems are used in social services delivery, its impacts on service users’ wellbeing and different ways to think about the roll out of new technologies in the sector (e.g, using trauma informed practice principles).

RESEARCHERS

Paul Henman

Prof Paul Henman

Lead Investigator,
University of Queensland

Learn more

Brooke Coco

Brooke Ann Coco

PhD Student,
RMIT University

Learn more

Lyndal Sleep profile picture

Dr Lyndal Sleep

Affiliate,
Central Queensland University

Learn more

PARTNERS

AlgorithmWatch Logo

Algorithm Watch (Germany)

Visit website

Data capacity and collaboration for ADM in the community sector

PROJECT SUMMARY

Group of people in huddle

Data capacity and collaboration for ADM in the community sector

Focus Area: Social Services
Research Program: Data
Status: Active

The project works toward a replicable framework for building capacity (expertise, literacy, data partnerships and data governance) to unlock the social value and impact of advanced data analytics, AI and ADM across the not-for-profit sector. The aim is to develop models for responsible data practices suitable for addressing the goals and challenges faced by the NFP sector, and assess and advance data literacy and expertise to improve ADM outcomes.

This project takes an innovative approach to addressing challenges in data collaboration and developing data capability across the not-for-profit (NFP) sector. Through participatory methods, it integrates technical approaches to responsible data management in computer science, legal approaches to data sharing, and social science approaches to data capability building and ‘data and AI for social good’.

The project works toward a replicable framework for building capacity (expertise, literacy, data partnerships and data governance) to unlock the social value and impact of advanced data analytics, AI and ADM across the not-for-profit sector. The aim is to develop models for responsible data practices suitable for addressing the goals and challenges faced by the NFP sector and assess and advance data literacy and expertise to improve ADM outcomes.

Phase One of the project worked with a range of not-for-profit organisations to establish the key challenges and opportunities in the sector for using data and ADM to address disadvantage in the community.

This research phase resulted in an Interim report: ‘Building Data Capacity in the Not-for-Profit Sector’. Our research has shown that data capability involves fostering effective and responsible data practices across three integrated dimensions: data access and infrastructure, data skills and data governance. Insights from Phase One were used to co-design a NFP specific Data Capability Framework and test the Framework through three participatory workshops throughout Phase Two.

Phase Two of the project applied participatory methods to generate a Data Capability Framework designed to support the Not-for-Profit sector.

As social and community services rapidly digitise, they are generating more data than ever before. Co-designed with organisations from across the sector, the Data Capability Framework for the Not-for-Profit Sector sets out a pathway for developing effective and responsible data practices across three integrated dimensions: data access and infrastructure, data skills and data governance. This work lays the foundations for safe, responsible and inclusive automated decision-making and AI use across the sector.

The Framework distils the challenges and successes of organisations we have worked with. It represents both the factors that underpin effective data capability and the pathways to achieving it. In other words, as technologies and data science techniques continue to change, data capability is both an outcome to aspire to, and a dynamic, ongoing process of experimentation and adaption.

RESEARCHERS

ADM+S Chief Investigator Anthony McCosker

Assoc Prof Anthony McCosker

Lead Investigator,
Swinburne University

Learn more

Jake Goldenfein

Dr Jake Goldenfein

Chief Investigator,
University of Melbourne

Learn more

Kimberlee Weatherall

Prof Kimberlee Weatherall

Chief Investigator,
University of Sydney

Learn more

Kath Albury

Prof Kath Albury

Associate Investigator,
Swinburne University

Learn more

Jane Farmer

Prof Jane Farmer

Associate Investigator,
Swinburne University

Learn more

ADM+S Investigator Julia Stoyanovich

Assistant Prof Julia Stoyanovich

Partner Investigator,
New York University

Learn more

Yong-Bin Kang

Dr Yong-Bin Kang

Research Fellow,
Swinburne University

Learn more

ADM+S Investigator Julia Stoyanovich

Dr Frances Shaw

Research Fellow,
Swinburne University

Learn more

Xiaofang Yao

Dr Xiaofang Yao

Affiliate,
Federation University

Learn more

PARTNERS

Infoxchange

Infoxchange

Visit website

Australian Red Cross Logo

Australian Red Cross

Learn more

Civic Automated Decision-Making

PROJECT SUMMARY

Person on wheelchair moving past city building

Civic Automated Decision-Making

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Data
Status:
 Active

As part of the ARC Centre’s mandate to create the knowledge and strategies necessary for responsible, ethical, and inclusive automated decision-making, this project engages with the role played by such systems in democracy and civic life. The impetus for this project is to supplement discussions of AI ethics with those of AI civics – and, in particular to consider the practices, policies, technologies, and social-political arrangements of automated decision making systems that are most compatible with a vibrant democracy.

Recent developments render such a conversation increasingly pressing. The institutions that to which we have entrusted the development of some of the most powerful automated contemporary information and communication technologies available do not necessarily have civic or democratic concerns as top priority – this is not what they are built to do. Our steering mechanisms are having a difficult time keeping up – and it is crucially important to consider alternative possible arrangements for storing and processing the data upon which society relies. These questions lie at the heart of what it means to formulate world-leading policy and practice, as envisioned by the Centre.

This project draws upon expertise from across the Centre’s programs and Focus Areas to develop conceptual and practical interventions designed to align automated systems with civic and democratic imperatives. The initial phase of the project was an agenda setting workshop to consider key issues and approaches. The next step will be a themed issue or edited collection that develops approaches to Civic ADM. The final stage will include integration of these approaches with practical initiatives in the Centre, including observability and accountability projects.

RESEARCHERS

Mark Andrejevic

Prof Mark Andrejevic

Lead Investigator,
Monash University

Learn more

Jake Goldenfein

Dr Jake Goldenfein

Chief Investigator,
University of Melbourne

Learn more

ADM+S Investigator Christine Parker

Prof Christine Parker

Chief Investigator,
University of Melbourne

Learn more

Distinguished Professor Julian Thomas

Prof Julian Thomas

Chief Investigator,
RMIT University

Learn more

Kimberlee Weatherall

Prof Kimberlee Weatherall

Chief Investigator,
University of Melbourne

Learn more

ADM+S Investigator James Meese

Dr James Meese

Associate Investigator,
RMIT University

Learn more

ADM+S Chief Investigator Andrew Kenyon

Prof Andrew Kenyon

Associate Investigator,
University of Melbourne

Learn more

Kylie Pappalardo profile picture

Dr Kylie Pappalardo

Associate Investigator,
QUT

Learn more

Michael Richardson

Assoc Prof Michael Richardson

Associate Investigator,
UNSW

Learn more

Andrew Roberts

Prof Andrew Roberts

Associate Investigator,
University of Melbourne

Learn more

ADM+S Investigator Robert Sparrow

Prof Robert Sparrow

Associate Investigator,
Monash University

Learn more

ADM+S Investigator Frank Pasquale

Prof Frank Pasquale

Partner Investigator,
Cornell Tech

Learn more

Kelly Lewis

Dr Kelly Lewis

Research Fellow,
Monash University

Learn more

Christopher O'Neill

Dr Christopher O’Neil

Research Fellow,
Monash University

Learn more

Jathan Sadowski

Dr Jathan Sadowski

Research Fellow,
Monash University

Learn more

Dr Aaron Snoswell

Dr Aaron Snoswell

Research Fellow,
QUT

Learn more

Georgia Van Toorn

Dr Georgia van Toorn

Research Fellow,
UNSW

Learn more

Zoe Horn

Zoe Horn

PhD Student,
Western Sydney University

Learn more

Lucinda Nelson

Lucinda Nelson

PhD Student,
QUT

Learn more

PARTNERS

Brooklyn Law School logo

Brooklyn Law School

Visit website

Data & Society Research Institute (US)

Visit website

OVIC Logo

Office of the Victorian Information Commissioner

Visit website

Considerate and Accurate Multi-party Recommender Systems for Constrained Resources

PROJECT SUMMARY

Mobile with Spotify music app

Considerate and Accurate Multi-party Recommender Systems for Constrained Resources

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Machines
Status: Active

This project will create a next generation recommender system that enables equitable allocation of constrained resources. The project will produce novel hybrid socio-technical methods and resources to create a Considerate and Accurate REcommender System (CARES), evaluated with social science and behavioural economics lenses.

CARES will transform the sharing economy by delivering systems and methods that improve user and non-user experiences, business efficiency, and corporate social responsibility.

PARTICIPATE

Participate in an online user study on multi-party fair recommendations

We are looking for users of the Spotify music application to complete a brief online study. In the study, you are expected to browse music recommendations and answer a set of questions.

The study is expected to take less than 15 minutes, and you will receive a AU$10 gift card as a thank you.

You will need to have an active Spotify account with at least 6 months of listening history to take part.

To verify your eligibility and participate in the study, please fill out this form.

RESEARCHERS

ADM+S Chief Investigator Mark Sanderson

Prof Mark Sanderson

Lead Investigator,
RMIT University

Learn more

ADM+S Chief Investigator Christopher Leckie

Prof Christopher Leckie

Chief Investigator,
University of Melbourne

Learn more

ADM+S Investigator Flora Salim

Prof Flora Salim

Chief Investigator,
UNSW

Learn more

Jeffrey Chan

Dr Jeffrey Chan

Associate Investigator,
RMIT University

Learn more

Danula Hettiachchi

Dr Danula Hettiachchi

Research Fellow,
RMIT University

Learn more

PARTNERS

University of Amsterdam logo

University of Amsterdam

Visit website

Decentering ADM: A Review of Automated Decision-Making in the Global South

PROJECT SUMMARY

Cash register with payment barcode in a shop in Delhi

Decentering ADM: A Review of Automated Decision-Making in the Global South

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: People
Status: Active

This project is a review of the current state of ADM implementation, practices and visions in different regions in the Global South. It includes an analysis of academic and grey literature, online resources and interviews with key stakeholders in four underrepresented regions (Latin America, Anglophone Africa, South and Southeast Asia and Pacific Island Archipelagos).

Our focus upon decentering ADM works to challenge dominant narratives of the discourse, practice and adoption of ADM across the world.

RESEARCHERS

ADM+S Chief Investigator Heather Horst

Prof Heather Horst

Lead Investigator

Learn more

Edgar Gómez-Cruz

Dr Edgar Gómez Cruz

Affiliate

Learn more

Adam Sargent

Dr Adam Sargent

Associate Investigator

Learn more

PARTNERS

Australian Red Cross Logo

Australian Red Cross

Learn more