Humans, Machines, and Decision Responsibility

PROJECT SUMMARY

Businessman using cell phone on subway train

Humans, Machines, and Decision Responsibility

Focus Areas: News & Media, Social Services, Mobilities, Health
Research Program: Institutions, Machines
Status: Active

Automated decision-making provokes a range of anxieties around transparency, equality, and accountability. A key response has been the call to ‘re-humanise’ automated decisions, with the hope that human control of automated systems might defend human values from mindless technocracy. Regulation of automated decision-making and AI often embeds this form of human centrism by prescribing a ‘human in the loop’ and the need for automated decisions to be ‘explained’. These requirements are central elements of the risk-based approaches AI regulation currently in development.

Despite their intuitive appeal, empirical research is revealing the limitations and complexities of these approaches. AI explanations sometimes provide little that is useful for decision subjects or decision makers, and risk distracting from more meaningful interrogation of why decisions are made. A human in the loop sometimes functions as a rubber stamp for automated decisions, cleaving accountability away from the true sites of decision responsibility.

This project seeks to generate better understandings of the functions, capacities, and normative role of humans within automated decision systems. It will investigate the ways that automated systems ought to explain or be explained to humans within decision processes, and how elements of decision-making including processes, responsibility, authority, and what counts as a decision itself, are fragmented and redistributed between humans, machines, and organisations. The goal is to generate empirical knowledge of how automated systems, humans, and organisations interact in different contexts when making decisions, and to move past outdated understandings of decisions-making that are hindering effective governance of automation in new decision contexts.

RESEARCHERS

Jake Goldenfein

Dr Jake Goldenfein

Lead Investigator,
University of Melbourne

Learn more

ADM+S Associate Director Jean Burgess

Prof Jean Burgess

Chief Investigator,
QUT

Learn more

Paul Henman headshot

Prof Paul Henman

Chief Investigator,
University of Queensland

Learn more

ADM+S Chief Investigator Christopher Leckie

Prof Chris Leckie

Chief Investigator,
University of Melbourne

Learn more

Prof Flora Salim

Prof Flora Salim

Chief Investigator,
UNSW

Learn more

Distinguished Professor Julian Thomas

Prof Julian Thomas

Chief Investigator,
RMIT University

Learn more

Kim Weatherall

Prof Kim Weatherall

Chief Investigator,
University of Sydney

Learn more

Henry Fraser

Dr Henry Fraser

Research Fellow,
QUT

Learn more

Awais Hameed Khan profile image

Dr Awais Hameed Khan

Research Fellow,
UQ

Learn more

Christopher O'Neill

Dr Chris O’Neil

Research Fellow,
Monash University

Learn more

Ash Watson

Dr Ash Watson

Research Fellow,
UNSW

Learn more

Fan Yang

Dr Fan Yang

Research Fellow,
University of Melbourne

Learn more

Jenny Kennedy

Libby Young

PhD Student
University of Sydney

Learn more

Fabio Mattioli

Dr Fabio Mattioli

Affiliate
University of Melbourne

Learn more

Australian Digital Inclusion Index Project

PROJECT SUMMARY

Indigenous child on computer

Australian Digital Inclusion Index Project

Focus Areas: News & Media, Social Services, Mobilities, Health
Research Program: People
Status: Active

Digital inclusion is about ensuring that all Australians can access and use digital technologies effectively. We are experiencing an accelerating digital transformation in many aspects of economic and social life. Our premise is that everyone should have the opportunity to benefit from digital technologies: to manage their health, access education and services, participate in cultural activities, organise their finances, follow news and media, and connect with family, friends, and the wider world.

The Australian Digital Inclusion Index (ADII or “Index”) uses survey data to measure digital inclusion across three dimensions of Access, Affordability and Digital Ability. We explore how these dimensions vary across the country and across different social groups.

In partnership with Telstra and through biennial data collections presented through reports and data visualisation dashboards, the ADII is capturing and communicating the evolving state of digital inclusion in Australia. This is complemented by aligned sub-projects with local, state and federal government departments and community partners to drill down into specific digital inclusion challenges for social groups or geographical regions of interest.

A detailed measure of digital inclusion for Australia allows us to identify the critical barriers to inclusion. These may be related to accessing networks, the costs of devices or data, or skills and literacies. Through these measures, the Index shapes digital equity policy and initiatives, research, and practice to increase digital inclusion in Australia.

Visit the ADII website 

RESEARCHERS

Distinguished Professor Julian Thomas

Prof Julian Thomas

Chief Investigator,
RMIT University

Learn more

ADM+S Chief Investigator Anthony McCosker

Prof Anthony McCosker

Chief Investigator,
Swinburne University

Learn more

Jenny Kennedy

Dr Jenny Kennedy

Associate Investigator,
RMIT University

Learn more

Sharon Parkinson

Dr Sharon Parkinson

Associate Investigator,
Swinburne University

Learn more

Kieran Hegarty

Kieran Hegarty

Research Fellow,
RMIT University

Learn more

RESEARCHER SUPPORT

Lucy Valenta profile image

Lucy Valenta

Research Coordinator,
RMIT University

Learn more

PARTNERS

Telstra

Telstra

Visit website

Is Pricing Discriminatory: Testing Automated Decision-Making Systems in Online Insurance Markets

PROJECT SUMMARY

Is Pricing Discriminatory: Testing Automated Decision-Making Systems in Online Insurance Markets

Focus Areas: News & Media, Social Services, Mobilities, Health
Research Program: Data
Status: Active

Advances in data-driven and AI systems are driving significant transformation in the emerging insurance technology (insurtech) sector.

This project investigates the extent to which automated decision-making systems impact the provision of consumer insurance via pricing algorithms which may produce unfair outcomes for particular subsets of society by engaging in proxy and price discrimination.

RESEARCHERS

Kelly Lewis

Dr Kelly Lewis

Lead Investigator,
Monash University

Learn more

Mark Andrejevic

Prof Mark Andrejevic

Chief Investigator,
Monash University

Learn more

Daniel Angus

Prof Daniel Angus

Chief Investigator,
QUT

Learn more

Kim Weatherall

Prof Kim Weatherall

Chief Investigator,
University of Sydney

Learn more

Zofia Bednarz

Dr Zofia Bednarz

Associate Investigator,
University of Sydney

Learn more

Jathan Sadowski

Dr Jathan Sadowski

Associate Investigator,
Monash University

Learn more

ADM+S professional staff Abdul Obeid

Dr Abdul Obeid

Data Engineer,
QUT

Learn more

PARTNERS

CHOICE

Visit website

Consumer Policy Research Centre Logo

Consumer Policy Research Centre

Visit website

Automation and Public Space

PROJECT SUMMARY

LiDAR sensing concept

Automation and Public Space

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Data
Status:
 Active

From delivery drones to digital twins to crowd surveillance, automated decision-making technologies and practices are increasingly impacting public and shared space. This project investigates how automated decision-making systems impact public and shared space via sensors that produce actionable digital simulations, artefacts, and interfaces. Through a mixed methods approach, it will examine current and potential effects of automated decision-making on the form, use, and experience of public space.

Technological development in this area is undergoing rapid change. Delivery via autonomous drone requires sensor-driven navigation systems, but the data and models they produce about public space will likely lead to modulations of that space in response. In urban and environmental governance, ‘digital twins’ are increasingly to monitor environments in real-time, simulate the impact of potential changes, and even implement those changes directly. Technologies such as these are not only increasingly deployed in Australia, but are also invented, designed, and tested here too, often in proximity to defence and defence industries.

Understanding how tools of automated spatiality reconfigure environments and the role of policy and industry in their innovation and uptake will generate new knowledge about a critical point of convergence between public space, technology, defence, and industry with national significance, as well as implications for international jurisdictions facing similar changes and challenges.

Over 3 years commencing in 2022, the project aims to answer the following questions:
• How is space-making automated across different technologies and contexts? What logics, techniques and practices are shared? What are distinct to different contexts?
• How does automated spatiality lead to the reconfiguring of public space?
• How are digital infrastructures, such as unmanned traffic management systems for civilian airspace, imagined, organised, and regulated?
• How do policy settings, industrial demands, and defence priorities shape the development and application of technologies of automated spatiality?

RESEARCHERS

Michael Richardson

Assoc Prof Michael Richardson

Lead Investigator,
UNSW

Learn more

Mark Andrejevic

Prof Mark Andrejevic

Chief Investigator,
Monash University

Learn more

Jake Goldenfein

Dr Jake Goldenfein

Chief Investigator,
University of Melbourne

Learn more

ADM+S Chief Investigator Anthony McCosker

Prof Anthony McCosker

Chief Investigator,
Swinburne University

Learn more

Jathan Sadowski

Dr Jathan Sadowski

Associate Investigator,
Monash University

Learn more

Rowan Wilken

Assoc Prof Rowan Wilken

Associate Investigator,
RMIT University

Learn more

Kelly Lewis

Dr Kelly Lewis

Research Fellow,
Monash University

Learn more

Christopher O'Neill

Dr Chris O’Neill

Research Fellow,
Monash University

Learn more

Thao Phan

Dr Thao Phan

Research Fellow,
Monash University

Learn more

Zoe Horn

Zoe Horn

PhD Student,
Western Sydney University

Learn more

Lauren Kelly

Lauren Kelly

Student,
RMIT University

Learn more

Andrew Brooks

Dr Andrew Brooks

Affiliate,
UNSW

Learn more

PARTNERS

OVIC Logo

Office of the Victorian Information Commissioner

Learn more

Risk, Rule-setters and Rule-takers: Regulatory approaches to risk in AI-supported and AI-automated decision-making for general welfare

PROJECT SUMMARY

Crowd in motion in busy precinct

Risk, Rule-setters and Rule-takers: Regulatory approaches to risk in AI-supported and AI-automated decision-making for general welfare

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Programs: Institutions
Status: Active

This project seeks to scope several approaches to deal with Automated Decision-Making and Decision-Support Systems-Related Risks (ADM/DSS RR) through norms and provide an evaluation of those approaches for their consideration in regulatory contexts.

The standpoint is to look at risk control of those systems beyond ethics or social principles and focus the discussion on the possible interventions from the regulator’s perspective.

The overarching questions and sub-questions guiding this project are:

  • What is risk in an ADM / DS System?
    – Is it possible to define it?
    – How is it different from technological risk?
    – How is it different from the concept of risk in
    management?
    – Are all “potential harms” risks of and ADM/DSS?
    – Is there a concept of risk usable for regulatory
    purposes?
  • What types of risks are common and which ones specific to ADM/DSS?
    – Due to the nature of the risk?
    – Due to the scale of the risk?
  • What is an acceptable risk:
    – From the point of view of society as a whole
    – From the point of view of the most vulnerable groups
    – From the point of view of the owner of the AI system
    – From the point of view of the users of the system
  • Can risk be separated from questions of liability/ responsibility or do they need to be regulated together?

RESEARCHERS

Kimberlee Weatherall

Prof Kimberlee Weatherall

Chief Investigator,
University of Sydney

Learn more

ADM+S Chief Investigator Nic Suzor

Prof Nicolas Suzor

Chief Investigator,
QUT

Learn more

José-Miguel Bello y Villarino

Dr José-Miguel Bello Villarino

Research Fellow,
University of Sydney

Learn more

Henry Fraser

Dr Henry Fraser

Research Fellow,
QUT

Learn more

PARTNERS

Gradient Institute logo

Gradient Institute

Learn more

The Toxicity Scalpel: Prototyping and evaluating methods to remove harmful generative capability from foundation models

PROJECT SUMMARY

Person with colourful text overlay

The Toxicity Scalpel: Prototyping and evaluating methods to remove harmful generative capability from foundation models

Focus Areas: News and Media
Research Programs: Machines
Status: Active

AI language models have made significant strides over the past few years. Computers are now capable of writing poetry and computer code, producing human-like text, summarising documents, engaging in natural conversation about a variety of topics, solving math problems, and translating between languages.

This rapid progress has been made possible by a trend in AI development where one general ‘foundational’ model is developed (usually using a large dataset from the internet) and then adapted many times to fit diverse applications, rather than beginning from scratch each time.

This method of ADM development can appear time and cost effective, but ‘bakes in’ negative tendencies like the creation of toxic content, misogyny, or hate speech at the foundational layer, which subsequently spread to each downstream application.

The goal of this project is to examine how language models used in ADM systems might be improved by making modifications at the foundation model stage, rather than at the application level, where computational interventions, social responsibility, and legal liability have historically focussed.

[This project description was generated by summarising parts of the project proposal document using a language model AI].

RESEARCHERS

ADM+S Investigator Flora Salim

Prof Flora Salim

Chief Investigator,
UNSW

Learn more

ADM+S Chief Investigator Nic Suzor

Prof Nic Suzor

Chief Investigator,
QUT

Learn more

Hao Xue

Dr Hao Xue

Associate Investigator,
UNSW

Learn more

Dr Aaron Snoswell

Dr Aaron Snoswell

Research Fellow,
QUT

Learn more

Lucinda Nelson

Lucinda Nelson

PhD Student,
QUT

Learn more

Assessing Prospective Harms (vs Benefits) associated with ADM

PROJECT SUMMARY

Two people looking at computer screens

Assessing Prospective Harms (vs Benefits) associated with ADM

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Programs: Data, Machines, Institutions
Status: 
Completed

The project (which is now completed) was set up as a preliminary exercise in assessing prospective harms vs prospective benefits associated with ADM as a first step to amelioration. It took a two-pronged approach: firstly, focusing on individual and social harms/costs that may be associated with automated or semi-automated data processing (including collection, retention, dissemination, and other uses of data) – versus prospective benefits; and secondly, assessing the levels of risk of these harms ranging from nebulous to very significant (and acknowledging there may be
uncertain outcomes and uneven distributions). The overall aim was thus to have a fuller appreciation of harms and risks as a precursor to thinking practically about amelioration/mitigation of costs.

More specifically, the project was geared to questions of elaborating and understanding the range of prospective harms associated with loss of control over data processing for individuals, groups and society, and indeed the entirety of the living world, as a first step to finding solutions such as changes in law, or social practices, or business methods, or technologies (or some combination of these).

The principal activity of the project was to have a series of workshops planned, organised and hosted by the coordinators CI Richardson, AI Roberts and Postdoc Jiménez (with administrator Astari.Kusumawardani providing support). The workshops featured the work of diverse ADM+S CIs, AIs, Researchers and Affiliates and adopted an intense mode of interrogation and discussion along with suggestions. The aim was to assist ADMS personnel with the preparation of reports, books and scholarly articles (as well as share insights and ideas).

Topics and presenters in the workshop series included the following:
•March: Aitor Jiménez (Megan Richardson chair), Crimes of digital capitalism
•March: Ariadna Matamoros- Fernández, Rosalie Gillett, Anjalee de Silva (Aitor Jiménez chair), •Gendered harm
•April: José-Miguel Bello Villarino, Henry Fraser (Megan Richardson chair), Where residual risks reside: a comparative approach to AI risk management under the EU’s AI Act Proposal
•April: Jake Goldenfein (Megan Richardsonchair) How competing constructions of humans legitimize online advertising
•May: Simon Coghlan, Christine Parker (Andy Roberts, chair), A preliminary framework for understanding how ADM/AI technologies can harm non-human animals
•June: Lisa Archbold (Andy Roberts chair), Children’s developmental privacy
•July: Frank Pasquale/Jeannie Paterson (Megan Richardson chair: co-hosted with CAIDE), Automated grace: toward more humane benefits administration via AI
•August: James Meese (Megan Richardson chair), Regulating news recommendation: looking beyond harm
•September: Megan Richardson (Jeannie Paterson chair – co-hosted with CAIDE), Trust norms and data rights
•October: Ariadna Matamoros- Fernández, Louisa Bartolo, Luke Troynar (Aitor Jiménez chair), Addressing harmful humour as an online safety issue
•November: Damian Clifford (Megan Richardson chair), Data protection and (in)accuracy

RESEARCHERS

ADM+S Investigator Christine Parker

Prof Christine Parker

Lead Investigator,
University of Melbourne

Learn more

Jake Goldenfein

Dr Jake Goldenfein

Chief Investigator,
University of Melbourne

Learn more

Kim Weatherall

Prof Kim Weatherall

Chief Investigator,
University of Sydney

Learn more

Zofia Bednarz

Dr Zofia Bednarz

Associate Investigator,
University of Sydney

Learn more

Simon Coghlan

Dr Simon Coghlan

Associate Investigator,
University of Melbourne

Learn more

ADM+S Chief Investigator Andrew Kenyon

Prof Andrew Kenyon

Associate Investigator,
University of Melbourne

Learn more

Ariadna Matamoros Fernandez profile picture

Dr Ariadna Matamoros-Fernández

Associate Investigator,
QUT

Learn more

James Meese

Dr James Meese

Associate Investigator,
RMIT University

Learn more

Andrew Roberts

Prof Andrew Roberts

Associate Investigator,
University of Melbourne

Learn more

ADM+S Investigator Ivana Jurko

Ivana Jurko

Partner Investigator,
Red Cross Australia

Learn more

José-Miguel Bello y Villarino

Dr José-Miguel Bello Villarino

Research Fellow,
University of Sydney

Learn more

Anjalee de Silva

Dr Anjalee de Silva

Research Fellow,
University of Melbourne

Learn more

Henry Fraser

Dr Henry Fraser

Research Fellow,
QUT

Learn more

Dr Rosalie Gillett profile picture

Dr Rosalie Gillett

Research Fellow,
QUT

Learn more

Aitor Jiménez

Dr Aitor Jiménez

Research Fellow,
University of Melbourne

Learn more

Damian Clifford

Dr Damian Clifford

Affiliate,
ANU

Learn more

ADM+S Investigator Fiona Haines

Prof Fiona Haines

Affiliate,
University of Melbourne

Learn more

Kobi Leins

Dr Kobi Leins

Affiliate,
King’s College

Learn more

Jeannie Paterson

Prof Jeannie Paterson

Affiliate,
University of Melbourne

Learn more

ADM+S Chief Investigator Megan Richardson

Prof Megan Richardson

Affiliate,
University of Melbourne

Learn more

PARTNERS

OVIC Logo

Office of the Victorian Information Commissioner (OVIC)

Learn more

Enabling digital transformation and considering digital futures within the cultural sector: Evaluating ACMI’s CEO digital mentoring project

PROJECT SUMMARY

ACMI building in the evening

Enabling digital transformation and considering digital futures within the cultural sector: Evaluating ACMI’s CEO digital mentoring project

Focus Area: News & Media
Research Program: Institutions
Status: Completed

This research investigated the enablers of digital transformation and considers digital futures within the cultural sector through evaluating the outcomes of ACMI’s CEO Digital Mentoring Program.

Funded by the Ian Potter Foundation and delivered in conjunction with the Australia Council, ACMI’s CEO Digital Mentoring Program offered strategic technology and digital mentoring for senior decision-making staff within the Australian cultural sector.

With digital platforms fundamentally reshaping how cultural content is created, distributed, and consumed, this research considered how cultural organisations might be better equipped to, and supported in, adopting, managing, and mitigating the risks associated with increasingly advanced technologies.

RESEARCHERS

Indigo Holcombe-James

Dr Indigo Holcombe-James

Lead Investigator

Learn more

Stephanie Livingstone

Stephanie Livingstone

PhD Student

Learn more

PARTNERS

Public Interest Litigation for AI Accountability

PROJECT SUMMARY

Woman sitting down with laptop

Public Interest Litigation for AI Accountability

Focus Areas: News and Media, Health, Social Services, Transport and Mobilities
Research Program: Institutions
Status: Active

If you have been harmed by bad automated decision-making, from robots to loan assessments, what can you do to right the wrong? What can the law do to help you? A growing number of public controversies about discriminatory, unpredictable and dangerous automated decision-making has raised questions about the most effective methods of accountability.

Through qualitative interviews with stakeholders (including class action and pro bono lawyers), this project seeks to identify the opportunities, enablers and barriers for public interest litigation to promote accountability and fairness in automated decision-making.

RESEARCHERS

ADM+S Chief Investigator Nic Suzor

Prof Nicolas Suzor

Lead Investigator,
QUT

Learn more

Henry Fraser

Dr Henry Fraser

Research Fellow,
QUT

Learn more

Zahra Stardust profile picture

Dr Zahra Stardust

Research Fellow,
QUT

Learn more

Political Economy of Sex Tech

PROJECT SUMMARY

Three hearts displayed on an LED screen

Political Economy of Sex Tech

Focus Area: News & Media
Research Programs: Data, Institutions
Status: Active

Smart sex technologies and networked apps are being used in sex and relationship education, to enhance sexual wellness and to improve sexual and reproductive health. To do so, they collect and process substantial amounts of intimate data. This project examines the political economy of ‘sex tech’ in order to identify how sexual technologies are being governed at scale, how sexual data is being collected, stored, shared and monetised, and how the material benefits of sex tech may be more equitably distributed.

It will provide empirical grounding to enrich scholarship on ethical data governance, predictive profiling and accountability of smart technologies.

RESEARCHERS

Zahra Stardust profile picture

Dr Zahra Stardust

Lead Investigator,
QUT

Learn more

Automating safety: developing better data models to help foster prosocial platforms

PROJECT SUMMARY

Blurred people crossing street

Automating safety: developing better data models to help foster prosocial platforms

Focus Area: News & Media
Research Program: Data
Status: Active

This project identifies how misunderstandings of harm and safety flow into flawed data logics and ineffective automated digital platform responses. To date, platforms have presented the principal unit of harm as individual pieces of content or media objects.

Based on this assumption, platforms’ responses to harm have primarily focused on moderating discrete pieces of content.

RESEARCHERS

ADM+S Associate Director Jean Burgess

Prof Jean Burgess

Lead Investigator,
QUT

Learn more

ADM+S Chief Investigator Nic Suzor

Prof Nic Suzor

Chief Investigator,
QUT

Learn more

Dr Rosalie Gillett profile picture

Dr Rosalie Gillett

Research Fellow,
QUT

Learn more

ADM+S professional staff Abdul Obeid

Dr Abdul Obeid

Data Engineer,
QUT

Learn more

Automated Content Regulation (Disinformation and Political Bias)

PROJECT SUMMARY

A group of people using mobile phones

Automated Content Regulation (Disinformation and Political Bias)

Focus Area: News & Media
Research Program: Data
Status: Active

This project will evaluate the moderation of social media content, which has become radically more reliant on machine learning classifiers during the Covid-19 pandemic. We examine moderation at this time through two case studies, which aim to:

  1. Test allegations of political bias in the removal of tweets, and
  2. Identify coordinated bot activity involved in spreading misinformation and the moderation responses of platforms.

Ultimately, this project will provide new knowledge about particular case studies, import insights into trends across cases and time, and new methodological techniques for assessing automated content moderation on social media platforms.

RESEARCHERS

ADM+S Chief Investigator Nic Suzor

Prof Nic Suzor

Lead Investigator,
QUT

Learn more

ADM+S Associate Director Jean Burgess

Prof Jean Burgess

Chief Investigator,
QUT

Learn more

ADM+S Chief Investigator Andrew Kenyon

Prof Andrew Kenyon

Chief Investigator,
University of Melbourne

Learn more

ADM+S Investigator Timothy Graham

Dr Timothy Graham

Associate Investigator,
QUT

Learn more

PARTNERS

American University, Washington, DC Logo

American University

Learn more

Ecological Implications of Data Centres

PROJECT SUMMARY

Data centre

Ecological Implications of Data Centres

Focus Areas: News and Media, Transport and Mobility, Health, Social Services
Research Program: Institutions
Status: Active

The project seeks to understand how companies, public agencies and civil society address the environmental conditions and limitations facing the establishment and management of data centres and submarine cables in urban and coastal areas.

A central part of data centre management is heat management: servers produce heat, and as they are gathered in large numbers in close areas, temperatures rise raising the risk of fire. To overcome this, data centre operators have various techniques to cool down these facilities and avoid any risks of data loss caused by fires. Moreover, when landing, telecom subsea cables risk to damage the local biodiversity (especially marine plants).

Thus, this project will ask: what shapes the environmental impacts of data centres cooling infrastructures? What are the ecological implications involved with the landing of a telecom submarine cable or the creation of a new data centre? How are these ecological impacts made visible to stakeholders? To what extent do environmental assessments succeed in reconciling the various interests at stake (security of infrastructures, maritime trade, marine biodiversity) in the passage of a telecomunication cable? How do ecological and infrastructural vulnerabilities of both data centers and telecom submarine cables shape the world-wide interconnection of data at the heart of the digital economy?

In order to address this question, we will take as a case study the rapid growth of data centres and telecommunication subsea cables in Marseille (France), which is particularly interesting as this city is in a warm climate, making the issue of heat management more difficult there than in the north of Europe.

This project is conducted by ADM+S Research Fellow Dr Loup Cellard in collaboration with Dr Clément Marquet (Mines Paris).

RESEARCHERS

ADM+S Investigator Christine Parker

Prof Christine Parker

Lead Investigator,
University of Melbourne

Learn more

ADM+S Investigator Karen Yeung

Prof Karen Yeung

Partner Investigator,
University of Birmingham

Learn more

Loup Cellard

Dr Loup Cellard

Affiliate,
Datactivist Coop

Learn more

ADM+S Investigator Fiona Haines

Prof Fiona Haines

Affiliate,
University of Melbourne

Learn more

PARTNERS

Université de Technologie de Compiègne Logo

Université de Technologie de Compiègne

Learn more

University of Birmingham

Learn more

Platform governance of and by bots

PROJECT SUMMARY

Phone with chatbot

Platform governance of and by bots

Focus Area(s): News & Media
Research Program: Data
Status: Active

This project brings together expertise in digital media, platform studies, and law with data science and machine learning to study the roles and data operations of bots – pre-programmed automated agents – on social media platforms. It aims to map, describe and evaluate the ways that platforms and their users make use of automated agents in governance and community management, and the competing norms and values associated with these practices.

It also examines how platforms and their communities engage in the governance of bots, including through automated moderation and technical limitations. We expect to develop new methods for the public oversight and evaluation of platform governance; as well as to understand why and how bots are understood, valued, and managed in online communities, and to suggest the implications for the benefits of bots for transparent platform governance, including by user communities.

The objectives of this project include:
Undertake a detailed empirical investigation of the role of ‘official’, sanctioned, and user-created bots in governing and managing platform cultures, and the implications of these uses of bots for equality, transparency, and user experience.

Through the data-driven analysis of a particular bot-related controversy, conduct a detailed case study of the norms attached to ‘coordination’ and ‘bot-like’ (or ‘inauthentic’) behaviour on Reddit, and how these norms are enacted and contested through community-led platform governance.
Develop new and updated frameworks for identifying and promoting the pro-social and beneficial uses of bots by platforms and their user communities.

RESEARCHERS

ADM+S Investigator Timothy Graham

Dr Timothy Graham

Lead Investigator,
QUT

Learn more

ADM+S Associate Director Jean Burgess

Prof Jean Burgess

Lead Investigator,
QUT

Learn more

Daniel Angus

Prof Daniel Angus

Chief Investigator,
QUT

Learn more

Axel Bruns

Prof Axel Bruns

Chief Investigator,
QUT

Learn more

ADM+S Chief Investigator Nic Suzor

Prof Nicolas Suzor

Chief Investigator,
QUT

Learn more

Transparent Machines: From Unpacking Bias to Actionable Explainability

PROJECT SUMMARY

Person typing on computer

Transparent Machines: From Unpacking Bias to Actionable Explainability

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Machines
Status: Active

ADMs, their software, algorithms, and models, are often designed as “black boxes” with little efforts placed on understanding how they work. This lack of understanding does not only impact the final users of ADMs, but also the stakeholders and the developers, who need to be accountable for the systems they are creating. This problem is often exacerbated by the inherent bias coming from the data from which the models are often trained on.

Further, the wide-spread usage of deep learning models has led to increasing number of minimally-interpretable models being used, as opposed to traditional models like decision trees, or even Bayesian and statistical machine learning models.

Explanations of models are also needed to reveal potential biases in the models themselves and assist with their debiasing.

This project aims to unpack the biases in models that may come from the underlying data, or biases in software (e.g. a simulation) that could be designed with a specific purpose and angle from the developers’ point-of-view. This project also aims to investigate techniques to generate diverse, robust and actionable explanations for a range of problems and data types and modality, from large-scale unstructured data, to highly varied sensor data and multimodal data. To this end, we look to generate counterfactual explanations that have a shared dependence on the data distribution and the local behaviour of the black-box model by level, and offer new metrics in order to measure the opportunity cost of choosing one counterfactual over another. We further aim to explore the intelligibility of different representations of explanations to diverse audiences through an online user study.

RESEARCHERS

ADM+S Investigator Flora Salim

Prof Flora Salim

Lead Investigator,
UNSW

Learn more

Daniel Angus

Prof Daniel Angus

Chief Investigator,
QUT

Learn more

ADM+S Chief Investigator Paul Henman

Prof Paul Henman

Chief Investigator,
University of Queensland

Learn more

ADM+S Chief Investigator Mark Sanderson

Prof Mark Sanderson

Chief Investigator,
RMIT University

Learn more

Jeffrey Chan

Dr Jeffrey Chan

Associate Investigator,
RMIT University

Learn more

ADM+S Chief Investigator Falk Scholer

Prof Falk Scholer

Associate Investigator,
RMIT University

Learn more

ADM+S Investigator Damiano Spina

Dr Damiano Spina

Associate Investigator,
RMIT University

Learn more

ADM+S Investigator Maarten de Rijke

Prof Maarten de Rijke

Partner Investigator,
University of Amsterdam

Learn more

Peibo Li

Peibo Li

PhD Student,
UNSW

Learn more

Edward Small

Edward Small

PhD Student,
RMIT University

Learn more

Kacper Sokol

Kacper Sokol

Affiliate,
ETH Zurich

Learn more

PARTNERS

University of Amsterdam logo

University of Amsterdam

Visit website

Quantifying and Measuring Bias and Engagement

PROJECT SUMMARY

Man working on laptop

Quantifying and Measuring Bias and Engagement

Focus Areas: News & Media, Health
Research Programs: Machines, Data
Status: Active

Automated decision-making systems and machines – including search engines and intelligent assistants – are designed, evaluated, and optimised by defining frameworks that model the users who are going to interact with them. These models are typically a simplified representation of users (e.g., using the relevance of items delivered to the user as a surrogate for system quality) to operationalise the development process of such systems. A grand open challenge is to make these frameworks more complete, by including new aspects such as fairness, that are as important as the traditional definitions of quality, to inform the design, evaluation and optimisation of such systems.

Recent developments in machine learning, information access, and AI communities attempt to define mechanisms to minimise the creation and reinforcement of unintended cognitive biases.

However, there are a number of research questions related to quantifying and measuring bias and engagement that remain unexplored:
– Is it possible to measure bias by observing users interacting with search engines, or intelligent assistants?
– How do users perceive fairness, bias, or trust? How can these perceptions be measured effectively?
– To what extent can sensors in wearable devices and interaction logging (e.g., search queries, app swipes, notification dismissal, etc) inform the measurement of bias and engagement?
– Are the implicit signals captured from sensors and interaction logs correlated with explicit human ratings w.r.t. bias and engagement?

The research aims to address the research questions above by focusing on information access systems that involve automated decision-making components. By partnering with experts in fact-checking, we use misinformation management as the main scenario of study, given that bias and engagement play an important role in three main elements of the automated decision-making processes: the user, the system, and the information that is presented and consumed.

The methodologies considered to address these questions include lab user studies (e.g., observational studies), and the use of crowdsourcing platforms (e.g., Amazon Mechanical Turk). The data collection processes include: logging human-system interactions; sensor data collected using wearable devices; and questionnaires.

RESEARCHERS

Dr Damiano Spina

Dr Damiano Spina

Lead Investigator,
RMIT University

Learn more

ADM+S Chief Investigator Anthony McCosker

Assoc Prof Anthony McCosker

Chief Investigator,
Swinburne University

Learn more

ADM+S Investigator Flora Salim

Prof Flora Salim

Chief Investigator,
UNSW

Learn more

ADM+S Chief Investigator Mark Sanderson

Prof Mark Sanderson

Chief Investigator,
RMIT University

Learn more

ADM+S Associate Investigator Jenny Kennedy

Dr Jenny Kennedy

Associate Investigator,
RMIT University

Learn more

ADM+S Chief Investigator Falk Scholer

Prof Falk Scholer

Associate Investigator,
RMIT University

Learn more

Danula Hettiachchi

Dr Danula Hettiachchi

Research Fellow,
RMIT University

Learn more

Person icon

Nuha Abu Onq

PhD Student,
RMIT University

Marwah Alaofi

Marwah Alaofi

PhD Student,
RMIT University

Learn more

Person icon

Hmdh Alknjr

PhD Student,
RMIT University

Danula Hettiachchi

Sachin Cherumanal

PhD Student,
RMIT University

Learn more

Kaixin Ji

Kaixin Ji

PhD Student,
RMIT University

Learn more

PARTNERS

ABC logo

Australian Broadcasting Corporation

Visit website

AlgorithmWatch Logo

Algorithm Watch (Germany)

Visit website

Bendigo Health logo

Bendigo Hospital

Visit website

Google Logo

Google Australia

Visit website

RMIT ABC Fact Check Logo

RMIT ABC Fact Check

Visit website

Governing ADM Use

PROJECT SUMMARY

Blurred people in busy precinct

Governing ADM Use

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Institutions
Status: Active

The Governing ADM Use Project was an ‘umbrella’ project designed to seed the work of the ADM+S Institutions program in the rapidly evolving area of ADM and AI regulation. The project conceives the challenge of governing ADM use as a multi layered network incorporating the regulation of the use of ADM by government authorities, the regulation by government of ADM use in the commercial and private sector, and the interaction of ADM-specific regulation and governance with a range of other areas of law, regulation and governance that impinge and interact (more or less directly) with the specific governance of ADM/AI.

This latter category extends from data and privacy regulation to competition and consumer protection and beyond to sector and problem specific areas of regulation such as energy regulation, worker health and safety, labour force regulation and importantly environmental and planning laws. This program of work has sought to understand the special role of law as well as broader influences on public and private sector ADM use, and how these change – or need to change – to respond to the impacts of automation. A particular feature of this program of work has been to expand our understanding of the eco-system of law and governance properly concerned with regulating ADM/AI to include how we govern the ecological impact of ADM/AI use.

RESEARCHERS

ADM+S Investigator Christine Parker

Prof Christine Parker

Lead Investigator,
University of Melbourne

Learn more

ADM+S Chief Investigator Megan Richardson

Prof Megan Richardson

Lead Investigator,
University of Melbourne

Learn more

Jake Goldenfein

Dr Jake Goldenfein

Chief Investigator,
University of Melbourne

Learn more

Kim Weatherall

Prof Kim Weatherall

Chief Investigator,
University of Sydney

Learn more

ADM+S Investigator Karen Yeung

Prof Karen Yeung

Partner Investigator,
University of Birmingham

Learn more

José-Miguel Bello y Villarino

Dr José-Miguel Bello y Villarino

Research Fellow,
University of Sydney

Learn more

Henry Fraser

Dr Henry Fraser

Research Fellow,
QUT

Learn more

Aitor Jiménez

Dr Aitor Jiménez

Research Fellow,
University of Melbourne

Learn more

Loup Cellard

Dr Loup Cellard

Affiliate,
Datactivist Coop

Learn more

ADM+S Investigator Fiona Haines

Prof Fiona Haines

Affiliate,
University of Melbourne

Learn more

Democratic Practices of Governance Given ADM

PROJECT SUMMARY

Busy street crossing aerial view

Democratic Practices of Governance Given ADM

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Institutions
Status: Active

This project examines possibilities for democratic practice, institutions and governance given automated decision-making (ADM). It focuses on challenges to and opportunities for liberal and democratic institutions and governance presented by ADM. The project aims to bridge analysis of ADM’s deployment across different domains with scholarly literature on republican and positive freedom, the rule of law and liberal democratic rights.

Overall, the project seeks to develop a theoretically rich analysis of democracy and freedom given ADM and apply the analysis to specific examples of current regulatory and democratic challenge.

RESEARCHERS

ADM+S Investigator Christine Parker

Prof Christine Parker

Lead Investigator,
University of Melbourne

Learn more

Mark Andrejevic

Prof Mark Andrejevic

Chief Investigator,
Monash University

Learn more

Jake Goldenfein

Dr Jake Goldenfein

Chief Investigator,
Melbourne University

Learn more

Distinguished Professor Julian Thomas

Prof Julian Thomas

Chief Investigator,
RMIT University

Learn more

ADM+S Investigator Sarah Erfani

Dr Sarah Erfani

Associate Investigator,
University of Melbourne

Learn more

Andrew Roberts

Prof Andrew Roberts

Associate Investigator,
University of Melbourne

Learn more

ADM+S Investigator Ivana Jurko

Ivana Jurko

Partner Investigator,
Red Cross Australia

Learn more

Anjalee de Silva

Dr Anjalee de Silva

Research Fellow,
University of Melbourne

Learn more

Aitor Jiménez

Dr Aitor Jiménez

Research Fellow,
University of Melbourne

Learn more

Chathurika Akurugoda

Chathurika Akurugoda

PhD Student,
University of Melbourne

Learn more

Lisa Archbold

Lisa Archbald

PhD Student,
University of Melbourne

Learn more

Phoebe Galbally

Phoebe Galbally

PhD Student,
University of Melbourne

Learn more

Avantik Tamta

Avantik Tamta

PhD Student,
University of Melbourne

Learn more

ADM+S Investigator Fiona Haines

Prof Fiona Haines

Affiliate,
University of Melbourne

Learn more

ADM+S Chief Investigator Megan Richardson

Prof Megan Richardson

Affiliate,
University of Melbourne

Learn more

The Coronavirus Impact

PROJECT SUMMARY

COVID19 Stay safe on mobile device

The Coronavirus Impact

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Data
Status:
 Active

This project focused on a publication output: a themed issue of the journal New Media & Society. Our theme proposal was accepted and the theme issue is in its final stages pre-publication. We are still waiting for comments on one article, but 10 articles have been accepted for publication by the journal and the introduction has been written. We are only waiting for the decision on the last outstanding article before submitting the complete package to the editors for final review. The entire issue ended up being written by Centre members.

The focus of the issue is on the range of roles played by automated decision making systems in the pandemic response. These range from the automated curation of news content to automated contact tracing and air quality management. Contributions came from all four focus areas of the Centre. The timeframe for the issue enabled the inclusion of articles that tracked the shift from pandemic to endemic and an analysis of the ways in which systems developed in response to the pandemic persisted or faded away.

RESEARCHERS

Mark Andrejevic

Prof Mark Andrejevic

Lead Investigator,
Monash University

Learn more

ADM+S Associate Director Jean Burgess

Prof Jean Burgess

Chief Investigator,
QUT

Learn more

ADM+S Chief Investigator Heather Horst

Prof Heather Horst

Chief Investigator,
Western Sydney University

Learn more

ADM+S Chief Investigator Sarah Pink

Prof Sarah Pink

Chief Investigator,
Monash University

Learn more

Gerard Goggin

Prof Gerard Goggin

Associate Investigator,
University of Sydney

Learn more

Ariadna Matamoros Fernandez profile picture

Prof Ariadna Matamoros-Fernandez

Associate Investigator,
QUT

Learn more

Christopher O'Neill

Assoc Prof Michael Richardson

Associate Investigator,
UNSW

Learn more

Rowan Wilken

Assoc Prof Rowan Wilken

Associate Investigator,
RMIT University

Learn more

Dr Silvia Montaña-Niño profile picture

Dr Silvia Montaña-Niño

Research Fellow,
QUT

Learn more

Christopher O'Neill

Dr Christopher O’Neil

Research Fellow,
Monash University

Learn more

Dr Silvia Montaña-Niño profile picture

Dr Georgia van Toorn

Research Fellow,
UNSW

Learn more

PARTNERS

Australian Red Cross Logo

Australian Red Cross

Visit website

OVIC Logo

Victorian Information Commissioner

Visit website

Data & Society Research Institute (US)

Visit website

Data mapping and ADM to advance humanitarian action and preparedness

PROJECT SUMMARY

Volunteer charity workers

Data mapping and ADM to advance humanitarian action and preparedness

Focus Areas: News & Media, Social Services
Research Program: Data
Status: Active

Humanitarian organisations and other NGOs are undergoing significant digital transformation. In a complicated digital media environment, new analytics capabilities can improve the role and effectiveness of organisations like Australian Red Cross in building community resilience, expanding volunteer networks, and informing rapid response. New models are needed for building data capability within communities prone to disaster and emergency. This includes community-driven practices for gathering useful open access data and local knowledge to aid and automate decision-making in disaster preparedness.

This project aimed to explore the potential of data partnerships and local community data capability for improving humanitarian preparedness and response to emergency situations. It contributes to developing new techniques for improving data-driven mapping of community strengths, knowledge and resilience. The work will improve advocacy and preparedness and enhance Red Cross’s data analytics capability as the organisation seeks to work with and empower local communities.

The project’s interim report, Mapping Community Resources for Disaster Preparedness: Humanitarian Data Capability and Automated Futures, sets out background knowledge about open data and mapping practices for disaster response, prediction and preparedness. Building on stakeholder workshops and international collaboration, the Mapping Community Resources report presents a model for community-oriented, open access and strengths-based data mapping capability.

RESEARCHERS

ADM+S Chief Investigator Anthony McCosker

Assoc Prof Anthony McCosker

Lead Investigator,
Swinburne University

Learn more

Daniel Angus

Prof Daniel Angus

Chief Investigator,
QUT

Learn more

Kath Albury

Prof Kath Albury

Associate Investigator,
Swinburne University

Learn more

Jane Farmer

Prof Jane Farmer

Associate Investigator,
Swinburne University

Learn more

Peter Kamstra

Dr Peter Kamstra

Associate Investigator,
Swinburne University

Learn more

Rowan Wilken

Assoc Prof Rowan Wilken

Associate Investigator,
RMIT University

Learn more

ADM+S Investigator Ivana Jurko

Ivana Jurko

Partner Investigator,
Red Cross Australia

Learn more

PARTNERS

Australian Red Cross Logo

Australian Red
Cross

Visit website

Everyday Data Cultures

PROJECT SUMMARY

Businessman using cell phone on subway train

Everyday Data Cultures

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Data
Status: Completed

This project explored the role of everyday data practices and literacies in automated decision-making. Its primary contribution is the novel conceptual framework of everyday data cultures, which is based on the cultural studies of everyday life. As well as a number of papers and public talks, it produced a co-authored monograph: Everyday Data Cultures (Polity Press, 2022).

Members of this team used this framework in subsequent research that sought to integrate everyday community experience into data projects with our partners in a variety of sectors across aspects of all four of the Centre’s focus areas. It will be used in future work within the Centre seeking to make sense of the impact and take-up of Generative AI in daily life – at home, at work, and in intimate relationships.

RESEARCHERS

ADM+S Associate Director Jean Burgess

Prof Jean Burgess

Lead Investigator,
QUT

Learn more

ADM+S Chief Investigator Anthony McCosker

Assoc Prof Anthony McCosker

Chief Investigator,
Swinburne University

Learn more

Rowan Wilken

Assoc Prof Rowan Wilken

Associate Investigator,
RMIT University

Learn more

Kath Albury

Prof Kath Albury

Associate Investigator,
Swinburne University

Learn more

Mapping ADM Across Sectors

PROJECT SUMMARY

Blurred crowd of people

Mapping ADM Across Sectors

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Programs: Data, Machines, Institutions, and People
Status: Active

ADM systems have the potential to greatly improve the overall quality of life in society, but they may also exacerbate social, political, and economic inequality. The role they play in reinforcing, reproducing, and reconfiguring power relations is, as recent events demonstrate, a key concern with respect to the deployment of automated decision making systems. When such systems are used to decide how benefits, resources, services, or information are allocated in society, they bear directly on the character and quality of life in that society. We are interested in both the potential benefits of the deployment of the technology and the potential harms. We do not treat such systems in the abstract, but are centrally concerned with the social, political, and economic relations in which they are embedded and which shape their deployment. A key question for the ADM+S Centre, in other words, is not just how best to design and deploy the technology, but what economic and political arrangements are most compatible with their fair, ethical, responsible, and democratic use.

The Social Issues in Automated Decision-Making report brings together material collected from discussions with leaders in the Centre’s focus areas and feedback from an international collection of experts in their respective domains. For each focus area we followed a similar methodology for canvassing key social issues. We started by discussing key social issues with Focus Area leaders and their teams. We then canvassed the academic literature, reports by industry groups and relevant independent organisations, and media coverage. For each area, we sought to identify key applications of ADM and the possible social benefits and harms with which they are associated. We also sought to identify continuities in these social issues both within and across the Centre’s main focus areas.

This is neither a final nor a definitive report. It marks the first step in the Centre’s ongoing social issues mapping project. The document will develop over time to reflect the insights that emerge from ongoing collaborations.

Read the report.

RESEARCHERS

Mark Andrejevic

Prof Mark Andrejevic

Lead Investigator,
Monash University

Learn more

Paul Henman

Prof Paul Henman

Chief Investigator,
University of Queensland

Learn more

ADM+S Investigator Ramon Lobato

Assoc Prof Ramon Lobato

Associate Investigator,
RMIT University

Learn more

Jathan Sadowski

Dr Jathan Sadowski

Associate Investigator,
Monash University

Learn more

Kelly Lewis

Dr Kelly Lewis

Research Fellow,
Monash University

Learn more

Christopher O'Neill

Dr Christopher O’Neil

Research Fellow,
Monash University

Learn more

Georgia Van Toorn

Dr Georgia van Toorn

Research Fellow,
UNSW

Learn more

Ash Watson

Dr Ash Watson

Research Fellow,
UNSW

Learn more

Vaughan Wozniak-O'Connor

Dr Vaughan Wozniak-O’Connor

Research Fellow,
UNSW

Learn more

Daniel Binns

Dr Daniel Binns

Affiliate,
RMIT University

Learn more

Lyndal Sleep profile picture

Dr Lyndal Sleep

Affiliate,
Central Queensland University

Learn more

PARTNERS

OVIC Logo

Office of the Victorian Information Commissioner

Learn more

Australian Red Cross Logo

Australian Red Cross

Learn more

Mapping the Digital Gap

PROJECT SUMMARY

Two women sit in chairs. The woman on the left is wearing a dark blue tank top and is holding an iPad and they are both looking at. The woman on the right is wearing a black T-shirt with a white graphic on it
Co-researcher Guruwuy Ganambarr does survey with resident Alissia Wirrpanda in in Gäṉgaṉ Community, NT

Mapping the Digital Gap

Focus Area: News and Media
Research Program: People
Status: Active

Improving digital inclusion outcomes and access to services in remote Aboriginal and Torres Strait Islander communities is critically important for informed decision making and agency. People living in Australia’s 1100 remote Indigenous communities are likely to be among the most digitally excluded Australians. The Australian Digital Inclusion Index (ADII) found that people in remote communities often have extremely limited access to digital infrastructure and services and encounter very high costs for internet access, especially in relation to their income.

The Mapping the Digital Gap project is a four-year research project conducted by the ARC Centre of Excellence for Automated Decision Making and Society in partnership with Telstra. Working with 10-12 remote First Nations communities over three years, this project will:

  1. Generate a detailed account of the distribution of digital inclusion across Indigenous communities;
  2. Track changes in measures of digital inclusion for these communities over time;
  3. Inform the development and evaluation of appropriate local strategies for improving digital inclusion capabilities and services enabling informed decision making; and
  4. Provide evidence to inform policy and program resourcing by government and industry.

Research sites have been identified based on criteria to ensure a diverse national sample, and the research team is working closely with local and regional agencies on all community-based research and the analysis of results to ensure the project adheres to local policies and cultural protocols, community trust and engagement, and to ensure the research addresses local needs and provides benefit to the community.

The data collected through the Mapping the Digital Gap project will enable comparison with national results collected for the ADII. This will enable measurement and tracking of the scale of the digital gap for remote First Nations communities. With a new Closing the Gap target of equal levels of digital inclusion for Aboriginal and Torres Strait Islander people by 2026, this project aims to provide data to inform policy and programs to help close the digital gap.

OUTCOMES REPORT

Mapping the digital gap 2023 outcomes report

2023 Outcomes Report

27 September 2023

This first outcomes report provides an overview of the first year findings from 2022 research visits. It covers key survey results and indicators of the digital gap; context and findings for each of the ten research sites; and analysis of results across the three ADII dimensions of digital inclusion – Access, Affordability and Digital Ability – as well as the crucial role of service delivery and news and media access in these communities. Case studies, photos and quotes from interviews highlight the on-the-ground experience for residents and service providers across the research sites.

Read on APO

PUBLICATIONS

Wilcannia, NSW community outcomes report

23 June 2022

Read on APO

Mapping the digital gap - background paper

Background paper: project objectives, context and method

6 Oct 2022

Read on APO

Wujal Wujal, Queensland community outcomes report 2022

4 Oct 2022

Read on APO

Mapping the digital gap: Erub (Darnley Island), Zenadth Kes (Torres Strait) Queensland community outcomes report 2022

4 Nov 2022

Read on APO

Tennant Creek, Barkley region, Northern Territory community outcomes report 2022

17 Nov 2022

Read on APO

Yuelamu, Northern Territory community outcomes report 2022

6 Dec 2022

Read on APO

Mapping the digital gap Galiwinku report image

Galiwin’ku, East Arnhem Land NT community outcomes report 2022

21 Dec 2022

Read on APO

Gangan, Arnhem Land NT community outcomes report 2022

22 Mar 2022

Read on APO

Kalumburu report 2022

Kalumburu, Kimberleys, WA community outcomes report 2022

27 Mar 2023

Read on APO

2022 Djarindjin Lombadina report cover

Djarindjin and Lombadina, West Kimberley, WA, community outcomes report 2022

4 Apr 2023

Read on APO

Wadeye, NT community outcomes report 2022

11 Jun 2023

Read on APO

INQUIRIES

Please contact mtdg@rmit.edu.au with any inquiries

RESEARCHERS

Distinguished Professor Julian Thomas

Prof Julian Thomas

Chief Investigator,
RMIT University

Learn more

Lauren Ganley

Lauren Ganley

Head of First Nations Strategy & Engagement,
Telstra

Learn more

Daniel Featherstone

Dr Daniel Featherstone

Senior Research Fellow,
RMIT University

Learn more

Lyndon Ormond-Parker

Dr Lyndon Ormond-Parker

Principal Research Fellow,
RMIT University

Learn more

Jenny Kennedy

Dr Jenny Kennedy

Associate Investigator,
RMIT University

Learn more

Indigo Holcombe-James

Dr Indigo Holcombe-James

Affiliate,
RMIT University

Learn more

RESEARCH SUPPORT

Leah Hawkins

Leah Hawkins

Project Officer,
RMIT University

Learn more

Lucy Valenta profile image

Lucy Valenta

Research Coordinator,
RMIT University

Learn more

PARTNERS

Telstra

Telstra

Visit website

Diverse Experiences of ADM: Design, Curation and Use

PROJECT SUMMARY

Research Materials

Diverse Experiences of ADM: Design, Curation and Use

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: People
Status: Active

The ‘Diverse Experiences of ADM’ is the overarching thematic title for a collection of studies that examine the social, cultural and ethical dimensions of how people understand and experience ADM and other new and emerging technologies. This project explores how members of diverse communities shape existing, emerging and future practices of ADM in an effort to understand and develop equitable futures. Several studies address disabled people’s lived experiences of ADM and other emerging technologies and what services they would like to see introduced to better support their care and wellbeing. Others look at health technology startups and the thinking behind developers’ visions of future technologies and identify how health and medical technologies are portrayed in Australian industry websites and news reports. One strand addresses gender, sexual health and digital contraception technologies.

Digital mental health is also a focus of some of the studies conducted in this project. There is a strong emphasis on using participatory, experimental, creative and arts-based methods to conduct research and to engage in community research translation and engagement, including artworks, zines and exhibitions. There is also a more-than-human orientation across this project, identifying the entanglements of humans not only with digital devices, software and data but with other animals and living things and the physical elements of the ecosystems in which these technologies are imagined, developed, promoted, used or resisted.

RESEARCHERS

ADM+S Chief Investigator Heather Horst

Prof Heather Horst

Lead Investigator,
Western Sydney University

Learn more

Prof Deborah Lupton

Lead Investigator,
UNSW

Learn more

Sarah Pink

Prof Sarah Pink

Lead Investigator,
Monash University

Learn more

Jackie Leach Scully profile picture

Prof Jackie Leach Scully

Chief Investigator,
UNSW

Learn more

Georgia Van Toorn

Dr Georgia van Toorn

Research Fellow,
UNSW

Learn more

Ash Watson

Dr Ash Watson

Research Fellow,
UNSW

Learn more

Vaughan Wozniak-O'Connor

Dr Vaughan Wozniak-O’Connor

Research Fellow,
UNSW

Learn more

Cecily Klim

Cecily Klim

PhD Student,
UNSW

Learn more

Megan Rose

Dr Megan Rose

PhD Student,
UNSW

Learn more

Jacinthe Flore

Dr Jacinthe Flore

Affiliate,
University of Melbourne

Learn more

PARTNERS AND COLLABORATING ORGANISATIONS

Consumer Health Forum of Australia Logo

Consumers Health Forum of Australia

Visit website

Health Consumers NSW

Health Consumers NSW

Visit website

Data Ethics, Rights, and Markets

PROJECT SUMMARY

Blurred people moving

Data Ethics, Rights, and Markets

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Data
Status: Active

The goal of this project is to contribute to the theoretical “backbone” of the ADM+S Centre and help synthesise the findings from projects in different focus areas and research programs through the creation of an historically informed theoretical overview to the social issues associated with the rise of automated decision-making (ADM).

The project supplements the descriptive mapping project (typologies and taxonomies of ADM) with an issue mapping project that connects directly with the core social concerns of the Centre: fairness, ethics, inclusion, and effectiveness.

RESEARCHERS

Distinguished Professor Julian Thomas

Prof Julian Thomas

Lead Investigator,
RMIT University

Learn more

ADM+S Associate Director Jean Burgess

Prof Jean Burgess

Chief Investigator,
QUT

Learn more

Axel Bruns, Chief Investigator with the ADM+S Centre

Prof Axel Bruns

Chief Investigator,
QUT

Learn more

Jake Goldenfein

Dr Jake Goldenfein

Chief Investigator,
University of Melbourne

Learn more

Paul Henman

Prof Paul Henman

Chief Investigator,
University of Queensland

Learn more

ADM+S Chief Investigator Anthony McCosker

Assoc Prof Anthony McCosker

Chief Investigator,
Swinburne University

Learn more

ADM+S Investigator Christine Parker

Prof Christine Parker

Chief Investigator,
University of Melbourne

Learn more

Sarah Pink

Prof Sarah Pink

Chief Investigator,
Monash University

Learn more

ADM+S Chief Investigator Mark Sanderson

Prof Mark Sanderson

Chief Investigator,
RMIT University

Learn more

Kimberlee Weatherall

Prof Kimberlee Weatherall

Chief Investigator,
University of Sydney

Learn more

ADM+S Chief Investigator Megan Richardson

Prof Megan Richardson

Affiliate,
University of Melbourne

Learn more

PARTNERS

Australian Red Cross Logo

Australian Red Cross

Visit website

Data & Society Research Institute (US)

Visit website

OVIC Logo

Victorian Information Commissioner

Visit website

The Australian Ad Observatory Project

PROJECT SUMMARY

Woman looking at device in dark room

The Australian Ad Observatory Project

Focus Area(s): News & Media
Research Program: Data
Status: Active

The Ad Observatory develops and applies tools for observing how so-called ‘dark ads’ are targeted on Facebook. The goal is to respond to changes in the advertising environment by providing models for accountability and transparency of advertising targeted to individuals on social media. The current tool is limited to the use of Facebook on desktop and laptop computers. The Observatory team, however, has worked with different approaches on other platforms and is developing a mobile app that will collect ads from users.

To date we have over 1900 volunteers participating in the Facebook component of the project by installing the Observatory’s browser extension which allows them to share with us the sponsored content that appears in their news feeds. This participation has yielded more than 700,000 ad observations of more than 300,000 unique ads. These ads have, in turn, served as the basis for research projects on greenwashing and on the advertising of harmful products and services including: alcohol, gambling, ultra-processed foods, and financial services. Outputs so far include six documents including working papers, technical reports, and academic publications. The project has also received substantial media attention, resulting in stories by partner organisation ABC about illegal gambling ads and scam ads. It has also resulted in collaboration with organisations including CHOICE, the Consumer Policy Research Centre, the Alliance for Gambling Reform, and VicHealth. Project findings and approaches have been presented at international conferences and we continue to develop partnerships both nationally and internationally.

For more information, and to join the Australian Ad Observatory,
click here.

RESEARCHERS

Mark Andrejevic

Prof Mark Andrejevic

Lead Investigator,
Monash University

Learn more

Daniel Angus

Prof Daniel Angus

Chief Investigator,
QUT

Learn more

ADM+S Associate Director Jean Burgess

Prof Jean Burgess

Chief Investigator,
QUT

Learn more

ADM+S Investigator Christine Parker

Prof Christine Parker

Chief Investigator,
University of Melbourne

Learn more

Kim Weatherall

Prof Kim Weatherall

Chief Investigator,
University of Sydney

Learn more

ADM+S Chief Investigator Christopher Leckie

Prof Chris Leckie

Chief Investigator,
University of Melbourne

Learn more

Nicholas Carah

Assoc Prof Nicholas Carah

Associate Investigator,
University of Queensland

Learn more

Kelly Lewis

Dr Kelly Lewis

Research Fellow,
Monash University

Learn more

Christopher O'Neill

Dr Christopher O’Neil

Research Fellow,
Monash University

Learn more

Lauren Hayden

Lauren Hayden

PhD Student,
University of Queensland

Learn more

ADM+S professional staff Abdul Obeid

Dr Abdul Obeid

Data Engineer,
QUT

Learn more

ADM+S Investigator Christine Parker

Dr César Albarrán-Torres

Affiliate,
Swinburne University

Learn more

Bronwyn Carlson

Prof Bronwyn Carlson

Affiliate,
Macquarie University

Learn more

Loup Cellard

Dr Loup Cellard

Affiliate,
Datactivist Coop

Learn more

Robbie Fordyce

Dr Robbie Fordyce

Affiliate,
Monash University

Learn more

ADM+S Chief Investigator Megan Richardson

Prof Megan Richardson

Affiliate,
University of Melbourne

Learn more

Verity Trott

Dr Verity Trott

Affiliate,
Monash University

Learn more

PARTNERS AND COLLABORATING ORGANISATIONS

Consumer Policy Research Centre Logo

Consumer Policy Research Centre (CPRC)

Learn more

New York university

New York University

Learn more

AlgorithmWatch logo

Algorithm Watch

Learn more

RMIT ABC Fact Check Logo

RMIT ABC Fact Check

Learn more

CHOICE

Learn more

FARE Logo

Foundation for Alcohol Research and Education (FARE)

Learn more

ABC logo

Australian Broadcasting Corporation

Visit website

Civic Automated Decision-Making

PROJECT SUMMARY

Person on wheelchair moving past city building

Civic Automated Decision-Making

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Data
Status:
 Active

As part of the ARC Centre’s mandate to create the knowledge and strategies necessary for responsible, ethical, and inclusive automated decision-making, this project engages with the role played by such systems in democracy and civic life. The impetus for this project is to supplement discussions of AI ethics with those of AI civics – and, in particular to consider the practices, policies, technologies, and social-political arrangements of automated decision making systems that are most compatible with a vibrant democracy.

Recent developments render such a conversation increasingly pressing. The institutions that to which we have entrusted the development of some of the most powerful automated contemporary information and communication technologies available do not necessarily have civic or democratic concerns as top priority – this is not what they are built to do. Our steering mechanisms are having a difficult time keeping up – and it is crucially important to consider alternative possible arrangements for storing and processing the data upon which society relies. These questions lie at the heart of what it means to formulate world-leading policy and practice, as envisioned by the Centre.

This project draws upon expertise from across the Centre’s programs and Focus Areas to develop conceptual and practical interventions designed to align automated systems with civic and democratic imperatives. The initial phase of the project was an agenda setting workshop to consider key issues and approaches. The next step will be a themed issue or edited collection that develops approaches to Civic ADM. The final stage will include integration of these approaches with practical initiatives in the Centre, including observability and accountability projects.

RESEARCHERS

Mark Andrejevic

Prof Mark Andrejevic

Lead Investigator,
Monash University

Learn more

Jake Goldenfein

Dr Jake Goldenfein

Chief Investigator,
University of Melbourne

Learn more

ADM+S Investigator Christine Parker

Prof Christine Parker

Chief Investigator,
University of Melbourne

Learn more

Distinguished Professor Julian Thomas

Prof Julian Thomas

Chief Investigator,
RMIT University

Learn more

Kimberlee Weatherall

Prof Kimberlee Weatherall

Chief Investigator,
University of Melbourne

Learn more

ADM+S Investigator James Meese

Dr James Meese

Associate Investigator,
RMIT University

Learn more

ADM+S Chief Investigator Andrew Kenyon

Prof Andrew Kenyon

Associate Investigator,
University of Melbourne

Learn more

Kylie Pappalardo profile picture

Dr Kylie Pappalardo

Associate Investigator,
QUT

Learn more

Michael Richardson

Assoc Prof Michael Richardson

Associate Investigator,
UNSW

Learn more

Andrew Roberts

Prof Andrew Roberts

Associate Investigator,
University of Melbourne

Learn more

ADM+S Investigator Robert Sparrow

Prof Robert Sparrow

Associate Investigator,
Monash University

Learn more

ADM+S Investigator Frank Pasquale

Prof Frank Pasquale

Partner Investigator,
Cornell Tech

Learn more

Kelly Lewis

Dr Kelly Lewis

Research Fellow,
Monash University

Learn more

Christopher O'Neill

Dr Christopher O’Neil

Research Fellow,
Monash University

Learn more

Jathan Sadowski

Dr Jathan Sadowski

Research Fellow,
Monash University

Learn more

Dr Aaron Snoswell

Dr Aaron Snoswell

Research Fellow,
QUT

Learn more

Georgia Van Toorn

Dr Georgia van Toorn

Research Fellow,
UNSW

Learn more

Zoe Horn

Zoe Horn

PhD Student,
Western Sydney University

Learn more

Lucinda Nelson

Lucinda Nelson

PhD Student,
QUT

Learn more

PARTNERS

Brooklyn Law School logo

Brooklyn Law School

Visit website

Data & Society Research Institute (US)

Visit website

OVIC Logo

Office of the Victorian Information Commissioner

Visit website

Considerate and Accurate Multi-party Recommender Systems for Constrained Resources

PROJECT SUMMARY

Mobile with Spotify music app

Considerate and Accurate Multi-party Recommender Systems for Constrained Resources

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: Machines
Status: Active

This project will create a next generation recommender system that enables equitable allocation of constrained resources. The project will produce novel hybrid socio-technical methods and resources to create a Considerate and Accurate REcommender System (CARES), evaluated with social science and behavioural economics lenses.

CARES will transform the sharing economy by delivering systems and methods that improve user and non-user experiences, business efficiency, and corporate social responsibility.

PARTICIPATE

Participate in an online user study on multi-party fair recommendations

We are looking for users of the Spotify music application to complete a brief online study. In the study, you are expected to browse music recommendations and answer a set of questions.

The study is expected to take less than 15 minutes, and you will receive a AU$10 gift card as a thank you.

You will need to have an active Spotify account with at least 6 months of listening history to take part.

To verify your eligibility and participate in the study, please fill out this form.

RESEARCHERS

ADM+S Chief Investigator Mark Sanderson

Prof Mark Sanderson

Lead Investigator,
RMIT University

Learn more

ADM+S Chief Investigator Christopher Leckie

Prof Christopher Leckie

Chief Investigator,
University of Melbourne

Learn more

ADM+S Investigator Flora Salim

Prof Flora Salim

Chief Investigator,
UNSW

Learn more

Jeffrey Chan

Dr Jeffrey Chan

Associate Investigator,
RMIT University

Learn more

Danula Hettiachchi

Dr Danula Hettiachchi

Research Fellow,
RMIT University

Learn more

PARTNERS

University of Amsterdam logo

University of Amsterdam

Visit website

The Automated Newsroom in Australia and beyond: Problems and challenges in the use of automated decision-making systems in journalistic practice

PROJECT SUMMARY

Lady with glasses looking at computer screen

The Automated Newsroom in Australia and beyond: Problems and challenges in the use of automated decision-making systems in journalistic practice

Focus Area: News and Media
Research Program: People
Status: Active

This interview-driven research project provides a comprehensive overview of current journalistic designs and values following the implementation of automated tools and Artificial Intelligence (AI) in Australian commercial and public service newsrooms. It delves into the current configurations of editorial automation, specifically during the pandemic and before the development of generative AI times in datafied societies. The study explored how journalists, editors, and developers imbue with journalistic ideals the creation and industrialisation of automation processes, data-centric tools and types of AI in different stages of editorial work ranging from information gathering, data journalism, automated writing and summarising, producing and editing, visualising, distributing and recommending.

Drawing on a purposeful sampling method, that is, choosing practitioners who were most likely to be working on a daily basis with automated technologies, 17 journalists from the leading national and regional outlets, were interviewed out of 100 professionals invited to participate during the pandemic years. The study concludes that while this critical incident impelled journalists to be more familiar with data journalism practices and data management processes, the situation was not enough to accelerate complex automated processes such as, for example, automated text generation or any ML uses. The amount of COVID-19-related data being monitored, collected and then delivered to newsrooms by government and public entities (e.g., cases, infections, deaths, hospitalisations, and numbers of vaccinated Australians, among other structured data) animated some journalists and developers in Australia to incorporate, adapt and reassess to a certain extent some data tasks embedded in the production routines during this acute incident. However, automated-generated text during the pandemic was not sustainable in the long term due to the characteristics of the Australian news market, and audience news avoidance. Some participants reported that these automating processes were challenging to sustain also because of the evolving consumption trends during the pandemic. On the other hand, the study also outlines increasing uses of AI commercial tools, such as transcription applications and some advances in implementing news recommender systems (NRS) and voice assistants, such as the ABC emergency voice assistance.
Commercial outlets have progressively adopted algorithmic systems regarding news recommendations, but the development “is still in its infancy”. Although the study could not cover the popularisation of generative AI, unveils trends and perceptions of AI, which would require an expansion in a second round of interviews.

The second stage of this project replicates the Australian study in Latin American newsrooms (with a project agreement titled: Envisioning automated journalism in Latin America). Currently, collaborators on this project from La Sabana and the lead investigator are interviewing outlets practitioners in the region. To undertake the Latin American study, the lead investigator submitted an ethics extension based on Project 421 to be able to interview participants in that region until 2024.

The project developed one important ramification and collaboration with the Centre-affiliated investigators and one Latin American University. With the ADM+S affiliated researcher, Dr Michelle Riedlinger, from the Global Journalism Innovation Lab (GJIL) and the Digital Media Research Centre, and Dr Victor Garcia Perdomo from Universidad de La Sabana (Colombia), as well as Dr Marina Joubert from Stellenbosch University, we submitted a project to the Research Foundational Integrity Meta Grant. This study was awarded funding in December 2022 and started in 2023. It incorporates questions on automated fact-checking in counteracting misinformation and disinformation. The overarching investigation delves into the uses of social media algorithmic tactics deployed by Meta-affiliated fact-checkers in the Southern Hemisphere to counteract COVID-19 vaccine problematic content. These organisations follow the Meta fact-checking policies and have access to automated and AI platform tools for misinformation detection. We explored their uses and algorithmic practices with a particular focus on the Southern Hemisphere.

RESEARCHERS

Dr Silvia Montaña-Niño profile picture

Dr Silvia Ximena Montana-Nino

Project lead,
QUT

Learn more

ADM+S Associate Director Jean Burgess

Prof Jean Burgess

Chief Investigator,
QUT

Learn more

Axel Bruns, Chief Investigator with the ADM+S Centre

Prof Axel Bruns

Chief Investigator,
QUT

Learn more

ADM+S Chief Investigator Heather Horst

Prof Heather Horst

Chief Investigator, Western Sydney University

Learn more

PARTNERS

ABC logo

Australian Broadcasting Commission (ABC)

Learn more

Decentering ADM: A Review of Automated Decision-Making in the Global South

PROJECT SUMMARY

Cash register with payment barcode in a shop in Delhi

Decentering ADM: A Review of Automated Decision-Making in the Global South

Focus Areas: News and Media, Transport and Mobility, Health, and Social Services
Research Program: People
Status: Active

This project is a review of the current state of ADM implementation, practices and visions in different regions in the Global South. It includes an analysis of academic and grey literature, online resources and interviews with key stakeholders in four underrepresented regions (Latin America, Anglophone Africa, South and Southeast Asia and Pacific Island Archipelagos).

Our focus upon decentering ADM works to challenge dominant narratives of the discourse, practice and adoption of ADM across the world.

RESEARCHERS

ADM+S Chief Investigator Heather Horst

Prof Heather Horst

Lead Investigator

Learn more

Edgar Gómez-Cruz

Dr Edgar Gómez Cruz

Affiliate

Learn more

Adam Sargent

Dr Adam Sargent

Associate Investigator

Learn more

PARTNERS

Australian Red Cross Logo

Australian Red Cross

Learn more

The Australian Search Experience

PROJECT SUMMARY

Person searching laptop with labrador by their side

The Australian Search Experience

Focus Area: News and Media
Research Program: Data
Status: Active

There is a lot of speculation about the impact that search engines have on the information we encounter. Search engine personalisation may be influencing individuals’ search results, and thereby shape what they know of the world. This may affect their personal decisions, and our collective decisions as a society – from how we spend our money or who we vote for to our attitudes on critical issues such as the safety of COVID-19 vaccines.

This research examines the extent to which search results are personalised, by various leading search engines and their algorithms, based on the profiles established by those search engines for their different users. It compiles and analyses the search recommendations encountered by a wide range of genuine users across prominent digital media platforms, for a variety of generic and specific topics, and over time.

The project launched in late July 2021 and over 12 months collected over 350 million search results from more than 1,000 participants. The project took a citizen science approach, relying on data donations from the general public made through a unique desktop browser plugin. ADM+S researchers have been analysing the data to understand the personalisation of search results for critical news and information, across key platforms including Google and YouTube, based on the profiles these platforms establish for their different users.

CASE STUDIES

Case Study: Google News
This project is examining Google News results to understand how recommender systems and search personalisation intersect with news distribution. Preliminary findings show limited evidence of personalisation, with news and information sources recommended for particular searches mainly influenced by the search topic. The team is now exploring the diversity of news outlets in the dataset, with the goal of finding out how much local and national news is featured in Google News results. The project will also reveal whether particular news outlets appear more often than others.

Case Study: Comparing search results across Google platforms/services
This project examines search results across Google News, Google Search, Google videos, and YouTube to understand how different Google services and platforms operationalise ‘authoritativeness’ across socio-cultural issues and over time. The project focuses on the sources that are ranked at the top on each service/platforms and reflects on issues of media diversity in relation to these results.

PUBLICATIONS

The Australian Search Experience: Background Paper

15 Jan 2022

Read on APO

RESEARCHERS

Axel Bruns, Chief Investigator with the ADM+S Centre

Prof Axel Bruns

Lead Investigator, QUT

Learn more

Mark Andrejevic

Prof Mark Andrejevic

Chief Investigator, Monash University

Learn more

ADM+S Associate Director Jean Burgess

Prof Jean Burgess

Chief Investigator, QUT

Learn more

ADM+S Chief Investigator Nic Suzor

Prof Nicolas Suzor

Chief Investigator, QUT

Learn more

Kimberlee Weatherall

Prof Kimberlee Weatherall

Chief Investigator, University of Sydney

Learn more

Daniel Angus

Prof Daniel Angus

Associate Investigator, QUT

Learn more

ADM+S Investigator Timothy Graham

Dr Timothy Graham

Associate Investigator, QUT

Learn more

Ariadna Matamoros Fernandez profile picture

Dr Ariadna Matamoros-Fernández

Associate Investigator, QUT

Learn more

ADM+S Investigator James Meese

Dr James Meese

Associate Investigator, RMIT University

Learn more

ADM+S Chief Investigator Falk Scholer

Prof Falk Scholer

Associate Investigator, RMIT University

Learn more

ADM+S Investigator Damiano Spina

Dr Damiano Spina

Associate Investigator, RMIT University

Learn more

Louisa Bartolo profile picture

Louisa Bartolo

PrD Student,
QUT

Learn more

Arjun Srinivas

Arjun Srinivas

PhD Student,
QUT

Learn more

PARTNERS

AlgorithmWatch logo

AlgorithmWatch
Visit website

University of Twente

University of Twente

Learn more