PROJECT SUMMARY

Evaluating Automated Cultural Curating and Ranking Systems with Synthetic Data
Focus Areas: News & Media
Status: Active
As culture becomes increasingly mediated through automated systems, it is crucial to devise means of evaluating their performance from a societal perspective. Automated systems increasingly navigate a sea of content on our behalf, shaping the flow of culture and cultural products such as news, information retrieval and search, recommender systems and music and video.
This project addresses the question of how to study and evaluate the role that automated systems play in shaping this flow. It brings together technical innovations in the use of synthetic data for hybrid approaches to simulate a broad range of behaviours that influence automated decision-making systems, with a specific focus on ranking-based systems.
It will build tools and approaches to evaluate how recommender and ranking-based systems might incorporate cultural and civic values, such as better representation of artists of colour on streaming platforms or higher visibility and circulation for information of significant public interest.
This project will develop strategies for intervening in the automated flow of culture to advance Centre priorities of responsive, ethical, and inclusive automated decision making.
PROJECT OBJECTIVES
- Understand what cultural products people are exposed to and in what order and why;
- Evaluate whether and how ranking-based systems might incorporate factors and values that range from commercial to cultural and civic;
- Understand how different automated systems create an overall cultural milieu through their combinations and interactions with one another;
- Provide key insights into how ADMs are experienced in specific sites;
- Develop ways to ensure that automated intervention in cultural flows aligns with social priorities, including commitments to diversity, fairness, and inclusion; and
- Demonstrate the appropriate contexts and methods for using synthetic data in evaluating ADM systems.
MORE INFORMATION
RESEARCHERS







Prof Mark Sanderson
Chief Investigator,
RMIT University
Learn more

Prof Julian Thomas
Chief Investigator,
RMIT University
Learn more

Dr Danula Hettiachchi
Associate Investigator,
RMIT University
Learn more

Dr Joel Stern
Associate Investigator,
RMIT University
Learn more



PARTNERS
