Our analysis of the hundreds of millions of search results donated by the more than 1,000 citizen scientists who have installed the browser plugin so far is still ongoing, and we will release detailed results from this research at a later stage. However, at the ADM+S News & Media Symposium on 30 September 2021 we presented the following very preliminary observations about key patterns in the dataset. You can also watch the full presentation below.

To find out more about The Australian Search Experience and to join the project visit the main webpage here

INITIAL FINDINGS

Very different patterns across platforms Google Search, Google News, Google Video and Youtube

  • Google search largely stable
  • Google news very fast-moving
  • Google Video quite static
  • YouTube often stable in top ~5 results, then highly changeable.

Further analyses

  • Detailed analyses per platform, and cross-platform comparisons.
  • Further breakdown by demographic attributes and browser features
  • Extension to non-organic search results
  • Evaluation of search result quality

Limited evidence of search personalisation so far

  • Personalisation in Google Search largely driven by user location
  • Critical search topics appear manually curated, at least in part
  • Some results differences based on browser type (desktop vs mobile)
  • Other platforms (especially YouTube) need further detailed analysis

Additional outreach

  • Demographic profile of citizen scientist cohort unrepresentative
  • Need to compensate for participant attrition over time.
  • Gradual variation of search terms to address emerging topics
  • Focus especially on major upcoming events – e.g. federal election

Findings presented at the ADM+S News and Media Research Symposium
30 September 2021

PRESENTATION SLIDES

Slides from the ADM+S News and Media Research Symposium presentation are available here.

CONTACT US

If you need help installing the plugin or have a question contact us datadonation@admscentre.org.au

AlgorithmWatch logo

This project is being conducted in collaboration with partner AlgorithmWatch.

AlgorithmWatch is a non-profit research and advocacy organization that is committed to watch, unpack and analyze automated decision-making (ADM) systems and their impact on society.

Visit AlgorithmWatch