Digital Platform Regulators Forum paper on Multimodal Foundation Models: Implications for regulation and consumer safety

Author Kathy Nickels
Date 20 September 2024

The Australian Government’s Digital Platform Regulators Forum (DP-REG) has published their latest working paper on multimodal foundation models (MFMs) used in generative artificial intelligence (AI).

The paper “Examination of technology – Multimodal Foundation Models” examines MFMs. Unlike large language models (LLMs), which focus on text, MFMs are a type of generative AI capable of processing and producing various data types, including images, audio, and video. 

This extension from more commonly used LLMs to MFMs broadens the potential use cases for generative AI, allowing it to be used for a wider range of tasks. 

The paper discusses some of the implications of this advancing technology for consumer protection, competition, the media and information environment, privacy, and online safety within the digital platform context and assesses how these technologies affect the regulatory roles and responsibilities of each DP-REG member.

The working paper was prepared by representatives from the Australian Competition and Consumer Commission (ACCC), the Australian Communications and Media Authority (ACMA), eSafety and the Office of the Australian Information Commissioner (OAIC) in their capacity as members of the Digital Platform Regulators Forum.

Concerns around the use of MFMs raised by the DP-REG include scams and misleading conduct exacerbated by deepfake images and videos, the spread of misinformation and disinformation in Australia, generation of potentially harmful and illegal content and the potential use of personal information in unexpected ways outside the control of the individual.

With the rapid expansion of generative AI into diverse fields, including image and video generation, the paper seeks to explore the broader implications of these technologies.  

This paper supports DP-REG’s 2024–26 strategic priorities, which include a focus on understanding, assessing and responding to the benefits, risks and harms of technology, including AI models. It aims to complement and inform broader government work on AI that is underway.

The Digital Platform Regulators Forum (DP-REG) is an important information-sharing and collaboration initiative between Australian independent regulators focused on fostering a safe, trusted, fair, innovative and competitive digital economy in Australia.

The paper acknowledges the contribution made by experts from the ARC Centre of Excellence for Automated Decision-Making and Society stating that, “their insights on generative AI have been instrumental in preparing this paper.”

The following ADM+S members are acknowledged for their contributions to the paper. 

SEE ALSO