ACMMM25 - Grand Challenge on Multimedia Verification

1University of Bergen 2Faktisk.no 3NICT 4KU Leuven 5Aalto University 6Simula Research Laboratory 7Institutt for Journalistikk 8University of Science - VNUHCM

Abstract

The Grand Challenge on Multimedia Verification is an open competition where researchers and practitioners compete to verify the authenticity and context of multimedia content, addressing real-world misinformation challenges. Participants analyze provided images and videos, assess sources, detect manipulations, and submit a detailed verification report.

In addition to the main task, participants can also take part in the OOC Subtask (Out-of-Context Detection), which focuses on identifying whether multimedia content has been misused in an incorrect or misleading context. This subtask continues the work from the Grand Challenge on Detecting Cheapfakes, previously held at ACM MMSys 2021, ACM MM 2022, IEEE ICME 2023, and ACM ICMR 2024.

There are no restrictions on methodology: solutions can be fully manual, fully automated, or a mix of OSINT, existing tools, and newly developed techniques.

Participants can choose to:

  • Compete in the main task.
  • Compete in the OOC Subtask only.
  • Compete in both the main task and the OOC Subtask.

Additionally, as part of the main task, participants may provide a concise verification summary for general readers. This component is optional and will be evaluated separately based on the main task results.

The competition consists of three stages: Training, Validation, and Real-World Verification. Participants first explore 100 50 known cases to familiarize themselves with the tasks. In the Validation stage, they must analyze 20 10 new cases and pass an evaluation to qualify for the Real-World Verification Stage, where 10 live verification cases will test their methods on fresh, evolving misinformation challenges.

Recognition & Awards. Teams submitting a scientific paper may present at ACM Multimedia, subject to peer review. Only paper-submitting teams are eligible for awards, but all participants’ scores will be officially recognized.

Note: To ensure the quality and accuracy of the cases, we have reduced the number of samples and only provide the high-quality ones.

Important dates

  • March 3, 2025 – Registration Opens
  • March 7, 2025 – Test Data Released
  • May 1, 2025 May 16, 2025 – Validation Data Released
  • May 15, 2025 May 30, 2025 – Registration Closes
  • May 30, 2025 June 13, 2025 June 27, 2025 – Submission Deadline for Results, Reports, and Papers. Please refer to the Submission Guideline for more details.
  • June 30, 2025 – Notification of Paper and Results (Accepted teams move to the final stage)
  • July 28 – August 8, 2025 – Final Stage - Real World Verification
    • July 28 – August 1, 2025 – Task Release (Two tasks per day)
    • August 8, 2025 – Final Results Announcement
  • August 26, 2025 – Camera-Ready Paper Submission Deadline
  • October 27 – 31, 2025 – Conference

Note: Due to the careful preparation of the dataset for testing and validation, we have adjusted the timeline to ensure data quality and integrity.

Organized by

Organization 1

University of Bergen

Organization 2

University of Science - VNUHCM-

Organization 3

NICT

Organization 4

NORDIS