The Third International Workshop on Open Media Forensics Challenge

OpenMFC 2023 Workshop Agenda

Nov. 14 - 15, 2023



Summary

The Third International Workshop on the Open Media Forensics Challenge (OpenMFC 2023) is currently scheduled for November 14 - 15, 2023. This workshop is an integral part of the NIST OpenMFC program, with a primary focus on fostering collaboration among a diverse group of stakeholders across various domains. These domains encompass art, media (including image, video, audio, and text) generation and manipulation, media forensics, anti-forensics, artificial intelligence (AI), and human-machine interaction (HMI). Our shared objective is to drive innovation in the field of media forensics through an evaluation program.

The OpenMFC 2023 workshop will be held in conjunction with the TRECVID 2023 workshop. The TRECVID 2023 workshop is a hybrid event, combining in-person and virtual participation, and it is organized by teams within the Information Access Division (IAD) of the Information Technology Laboratory (ITL) at the National Institute of Standards and Technology (NIST).

Here is information about previous OpenMFC workshops:


Call for participation

The surge in AI-related activity and interest has given rise to various emerging technologies, including Generative AI, deepfake, CGI, and anti-forensic techniques. These technologies pose a substantial threat to the credibility of media content. In response, dedicated researchers are actively engaged in the fight against disinformation, striving to identify both unintentional misinformation and deliberate deception. Their efforts are crucial for maintaining trust and authenticity in digital content.

We invite presentations and discussions from both OpenMFC participants and the wider research community on a diverse range of topics, including but not limited to:


Workshop Registration

Although the workshop is designed for active participant team members in the OpenMFC program, the workshop is open to the public. We do highly encourage any researcher in academia, industry, or government to attend if they wish.

Please register for the TRECVID 2023 and OpenMFC 2023 workshops using the external link (a single registration for two workshops):

OpenMFC/TRECVID 2023 Register

Virtual Only Registration Fee: $40.


Invited Keynote Speakers

Empire Innovation Professor: Siwei Lyu, University at Buffalo, State University of New York

Siwei Lyu Image


Speaker Profile: Siwei Lyu is a SUNY Empire Innovation Professor at the University at Buffalo, State University of New York. He serves as the director of the UB Media Forensic Lab (UB MDFL) and Co-Director of the Center for Information Integrity (CII). Prior to joining UB, Dr. Lyu held the position of full Professor at the University at Albany, State University of New York, where he served as the Founding Director of UAlbany's Computer Vision and Machine Learning Lab (CVML).

Dr. Lyu's research interests span digital media forensics, computer vision, and machine learning. He has published over 190 journal and conference papers.

Recognized for his achievements, Dr. Lyu has received numerous awards, including the IEEE Signal Processing Society Best Paper Award, the National Science Foundation CAREER Award, both SUNY Albany's Presidential Award and Chancellor's Award for Excellence in Research and Creative Activities, the Google Faculty Research Award, and the IEEE Region 1 Technological Innovation (Academic) Award.

Professor Jennifer L. Newman, Iowa State University

Jennifer L. Newman Image

Speaker Profile: Jennifer Newman is a full professor in the Department of Mathematics at Iowa State University. Her primary research focuses on creating and applying discrete mathematics, statistics, and machine learning tools to address challenges in steganography, steganalysis, forensic image analysis, validity of severe storm reports, image processing, texture analysis, and other imaging-related topics.

With over 8 awards and 75 publications in mathematics, engineering, and computer vision, Professor Newman's impactful research is supported by NIST’s Center for Statistics and Applications in Forensic Evidence (CSAFE). Her team collaborates with the National Oceanic and Atmospheric Administration (NOAA) to develop a machine learning diagnostic tool for verifying severe wind reports.

Professor Jun-Cheng Chen, Research Center for Information Technology Innovation, Academia Sinica

Prof. Jun-Cheng Chen Image

Speaker Profile: Dr. Jun-Cheng Chen is an associate research fellow at the Research Center for Information Technology Innovation, Academia Sinica.

Dr. Chen earned his Ph.D. in Computer Science from the University of Maryland, College Park, USA, under the guidance of Prof. Rama Chellappa in 2016. From 2017 to 2019, he served as a postdoctoral research fellow at the University of Maryland Institute for Advanced Computer Studies.

Dr. Chen's research interests encompass computer vision, machine learning, deep learning, adversarial robustness, and their applications to biometrics, including face recognition/facial analytics, activity recognition/detection in the visual surveillance domain, etc. Notably, he was awarded the APSIPA ASC Best Paper Award in 2023 and the ACM Multimedia Best Technical Full Paper Award in 2006.

Wendy Dinova-Wimmer, Sr. Digital Media Architect, Office of the Public Sector CTO, Adobe

Wendy Dinova-Wimmer Image

Speaker Profile: Wendy Dinova-Wimmer, Sr. Digital Media Architect. Wendy works in Adobe’s Office of the Public Sector CTO Office supporting government customers with all things digital media. Prior to joining Adobe, Wendy spent thirty years in the government, first as a graphic designer and then visualizing scientific analysis with 3D animation. After 9/11, Wendy dove into multimedia forensic analysis specializing in media authentication. Wendy contributes to forensic image standards with the Organization of Scientific Area Committees for Forensic Sciences (OSAC) and ASTM standards organization. Wendy works as a Trusted Advisor with the Content Authenticity Initiative (CAI).

Prof. Matthew Stamm, Drexel University

Prof. Matthew Stamm Image

Speaker Profile: Dr. Matthew C. Stamm is an Associate Professor in the Department of Electrical and Computer Engineering at Drexel University, where he leads the Multimedia and Information Security Lab (MISL). His research encompasses signal processing, machine learning, and information security, with a particular focus on information forensics and anti-forensic countermeasures.

Dr. Stamm’s research has been funded by the National Science Foundation (NSF), the Defense Advanced Research Projects Agency (DARPA), the Army Research Office (ARO), and the Defense Forensics and Biometrics Agency (DFBA). He is the recipient of a National Science Foundation CAREER Award and the Drexel University College of Engineering Outstanding Early-Career Research Achievement Award.

Moreover, Dr. Stamm has played a pivotal role in academic leadership, serving as the General Chair of the 2017 ACM Workshop on Information Hiding and Multimedia Security (IH&MMSec) and leading the organization of the IEEE Signal Processing Society’s 2018 Signal Processing Cup competition.

Rijul Gupta, Founder and CEO of Deep Media

Speaker Photo Image

Speaker Profile: Rijul Gupta is the Founder and CEO of Deep Media (https://www.deepmedia.ai), a pioneering force in Synthetic Media. Armed with a degree in Machine Learning from Yale University, Rijul is recognized as a thought leader in DeepFake technology, earning a distinction by Forbes. His commitment to ensuring the ethical use of DeepFake technology led him to establish DeepMedia, where he champions its responsible and secure application.

Prior to founding DeepMedia, Rijul amassed over 7 years of experience as a machine-learning engineer, contributing his expertise to the development of advanced object recognition, pattern matching, and product recommendation AI. His work has left an indelible mark on prominent companies such as Nike, Nordstrom, GAP, and Bloomingdale’s.

A Thiel Fellow Finalist and a patented inventor, Rijul Gupta has rightfully earned a place in Forbes Magazine's prestigious "Forbes Next 1000."


­­OpenMFC 2023 Workshop Agenda

­­Nov. 14 -15, 2023

Tuesday Wednesday

Day 1: Tuesday Nov. 14, 2023 (EST)

Time Start Time End Topic Material
9:00 AM 12:25 PM TRECVID 2023
TRECVID 2023 Agenda
12:25 PM 1:30 PM Lunch Break
1:30 PM 1:40 PM OpenMFC 2023 Workshop Opening Remarks
Jim Horan, Group Leader, Multimodal Information Group, Information Access Division, ITL, NIST
1:40 PM 2:20 PM Invited keynote: Combatting with DeepFakes
Professor Siwei Lyu, University at Buffalo, State University of New York
  • Video
  • Slides
  • 2:20 PM 2:30 PM Break
    2:30 PM 3:10 PM Invited Keynote on Stego
    Professor Jennifer Newman, Iowa State University
  • Video
  • Slides
  • 3:10 PM 3:50 PM Invited Keynote: Video Forensics Beyond Deepfakes
    Professor Matthew Stamm, Drexel University
  • Video
  • Slides
  • Day 2: Wednesday Nov. 15, 2023 (EST)

    Time Start Time End Topic Material
    9:00 AM 11:35 AM TRECVID 2023
    TRECVID 2023 Agenda
    11:35 AM 12:30 PM Lunch Break
    12:30 PM 1:10 PM Invited Keynote on Deepfake
    Professor Jun-cheng Chen, Research Center for Information Technology Innovation, Academia Sinica
  • Video
  • Slides
  • 1:10 PM 1:50 PM Invited keynote on Manipulation and Standards
    Wendy Dinova-Wimmer, Sr. Digital Media Architect, Office of the Public Sector CTO, Adobe
  • Video
  • Slides
  • 1:50 PM 2:00 PM Break
    2:00 PM 2:40 PM Invited Keynote about Deepmedia
    Rijul Gupta, Founder and CEO of Deep Media
  • Slides
  • 2:40 PM 3:15 PM OpenMFC 2023 Overview
    Dr. Haiying Guan, Senior Computer Scientist, NIST
  • Video
  • Slides