ÃÛÑ¿´«Ã½

An evaluation of generated/manipulated image detection

Paper 414: Detecting manipulated media is crucial to combat misinformation.

Published: 1 May 2024
A set of data points imposed over a photograph of a man
  • Marc Górriz Blanch

    Marc Górriz Blanch

    Graduate R&D Engineer
  • Woody Bayliss

    Woody Bayliss

    PhD Researcher
  • Danijela Horak

    Danijela Horak

    Head of Applied Research, AI

Advancements in image generation and manipulation technology offer both opportunities and risks. Detecting manipulated media is crucial to combat misinformation. This report, part of the 'Anomaly Detection' project within generative AI pilot initiatives, aims to understand the strengths and weaknesses of existing detection algorithms. By doing so, the ÃÛÑ¿´«Ã½ can make informed decisions regarding the integration of these algorithms into the journalistic process.

Our evaluation dataset comprises three image types: fully generated, partially manipulated, and face-altered. Augmented to simulate real-world scenarios (compression, resizing, social media processing), our study focuses on precision, recall, and F1-score metrics, addressing both false positives and false negatives. According to the evaluations conducted for this report in early 2024, the ÃÛÑ¿´«Ã½â€™s assessment is that none of the deepfake detectors tested perform effectively in detecting all types of deepfake instances.

This paper is authored by ÃÛÑ¿´«Ã½ Research & Development's Marc Gorriz-Blanch, Woody Bayliss, Sinead O’Brien, Danijela Horak and Juil Sock, with Maryam Ahmed and Blathnaid Healy, our partners from ÃÛÑ¿´«Ã½ News

Image by  / © ÃÛÑ¿´«Ã½ /  / Mirror B / 

White Paper copyright

© ÃÛÑ¿´«Ã½. All rights reserved. Except as provided below, no part of a White Paper may be reproduced in any material form (including photocopying or storing it in any medium by electronic means) without the prior written permission of ÃÛÑ¿´«Ã½ Research except in accordance with the provisions of the (UK) Copyright, Designs and Patents Act 1988.

The ÃÛÑ¿´«Ã½ grants permission to individuals and organisations to make copies of any White Paper as a complete document (including the copyright notice) for their own internal use. No copies may be published, distributed or made available to third parties whether by paper, electronic or other means without the ÃÛÑ¿´«Ã½'s prior written permission.

Search by Tag:

Rebuild Page

The page will automatically reload. You may need to reload again if the build takes longer than expected.

Useful links

Demo mode

Hides preview environment warning banner on preview pages.

Theme toggler

Select a theme and theme mode and click "Load theme" to load in your theme combination.

Theme:
Theme Mode: