Shallowfake suspectsGuide

Reading suspect-region maps

In this tutorial we demonstrate the different ways that both positive and negative examples of shallowfakes can be detected, as well as the type of complicated images that can cause false positives. You can download these examples to try them in the scanner yourself.

Because of the way some deepfake images are constructed, they may show large masked regions. That's not a bug: deepfakes can have different structure than real images, and that is also exposed by the algorithms we use for shallowfake detection.

Nine upload-ready images, three edit masks, and source notes.

01

Three edits with quiet originals

Scan each original and its edited version. The Standard map is quiet over the target in the original, then responds where the edit was made. Open the supplied edit mask after comparing the maps.

A bear altered

The original map stays quiet over the bear on the left. After a localized Photoshop edit changes that bear, the map marks the edited area.

Original · Standard map

Original image

Download image ↓
Two brown bears facing each other behind a log
Upload image
Standard map of the original image with two bears
Standard map · hard edges

The original scene has almost no Standard-map response; the bear that will be changed is unmarked.

Edited · Standard map

Edited image

Download image ↓
Two bears behind a log, with the left bear changed by image editing
Upload image
Standard map responding to the edited bear
Standard map · hard edges

The response appears over the changed bear and follows most of the edited area.

Reveal the edited area
Two bears behind a log, with the left bear changed by image editing

The translucent red area is the dataset's edit mask. It marks the area that was changed, independently of the scanner response.

Download the edit mask ↓

An elephant altered

The left elephant is quiet in the original map. An edited version changes that elephant, and the map responds over it.

Original · Standard map

Original image

Download image ↓
Two elephants in scrub beside a road
Upload image
Standard map of the original image with two elephants
Standard map · hard edges

The original scene produces a quiet Standard map, including the left elephant.

Edited · Standard map

Edited image

Download image ↓
Two elephants in scrub, with the left elephant changed by image editing
Upload image
Standard map responding to the edited elephant
Standard map · hard edges

The edited map covers most of the changed elephant and remains largely quiet elsewhere.

Reveal the edited area
Two elephants in scrub, with the left elephant changed by image editing

The translucent red area shows the supplied edit mask for the left elephant. Compare its shape with the map above.

Download the edit mask ↓

A skier's skis changed

The original snow scene is nearly quiet. In the edited version, the map follows the changed skis without broadly marking the snow.

Original · Standard map

Original image

Download image ↓
A skier moving across a snowy slope
Upload image
Standard map of the original skier image
Standard map · hard edges

The Standard map shows almost no response on the original skis or the snow.

Edited · Standard map

Edited image

Download image ↓
A skier moving across snow with edited skis
Upload image
Standard map responding to the edited skis
Standard map · hard edges

The response traces the changed skis and leaves most of the scene unmarked.

Reveal the edited area
A skier moving across snow with edited skis

The translucent red area is the supplied edit mask for the skis. Compare it with the map response before opening the mask.

Download the edit mask ↓
02

False signals in control scenes

These copies received no local content edit during preparation. Scan each one and inspect the Experimental map. Its additional noise analysis is especially prone to false positives.

No local edit · Experimental map

Dense foliage

Download image ↓
A red-shouldered hawk among dense foliage and branches
Upload image
Experimental map preview with scattered red responses among foliage
Experimental map · hard edges

The experimental map marks leaves and branches in a control image. Texture alone can produce suspect regions.

No local edit · Experimental map

Clouds and reflections

Download image ↓
Sunset clouds reflected in a lake between dark wooded banks
Upload image
Experimental map preview with broad red responses across sky and water
Experimental map · hard edges

Broad responses cover parts of the sky, shoreline, and water. A large colored area can still appear without an introduced alteration.

No local edit · Experimental map

Natural light transitions

Download image ↓
Sunset clouds and sunlit canyon walls above vegetation
Upload image
Experimental map preview with scattered red responses near canyon light transitions
Experimental map · hard edges

Scattered responses occur near bright sky, sunlit cliffs, and vegetation. Compare each marked region with the scene before treating it as an edit.

03

Sources and use

The edit pairs come from a public research dataset. The control scenes have public source pages.

Three edit pairs
TGIF: Text-Guided Inpainting Forgery Dataset by Hannes Mareen and collaborators, distributed under CC BY-SA 4.0. The source photographs are MS COCO images, which the dataset credits under CC BY 4.0. These are Photoshop inpainting edits with supplied masks; the originals and edits retain their native PNG pixels.
Dense foliage
Red-shouldered Hawk by Heather Henkel / USGS. Source page states Public Domain. The tutorial uses a resized, uniformly encoded copy as a control scene.
Clouds and reflections
Sunset over Lake Anne by Jessica Rodysill / USGS. Source page states Public Domain.
Natural light transitions
Sunset clouds above Grand Canyon by Emily Palmquist / USGS. Source page states Public Domain.

The three edit pairs were selected for clear control-to-edit comparisons; they are examples, not an accuracy estimate. “No local edit” labels apply to the three control copies and do not certify the original photographs' complete editing history. Those control images were re-encoded and resized for the tutorial. Use map responses as diagnostic evidence, not authoritative answers.