Dual-Stream AI Combines Compression Clues and Deep Vision to Expose Doctored Images

Every day, millions of manipulated images circulate across social media, news platforms, and courtrooms, and the tools that create them are growing more powerful by the month. A new study published in Neural Computing and Applications proposes a fresh line of defense: a dual-stream convolutional neural network that fuses what a picture looks like with the faint statistical fingerprints left behind by image compression. The work, led by Ankit Kumar Jaiswal of Jawaharlal Nehru University in New Delhi, together with Asad Nizami of the University of Bonn and Rajeev Srivastava of the Indian Institute of Technology (BHU) Varanasi, tackles one of the most stubborn problems in digital forensics—finding not just whether an image has been tampered with, but exactly where.

The central insight behind the architecture is that two very different kinds of evidence can reveal a forgery. The first is semantic: a spliced photograph often contains objects whose lighting, edges, or textures do not quite agree with their surroundings, and modern deep learning models have become remarkably good at picking up such visual inconsistencies. The second is statistical: when a digital image is saved as a JPEG file, the compression process leaves a characteristic pattern of errors that changes wherever a region has been pasted in, retouched, or re-saved. Error Level Analysis, or ELA, is a classic forensic technique that amplifies these discrepancies by measuring how much a picture degrades when it is recompressed at a known quality level. Regions that were manipulated after the original compression tend to show different error levels than untouched areas, making them glow under analysis.

ELA has long been valued by forensic practitioners for exactly this reason, but it comes with a practical drawback: computing it across large collections of images is computationally expensive, and interpreting its output by hand or with shallow classifiers is unreliable. The new study sidesteps this bottleneck by vectorizing the ELA computation so that it can run efficiently alongside the RGB stream, turning a slow manual step into a fast, parallelized preprocessing operation that feeds directly into the network. Rather than choosing between appearance and compression evidence, the authors treat both as first-class inputs, processing them in parallel from the very first layer of the model.

Concretely, the architecture consists of two lightweight encoder networks, one receiving the original RGB image and the other receiving its ELA map. Each encoder progressively extracts features at multiple scales, learning representations that capture both local texture anomalies and broader structural context. The two feature streams are then fused and passed into a single shared decoder, which reconstructs a pixel-level map indicating which regions of the image are likely to have been manipulated. Skip connections run from both encoders into the decoder, a design borrowed from the celebrated U-Net segmentation architecture, which preserves fine spatial detail that would otherwise be lost as features pass through successive downsampling stages. This matters enormously in forgery localization, where the difference between a useful forensic tool and a useless one often comes down to whether the output mask aligns precisely with the tampered pixels.

A second key ingredient is attention. The convolution blocks in both the encoder and decoder modules are augmented with the Convolutional Block Attention Module, or CBAM, a widely used mechanism that refines features along two complementary dimensions. The channel attention component learns which feature maps are most informative for distinguishing authentic content from manipulated content, effectively letting the network emphasize, say, the channels that respond to compression artifacts while suppressing those that encode irrelevant background detail. The spatial attention component then highlights the specific pixel locations where suspicious evidence is concentrated. Stacked together, these attention operations sharpen the discriminative power of the learned features without adding substantial computational cost, which is essential for a model intended to be practical rather than merely accurate on a benchmark.

The design choices reflect a deliberate focus on a particular family of forgeries: those that introduce compression inconsistencies. Image splicing, in which a fragment of one photograph is pasted into another, and retouching, in which parts of an image are altered or enhanced, both tend to disturb the uniform JPEG error signature of an authentic file. Because the pasted region typically originates from an image with a different compression history, its error level profile differs from that of its new surroundings. By feeding the ELA map directly into a dedicated encoder, the network can learn to exploit these discrepancies automatically, rather than relying on hand-crafted thresholds that break down when image quality, resolution, or compression settings vary.

This approach distinguishes the work from many recent deep learning methods for forgery detection, which have grown increasingly heavy. Survey literature in the field notes that while numerous proposed models achieve impressive results on standard benchmarks, many are either computationally intensive or generalize poorly to datasets they were not trained on. The authors position their model as a lighter alternative: by using lightweight encoders and an efficient vectorized ELA pipeline, the system aims to deliver competitive localization performance without the enormous parameter counts and inference costs of large vision transformers or heavily engineered multi-stage pipelines. In forensic practice, where investigators may need to triage thousands of images, that efficiency is not a luxury but a requirement.

The evaluation strategy follows the conventions of the field, drawing on established benchmark datasets for manipulated images, including collections such as CASIA, CoMoFoD, and related corpora that have become standard proving grounds for splicing and copy-move detection methods. The reported results show competitive performance on these benchmarks, indicating that the dual-stream design with CBAM-augmented blocks can hold its own against existing approaches while remaining computationally lean. The authors also tested the model on a large collection of real and fake faces hosted publicly on Kaggle, extending the evaluation beyond generic object scenes to the portrait imagery that dominates online misinformation.

Perhaps the most scientifically honest part of the study is what it admits. In cross-dataset evaluation—training on some datasets and testing on a completely unseen one—the model, like most of its predecessors, struggled to generalize to the full diversity of real-world manipulations. This is a well-documented weakness across the entire field of image forensics: models tend to learn dataset-specific cues, such as the compression settings or camera characteristics of a particular corpus, rather than universally valid traces of tampering. When those cues shift, performance drops. The authors explicitly flag this as an important avenue for future research, a candid acknowledgment that benchmark success does not yet translate into forensic reliability in the wild, where adversaries can re-encode, resize, and filter images precisely to erase the very artifacts detectors rely on.

The stakes for this line of research could hardly be higher. Generative tools now allow anyone to fabricate convincing photographs in seconds, and manipulated images have been documented influencing elections, financial markets, and public health debates. Passive forensic techniques—those that detect tampering without access to the original file or cryptographic signatures—are among the few remaining checks on this flood of synthetic and doctored content. By showing that a classical forensic signal like ELA can be vectorized, paired with deep visual features, and refined with attention mechanisms inside a compact encoder-decoder network, the study offers a template for building detectors that are simultaneously fast, accurate, and grounded in the physics of image formation. The road to robust, generalizable forensics remains long, but this work demonstrates that the most promising path may lie not in abandoning classical techniques for deep learning, but in teaching them to work together.

Subject of Research: Dual-stream CNN with RGB–ELA inputs and CBAM attention for detecting and localizing image forgeries

Article Title: An optimized dual-stream CNN with vectorized RGB–ELA inputs and CBAM attention for image forgery detection

Article References: Jaiswal, A. K., Nizami, A., & Srivastava, R. (2026). An optimized dual-stream CNN with vectorized RGB–ELA inputs and CBAM attention for image forgery detection. Neural Computing and Applications, 38(19), Article 796. https://doi.org/10.1007/s00521-026-12534-w

Image Credits: AI Generated

DOI: 10.1007/s00521-026-12534-w

Keywords: image forgery detection, digital image forensics, error level analysis, convolutional neural network, CBAM attention, feature fusion, image splicing, forgery localization, deep learning, U-Net, JPEG compression artifacts, computer vision