AI Depth Mapping Isn’t Magic Even if the Results Are

Upscaling doesn’t “restore hidden detail”

It predicts plausible detail using patterns learned from massive datasets.

That’s why it can look astonishing, and that’s why it can hallucinate.

Introduction

Scarcity is dead. Pixels are not.

When you upscale a video, you’re not excavating some secret 4K master that the universe forgot to give you. You’re asking a model to predict what the missing detail should look like.

It’s pattern completion at scale, and that distinction matters. Because once you understand that upscaling is prediction — not recovery — you stop asking the wrong question (“Can this make it real 4K?”) and start asking the right one: what kind of predicted outcome do I want?

Imagine you have a tiny 256×256 image. You stretch it to 1024×1024.

Now there are empty pixel slots. Millions of them.

Traditional upscaling (bicubic, bilinear) fills those slots by averaging nearby pixels. The result is smooth but blurry.

AI upscaling does something different.

It has seen millions of faces, buildings, trees, text, anime frames, compression artifacts, etc. When it sees a blurry eye, it predicts what sharp eyes usually look like. When it sees low-resolution text, it predicts how text edges typically behave.

It doesn’t “find” missing data. It guesses intelligently.

What's happening under the hood

Super-resolution models learn a mapping: low-resolution (LR) → high-resolution (HR)

But the mapping is not deterministic. For any low-resolution patch, there are many possible high-resolution interpretations. So the model must choose one.

Residual Learning: most modern super-resolution networks don’t try to recreate the whole image. They predict the residual — the difference between the upscaled base and the enhanced version. This is computationally efficient and stabilizes training.

Loss Functions Shape Personality: How a model is trained determines its “aesthetic bias.”

Common losses:

• L1 / L2 Loss: penalizes pixel differences. Produces safe but softer outputs.

• Perceptual Loss (VGG-based): optimizes for feature similarity in deep networks. Produces sharper, more realistic texture.

• Adversarial (GAN) Loss: a discriminator judges realism. This creates crisp details — but increases hallucination risk.

Hallucination vs Reconstruction: When people complain about AI upscaling “making things up,” they’re correct. But that’s not a bug. It’s an unavoidable property of the problem.

Low resolution destroys information. The model must reconstruct missing high-frequency content probabilistically.

Upscaling adds more detail

…but more detail isn't always better

Here’s a counterintuitive truth: Over-sharpening reduces realism.

When a model pushes too hard:

• Skin becomes plastic

• Hair becomes crunchy

• Text warps

• Edges halo

In still images, this might pass, but in video it falls apart. Temporal coherence exposes overconfidence.

Artifact field guide

Upscaling Edition

Upscaling models don't have a universal "best"

They have personalities.

Below is a practical, real-world summary of the model families most commonly used in modern video enhancement stacks, most of which are included in Anelo in some form.