Image upsampling is a common yet challenging task, since it is severely underconstrained.
While considerable progress was made in preserving the sharpness of salient edges,
current methods fail to reproduce the fine detail typically present in the textured
regions bounded by these edges, resulting in unrealistic appearance.
In this paper we address this fundamental shortcoming by integrating higher-level
image analysis and custom lowlevel image synthesis. Our approach extends and refines
the patch-based image model of Freeman et al.  and interprets the image as a
tiling of distinct textures, each of which is matched to an example in a database
of relevant textures. The matching is not done at the patch level, but rather collectively,
over entire segments. Following this model fitting stage, which requires some user
guidance, a higher-resolution image is synthesized using a hybrid approach that
incorporates principles from examplebased texture synthesis. We show that for images
that comply with our model, our method is able to reintroduce consistent fine-scale
detail, resulting in enhanced appearance textured regions.
Full Paper as PDF
This page contains:
1. Comparison of our texture hallucination method with other upsampling methods
2. Segmentation levels
3. Texture database
Click on the method name at the left of each image in order to toggle between the results.
To see the visualization/effect of some components of our method please click the image descriptions to the right of each image.
We compare our image upsampling method with results obtained via the following methods:
[Bicubic] Adobe Photoshop's bicubic interpolation
[Freeman et al.] W. T. Freeman, T. R. Jones, and E. C. Pasztor.
Example-based super-resolution. IEEE Computer Graphics and Applications, 22(2):56-65,
[Kim et al.] K. I. Kim and Y. Kwon. Example-based learning
for single-image super-resolution and JPEG artifact removal. Technical Report 173,
[Fattal] R. Fattal. Image upsampling via imposed edge statistics.
ACM Trans. Graphics (Proc. SIGGRAPH 2007), 26(3):95-102, 2007.
[Glasner et al.] D. Glasner, S. Bagon, and M. Irani. Super-resolution from a single image. In Proc. ICCV, 2009.
[Shan et al.] Q. Shan, Z. Li, J. Jia, and C.-K. Tang. Fast image/video upsampling. ACM Trans. Graphics, 27(5):1–7, 2008.
[Genuine Fractals] A state-of-the-art image enlarging commercial