Image Quality Factors | Imatest (2024)

Image Quality Factors are also called Key Performance Indicators (KPIs).

Image Quality Factor Video Series

Image Quality Factors | Imatest (13)

Image Quality Video Series: Sharpness

Nov 7, 2016

Watch on YouTube or download

The highest quality images are created by optimizing many key image quality factors. Sharpness determines the amount of detail an imaging system can reproduce. Learn how to optimize sharpness in your camera system using Imatest.


Jan 16, 2017

Watch on YouTube or download

The highest quality images are created by optimizing many key image quality factors. Noise is an undesirable random spatial variation, visible as grain in film, or pixel level fluctuation in digital images. Learn how Noise effects your camera system using Imatest.

Image Quality Factors | Imatest (15)

Image Quality Video Series: Chromatic Aberration

Feb 21, 2017

Watch on YouTube or download

Lateral chromatic aberration (LCA), AKA lateral chromatic displacement (LCD) and “color fringing”, is a lens aberration that causes colors to focus at different distances from the image center. It is most visible near the corners of images. In this video, we will explain the techniques used to measure for LCA.


Image Quality Factors | Imatest (16)

Image Quality Video Series: Color Accuracy

Apr 17, 2017

Watch on YouTube or download

Learn the basics of testing color accuracy, including how to process RAW images, measurement techniques, and how to encode color for human perception.

Image Quality Factors | Imatest (17)

Image Quality Video Series: Dynamic Range

May 16, 2017

Watch on YouTube or download

The highest quality images are produced by optimizing many key factors. Dynamic Range is characterized by the ratio between the highest light intensity that a camera system can capture and the darkest tones that become indistinguishable from noise. Dynamic range measurements are useful for optimizing system performance and for verifying camera design specifications. Informed consumers seek camera systems with superior dynamic range, which can capture information in dark shadows while maintaining detail in brighter areas.


Image Quality Factors | Imatest (18)

Image Quality Video Series: ISO Sensitivity & Exposure Accuracy

Jun 9, 2017

Watch on YouTube or download

ISO Sensitivity (or ISO speed) is a measure of how strongly an image sensor and/or camera responds to light. The higher the sensitivity, the less light (smaller aperture and/or shorter exposure time) required to capture a good quality image.

Image Quality Factors | Imatest (19)

Image Quality Video Series: Uniformity

Jun 9, 2017

Watch on YouTube or download

Lens shading, Light falloff & Vignetting:
Where your image becomes darker the further you get from the center. This is due to the radial nature of the lens which collects more light in the center. It can be particularly strong with wide angle lenses. Non-uniformity is also caused by the chief ray angle of light incident to the sensor which has reduced quantum efficiency as the angle increases.


Image Quality Factors | Imatest (20)

Image Quality Video Series: Distortion

Jun 27, 2017

Watch on YouTube or download

Lens (optical) distortion is an aberration that causes straight lines to curve near the edges of images. It can be troublesome for architectural photography and photogrammetry (measurements derived from images).

Summary table— Image quality factors and corresponding test charts and modules
SharpnessNoiseDynamic range, tone, & contrastColor accuracy
Lens DistortionUniformityBlemishesISO Sensitivity
Lateral Chromatic AberrationLens Flare (Veiling Glare)Color MoiréArtifacts
Data compression lossesDmaxColor gamutTexture Detail

Overview of image quality and Imatest measurements

Image quality is one of those concepts that’s greater than the sum of its parts. But you can’t ignore the parts if your goal is to produce images of the highest quality. Every image quality factor counts.

This page introduces the key image quality factors and briefly describes how Imatest™ measures them— with links to detailed pages. It is a guide to Imatest organized by image quality factors. Other guides include the Tour (organized by module) and Imatest documentation (the Table of Contents).

To illustrate the quality factors, we use this early morning image of Monument Valley from Hunt’s Mesa, near the Arizona-Utah border.

Image Quality Factors | Imatest (21)

Image quality measurements are affected by the

  • LensImatest cannot measure lenses by themselves, but lenses can be effectively compared to one another using a single camera body with consistent image processing settings.
  • SensorImatest can measure the performance of the Lens+sensor from minimally-processed RAW images if they are available. Sharpness, distortion, vignetting, Lateral Chromatic Aberration, noise, and dynamic range are the principal factors that can be measured at this stage. Most of these measurements can be clearly classified as good/bad.
  • Image processing pipeline— typically includes demosaicing, color correction, white balance, application of gamma and tonal response curves, sharpening, and noise reduction. Measured from the image delivered to the user (such as in-camera JPEG images). Additional image quality factors include tonal response (contrast, etc.), color response, and many others. The output of the pipeline may be compared to the minimally-processed lens+sensor measurements.The effect of the pipeline on subjective image quality can be highly scene- and application-dependent, making it difficult to assign “good” or “bad” rankings. Imatest results for these factors need to be interpreted carefully. Examples:
    • Higher contrast images often score higher in visual quality assessment tests, but high contrast can cause clipping (visible as burnt-out highlights) in contrasty (often sunlit) scenes. Tonal response curves with “shoulders” can help. See Stepchart and Multicharts.
    • Most consumers find accurate color to be boring, so camera manufacturers “enhance” colors in a number of ways, such as boosting chroma. See Colorcheck and Multicharts.
    • Most consumers dislike noisy images, but software noise reduction (typically lowpass filtering in areas that lack contrasty features) can remove fine texture, resulting in a cartoon-like “plastic” skin appearance. See Log F-Contrast and Random/Dead Leaves.

Summary table

This table summarizes the image quality factors and links to pages where they are described in detail. Most of the charts are available from Imatest Store.

Quality factor ChartModuleComments

Camera, lens

Blemishes, Sensor defectsPlain, uniformly-illuminated surface
(flat field)
Blemish DetectCan be displayed on flat screen monitor with Screen Patterns and opal diffusing glass. Note [1]
Color accuracyX-Rite ColorChecker (24-patch)Colorcheck, Multicharts, Multitest
IT8.7Multicharts, Multitest
ColorChecker SG, general mxn grids, and many other chartsMulticharts, MultitestNote [1]
Dynamic range (DR),
Tonal response,
Contrast
Grayscale step chartsStepchart, Multicharts, MultitestTransmission charts such as the Imatest 36-Patch Dynamic Range chart or the Stouffer T4110 recommended for DR. Algorithm
Reflective step charts (also works with transmissive charts)Dynamic RangePostprocessor for Stepchart, Multitest. Calculates DR by combining several analyses at different exposures. Doesn’t require a transmission chart.
Special charts: ISO-16067-1, QA-62, EIA Grayscale, ISO-14524
OECF
, ISO-15739
Noise
Stepchart, Multicharts, MultitestNote [1]. Many are available from the Imatest Store.
ColorChecker, ColorChecker SG, IT8.7, Step ChartsMulticharts, Multitest
SFRplus, ISO 12233:2014 E-SFRSFRplus, eSFR ISOSFRplus does not measure DR. eSFR ISO measures ISO 15739 DR. Highly automated. Measures several factors. Available from the Imatest Store.
Exposure accuracyStep charts (reflective)Stepchart, Multicharts, Multitest
X-Rite ColorChecker Colorcheck, Multicharts, Multitest
ISO Sensitivity
(closely related to
Exposure Index)
Step chartsStepchartTwo ISO sensitivity measurements are displayed when incident light (lux) is entered. Details in ISO Sensitivity and Exposure Index
Various color and step chartsMulticharts, Multitest
SFRplusSFRplus
X-Rite ColorCheckerColorcheck, Multicharts, Multitest
Lateral chromatic aberrationSlanted edge, ISO 12233 chartsSFRAvailable from the Imatest Store. Note [2]
SFRplus, ISO 12233:2014 E-SFR, CheckerboardSFRplus, eSFR ISO, SFRreg, CheckerboardAvailable from the Imatest Store. Note [2]
Dot patternDot PatternAvailable from the Imatest Store. Note [2]
Lens distortionSquare or rectangular grid or checkerboard,DistortionPrintable by Test Charts or displayed on LCD flat screen monitor with Screen Patterns.
SFRplus, ISO 12233:2014 E-SFRSFRplus, eSFR ISO, CheckerboardHighly automated. Measures several factors. Results in the Image & Geometry display.
Dot patternDot PatternAvailable from Imatest Store.
Light falloff, vignettingPlain, uniformly-illuminated surfaceUniformityCan be displayed on flat screen monitor with Screen Patterns. Opal diffusing glass recommended.
NoiseStep chartsStepchart
X-Rite ColorCheckerColorcheck
SFRplusSFRplusMeasures flat areas near slanted-edges. Best with low (4:1) contrast charts.
eSFR ISOeSFR ISOMeasures noise from grayscale surrounding center of chart.
Wide variety of grayscale stepcharts and color chartsMultichartsWorks with a large variety of grayscale and color charts if patches are large enough. Can measure sensor (raw) noise.
Sharpness (MTF)Slanted-edge, ISO 12233SFR, Rescharts
ISO 12233:2000 and 2014 charts available from Imatest Store. Edges printable by Test Charts. Algorithm
SFRplus, eSFR ISO, SFRreg, CheckerboardSFRplus, eSFR ISO, SFRreg, CheckerboardHighly automated. Measures several factors. Available from Imatest Store.
Other charts: Star, Spilled Coins, Wedge, etc.Rescharts, Star, Log F-C, Random, WedgeBoth interactive and fixed modules. Each responds differently to signal processing.
Texture detailLog F-Contrast, Spilled Coins (Dead Leaves)Log F-Contrast
Random/Dead Leaves
Lens flare (Veiling glare) Reflective Q-13 or Q-14 step chart with “black hole”StepchartSee Veiling Glare. Note [1]
Color moiré Log Frequency Log Frequency, Wedge
Artifacts Log F-Contrast
Any arbitrary image
Log F-Contrast
SSIM
Notes [1,2] SSIM measures degradation due to image processing (primarily compression) by comparing two images: reference and processed.

Prints

Dmax (deepest black tone)Custom test chart printed from file, scanned on profiled flatbed scannerPrint TestGamutvision extracts these properties from ICC profiles.
Color gamut

Notes: [1] Not available in Imatest Studio. Available in Master, Image Sensor, etc. [2] can be printed from Test charts, but we recommend purchasing it from the Imatest Store.

Links

The RIT Center for Imaging Science has done some excellent work, but links that used to be on their site are hard to find. Some missing links: Direct Digital Image Capture of Cultural Heritage from RIT is a gold mine of information. Links to a number of reports on image quality targeted at museums and cultural institutions. The 78-page Final Project Report by Berns, Frey, Rosen, Smoyer and Taplin, July 2005, is probably the best summary unless you have time for Erin P (Murphy) Smoyer’s 345 page Master’s thesis (about twice the length of the average Ph.D. thesis).

The Research Library Group (RLG) has some useful documents such as Guides to Quality in Visual Resource Imaging (2000). These articles are the predecessors to the above-mentioned RIT Direct Digital Image Capture work.

Paul van Walree has an excellent page on Optics, covering several sources of degradation.

The University of Texas Laboratory for Image & Video Engineering is doing some interesting work on image and video quality assessment, which approaches the problem using information theory, natural scene statistics, wavelets, etc. Challenging material!

Details of several Imatest algorithms are included in Appendix C, Video Acquisition Measurement Methods (pp. 91-125), of the Public Safety SoR (Statement of Requirements) volume II v 1.0, released by SAFECOM, prepared by ITS (a division of NTIA, U.S. Department of Commerce). No credit is given, but the style and illustrations will be recognizable.

Image Quality Factors | Imatest (2024)
Top Articles
Latest Posts
Article information

Author: Lakeisha Bayer VM

Last Updated:

Views: 6107

Rating: 4.9 / 5 (49 voted)

Reviews: 88% of readers found this page helpful

Author information

Name: Lakeisha Bayer VM

Birthday: 1997-10-17

Address: Suite 835 34136 Adrian Mountains, Floydton, UT 81036

Phone: +3571527672278

Job: Manufacturing Agent

Hobby: Skimboarding, Photography, Roller skating, Knife making, Paintball, Embroidery, Gunsmithing

Introduction: My name is Lakeisha Bayer VM, I am a brainy, kind, enchanting, healthy, lovely, clean, witty person who loves writing and wants to share my knowledge and understanding with you.