Jump to content

DxOMark

From Wikipedia, the free encyclopedia

DXOMARK
Logo
Type of site
Professional benchmarking ratings for digital camera systems, camera lenses, photography equipment, and smartphone camera systems
Available in2 languages
List of languages
English, Chinese
Headquarters92100 Boulogne-Billancourt, Paris, France[1]
Area servedWorldwide
OwnerDXOMARK Image Labs SAS
EditorLars Rehm (editor-in-chief)
Key peopleFréderic Guichard (CEO) Marie Frécénon (CFO)
Industryphotography
ProductsSmartphone and digital camera ratings
ServicesConsulting, scientific benchmarking
URLwww.dxomark.com
CommercialYes
RegistrationNone
Launched2008; 16 years ago (2008)[2]
Current statusActive
Content licence
Copyright

DXOMARK is a commercial website described as "an independent benchmark that scientifically assesses smartphones, lenses and cameras".[2][3] Founded in 2008, DXOMARK was originally owned by DxO Labs,[4] a French engineering and consulting company, which is headquartered in Boulogne-Billancourt, Paris, France.[1][4][2][5] DXOMARK Image Labs was separated from DxO Labs in September 2017, and was later re-branded to DXOMARK in 2019.[6][7] DXOMARK is now a wholly independent privately-owned company.[6]

DXOMARK scores are used in many independent news publications and specialist media sites.[2]

DXOMARK rating systems

[edit]

The score(s) awarded by DXOMARK are based upon a comprehensive and highly-documented, but commercially secret methodology. An overall 'headline' (v) score is awarded, but that is based upon an aggregated overview of a number of other very specific and detailed test attributes, although the actual weighting of those individual attributes is unknown.[4] DXOMARK themselves stress that "the overall score is not a weighted sum of the sub-scores. It is a proprietary and confidential mapping of sub-scores into a combined score". DXOMARK also highlight that they consult directly with the equipment manufacturers, with the objective of helping them make better cameras.[4]

In respect of specific score figures, it is not clear what headroom or ceiling level is available to the DXOMARK scoring system.[4] Some early high performers might have suggested an upper limit of 100 points,[4] yet later high performers are awarded scores in excess of 100. It is also important to note that the DXOMARK score is not based on any averages.[4]

Camera sensor rating

[edit]

The DXOMARK Sensor Score measures several important image quality metrics of the RAW image[8] captured by the camera's sensor.[9] The overall score is a confidential combination of three sub-scores:[9][10]

Another metric, the Perceptual MegaPixel (P-MPix), defined as 'the unit of a sharpness measurement', is used to rate the resolution a camera produces when paired to a particular lens.[11] DXOMARK claims that P-MPix is a more accurate and relevant value for photographers to consider than alternate measures of sharpness when evaluating camera and lens image quality.[11][12][13][14][15][unreliable source] As of December 2015, the Canon EF 300mm f/2.8L IS II USM lens mounted on a Canon EOS 5DS R has the highest measured P-MPix (45 P-MPix), followed by the Carl Zeiss APO Sonnar T* 2/135 ZE (41 P-MPix on Canon EOS 5DS R and 36 P-MPix on Nikon D800E).[16]

Camera lens rating

[edit]

The DXOMARK Lens Score provides ratings for camera lenses, as tested using its proprietary tool-set in combination with various camera models.[8][10][17] As with the DxOMark Sensor Score, the DXOMARK Lens Score is an aggregation of five separate sub-scores; namely: sharpness, distortion, vignetting, transmission, and chromatic aberration.[17]

Smartphone camera rating

[edit]

As smartphones began to overtake point-and-shoot cameras,[18] DXOMARK began testing smartphones and other mobile devices in 2011, and introduced DXOMARK Mobile[7] in 2012.[19][20][21] A major update was made in September 2017, adding tests designed to stress the capabilities of current-model smartphones, including those with dual lenses; such as lower-light shooting, telephoto zoom, depth effect, and bokeh.[5][19][20][22] In September 2019, the DXOMARK Mobile score was renamed DXOMARK Camera.[7][19][23]

DXOMARK Camera Overall Score is the headline number reported for each tested device, and consists of a proprietary combination of DXOMARK Camera Photo, and DXOMARK Camera Video category scores.

DXOMARK's Camera Photo score is a proprietary combination of nine category sub-scores:[23]

  • Exposure and contrast
  • Colour
  • Auto-focus
  • Texture
  • Noise
  • Artifacts
  • Night (enhanced from Flash, September 2019)[19][22][23][24]
  • Zoom[22]
  • Bokeh[22]
  • Wide (added September 2019)[19][23][24]
  • Preview (added October 2020)[25]

DXOMARK's Camera Video score includes six of the same sub-scores as DXOMARK's Mobile Photo score (Exposure, Colour, Auto-focus, Texture, Noise, and Artifacts), along with Stabilisation.

DXOMARK's tests are conducted by the company's technical staff under a variety of lighting conditions; ranging from low-light 1 Lux, to bright daylight outdoors.[22] Sub-scores are combined using a proprietary and confidential mapping into an overall score. Tests are also confined to default modes, except for Zoom and Bokeh, which has caused reviewers to be cautious when using them.[4]

Selfie-camera rating

[edit]

On 22 January 2019, DXOMARK started to release the results of a new metric; testing the front-facing 'selfie' cameras on smartphones.[19][26][27] These new standalone DXOMARK Selfie tests are undertaken for both Photo and Video, though the 'headline' DXOMARK Selfie score will combine both.[27] For DXOMARK Selfie Photo, there are sub-scores for Exposure, Colour, Focus, Texture, Noise, Artifacts, Flash, and Bokeh. For DXOMARK Selfie Video, sub-scores include Exposure, Colour, Focus, Texture, Noise, Artifacts, and Stabilisation.[27]

Smartphone audio rating

[edit]

On 10 October 2019, DXOMARK introduced a new Audio benchmark for smartphones.[28] Phones are tested for playback using their internal speakers, and for recording using their built-in microphones.[29] DXOMARK Audio tested categories include:[28][29]

  • Timbre (frequency response, treble/mid-range/bass, total balance, volume dependency)
  • Dynamics (attack, bass precision, punch, volume dependency)
  • Spatial (wideness, balance, distance, localisation)
  • Volume (maximum, minimum, user volume consistency)
  • Artifacts (noise, pumping, clipping, user artifacts, other artifacts)

For recording only:[28][29]

  • Background (directivity, noise profile, artifacts)

Smartphone display ratings

[edit]

In October 2020, DXOMARK introduced a rating system for mobile device displays (screens). DXOMARK Display tests over 400 measurements, and more than 20 hours of laboratory evaluations and real-life scenarios. The result includes six sub-scores: Readability, Colour, Video, Motion, Touch, and Artifacts.[30]

Wireless speaker ratings

[edit]

In November 2020, DXOMARK introduced a rating system, DXOMARK Sound, for wireless speakers, based on factors including both lab tests using sound-level meters and calibrated microphones, as well as 20 hours of perceptual assessment. Customized music clips, created by DXOMARK in collaboration with professional musicians and recording studios, include those in the styles of jazz, hip-hop, classical, pop, rock, Latin, electronic, and alternative genres.[31]

Battery ratings

[edit]

DXOMARK started smartphone battery testing on 10 May 2021. DXOMARK's battery test protocol is based on 70 measurements and takes 150 hours to test.[32]

Comparison tool

[edit]

Users of the DXOMARK website can select several devices of the same class, and have the website display a comparison of their test scores and graphical versions of the actual test data.[10][33]

Analyzer

[edit]

Analyzer is a suite of software tools published by DXOMARK, that includes test targets and test equipment. It is used by camera companies, as well as press publications and websites;[34] to test sensors, lenses, and standalone cameras, as well as mobile devices with cameras. Testing can be performed on both RAW and JPEG images, as well as video. Analyzer is also the analysis engine behind dxomark.com[8][34][35] Results can be displayed either numerically or graphically.[36] Originally introduced by DxO Labs, Analyzer is now a product of DxOMark, which has been separated from DxO.[6][37]

Analyzer includes modules for testing optics, sensors, stabilisation, video, timing, and 3D features.[38]

Usage in industry

[edit]

DXOMARK ratings are often used by the press to describe the image quality characteristics of their cameras and mobile devices.[4][39][40][41] High DXOMARK Camera ratings have also been featured as hallmarks of quality in vendor announcements[42] and marketing materials,[43] although reviewers are careful to note that the ratings only reflect image quality.[44][45][46] DXOMARK also provides consulting services to hardware manufacturers, related to image quality.[47][48]

See also

[edit]

References

[edit]
Citations
  1. ^ a b "Contact us". www.DxOMark.com. DxOMark. Retrieved 4 October 2020.
  2. ^ a b c d "What is DxOMark?". www.DxOMark.com. DxOMark. Retrieved 13 October 2020.
  3. ^ "Honor ranks #2 in the world of smartphone cameras – That's according to camera specialists DxOMark". Esquire Middle East – the Region's Best Men's Magazine. Esquire Middle East – Hearst Communications, Inc. 24 July 2019. Retrieved 4 October 2020.
  4. ^ a b c d e f g h i "What is a DXOMark score?". www.PCWorld.idg.com.au. PC World Australia – IDG Communications. 20 March 2018. Archived from the original on 1 June 2020. Retrieved 14 October 2020.
  5. ^ a b "DxOMark unveils expanded mobile benchmark suite". Smart-Chimps.co.uk. Smart Chimps. 12 September 2017. Retrieved 4 October 2020.
  6. ^ a b c "DxOMark splits from DxO Labs, is now an independent privately-owned company". www.DPReview.com. Digital Photography Review. 8 January 2018. Retrieved 13 October 2020.
  7. ^ a b c "DxOMark: Huawei Mate 30 Pro camera score will be announced today". www.Gearbest.com. Gearbest blog. 26 September 2019. Archived from the original on 29 September 2019. Retrieved 13 October 2020.
  8. ^ a b c "Lens reviews explained". www.DPReview.com. Digital Photography Review. 30 October 2012. Retrieved 12 November 2020.
  9. ^ a b "Sensors Database – DxOMark". www.DxOMark.com. DxOMark. Retrieved 13 October 2020.
  10. ^ a b c "A simple guide to the DXOMARK numbers". DaystarVisions.com. Daystar Visions. 2015. Retrieved 13 October 2020.
  11. ^ a b "DxOMark reviews > looking for new photo gear? DXOMARK's Perceptual Megapixel can help you". www.DxOMark.com. DxO Labs. 17 December 2012. Archived from the original on 14 August 2013. Retrieved 23 August 2016.
  12. ^ "Perceptual Megapixel: lens sharpness boiled down to a single number". PetaPixel.com. PetaPixel blog. 17 December 2012. Retrieved 13 October 2020.
  13. ^ "DxOMark introduces the 'Perceptual Megapixel'". TimGrey.com. Tim Grey's blog – thoughts on photography, digital imaging, and travel. 6 January 2013. Archived from the original on 27 August 2013. Retrieved 23 August 2016.
  14. ^ "DxO Labs tries making sense of camera lens sharpness". www.CNET.com. CNET – CBS Interactive Inc. 17 December 2012. Retrieved 13 October 2020.
  15. ^ "DxOMark scores lens sharpness with Perceptual Megapixel". www.Photo.net. Photo.net Photography forums. 20 December 2012. Retrieved 13 October 2020.
  16. ^ "Lenses > Camera Lens Ratings > Optical Metric Scores > camera lens ratings by DXOMARK". www.DxOMark.com. DxO Labs. Archived from the original on 20 November 2013. Retrieved 13 October 2020.
  17. ^ a b "Lenses Database – DXOMARK". www.DxOMark.com. DxOMark. Retrieved 13 October 2020.
  18. ^ Daisuke Wakabayashi (30 July 2013). "The point-and-shoot camera faces its existential moment; as more users opt for smartphones, companies wonder what's next". www.WSJ.com. The Wall Street Journal – Dow Jones & Company, Inc.
  19. ^ a b c d e f "Introducing our new Wide and Night scores". www.DxOMark.com. DxOMark. 18 September 2019. Retrieved 13 October 2020.
  20. ^ a b "DxOMark revamps its mobile testing for the phone cameras of 2017; new testing method will take into account dual cameras, selfie performance, and other recent trends". www.AndroidCentral.com. Android Central – Future US, Inc. 12 September 2017. Retrieved 13 October 2020.
  21. ^ Lexy Savvides (10 October 2012). "Smartphones outperforming high-end compact cameras". www.CNET.com.au. CNET Australia – CBS Interactive. Archived from the original on 24 February 2014. Retrieved 15 February 2014.
  22. ^ a b c d e "DxOMark adds bokeh and zoom to new smartphone camera scoring scale; DxOMark's testing protocol for scoring smartphone cameras adds zoom, bokeh". www.DigitalTrends.com. Digital Trends – Designtechnica Corporation. 12 September 2017. Retrieved 13 October 2020.
  23. ^ a b c d Monckton, Paul (24 September 2019). "iPhone 11's best camera features now part of DxOMark tests". Forbes. Archived from the original on 27 November 2020. Retrieved 13 October 2020.{{cite web}}: CS1 maint: bot: original URL status unknown (link)
  24. ^ a b "DxOMark adds Wide and Night scores to its tests, [Samsung Galaxy] Note 10 tops recalculated results". www.GSMArena.com. GSM Arena. 18 September 2019. Retrieved 13 October 2020.
  25. ^ "DxOMark test shows superiority of Apple's cameras". www.DigitalInformationWorld.com. Digital Information World. 22 October 2020. Retrieved 12 November 2020.
  26. ^ "Here are the best selfie cameras on the market, according to DxOMark". www.DigitalTrends.com. Digital Trends – Designtechnica Corporation. 22 January 2019. Retrieved 14 October 2020.
  27. ^ a b c Monckton, Paul (22 January 2019). "How DxOMark's new test ranks selfie cameras". Forbes. Archived from the original on 7 November 2020. Retrieved 14 October 2020.{{cite web}}: CS1 maint: bot: original URL status unknown (link)
  28. ^ a b c Lovejoy, Ben (10 October 2019). "DxOMark audio testing begins, with interesting results for iPhones - finds iPhone 11 Pro Max worse than iPhone XS Max". 9to5Mac.com. 9to5Mac blog. Archived from the original on 24 October 2020. Retrieved 14 October 2020.{{cite web}}: CS1 maint: bot: original URL status unknown (link)
  29. ^ a b c Mehta, Ivan (10 October 2019). "DxOMark launches audio ranking to test recording and playback quality of phones". TheNextWeb.com. Plugged | The Next Web. Retrieved 14 October 2020.
  30. ^ "DXOMARK introduces new score for smartphone display and expands smartphone rear-camera testing". Markets.BusinessInsider.com. Markets Insider – Insider Inc. and finanzen.net GmbH. 21 October 2020. Retrieved 12 November 2020.
  31. ^ "DXOMark announces new benchmark for the sound quality of wireless speakers". www.TechRadar.com. TechRadar – Future Publishing Limited. 4 November 2020. Retrieved 12 November 2020.
  32. ^ "Introducing the DXOMARK Battery protocol". DXOMARK. 10 May 2021. Retrieved 10 May 2021.
  33. ^ "How do I use DxOMark?". Northrup.photo. Tony & Chelsea Northrup. 30 June 2015. Retrieved 14 October 2020.
  34. ^ a b "Popular Photography: how we test". www.PopPhoto.com. Popular Photography – Bonnier Corporation. 2 February 2013. Retrieved 13 November 2020.
  35. ^ "Publication Partagée". www.ChassImages.com (in French). Chasseur d’Images. Archived from the original on 4 March 2016. Retrieved 8 November 2015.
  36. ^ "How we test lenses". www.SLRgear.com. SLR Gear!. Archived from the original on 27 November 2020. Retrieved 8 November 2015.
  37. ^ "DxO Analyzer". corp.DxOMark.com. DxOMark. Retrieved 9 March 2018.
  38. ^ "DxO Analyzer 5". www.PhotographyBlog.com. Photography Blog. 19 October 2012. Retrieved 11 November 2015.
  39. ^ "HTC 10 gets the same DXOMark score as Galaxy S7". www.AndroidCentral.com. Android Central. 12 April 2016. Retrieved 23 August 2016.
  40. ^ "Leading camera lab report: Samsung Galaxy S7 Edge named new smartphone camera champion". news.Samsung.com. Samsung Newsroom. 18 March 2016. Retrieved 23 August 2016.
  41. ^ "How Google hopes its Pixel camera will win over iPhone fans". www.CNET.com. CNET. Retrieved 13 November 2016.
  42. ^ "8 times Google savagely burned Apple during the Pixel announcement". www.MacWorld.com. Mac World. Retrieved 13 November 2016.
  43. ^ "Google Pixel 2 and Pixel 2 XL". www.VerizonWireless.com. Verizon Wireless. Retrieved 8 March 2018.
  44. ^ Bagnell, Juan Carlos (4 October 2016). "Google Pixel: a great DxOMark score doesn't mean 'the best smartphone camera'". PocketNow.com. Archived from the original on 4 September 2018. Retrieved 13 November 2016.
  45. ^ "Who is hiding behind DxOMark scores?". www.AndroidPit.com. Android PIT. Archived from the original on 30 August 2017. Retrieved 15 June 2017.
  46. ^ "Google's new Pixel 2 phone cameras are highly rated". Fortune.com. Fortune. 4 October 2017. Retrieved 5 October 2017.
  47. ^ "DxOMark scores shouldn't be your definitive camera rating system". www.AndroidAuthority.com. Android Authority. 9 October 2017. Retrieved 10 October 2017.
  48. ^ "A summary of MKBHD's explanation of DxOMark ratings". ResourceMagOnline.com. Resource. October 2017. Retrieved 17 October 2017.
Further reading
  • "Photography – 5 features that make awful smartphone cameras a thing of the past". www.DigitalTrends.com. Digital Trends – Designtechnica Corporation. 26 February 2018. Retrieved 14 October 2020. The camera-testing wizards at DxOMark have now been testing smartphone cameras for five years, and with that milestone comes five years worth of data on the tech inside our smartphone cameras. So what makes the smartphone camera of today so capable? DxOMark recently shared five technologies that have caused smartphone camera capabilities to grow exponentially in the last five years.
[edit]
Retrieved from "https://en.wikipedia.org/w/index.php?title=DxOMark&oldid=1227070660"