Every review causes a war of words. Is DxOMark, which gives high scores to Huawei P10's camera, reliable?

Every review causes a war of words. Is DxOMark, which gives high scores to Huawei P10's camera, reliable?

Yesterday, the famous camera evaluation organization DxOMark released the camera evaluation results of Huawei's new flagship P10. In the end, the score of Huawei P10 was fixed at 87 points. This result tied for third place with Moto Z Force Droid, Samsung Galaxy S6 Edge Plus, Sony Xperia XZ and Sony Xperia Z5, defeating classic models such as iPhone 7.

However, the focus of our article today is not on the camera performance of Huawei P10, but DxOMark. Like every previous evaluation, DxOMark's score has once again been criticized by netizens. Many people think that DxOMark's evaluation no longer has credibility. Why can Sony, which does not perform well in photography, dominate the list? Why shouldn't models such as Huawei P10 and iPhone 7 be ranked in the top few? Even the saying that DxOMark takes money has emerged, and there was a lot of saliva flying around. So how does DxOMark do the evaluation? Will it collect kickbacks from manufacturers? How did those results in the evaluation that are far from our usual cognition come about? DxOMark was founded in 2003 and has always been committed to professional camera and lens evaluation, but in recent years it has also started to evaluate mobile phone photography. On their website, we can see their definition of themselves: Objective, Independent, Comprehensive, which means objective, independent and comprehensive. So why does DxOMark still have so many "controversial penalties"? This requires talking about their "rigid" evaluation method. In order to achieve the most accurate evaluation data, DxOMark's laboratory is covered with matte materials, the temperature is controlled at 21-25 degrees, the humidity is between 30-70%, and the on-site light source has even been corrected for color temperature using spectral equipment to strictly control the entire test environment. And they don't use the naked eye to make horizontal and vertical comparisons, but use professional equipment to read out the various data of the RAW format photo file, and then calculate the score of a certain aspect according to the relevant formula. Look at the calculation formula of the signal-to-noise ratio below. Are you dumbfounded? And it is precisely because of DxOMark's testing method that only looks at data and not actual performance that the actual perception may be different from the test results. For example, there is a similar "shortcoming" in the camera testing standard: DxOMark scores according to Print points (scores after compression to a certain size) in the sensitivity test, and this algorithm is more advantageous for high-pixel models! In addition to Print points, there are actually testing methods such as Screen points.
There are Screen and Print options in the upper right corner. Can we also infer from this point whether the same tendency will appear on mobile phones? Will the DxOMark algorithm be biased towards Sony's mobile phones? In addition, in the test of Artifacts, a problem of image quality degradation, the Artifacts scores of many old models are far better than those of new models, which makes us have to doubt that for metaphysical issues such as image quality, can data really completely replace the observation of the eyes? In addition, many mobile phones cannot output RAW. Each sample is the product of the joint influence of the lens, CMOS, ISP, and algorithm. Later, there are a series of changes such as HDR, dynamic range improvement, noise reduction, multi-frame synthesis, and even color adjustment. In this case, DxOMark still uses a specific scoring method to test, which seems objective, but it is actually the most subjective approach. The best proof is that DxOMark cannot provide specific standards, reference documents, and original test data for mobile phone testing. This is where DxOMark's advantage as a camera evaluation agency comes into play. Professional photographers only look at RAW and not JPG. Few people use in-camera filters, multi-frame synthesis and other functions when taking photos, because only good RAW files can give them more room for post-production adjustments. I think it may be because the test content previously catered too much to the needs of professional photographers that DxOMark is not suitable for mobile phone testing!
The importance of RAW for post-production. Finally, video shooting is also given a relatively heavy weight in the DxOMark test, and the scores of mobile phones with good video are relatively high. The focus test and anti-shake test are also full of doubts. For example, in the focus test, the focus score of the Samsung S5 with phase focus is far lower than that of the S4. And when we generally use the automatic mode to take pictures, DxOMark uses the full manual mode for testing. Don’t you think this is a special treatment for Sony? So if you want to define the DxOMark score, in terms of absolute image quality, although the DxOMark score has an inexplicable tendency, it still has a very strong reference significance. Some pictures are really only taken well by the first place, and the second place is really not good. Some photos can only be seen clearly by those few mobile phones when they are enlarged to 100%. However, in our daily use, we should compare the sample photos horizontally and vertically, and try out the camera experience of the phone ourselves, then we can choose the phone that suits us best. Sometimes we really can't easily equate high scores with high quality, just like we said when we were in school: the person with the best test scores is not necessarily the best in the class.

As a winner of Toutiao's Qingyun Plan and Baijiahao's Bai+ Plan, the 2019 Baidu Digital Author of the Year, the Baijiahao's Most Popular Author in the Technology Field, the 2019 Sogou Technology and Culture Author, and the 2021 Baijiahao Quarterly Influential Creator, he has won many awards, including the 2013 Sohu Best Industry Media Person, the 2015 China New Media Entrepreneurship Competition Beijing Third Place, the 2015 Guangmang Experience Award, the 2015 China New Media Entrepreneurship Competition Finals Third Place, and the 2018 Baidu Dynamic Annual Powerful Celebrity.

<<:  When gamers win glory for the country in the Asian Games, the living room big screen finds a way to win back young people

>>:  "Unlimited" data usage is just a gimmick, and it's too early to say Wi-Fi is obsolete

Recommend

Is this Apple’s “disaster” point or turning point?

[[251089]] Image source: Visual China Suppliers w...

Try out the 4-in-1 iPhone external lens to improve your photography experience

Olloclip is the first accessory manufacturer to p...

How much does a four-day tour to Hong Kong and Macau cost?

If you travel independently, all the expenses wil...

Analyze user churn from 4 perspectives!

The author of this article, through his own proje...

To protect your account security, Microsoft invites you to delete your password

Now, users can remove passwords from their Micros...

2021 Mobei Google SEO Optimization Seventh VIP

2021 Mobei Google Optimization Seventh VIP...

The "Pumpkin Lantern" exploded 150 million kilometers away

Various Jack-o'-Lanterns are symbols of tradi...

Looking at the user life cycle from the data: Will lost users come back?

Looking at the user life cycle from data One of t...

What is nofollow? What does nofollow mean?

Many friends who are engaged in website SEO optim...

Hacker Attack and Defense SQLMAP Practical Edition

Course Description This course starts with SQLMAP...

ZTE's logic for making cars: cars are smartphones on four wheels

Another heavyweight company has joined the car-ma...