We just talked about the misleading Intel i9 9900K benchmarks that Principled Technologies provided. These numbers suggested that the Intel i9 9900K offers up to double the performance of the AMD Ryzen 2700X. Publications from all around the world have proven them wrong.
Principled Technologies Statement Regarding Controversy
Principled Technologies has now released a statement concerning the Intel i9 9900K benchmarks that it published. The company has tried to defend themselves and it is a far cry if you ask me. The statement starts off by forming credibility by talking about the number of years that the company has been testing products. The statement is as follows:
For almost 16 years, we have tested products for our clients because they trust our integrity. We have worked not just for any one company but for dozens of the leading technology firms, including rivals such as Intel and AMD, Microsoft and Google, Dell and HP, and many others.
I don’t really care how long Principled Technologies has been in the business. Misleading numbers are misleading numbers. If you made a mistake you own up to them. If Intel paid the company to make their products superior then you mention that when you are caught. Principled Technologies clearly denied any misleading numbers by stating the following:
Before going further, we thus must categorically deny any dishonesty in our work on this project for Intel or in any of our other projects.
Principled Technologies also addressed the major issues that we saw in the testing methodology and we are going to look into the responses to each mistake that was made. Next, we are going to look into the detailed explanation that the company has provided regarding the testing methodology of the Intel i9 9900K benchmarks.
Intel i9 9900K Benchmarks: Methodology Breakdown
The first issue that we mentioned was that the AMD CPUs were tested without XMP enabled. AMD CPUs are fond of fast RAM and without XMP these CPUs take a hit of up to 15%. The following is what Principled Technologies had to say regarding the matter:
To have complete parity across all systems, and to allow the Intel Core i9 X-series and AMD Ryzen Threadripper to fully utilize memory bandwidth, we used 4 16GB DDR4 DIMMs on all configurations.
The response confirms that XMP was not enabled on the AMD Ryzen chips and that “D.O.C.P is selected for AMD-equivalent memory settings to XMP.”
Other issues that I noticed were that the benchmarks were only at 1080p. Principled Technologies responded to that by stating that 1080p was the most commonly used resolution and that 62% of gamers use this resolution. The data to back this information is from a Steam Hardware Survey. The following is the statement regarding the matter:
One goal of this study was to test the CPUs and their graphics subsystems, not the GPUs, so we ran the tests at the most common gaming resolution (62.06%), 1920×1080, according to the Steam Hardware Survey.
Principled Technologies mentioned that further testing was underway and that if they found different results then they would share it with the rest of the community. We know that many publications have done these tests on their own and that there is a significant difference.
It will still be interesting to see what the new findings will look like. We shall find out in the upcoming days, so stay tuned for further information regarding the matter.
Let us know what you think about the statement from Principled Technologies regarding the Intel i9 9900K CPU benchmarks and whether or not you think something fishy is going on here.