Futuremark Announces Results Using Non-WHQL Will Not Be Published

Futuremark has announced that at least for the time being they have disabled publication of results using questionable drivers. Nvidia's Non-WHQL Detonator 42.67, 42.68 and 42.69 drivers among those that are Non-WHQL certified. Of course you will be able to still run 3DMark03 to test the performance of a system using Non-WHQL certified drivers and the results are not deleted, but they are not able to be published.

Futuremark has taken the position that they encourage companies to release WHQL certified drivers and results using WHQL drivers should be the only results used to compare the performance of systems. Futuremark has been under fire lately since the release of 3DMark03 and they continue to investigate the possibility that certain drivers that have been appearing lately are optimized to enhance the performance of 3DMark03. While some of these drivers do in fact achieve better scores in 3DMark03, it seems that they do it at the expense of rendering and image quality. Futuremark continues to investigate the impact that these drivers have on 3DMark03.

At least for the time being, the only real way to insure some sort of integrity of the testing process is using WHQL certified drivers. Of course much of the problem surrounding these driver versions has to attributed to their, (in many cases) leaked or beta status. Still, some major companies have not released a WHQL driver in over six months in some cases. Futuremark of course does indicate that they are not banning beta or leaked drivers, but the results will not be officially published.

While listening to Catalyst driver Guru Terry Makedon speak at Lanwar 18, he stressed the importance of WHQL certification as one of the most important keys to over all system stability. ATI for example, has been committed to releasing only WHQL drivers and have been making their regular driver release targets. Every driver released from ATI, so far this year has been WHQL certified. This pales in stark contrast to many other companies who continue to release Non-WHQL drivers on a regular basis.

Of course some might view this announcement from Futuremark as throwing gasoline on the already growing fire, it is refreshing for a company to take a stand on an important issue like this. I believe that there is no reason that manufactures should not be committed to releasing certified drivers that follow some sort of guidelines. The guidelines that WHQL offers, does at least level the playing field and allow better comparisons between products, because all of the drivers and a certain category have to follow these guidelines.