The Wayback Machine - https://web.archive.org/web/20070926010340/http://www.pcabx.com:80/

PC ABX Web Site

"Shedding light by means of the combustion of snake oil"

PCABX� FAQ

1.0 What is PC ABX?
1.1 PC ABX is a 32 bit Windows PC-based "Virtual Reality" methodology for testing audio products� and obtaining information about issues relating to audibility. It is based on the ABX methodology for "Double Blind" audio tests. For more information about ABX testing, please see The ABX Web site .

ABX software for Unix (source code) can be found at� abx.c from the Lame Source

ABX software for Linux can be found at� http://www.beryllium.net/~remco/linabx/

ABX software for Macintosh can be downloaded here: program/MacABX.hqx . This software was provided courtesy of Chris Johnson who has an audio-related web site at http://www.airwindows.com .

An ABC/Hr comparator can be found at Darryl Miyaguchi's web site at http://ff123.net/abchr/abchr.html

Another ABX Comparator can be found at Timo Esser's web site at http://www.esser.u-net.com/abx.htm

The WINABX comparator can be downloaded from� http://www.kikeg.arrakis.es/winabx/winabx.zip . Sound card related test files can be downloaded from http://www.kikeg.arrakis.es .

The foobar2000 music player includes a ABX comparator that can be downloaded from http://www.foobar2000.org/components.html#foo_abx .

PCABX IS NOT intended to be a general replacement for properly-designed listening tests involving audio equipment that is already in your listening room. There are many situations where PCABX is beneficial, even when the equipment is directly available to you for listening.�

Properly-designed listening tests have been behind the development of important technological advances such as perceptual coders (MP3) and various audio� products, particularly loudspeakers.�

Unfortunately, over the past 20� years, very few (prior to PCABX, perhaps 1,000 people) have had the opportunity to participate in a properly-designed listening test. Most properly-designed listening tests have taken place in research and development facilities belonging to universities and large corporations.�

PCABX provides the average recording engineer or audiophile the opportunity, in his own listening room, to apply the power of properly-designed listening tests to his personal development as a sensitive, reliable listener. Thus, properly-designed listening tests can benefit a far larger group of people and inform their purchase decisions.

If you are already familiar with PCABX, Click here to proceed directly to the PCABX Listening Room.

If you already know about PCABX and want to get started right away, please click here.

1.2
Since the creation of� the first� hardware-based ABX�DBT comparator which� I helped invent over 23 years ago, a number of innovations have been made to improve the sensitivity and reliability of DBTs:

�1.2.1 PCABX optimizes the listener's control over the listening test by making ABX Comparators easy to obtain and use. About 10,000 ABX comparators have been downloaded from www.pcabx.com since 10/1/1999. The current download rate is about �200 per week, which probably exceeds the total number of hardware DBT comparators that�were built in the 22�or so�years�between the invention of the ABX test and� the opening of the www.pcabx.com�web site. Right now over 2,000 tests per week are being downloaded from www.pcabx.com . In the last 6 months of the year 2001 just under 80,000 test files were downloaded.

1.2.2 PCABX provides formal listener training based on relevant listening challenges of increasing difficulty, such as is provided at http://www.pcabx.com/training/index.htm�. These challenges simultaneously educate,�test and self-qualify the listener and his listening equipment. The goal of this training is the production of "Severe Listeners" who reliably detect large, small and subtle audible differences between audio products. http://www.pcabx.com/product/index.htm�is a list of audio products currently available for audition at www.pcabx.com.

1.2.3 PCABX is�a test paradigm that compares the performance of all equipment to a well-known ideal: Sonic Accuracy. Two different pieces of equipment can also be compared to each other, but the focus of most�comparisons�is sound quality relative to�a perfect ideal which is the original audio signal�prior to passing through the audio product under test.

1.2.4 PCABX very much lends itself to pre-selection of short audio selections that are� intolerant of audible artifacts in audio equipment. It is well known that much musical program material is tolerant of flaws in the reproduction of music. Under ordinary circumstances listeners may become bored or distracted while listening for differences because the program material is not severe enough to clearly stimulate audible artifacts. In fact it is arguable that the natural sounds of many instruments have a side-effect of masking technical differences in sound reproduction. The http:www.pcabx.com web site is based on collections of natural and simulated sounds that have been found to be intolerant of poor quality reproduction systems.

1.2.5 PCABX enables people to do listening tests on audio equipment that is not in their possession. The� relevance of the PCABX process to the sale or promotion of audio products over the internet or�"by mail" �seems obvious. www.pcabx.com's "Product Listening Room" located at http://www.pcabx.com/product/index.htm can be thought of as the internet equivalent of a HiFi salon.�
1.2.6 PCABX is based on the earlier work by various experimenters who executed Double Blind Listening Tests (DBTs) by playing computer audio files under the control of a computer software-based test coordinator. Examples of this kind of testing can be found at http://www.tnt.uni-hannover.de/project/mpeg/audio/public/w2006.pdf (ca. 1998) and http://www.revelspeakers.com/i/listening_lab.pdf (ca. 1993). Please also see "Subjective Evaluation of State-of-the-Art Two-Channel Audio Codecs"� by Gilbert A. Soulodre, Theodore Grusec, Michel Lavoie,and Louis Thibault , JAES Volume 46 Number 3 (March 1998) and "A Method for Training Listeners and Selecting Program Material for Listening Tests" by Sean Olive� AES Preprint 3893 (AES Convention 97 in 1994).
1.3

This web site encourages conformance with applicable international technical standards organizations publications including� ITU Recommendation BS 1116-1. You can find out more about this document at http://www.itu.int/itudoc/itu-r/rec/bs/1116-1.html . The approximate cost of this 26 page document in MS Word or PDF format is $12.00 US as of 10/1/2000.�

This document says in part:

--- begin quotes from ITU BS 1116-1 ---

"The ITU Radiocommunication Assembly, considering

a)������������� that Recommendations ITU-R BT.500, ITU-R BS.562, ITU-R BT.710 and ITU-R BT.811 have established some methods for assessing subjective quality of audio and video systems;

b)������������� that subjective listening tests permit assessment of the degree of annoyance caused to the listener by any impairment of the wanted signal during its transmission between the originating source and the listener;

c)������������� that classical objective methods may not be adequate in assessing advanced audio coding schemes and that perceptual objective assessment methods are being developed for testing the sound quality of sound systems;

d)������������� that the use of standardized methods is important for the exchange, compatibility and correct evaluation of the test data;

e)������������� that the introduction of new advanced digital audio systems exploiting psycho-acoustic properties, especially with small impairments requires advancements in subjective assessment methods;

f)�������������� that the introduction of new multichannel stereophonic sound systems with or without accompanying picture requires new subjective assessment methods, including the experimental conditions,

recommends

1�������������� that the testing, evaluation and reporting procedures given in Annex 1 be used for the subjective assessment of small impairments in audio systems including multichannel sound systems (with or without picture).

...

Annex 1

...

Test Method:

To conduct subjective assessments in the case of systems generating small impairments, it is necessary to select an appropriate method. The �double-blind triple-stimulus with hidden reference� method has been found to be especially sensitive, stable and to permit accurate detection of small impairments. Therefore, it should be used for this kind of test.

...

--- end quotes from ITU BS 1116-1 ---

PCABX is generally considered to be a �double-blind triple-stimulus with hidden reference� method or an acceptable equivalent.��

Ten (10) Requirements For Sensitive and Reliable Listening Tests

(1) Program material must include critical passages that enable audible differences to be most easily heard.

(2) Listeners must be sensitized to a audible differences, so that if an� audible difference is generated by the equipment, the listener will notice it and have a useful reaction to it.

(3) Listeners must be trained to listen systematically so that audible problems are heard.�

(4) Procedures should be "open" to detecting problems that aren't necessarily technically well-understood or even expected, at this time. A classic problem with measurements and some listening tests is that each one focuses on one or only a few problems, allowing others to escape notice.�

(5) We must have confidence that the Unit Under� Test (UUT) is representative of the kind of equipment it represents. In other words� the UUT must not be broken, it must not be appreciably modified in some secret way, and must not be the wrong make or model,� among other things.

(6) A suitable listening environment must be provided. It can't be too dull, too bright, too noisy, too reverberant, or too harsh.�� The speakers and other components have to be sufficiently free from distortion, the room must be noise-free, etc..

(7) Listeners need to be in a good mood for listening, in good physical condition (no blocked-up ears!), and be well-trained for hearing deficiencies in the reproduced sound.

(8) Sample volume levels need to be matched to each other or else the listeners will perceive differences that are simply due to volume differences.

(9) Non-audible influences need to be controlled so that the listener reaches his conclusions due to "Just listening".�

(10) Listeners should control as many of the aspects of the listening test as possible. Self-controlled tests usually facilitate this. Most importantly, they should be able to switch among the alternatives at times of their choosing. The switchover should be as instantaneous and non-disruptive as possible.

2.0 Why would I want to become involved with PC ABX?
2.1 PC ABX is a reliable means for subjectively evaluating sound quality.
2.2 PC ABX is a means for evaluating the inherent sound quality of equipment that you don't have direct access to.
2.3 PC ABX is a means for training yourself to be a more sensitive and reliable listener for the purpose of evaluating the sound quality of audio equipment and software.
2.4 See what other sites on the web are saying about PCABX:

http://www.silcom.com/~aludwig/Sound_demos.html

"Arny Kruger has posted free downloadable software for performing ABX tests to compare two .wav files. His site also includes a selection of sample files to illustrate the effect of filtering out high frequencies, truncating bits, etc. Listen with good quality headphones (I use Sennheiser HD-545's). Otherwise effects will be washed out by the quality of computer speakers and the room you are sitting in. Standard computer sound cards are not the ultimate in fidelity, but they are adequate. One way to make A-B comparisons of multiple sound files is to open multiple Media Player windows, one for each file, and then play the files quickly in sequence. But Arny's ABX tester is better."

http://www.3dsoundsurge.com/features/weeks/Week29May.html :

"Can you hear the difference between 24 and 16 bits?
If you don't have a high quality professional soundcard that question may be tough to find an answer to but you Kr�ger's PCABX.com site will also let you see if you can hear the difference between 16, 15, 14, 13, 12, 11 and 10 bits."

http://www.3dsound.com/archive/week127.html :

"You can do you own listening tests and find some more info over at www.pcabx.com."

http://www.commvergemag.com/commverge/extras/P178673.asp :

"Arny Krueger's PCABX site contains detailed before-and-after oscilloscope displays showing the audio alterations caused by various codecs, as well as a number of test tone files."

http://commverge.e-insite.net/commverge/issues/2000/200012/12dd3.asp

"Arny Krueger, who maintains of the PC ABX audio testing Web site (www.pcabx.com), wrote to recommend a better approach. "I find it is helpful to use complex multitones for testing, because they tend to load up the codec with multiple concurrent frequencies, just like real-world program material," he said. "Pink or white noise is generally no stress at all for most good coders, because a fully loaded coder will reduce the signal-to-noise ratio in the frequency bands, producing noise with about the same power-spectral density as the original, but not actually the original noise."

http://fastforward.iwarp.com/setup.html :

"I use Arny Krueger's PC ABX program to conduct the equivalent of double-blind listening tests."

http://oeonline.com/~djcarlst/abx_hdwr.htm:�

"PCABX Comparator New in 1999"

http://www.sospubs.co.uk/sos/nov00/articles/pcnotes.htm

"Although the test files are nearly all in 16-bit/44.1kHz format, and quite a few are therefore about one megabyte each to download, the ABX Comparator is still an excellent way to help train your ears to hear problems in the mix. Best of all, it's freeware. Well done Arny! (www.pcabx.com/getting_started.htm)."

http://musepack.org/faq/

"I think I heard a problem with MPC encodings. What do I do now?"

"A: First: - Test the clip with an ABX (such as pcabx, found at (www.pcabx.com) tester using double blind tests. Often there's no problem, you can only hear the problem as long as you know what you are hearing. In other words, the placebo effect makes you *think* that you can tell a difference, but you actually cannot. Then the difference is only pure imagination. If you find that, after blind testing using ABX software, you can truly tell the difference between the source file and the encoded file..."

(If your web site mentions PCABX, I'll strongly consider posting a link here. Send me email by clicking this link: Arny Krueger.)

2.5 Print media mention of PCABX:

Europe's No1 Hi-Tech Music Recording Magazine Sound On Sound

November 2000 Issue:

"The reason I've explained this double-blind procedure is that this month, during my Internet travels, I came across a PC utility designed to give this facility to soundcard playback. The ABX Comparator was developed by Arny Krueger, whose excellent soundcard performance test site is already visited by many surfers, and it uses these double-blind techniques to help train your ears to discern different audio faults and limitations."

Hi-Fi News

October 2001 Issue:

"Although the ABX company ceased manufacture of the comparator in 1987, there is now a software equivalent called PC ABX, again designed by Arny Krueger, which operates in similar fashion via a personal computer running Windows.The PC ABX web site (wwwpcabx.com) offers various training files and example tests, for those who want to hone their listening skills.

"

2.6 Academic application of PCABX:
Published in June, 2001 by Sean Browne, of the University of Miami.

His Thesis is: "HYBRID REVERBERATION ALGORITHM USING TRUNCATED IMPULSE RESPONSE CONVOLUTION AND RECURSIVE FILTERING"

Please see: http://www.music.miami.edu/programs/mue/Research/sbrowne/thesis.pdf ,
page 63 (The 70th page of the .PDF file).

"The testing mechanism used was the PCABX testing software."

3.0 What does the PCABX Web site contain?
3.1 The PC ABX web site contains a piece of software called the PC ABX Comparator which allows you to play files containing sounds.
3.2 The PC ABX web site contains files with sounds that will help you to enhance your sensitivity and reliability as a listener.
3.3 The PC ABX web site contains sound files that allow you to compare the inherent sound quality of various pieces of equipment and software.
4.0 What do I need to benefit from PC ABX?
4.1 To run the PC ABX software you need:
4.1.1 An IBM PC running Windows 95, 98, NT 4, or Windows 2000.�
4.1.2 The ability to download relatively large files from this web site (DSL or cable modem preferred).�
4.1.3 Enough disk space to store the training and test files (at least 100 megabytes).
4.1.4 A PC sound card and loudspeakers of sufficient quality to satisfy you that the results of your listening tests are not hobbled by their sonic quality. For more information about sound card quality, please visit http://www.pcavtech.com . This topic is discussed further here.
4.2 This site requires a serious interest in audio.
4.3 This site will make demands on your Time. Figure on killing an hour just to get started, and spending at least a half hour for each test you want to do.
5.0 How can I find out about the technical properties of the equipment that was used to make the sound files on this site?
5.1 The sound files on this site relate to equipment tested at a sister site, http://www.pcavtech.com .
6.0 What will it cost me to use this site?
6.1 Nothing directly but your time and disk space. This site is advertiser-supported. Some of the files you will find on this site are sponsored by the vendors of the equipment used to prepare them.
7.0 When will this site be available to me for my use?
7.1 Right now! Click this hyperlink: www.pcabx.com/training/getting_started.htm
8.0 What are the benefits of PCABX?
8.1 Double blind - addresses listener bias, increases listener sensitivity,
and eliminates or reduces many common irrelevant influences
8.2 Rapid comparison - increases listener sensitivity and eliminates a
common irrelevant influence.
8.3 Multiple comparisons per trial - increases listener sensitivity.
8.4 Multiple trials - increases listener sensitivity and enables more
accurate estimation of outcome of test.
8.5 Test controlled by listener - increases listener sensitivity.
8.6 Level matching - increases listener sensitivity and eliminates a common irrelevant influence.�
8.7 Time synchronization - increases listener sensitivity and eliminates a
common irrelevant influence.
8.8 Progressive training - increases listener sensitivity
8.9 Program material selection - increases listener sensitivity.
8.10 Formal listener training - increases listener sensitivity.
8.11 Concurrent in-situ technical testing of UUT - eliminates a possible
irrelevant influence.
8.12 Listening environment choice - increases listener sensitivity.
8.13 Listener pre-qualification - increases listener sensitivity.
9.0 Who do I contact to find out more about this site?
9.1 The Webmaster, chief cook, and bottle-washer Arny Krueger.

Click here for Privacy Policy.


This Page created 9/22/1999

This Page last updated 12/02/2003

(c) Copyright 1999, 2000, 2001, 2002, 2003 Arnold B. Krueger, All rights reserved.