THOMAS STROMBERG As mentioned elsewhere, this utility does not change any of your settings, but merely provides feedback on services such as OpenDNS which may be faster for you.
As far as MU checking this project out, it's my 20% project, and fully open-source. See the source code for yourself! Each of the candidate nameservers, other than your ISP's, has been reviewed. namebench does test to make sure that commonly used sites such as Google and Paypal are not hijacked, and reports if it sees any other suspicious activity with candidate nameservers including your ISP's.
One note: The Mac OS X frontend on the current version (0.9.0) does not have congestion detection enabled, so the result quality is somewhat degraded if you have a very slow connection or are downloading large files in the background. This will be rectified in the next release.
(Version 0.9)