Here is a list of some system evaluation tools and postings available on the web:
The Edutools site is a not-for-profit information resource, with a focus on academic course management systems, both open source and proprietary.
EdTechPost matrix with many links to EduTools.
The Commonwealth of Learning conducted an Evaluation of five Open Source LMS in mid-2003 (Moodle, LON-CAPA, ILIAS, dotLRN, Atutor). The two finalists were ATutor and ILIAS.
Xplana OpenSource Evaluations from May 2003, which groups systems by type (PHP, java, etc).
Simon Fraser University LMS selection committee website, with many resources.
Brandon-Hall offers some free resources and a number of reports for purchase.