I was looking for an alternative to less and I found a pager called most which provides interesting features and colors out of the box.

Installing most is really trivial :

sudo apt-get|port|whatever install most
export PAGER=most

And try it with :

man ls

You should see a colorized man page :)