cvs can be used over a remote shell like ssh or locally.
if you want a web interface (read only) try
cvsweb (wow, those links really pop out, don't they?)
there are several gui interfaces to cvs. for windows,
tortoise cvs is one of the better ones.
if you want simplicity and ease of use, cvs is the way to go. it's trivial to set up a repository (no webserver/network/user configuration required, just one command). many people recommend "the newest thing" in source control without needing or understanding the features they are gaining and losing. cvs is the standard and it works well (being used currently by all bsd's, all of sourceforge, many linux developers [not torvalds, he uses bitkeeper], openbeos, and any clueful companies i've worked at).