There is a lot more info on the Island than can be found here. Just don't make the mistake I did and assume you will find twenty of these wonderful houses still standing. Only five are left.
Another great source of information - this article by Greg Rossel - you can find it here.
You leave from the town of Richmond - there are some fantastic historic buildings there:
There is no water, no food on the island so make sure you stop in at Annabelle's Cafe before hopping on the 9am ferry...it's a very friendly place. Get something to go.