A Stuart riverside mansion where a duchess carried coded royalist letters, a duke advised Charles II and Bridgerton later staged a ball. Here is its story and how to visit.