Oyster Bay is not only a small community with shops and restaurants, but it's a place rich in American history.