Otis Torrey Nelson - Otis Nelson's home in Milford Massachusetts

I have been researching the deeds of my colonial house in Milford, Massachusetts. Your ancestor, Otis T. Nelson, owned the house at one point. [Worcester Registry of Deeds: Book 343, Page 379] I am having trouble figuring out who he bought the house from. In the off chance someone reading this can lend me some guidance, I would be greatly appreciative. The local Historical Commission claims that Pres. George Washington stopped at the house to refresh in 1789, but I want to confirm the information they have.
Susan Elliott