Daniel Chesterman - Confusion over data

Hi Graham and Sue
Still working on the tree but I am confused by Daniel Chesterman with Ancestry database…I have just a few more days before it expires!
FYI-He was your mum Doris' great grandfather on her mothers side.
1851-1861 I started to research him and found him born in CLAPHAM around 1824.
He married Mary Ann. He is a French polisher.
They had 2 daughters (Mary Ann and Matilda) and three sons (Charles, Daniel and Henry), but I wondered if Charles died as an infant as he's not around at the house in 1861, unless perhaps staying with grandparents as he would have been 12 at that time.
1871 However, further research shows another Daniel Chesterman, born in CHIPPENHAM with a wife called Mary Ann and kids who are now 22 and 18, Daniel and Henry at home.He too is a French polisher! He sometimes has the initial J as his middle name.
1881 Chippenham Daniel and wife Mary Ann have their son, Charles living with them (aged 32) where Charles is described as a jeweller.
1891 Chippenham Daniel is in Islington Workhouse, where he dies a year later aged 66. Here Daniel is described as a piano tuner. These trades are often linked to each other though.
The other confusion that both Daniels had the same boarder staying with each of them
1861 with Clapham Daniel and 1871 with Chippenham Daniel. He was a French polisher.
The children's professions match up too.
1851 Clapham Daniel living at 10 Titchbourne Row, Marylebone
1861 Clapham Daniel living at 16 Corporation Court, Finsbury
1871 Chippenham Daniel living at 16 Corporation Court, Finsbury
1881 Chippenham Daniel living at 29 Corporation Row, Finsbury
1891 Chippenham Daniel is an inmate at Holborn Union Workhouse Infirmary, Archway Road, Upper Holloway, Islington.He is described as a pianoforte maker. He dies a year later in Islington.
Further confusion when I find Chippenham Daniels birth record.
Full name: Danel James Hyde Chesterman
Birth date: June 28 1824
Baptim Date 11 August 1824
Baptism Place: St Luke, Finsbury, Middlesex
Father James Chesterman
Mother Matilda Chesterman…. which would explain Daniels daughters name.
These Daniels are too closely linked, that I feel they must surely be one and the same.
What do you think?
Do you have any more information?
Cheers
Sue xx

NB I subsequently found that Charles Chesterman died in another Workhouse I'm afraid (12 Warpole Road, St Pauls, Greenwich) aged 69 from a congenital heart defeat. He was married and a Goldsmith.
My brain aches!