I can't find any vital records giving his exact birthplace, but his personal biography -- https://www.billyjoel.com/timeline/ -- says The Bronx. I think people just assume he was born in Long Island because he was raised in Levittown.
For a living person, an official biography they've approved is adequate in my book.