They are extremely confusing, this early, and woefully underdocumented (and no, Wikipedia is NOT an authoritative source!)
Bear in mind that Rotherfield "Greys" passed from Eva Grey Murdac Beauchamp to her cousin Walter de Grey, Archbishop of York, who subinfeudated it to his brother Robert. Walter and Robert's father is unknown but was NOT John de Grey, Bishop of Norwich (and may not have been a Grey at all). Their mother was Hawise de Grey, per a charter she made between October 1214 and November 1216. She stated that she was the *sister* of John de Grey, Bishop of Norwich, and that Robert and Walter (then Bishop of Worcester) were her sons.
And no, we don't know for sure who Hawise and John's father was either.