Harold J. Kennedy was the grandson of Daniel J. and Mary Loughrey O'Neil. Daniel was President of the Eastern League Baseball Association and Hampden County Commissioner. Harold was the elder brother of John Paul Kennedy and the son of J. Harry Kennedy and Mary O'Neil Kennedy, both educators.