Harold Rigby was born at Yangan, Queensland in 1901, where the family lived before moving interstate and finally settling at Wentworthville on the outskirts of Sydney about 1916. The Rigby family was well known in Wentworthville, taking part in community affairs and sporting activities, particularly rugby league.
Harold Rigby, his older brother Ernest, and his younger brother Vernon all played rugby league in the Wentworthville district. Ernest Rigby became a prominent referee in the Western Districts junior rugby league. Ernest is also the father of Leslie Louis Rigby (Wests #402).
