Ray Gormley’s brother was Edward Lucien Gormley, who also debuted for Wests First Grade in 1908. Their father was Bernard Gormley of Lidcombe was a well-known businessman and Rookwood Council Alderman who built and opened the first hotel in Lidcombe, the Railway Hotel.
He played rugby union at Ashfield from 1905. In 1907 he joined his brother at Western Suburbs Rugby Union Club and played Second Grade before switching across to play rugby league with Wests in 1908.