A native of Woodruff, Ashby is a graduate of Woodruff High School, Lenoir-Rhyne University and John A. Gupton College of Mortuary Science. He has been in the funeral ministry for 40 years. Ashby is married to the former Debbie Henderson, who is vice-president of the funeral home, and they have 4 children and 3 grandchildren.