Fred was born and raised in Gastonia, North Carolina. He moved to Jacksonville in his late teens and served time in the US Navy. Fred later married at age 20 and had a daughter name Adriana Durst. The marriage was turbulent - after one altercation, Durst spent a month behind bars.