Native to Los Angeles, he is the second son of Lillian Gold and Harry Hoffman, a family of Jewish immigrants from Ukraine and Romania. His mother chose the name Dustin in honor of actor Dustin Farnum.