Baker was born September 25, 1940, in Savannah, Georgia, and died August 1, 2007. At age thirteen, he moved to Fort Pierce, Florida, where he graduated from Lincoln Park Academy. He worked in the orange groves and tomato fields before he met Harold Newton and Alfred Hair. Baker began painting in the late 1960s.
He had a number of jobs, including selling insurance, baking breads at Dandee Bakery, and running his own restaurant, House of Foods, which was located on 25th Street in Fort Pierce. He married Gladys Paige in 1957 and had three daughters. Following his wife’s death, he married Ivory Young, who encouraged him to return to painting.
Baker’s paintings demonstrate a use of color different from that of the other Highwaymen, with an emphasis on pastels.