Born Mary Anne Stewart in Spanish Town, Jamaica, she was the eldest daughter of Walter Steward, Island Secretary of Jamaica. She was educated in England, and in 1852 married Captain George Robert Barker of the Royal Artillery, with whom she had two children. When Barker was knighted for his leadership at the Siege of Lucknow, Mary Anne became "Lady Barker". Eight months later Barker died.