User blog comment:IamJakuhoRaikoben/Chapter 482: Vigor, Review./@comment-24800928-20160418222458/@comment-1359322-20160418234830

Actually we don't even know for sure if Erza is from Rosemary, her actual parents may have left her behind and another couple took her under their care.