Because optoacoustic tomography (OAT) can provide functional information based on hemoglobin contrast, it is a promising imaging modality for breast cancer diagnosis. Developing an effective OAT breast imaging system requires balancing multiple design constraints, which can be expensive and time-consuming. Therefore, computer-simulation studies are often conducted to facilitate this task. However, most existing computer-simulation studies of OAT breast imaging employ simple phantoms such as spheres or cylinders that over-simplify the complex anatomical structures in breasts, thus limiting the value of these studies in guiding real-world system design. In this work, we propose a method to generate realistic numerical breast phantoms for OAT research based on clinical magnetic resonance imaging (MRI) data. The phantoms include a skin layer that defines breast-air boundary, major vessel branches that affect light absorption in the breast, and fatty tissue and fibroglandular tissue whose acoustical heterogeneity perturbs acoustic wave propagation. By assigning realistic optical and acoustic parameters to different tissue types, we establish both optic and acoustic breast phantoms, which will be exported into standard data formats for cross-platform usage.