Purpose: Pancreatic ductal adenocarcinoma (PDAC) is a heterogeneous disease with variable presentations and natural histories of disease. We hypothesized that different morphologic characteristics of PDAC tumors on diagnostic computed tomography (CT) scans would reflect their underlying biology. Experimental Design: We developed a quantitative method to categorize the PDAC morphology on pretherapy CT scans from multiple datasets of patients with resectable and metastatic disease and correlated these patterns with clinical/pathologic measurements. We modeled macroscopic lesion growth computationally to test the effects of stroma on morphologic patterns, hypothesizing that the balance of proliferation and local migration rates of the cancer cells would determine tumor morphology. Results: In localized and metastatic PDAC, quantifying the change in enhancement on CT scans at the interface between tumor and parenchyma (delta) demonstrated that patients with conspicuous (high-delta) tumors had significantly less stroma, higher likelihood of multiple common pathway mutations, more mesenchymal features, higher likelihood of early distant metastasis, and shorter survival times compared with those with inconspicuous (low-delta) tumors. Pathologic measurements of stromal and mesenchymal features of the tumors supported the mathematical model's underlying theory for PDAC growth. Conclusions: At baseline diagnosis, a visually striking and quantifiable CT imaging feature reflects the molecular and pathological heterogeneity of PDAC, and may be used to stratify patients into distinct subtypes. Moreover, growth patterns of PDAC may be described using physical principles, enabling new insights into diagnosis and treatment of this deadly disease.