Case-control studies comparing ADHD with typically developing individuals suggest that anatomical asymmetry of the caudate nucleus is a marker of attention deficit hyperactivity disorder (ADHD). However, there is no consensus on whether the asymmetry favors the right or left caudate nucleus in ADHD, or whether the asymmetry is increased or decreased in ADHD. The current study aimed to clarify this relationship by applying a dimensional approach to assessing ADHD symptoms that, instead of relying on clinical classification, utilizes the natural behavioral continuum of traits related to ADHD. Structural T1-weighted MRI was collected from 71 adults between 18 and 35 years and analyzed for caudate asymmetry. ADHD-like attentional symptoms were assessed with an objective measure of attentional problems, the ADHD score from the Test of Variables of Attention (TOVA). Impulsivity, a core feature in ADHD, was measured using the Barratt Impulsiveness Scale, a self-report measure that assesses attentional, non-planning, and motor features of impulsivity. We found that larger right relative to left caudate volumes correlated with both higher attentional impulsiveness and worse ADHD scores on the TOVA. Higher attentional impulsiveness also correlated with worse ADHD scores, establishing coherence between the objective measure and the self-report measure of attentional problems. These results suggest that a differential passage of information through frontal-striatal networks may produce instability leading to attentional problems. The findings also demonstrate the utility of a dimensional approach to understanding structural correlates of ADHD symptoms.