The current study examined the extent to which the Ohio Scales, Short Form, Problem Severity domain was able to perform as a reliable and valid measure within a large community mental health sample of multiethnic youth and families in Hawaiʻi. Using a sample of 1,125 youth participants, who were 59.1% male (n = 665), with a mean age of 12.96 (SD = 3.4), confirmatory factor analyses pointed to four factors (Externalizing, Delinquency, Anxiety, Depression), with subscale internal reliabilities varying slightly. The majority of convergence patterns between Problem Severity domain and related Child and Adolescent Functional Assessment Scale subscales were significantly correlated in the expected directions. Problem Severity subscale scores were mostly able to discriminate between youth with and without pertinent mental health diagnoses. Youth- and caregiver-report Problem Severity domain subscale and total scores were significantly correlated in the predicted directions. Finally, significant youth improvement was evident at 3-month follow-up, and Problem Severity intake and 3-month follow-up scores were significantly and positively related to one another. Implications and suggestions for future research are discussed.