Risk assessment tools driven by algorithms offer promising advantages in predicting the recidivism risk of defendants. Jurisdictions are increasingly relying upon risk tool outcomes to help judges at sentencing with their decisions on whether to incarcerate or whether to use community‐based sanctions. Yet as sentencing has significant consequences for public safety and individual rights, care must be taken that the tools relied upon are appropriate for the task. Judges are encouraged to act as gatekeepers to evaluate whether the forensic risk assessment tool offered has a sufficient level of validity in that it is fit for the purposes of sentencing, provides an acceptable level of accuracy in its predictions, and achieves an adequate standard of reliability with regard to its outcomes.