ah looking further into it, it seems to hinge on the RP stating “Residence card of a family member of a Union citizen.”
Do these actually exist? Ours doesn't say that so I guess it's the visa route but the Irish embassy stresses that for the spouse of a Brit this would be accelerated.