Talos defaults to adding the node.kubernetes.io/exclude-from-external-load-balancers= label to all control plane nodes, which are all I’m using in my Turing Pi, so that meant none of them were in the MetalLB VIP and is why I couldn’t connect to them.
I wish I knew this two hours ago.