Ah sucks. I rarely pay attention to latency specs as I use direct monitoring with my Fractal.
IMO, even with Fractal, you are going to want the lowest latency, because you will find native sims have advantages during production. Having to reamp to external hardware is a pita.
Most of the ones in the earlier list are not as good as your Motu M4 regarding latency besides the RME.
The RME converters aren't as good as the latest generation from the last year, unless you buy their mastering converters.
If you need more processing power, build a better computer. It is much more cost effective than UAD apollo and will run many more.
Currently the best usb latency is RME, followed by Motu on Mac and Presonus Quantum on PC. The latest Motu 828 and Presonus Quantum HD interfaces have better conversion than RME standaloone units like the Babyface and UFX3.
You will have a hard time improving much on the Motu M4, unless you need more inputs and/or a slight increase in fidelity. The Motu 828 Or Presonus Quantum HD8 are the best all around picks in a consumer interface in 2024. Some of the other ones like the Audient sound amazing but again, the latency not quite there.
You could get an RME digiface and a rack of external converters, but again, anything not released in the past year or so is not going to match the 828 or HD8 (-123db s/n). The built in mic pres also have a ton of gain. The Ferrofish ADACs are popular but not quite there unless you need a additional eight for tracking a band. I wouldn't buy an RME digiface unless you get something better than the Ferrofish. Behringer isn't even in the discussion.
Appolo usb latency is horrible and you are locked into their plugin ecosystem. It was great ten years ago, but for same price you can build a top of line machine that will probably double or quadruple your processing power depending on what you have now.
If you are on a Mac and have thunderbolt, a case might be made for apollo, but I have heard it has worse latency than RME usb because of all the extra dsp processing it has.
Good luck.