The
tbe would make a significant difference. The turbo will spool faster for one, as there is less back pressure. Make sure you get a good dump pipe as well. Michael South from over east does an awesome HiTech modified dump.
What year rex have you got? You might want to consider changing the up pipe at the same time as well, as there might be cat in there...wouldn't want that to break and end up where it's not supposed to be!