Ultimately went for the 6700 XT.
Some of the things that sold me were:
1. In Australia, it was over $100 cheaper
2. One of my friends had experience with Radeon drivers and spoke pretty positively about them.
3. The rumours are that the RTX 4070 will have a 192-bit bus... But will have more VRAM. Sold me that VRAM is more important than bandwidth. Also if the new gen is going for lower bandwidth, it's likely going to be more future proof to get more VRAM over getting more bandwidth.
Since I've gotten my RX 6700XT I've optimised my settings, and played around with my old GTX 1060 presets. Went from 56 fps average on the 1060, to 140 fps. Adjusted the settings a little more since, to give constant ~ 100 fps. Looks great with Radeon sharpening, legitimately looks like a higher resolution. Often I don't actually fill all my VRAM, and get to around 9-10gb usage. If I'd gotten the 3060Ti I would've been bottlenecked.
Also played with VR, having no issues driver-wise. It's a shame that none of the Radeon Adrenalin features go into VR, but I'm also kind of happy about it because it means there's less things to reduce my VR performance. Did my usual optimisations, used FSR heavily through VRperfkit, (on Rift S, set resolution to 2000 horizontal in SteamVR, set rendering to 0.75 in Vrperfkit) and was getting great quality and constant max frame rate (80fps) with only slight dips below when right above trees, and when servers cause spikes. SAM / resizable bar seems to give slightly lower FPS but a smoother experience. Ultimately very happy with the card.
Tried out some Ray tracing in other games, definitely not worth going for the 3060 ti for the ray tracing, such a massive drop in performance for not a whole lot.
I will say that if you can get a good deal on it, and you have the time to do some optimising, the 6700 XT will not disappoint.