I've also been frustrated with this problem from the start, any fix would be greatly appreciated as it's pretty much useless with the map on as it is. Also flying in VR here.
*On a side note, do the Gain and Contrast knobs even do anything right now? I dont see any difference when using those.