Correct me if I'm wrong, but this is probably due to the lower air density at higher altitudes limiting the effects / stability the control surfaces can give out. I don't know much about warbirds but from my personal pilot training this seems like the probable cause. Although the aircraft are rated to go at such altitudes, for optimum performance you are probably better off flying lower.