This is just about one the most annoying thing about viewports in C4D next to rotating any of the orthogonal views. Those should only pan!