The issue with a heads up display or rearview cameras is that each different view needs to be fully rendered for each camera and has a heavy GPU cost. Its the same issue with things like landing cameras and rear view mirrors. In fact, mirrors, if they do work are often prerendered of the room...