Actually, the map dragging behavior does not allow the center of the viewport to be outside of the lowest map blocks area.
So, if I want to work on the red area visible on the screenshot below:

And if I need to use some angle of view to be able to distinguish the height of the different blocks:

Zooming in does not allow me to drag the map lower (in relation to the viewport). So, that's what I see (the blue cross is visible in the first screenshot):

By dragging the map to the bottom/left corner of the viewport, we can more easily understand the dragging behavior. The top/right corner of the lowest blocks area is in the center of the viewport:

The solution might be to turn the map by 180 degrees. But it does not allow to work on the blocks located on the other side:

P.S: The map shown on those screenshots is not a good example of a scenario where this behavior is really annoying. Think of a mountain with all blocks having similar colors.
Actually, the map dragging behavior does not allow the center of the viewport to be outside of the lowest map blocks area.
So, if I want to work on the red area visible on the screenshot below:
And if I need to use some angle of view to be able to distinguish the height of the different blocks:
Zooming in does not allow me to drag the map lower (in relation to the viewport). So, that's what I see (the blue cross is visible in the first screenshot):
By dragging the map to the bottom/left corner of the viewport, we can more easily understand the dragging behavior. The top/right corner of the lowest blocks area is in the center of the viewport:
The solution might be to turn the map by 180 degrees. But it does not allow to work on the blocks located on the other side:
P.S: The map shown on those screenshots is not a good example of a scenario where this behavior is really annoying. Think of a mountain with all blocks having similar colors.