Shapes are never culled even after changing bounds

I have a few menus/scenes that are made up of lots of shapes. They are placed at places like (0,500,500), very far away from the camera. The camera goes to them when they are active.

I have set the bounds of everything to be 50

As far as I am aware everything in these menus should be culled.

If I look at the frame debugger I can see that everything is still being drawn

Compared to when I disabled the menus:

So am I totally missing something?

Does unity just never cull in editor?

I thought I checked this a while ago and it WAS working properly, maybe I broke something?

I plan to disable all these objects anyways, but I just to make sure I understand whats going on.