Heck yeah! You already know my thoughts, have to say though one of my favorite features about my system is that I skipped the baffles in my sump.
I'm still able to have the sump do everything I wanted it to (including DSB thanks to a Rubbermaid container)...I totally revamped my sump plan and it didn't require pulling any baffles out...down the road I could do on the fly changes similarly...I was able to experiment with ideal water line (for skimmer etc) and make adjustments without having to take my sump offline and mess with baffles...only downside is that I won't have perfect inline waterflow through, such as through successive sump chambers, but I really don't think that's a big deal...
To me personally, the biggest reason I like baffle less is due to water changes. Baffle less let's me do up to 40% water changes very fast and directly from the sump if I want, with much less effort than if I had to mess with complexity that baffles would add (including I may need to move pump to/from sump/display). Some people wouldn't benefit from this...I never anticipated this to be a good reason to skip baffles...but now that I run my tank/changes this way it is a huge plus for my maintenance routine and 100% glad I don't have baffles.