or you get both numbers on the same row and it's visually confusing

I dunno, you might want to poll the community with that question/suggestion. I think it may be worthwhile to have some temporary confusion.

Also, there are votes on the side for the submission, but not the comments, so I wonder how it might impact the comment section.

I think it can still be disabled via sub CSS but that's up to the mods of that sub

Only for desktop users, and more and more people are using their telephones to browse the internet. It's a problem I'm currently having with reddit. There's no way to do stuff like disable downvotes for mobile users it seems.

And mobile users seem much more likely to vote without commenting, which makes the situation worse.