Thinking about starting over on the PvE realm...

So I have two lvl 20s on the PvP realm but I feel like the realm is too overpopulated... it makes leveling harder in my opinion.
Now I am thinking about starting over on the PvE realm and wanted to ask... does it feel "empty" in comparison to PvP? I mean it's a big population difference. It is good that there aren't as many players as on the PvP but it would be really shit if it feels like there aren't many people playing at all.
Now I am thinking about starting over on the PvE realm and wanted to ask... does it feel "empty" in comparison to PvP? I mean it's a big population difference. It is good that there aren't as many players as on the PvP but it would be really shit if it feels like there aren't many people playing at all.