Bajor can't be much bigger then Earth if the gravity is roughly the same as Earth. If it was larger in area, it would have to still be around the same mass to have ~1G.
Not quite.
Let's hypothesise that Bajor has a diameter 25% larger than Earth and the same surface gravity. This would mean its mass is around 7.2 × 10²⁴ kg, or about 17% larger than Earth's, with a slightly higher escape velocity only 5% greater than Earth's.
If Bajor has twice Earth's diameter, well within the bounds of a super-Earth, and the same surface gravity its mass would be around 2.4× 10²⁵ kg, or about 75% larger than Earth's, with 1.4 times the escape velocity.
If we go nuts and say Bajor is a mega-Earth and has ten times Earth's diameter with the same surface gravity, its mass would be almost 100 times that of the Earth at around 6 × 10²⁶ kg, while its escape velocity would be over three times that of Earth (35.35km/s versus 11.18km/s), which would contribute to Bajor's apparent ability to capture or retain so many natural satellites.
This comparatively large size and mass for a class-M planet might also explain why the Cardassians viewed it as such a desirable mining target.
I recall them having 5 moons, but I don't remember their population ever being stated on DS9. (Regarding STAR CHARTS... I don't count the books as a source for onscreen evidence.)
Well, yeah... it's a book, by definition it's not onscreen evidence, which is why I called it out as such. In the absence of on-screen evidence though it can be useful in including something that the production team either intended to be the case, or at least signed off on.
Even if that 3.8 billion is accurate, considering its the largest planet in the system, that seems like a very small number... especially considering we have over 8 billion people on Earth right now.
The same book gives a population for Earth in the 2370s of 4.2 billion. Clearly overpopulation becomes less of an issue when you have warp drive and dozens of planets in easy reach, and we know many Bajorans fled the occupation to establish refugee colonies, with at least seven known outside of the Bajoran system.
That tells me there might not be as much land for Bajorans to be on.
We've seen Bajor from space multiple times on screen and it seems to have plenty of land.
And even if there was room, Bajor was being strip mined for over 50 years. Having space for people to live on means nothing if there aren't enough resources for them in that space.
Parts of the planet were stripmined, but certainly not all of it. Again, we've seen Bajor's surface multiple times, both from orbit and on the ground, and a lot of it still seems lushly green even immediately after the occupation in 2369. In Sisko's own words less than six years later,
"there are parts of the Eastern Province that are like Eden itself... lush green valleys covered in wild flowers that seem to spring up overnight... hundreds of small, crystal clear ponds interconnected by waterfalls."
Besides, DS9 is hardly large enough to handle the mining output of an entire planet, and it seems to be the only orbital mining station the Cardassians built.