What immediately bugs you when watching an episode? Mine is when they transport someone sitting down and they reintegrate in a standing position (or vice versa). Sure, the tech is near magical but my suspension of disbelief pretty much snaps when they do this.
Seems to be human and other advanced federation societies on planets that are fully developed like the home world, starfleet facilities, and such. They talk about not needing it on earth often enough but far flung colonies obviously use it. I think there is a limit to. I think of it like the replicator rations with voyager. Everyone gets enough to get everything they need and reasonably could want but some sort of system is in place for making spaceships and buildings and such and trade across planets and such. Im sure during extreme events there is likely rationing were you temporarily were on just enough to meet needs type of thing.