Well some did ponder such questions, completed a study and published those results (Ecological Succession and Viability of Human-Associated Microbiota on Restroom Surfaces). They showed that the ecological succession of bacterial populations does occur and that in general, a stable community does occur after 8 hours, and is made up of skin and environmental organisms rather than gut microorganisms.
"The prevalence of skin-associated, rather than feces-associated taxa, in the late-successional community suggests that organisms are selected for their ability to persist in a dry, aerobic environment, which is a very different environment from the gut. Human-associated microbiota, including Staphylococcus strains, can remain viable on BE surfaces for many hours after their dispersal [cleaning] agents are removed. This suggests that common BE surfaces may be significant fomites for viable human pathogens."