I have heard of Pokéstops removed because they were inaccessable, or in dangerous places, or in private places and the owner doesn’t wanted the visits.
But because of inactivity? We had here an example of a player with a Pokémon placed for more than a year in a Gym. And apart, this rule would be very bad for areas far away from the cities.