One of the necessary evils of government is those who are governed cede a monopoly of force to those who govern. That's why our second amendment allows for the individual to be armed, because our founders understood that the only way to stop tyranny is to level the playing field.
The force of the government should only be applied on things we would use force on ourselves. Rape, incest, murder, and robbery come to mind as situations where force is warranted, by both the individual and the government. A government should never use force to build a library or redistribute wealth. It's not the job of the government to do those things. Those are decisions left to the people. I don't care what grandiose idea government has to make it's citizen's life better, there will be dissent from at least one person. That alone is reason enough that one person's money should not be forcefully taken away to enlist it in the use of a project or program they don't want to fund. It's impeding upon their right to make decisions of their free will.
Now should the community decide they would love to have a library, and they organize and fund it on their own, then this is at the expense of no one who disagrees and detracts from no one's liberty.
To take from another by force, even if under the guise of government, is theft. To willingly band together for the good of the collective is community. Community is not government. Government is not community. Never allow the two to be confused with each other!