In Civil Disobedience, what does Thoreau mean, “I felt as if I alone of all my townsmen had paid..."?

There's a lot of people around, but you're the only one who did the right thing by stepping up to the plate