I am using a variation on the following Arduino project and it works, though I'm not quite sure how when it comes to the push button:
The schematic (from p22 of http://oomlout.com/products/ARDX/ARDX-experimenters-guide-DD.pdf):
The 5V voltage source runs through a 10K resistor, which is connected to pin 2 and the push button.
I believe that the circuit works like so: when the button is not pushed, it is a series circuit, and current only flows through the wire leading to pin 2. (Notably, the default state for digital pin 2 in the Arduino sketch is HIGH, not LOW.) When the button is depressed however, the circuit becomes parallel. Somehow, the circuit's action is constituted by this. Even if I'm essentially right I'm missing some details, so fill me in here.