Trouble with erasing on Gimp?

How come when I'm using layers when I erase or cut part of the top most layer it just turns white instead of seeing what's beneath? It's just acting like a white paintbrush! How to I make it completely transparent when I erase or cut?