Darrick Addison has written a helpful article for IBM DeveloperWorks called Introduction to Robotics Technologies. The article gives a quick overview of just about everything you need to know to get started in robotics including motors, sensors, power, and software. It also has links to a lot of GNU software useful for robotics applications.