It is simple to fly an airplane. And in the US it has recently become quite cost effective.
The most economical way is a license type called a “light sport” This will limit you in the weight and speed of the aircraft but it is still flying. This you can accomplish this license with a minimum of 20 total hours of flight. (15 Dual and 5 Solo) This license has been created to help make aviation affordable for your average person. By seeking this license you should be able to accomplish your license for approx. 4–5K (this includes testing fee’s, a little extra time etc.)
If you want to do it economically I would suggest King Air Schools for a home study program, webexams.com to make sure you pass your exam the first time and maybe Microsoft Flight Simulator to get familiar with some basic principles. These are all things you can do on your own time and would help you learn the material more quickly. And as already been mentioned, the external things like; communication, navigation, weather, etc are the most challenging part of aviation.
And if the cost still puts it out of range check out pilotfinance.com