To get a picture of what's going on, try logging in to your shell and install htop. It's a great little utility that shows you load averages, memory usage (broken down in to used, buffered, and cached memory in real time. Very handy.