I've used ofxtools to download things locally. It basically supports the old Quicken/QuickBooks interfaces which many US banks, brokerages, and credit cards support. It's pretty clumsy though.