What you're describing sounds to me like maybe your sway bar end links or the bushings that attach them are shot. They're really cheap to fix and primarily make their problems known at low speeds on speed bumps. It should be obvious if they need replacing once you look at them. They're probably the easiest bushings to change so I'd check them first. Good Luck!