Swimmers ear sucks. I deal with it too.
The only thing that is going to make it go away is a trip to the doctor. He'll likely give you drops (I've got Neomycin drops in as I type) that will make it feel better within a day or two.
Beyond that, you need to put something in to dry your ears out after being in the water. There are a few different products and home versions, mostly alcohol based. Like Jeff said, it's usually chronic so you'll need to use a drying formula as often as possible. I prefer Aur-Dri, available at most grocery and drug stores.