Ohhhh, we sound alike!!!! Eveyone calls me "Mother Earth." I am a freak when it comes to milk production. Some things to add: Try wearing a tighter bra...never go without one, EVER!!!!Cut down on your fluid intake a little and see if that helps. Cold cabbage leaves are a good one. Cabbage has estrogen and will help you dry up a little. you may want to look into the "Mini Pill." If it continues. BCP will also dry you up a little.
And the thing that helped me the best......Breast Shells. They are usually used for sore nipples or inverted nipples. They are a hard plastic disk that has a hole for your nipple. It has a cone shape that fits over that piece. What it does is let your nipple stay out by putting pressure on the areola. That little pressure actually relieves engorgement. The nipple is allowed to drip better and the milk is collected in the shell (cone part) They make you look like you are Madonna, but well worth it. I had a softer silicon pair, but I actually liked some older ones that I had that were a little harder plastic.
You have to be cafeful because at times the shells fill up quick and before you know it, you bend over and they dump out all over you!!!

I would taper off after 5-6 weeks. Your body will start to understand the "supply and demand" and regulate more. Good luck. It's tough but try to stick to it if you can.