This has actually been settled for a long time now. Muscle and Fitness published the results of a study on it back in the 90's.
They measured estrogen levels on men, and the ones with the most "roid rage" had the highest levels of estrogen.
Long story short, if you're on anything that's known to aromatize into estrogen, then you need to be using exemestane or something similar.
- - - Updated - - -
I should add that this was specific to athletes.