You likely are having issues because whey protein is just a processed cheese byproduct. Lots of people have issues with dairy and processed food in general.