Upgrading from 11.2.0 HF1 to HF4

Has anyone tried upgrading to from a version of 11.2.0 to HF 4 in that version? I am trying to do it in my lab and everytime I do it all of my ASM policies get reset back to default policy. I can't find anything in any of the logs that is denoting a problem but obviously something is not right. I am going to open a case on this but wanted to see if anyone has seen this behavior or has had success in this upgrade