Chatter client will not authorize

We have a APM policy to authenticate Salesforce users via SAML and it is working very well. When we try to authorize a Chatter client, the process works as expected (login page etc.) but it never authorizes, just hangs. I have set message boxes at each step of the policy and everything goes as expected to the point of the SAML assertion. Since the policy works perfectly fine for accessing Salesforce it looks that the Chatter authorization process needs something more. If a user already had Chatter installed the APM policy authenticates them without issue just like accessing Salesforce. Some documentation refers to the relay state being very important for Chatter. I have not been able to determine what the relay should look like or be.

Does anyone know what the relay state needs to be?

Know of a different solution for the Chatter authorization?