Change priority group?

I have a pool with two members. I would like to have traffic sent only to one of them unless that one fails. At that point it should send traffic only to the other server, even if the original comes back. Using a priority group should work for the first part, but how do I get the traffic to stay with the second server even after the first is brought back up. Can I use an iRule to change the priority group of the members?