Data Group irule Or Local LTM Policy to Allow Specific IP's, Per VIP

Hello, I need to create and Allow multiple lists of specific ip's, on a per VIP basis, to my Virtual Servers. Any idea how to accomplish this