Forum Discussion

aleksd_3205's avatar
aleksd_3205
Icon for Nimbostratus rankNimbostratus
Jul 25, 2013

ASM policy Import/Export.

Hi,

 

We have a lot of test/prod boxes and we have to manually sync ASM policies between them. I've decided to write a script to automatically export/import them. I have a few questions.

 

get the list of policies.

 

b.ASM.Policy.get_list()

 

give the user choise to select the policy to export and export it to /var/tmp. I verified that the policy has been succesfully exported and I cav view it in /var/tmp

 

b.ASM.Policy.export_policy_xml(app_list[choise], app_list[choise])

 

trying to download it. Should it put the file in the same folder where the script is? Couldn't figure out data and offset parameters.

 

print b.ASM.Policy.download_policy(app_list[choise], 10, 0)

 

I get something like this:

 

(reply){

 

return =

 

(ASM.FileTransferContext){

 

file_data = "PD94bWwgdmVycw=="

 

chain_type = "FILE_FIRST"

 

}

 

file_offset = 10

 

}

 

 

Should it be a FOR loop until flag indicates that it is LAST? I can't figure out how to download a file. Any suggestions?

 

 

Even if I skip this part and download/upload the file using ssh from/to /var/tmp I can't make it import the policy.

 

 

trying to import the policy from /var/tmp

 

 

b.ASM.Policy.import_policy('test_policy_name', 'asm-test_default')

 

 

Here is what I get:

 

suds.WebFault: Server raised fault: 'Exception caught in ASM::urn:iControl:ASM/Policy::import_policy()

 

Exception: Common::OperationFailed

 

primary_error_code : 15 (0x0000000F)

 

secondary_error_code : 0

 

error_string : An internal error has occured. import_policy failed '

 

 

 

Can anyone please help me figure out how to import/export the policy? Any help will be appreciated.

 

Thanks,

 

-Aleksei.

 

 

 

  • Try this...

     

     

    !/bin/env python
    '''
    ----------------------------------------------------------------------------
     The contents of this file are subject to the "END USER LICENSE AGREEMENT FOR F5
     Software Development Kit for iControl"; you may not use this file except in
     compliance with the License. The License is included in the iControl
     Software Development Kit.
    
     Software distributed under the License is distributed on an "AS IS"
     basis, WITHOUT WARRANTY OF ANY KIND, either express or implied. See
     the License for the specific language governing rights and limitations
     under the License.
    
     The Original Code is iControl Code and related documentation
     distributed by F5.
    
     The Initial Developer of the Original Code is F5 Networks,
     Inc. Seattle, WA, USA. Portions created by F5 are Copyright (C) 1996-2004 F5 Networks,
     Inc. All Rights Reserved.  iControl (TM) is a registered trademark of F5 Networks, Inc.
    
     Alternatively, the contents of this file may be used under the terms
     of the GNU General Public License (the "GPL"), in which case the
     provisions of GPL are applicable instead of those above.  If you wish
     to allow use of your version of this file only under the terms of the
     GPL and not to allow others to use your version of this file under the
     License, indicate your decision by deleting the provisions above and
     replace them with the notice and other provisions required by the GPL.
     If you do not delete the provisions above, a recipient may use your
     version of this file under either the License or the GPL.
    ----------------------------------------------------------------------------
    '''
    
    import base64
    import binascii
    import io
    
    def download_policy(b,policy_name,local_file):
        a = b.ASM.Policy
        stream_io = io.open(local_file,'wb')
        poll = True
        chunk_size = 64*1024
        foffset = 0
        lines = []
    
        while poll:
            res = a.download_policy(policy_name = policy_name, chunk_size = chunk_size, file_offset = foffset)
            foffset = long(res.file_offset)
            fdata = getattr(res,'return').file_data
            chain_type = getattr(res, 'return').chain_type
            lines.append(binascii.a2b_base64(fdata))
            if (chain_type == 'FILE_LAST') or (chain_type == 'FILE_FIRST_AND_LAST'):
                poll = False
                
        stream_io.writelines(lines)
        
    def upload_policy(b, local_file):
        a = b.ASM.Policy
        ctx = b.System.ConfigSync.typefactory.create(
                               'System.ConfigSync.FileTransferContext')
        poll = True
        chunk_size = 64*768
        ctx.chain_type = 'FILE_FIRST'
        tsent = 0
        try:
            f = io.open(local_file, 'rb')
        except IOError, e:
            print >> sys.stderr, e
            sys.exit(1)
        while poll:
            fdata = f.read(chunk_size)
            if len(fdata) != chunk_size:
                if tsent == 0:
                    ctx.chain_type = 'FILE_FIRST_AND_LAST'
                else:
                    ctx.chain_type = 'FILE_LAST'
                poll = False
            ctx.file_data = base64.b64encode(fdata)
            a.upload_policy(local_file, ctx)
            tsent += 1
            ctx.chain_type = 'FILE_MIDDLE'
    
    if __name__ == '__main__':
    
        import pycontrol.pycontrol as pc
        import base64
        import binascii
        import io
        import getpass
        import sys
        import os
    
        if pc.__version__[:3] == '2.0':
            pass
        else:
            print "Requires pycontrol v2.x!"
            sys.exit()
    
        if len(sys.argv) != 3:
            exit("Usage: getFile.py    ")
    
        host1 = sys.argv[1]
        uname1 = sys.argv[2]
        host2 = sys.argv[3]
        uname2 = sys.argv[4]
    
        upass1 = getpass.getpass(prompt = "Password ("+host1+"): ")
        upass2 = getpass.getpass(prompt = "Password ("+host2+"): ")
    
        b1 = pc.BIGIP(
            hostname = host1,
            username = uname1,
            password = upass1,
            fromurl = True,
            wsdls = ['ASM.Policy']
            )
            
        b2 = pc.BIGIP(
            hostname = host2,
            username = uname2,
            password = upass2,
            fromurl = True,
            wsdls = ['ASM.Policy', 'System.ConfigSync']
            )
        
        a1 = b1.ASM.Policy
        a2 = b2.ASM.Policy
    
        policies = a1.get_list()
        for p in policies[1:]:
            print "Downloading policy - "+p
            a1.export_policy_xml(policy_name = p, filename = p+".xml")
            download_policy(b1, p+".xml", p+".xml")
            
        for file_ in os.listdir("."):
            if file_.endswith(".xml"):
                print "Uploading/importing policy - "+file_[:-4]
                upload_policy(b2, file_)
                a2.import_policy(webapp_name = "", filename = "/var/tmp/"+file_) 
  • Try this...

     

     

    !/bin/env python
    '''
    ----------------------------------------------------------------------------
     The contents of this file are subject to the "END USER LICENSE AGREEMENT FOR F5
     Software Development Kit for iControl"; you may not use this file except in
     compliance with the License. The License is included in the iControl
     Software Development Kit.
    
     Software distributed under the License is distributed on an "AS IS"
     basis, WITHOUT WARRANTY OF ANY KIND, either express or implied. See
     the License for the specific language governing rights and limitations
     under the License.
    
     The Original Code is iControl Code and related documentation
     distributed by F5.
    
     The Initial Developer of the Original Code is F5 Networks,
     Inc. Seattle, WA, USA. Portions created by F5 are Copyright (C) 1996-2004 F5 Networks,
     Inc. All Rights Reserved.  iControl (TM) is a registered trademark of F5 Networks, Inc.
    
     Alternatively, the contents of this file may be used under the terms
     of the GNU General Public License (the "GPL"), in which case the
     provisions of GPL are applicable instead of those above.  If you wish
     to allow use of your version of this file only under the terms of the
     GPL and not to allow others to use your version of this file under the
     License, indicate your decision by deleting the provisions above and
     replace them with the notice and other provisions required by the GPL.
     If you do not delete the provisions above, a recipient may use your
     version of this file under either the License or the GPL.
    ----------------------------------------------------------------------------
    '''
    
    import base64
    import binascii
    import io
    
    def download_policy(b,policy_name,local_file):
        a = b.ASM.Policy
        stream_io = io.open(local_file,'wb')
        poll = True
        chunk_size = 64*1024
        foffset = 0
        lines = []
    
        while poll:
            res = a.download_policy(policy_name = policy_name, chunk_size = chunk_size, file_offset = foffset)
            foffset = long(res.file_offset)
            fdata = getattr(res,'return').file_data
            chain_type = getattr(res, 'return').chain_type
            lines.append(binascii.a2b_base64(fdata))
            if (chain_type == 'FILE_LAST') or (chain_type == 'FILE_FIRST_AND_LAST'):
                poll = False
                
        stream_io.writelines(lines)
        
    def upload_policy(b, local_file):
        a = b.ASM.Policy
        ctx = b.System.ConfigSync.typefactory.create(
                               'System.ConfigSync.FileTransferContext')
        poll = True
        chunk_size = 64*768
        ctx.chain_type = 'FILE_FIRST'
        tsent = 0
        try:
            f = io.open(local_file, 'rb')
        except IOError, e:
            print >> sys.stderr, e
            sys.exit(1)
        while poll:
            fdata = f.read(chunk_size)
            if len(fdata) != chunk_size:
                if tsent == 0:
                    ctx.chain_type = 'FILE_FIRST_AND_LAST'
                else:
                    ctx.chain_type = 'FILE_LAST'
                poll = False
            ctx.file_data = base64.b64encode(fdata)
            a.upload_policy(local_file, ctx)
            tsent += 1
            ctx.chain_type = 'FILE_MIDDLE'
    
    if __name__ == '__main__':
    
        import pycontrol.pycontrol as pc
        import base64
        import binascii
        import io
        import getpass
        import sys
        import os
    
        if pc.__version__[:3] == '2.0':
            pass
        else:
            print "Requires pycontrol v2.x!"
            sys.exit()
    
        if len(sys.argv) != 3:
            exit("Usage: getFile.py    ")
    
        host1 = sys.argv[1]
        uname1 = sys.argv[2]
        host2 = sys.argv[3]
        uname2 = sys.argv[4]
    
        upass1 = getpass.getpass(prompt = "Password ("+host1+"): ")
        upass2 = getpass.getpass(prompt = "Password ("+host2+"): ")
    
        b1 = pc.BIGIP(
            hostname = host1,
            username = uname1,
            password = upass1,
            fromurl = True,
            wsdls = ['ASM.Policy']
            )
            
        b2 = pc.BIGIP(
            hostname = host2,
            username = uname2,
            password = upass2,
            fromurl = True,
            wsdls = ['ASM.Policy', 'System.ConfigSync']
            )
        
        a1 = b1.ASM.Policy
        a2 = b2.ASM.Policy
    
        policies = a1.get_list()
        for p in policies[1:]:
            print "Downloading policy - "+p
            a1.export_policy_xml(policy_name = p, filename = p+".xml")
            download_policy(b1, p+".xml", p+".xml")
            
        for file_ in os.listdir("."):
            if file_.endswith(".xml"):
                print "Uploading/importing policy - "+file_[:-4]
                upload_policy(b2, file_)
                a2.import_policy(webapp_name = "", filename = "/var/tmp/"+file_) 
  • @Chris Campbell - thank you very much! I appreciate your help!

     

    How do you know that download size chunks should be 64_1024 and upload chunks 64_768?

     

    • Chris_Campbell1's avatar
      Chris_Campbell1
      Icon for Cirrus rankCirrus
      I didn't write that bit of code, it's taken from one of the pyControl examples.