Forum Discussion

msaud's avatar
msaud
Icon for Cirrus rankCirrus
Jun 19, 2023

F5 iRUule not working

This is API Application rather than web browser.   Source URL: https://mule-dev-openai-lb.ucsf.edu/tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01   Destinatio...
  • ScottE's avatar
    ScottE
    Jun 19, 2023

    Hello msaud 

    Please remove the "set" in the "set HTTP::uri ${newUri}" command so it reads "HTTP::uri ${newUri}".  I usually don't have the brackets but I doubt that makes a difference.

    Scott

  • AaronJB's avatar
    AaronJB
    Jun 19, 2023

    [edit] Ignore this, ScottE had the proper advice below 🙂

     

    What's not working for you exactly - what behaviour are you seeing?

    I did a quick test in the lab and I see the behaviour you'd expect (a 302 redirect) - obviously I've set the IP for mule-dev-openai-lb.ucsf.edu to the VIP in my lab here:

     

    $ curl -kv 'http://mule-dev-openai-lb.ucsf.edu/tccog2/openai/deployments/tccognitivedeployment/completi
ons?api-version=2022-12-01'
*   Trying 10.10.16.10:80...
* Connected to mule-dev-openai-lb.ucsf.edu (10.10.16.10) port 80 (#0)
> GET /tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01 HTTP/1.1
> Host: mule-dev-openai-lb.ucsf.edu
> User-Agent: curl/7.81.0
> Accept: */*
>
* Mark bundle as not supporting multiuse
* HTTP 1.0, assume close after body
< HTTP/1.0 302 Moved Temporarily
< Location: https://tccog2.openai.azure.com/tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01
< Server: BigIP
* HTTP/1.0 connection set to keep alive!
< Connection: Keep-Alive
< Content-Length: 0
<
* Connection #0 to host mule-dev-openai-lb.ucsf.edu left intact

     

ScottE's avatar
ScottE
Icon for MVP rankMVP

Hello msaud 

Please remove the "set" in the "set HTTP::uri ${newUri}" command so it reads "HTTP::uri ${newUri}".  I usually don't have the brackets but I doubt that makes a difference.

Scott

AaronJB's avatar
AaronJB
Icon for SIRT rankSIRT
Jun 19, 2023

Whoops, I missed that my test hadn't rewritten the URI - I can confirm as well, remove the 'set' and it works for me:

$ curl -kv 'http://mule-dev-openai-lb.ucsf.edu/tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01'
*   Trying 10.10.16.10:80...
* Connected to mule-dev-openai-lb.ucsf.edu (10.10.16.10) port 80 (#0)
> GET /tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01 HTTP/1.1
> Host: mule-dev-openai-lb.ucsf.edu
> User-Agent: curl/7.81.0
> Accept: */*
>
* Mark bundle as not supporting multiuse
* HTTP 1.0, assume close after body
< HTTP/1.0 302 Moved Temporarily
< Location: https://tccog2.openai.azure.com/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01
< Server: BigIP
* HTTP/1.0 connection set to keep alive!
< Connection: Keep-Alive
< Content-Length: 0
<
* Connection #0 to host mule-dev-openai-lb.ucsf.edu left intact
  • msaud's avatar
    msaud
    Icon for Cirrus rankCirrus
    Jun 20, 2023

    Hi Aaron,

    Look like iRule is working but we are getting below errors when trying to connect VIP-

    "error":{"code":"404","message": "Resource not found"}}

     

    Is there other things that we need to check?

    10:48:45.455     06/19/2023     Worker-0     [MuleRuntime].uber.05: [stagegw-its-azure-openai-proxy].proxy.CPU_LITE @7e88db99     DEBUG

    event:898e3e00-0ec9-11ee-a321-02a4b434dd63 REQUESTER POST /tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01 HTTP/1.1 x-ssl-client-verify: NONE x-real-ip: 64.54.198.22 user-agent: PostmanRuntime/7.32.2 accept: */* cache-control: no-cache postman-token: bb49fc79-8441-4426-b4ea-c7b2de2835c7 accept-encoding: gzip, deflate, br authorization: Basic MDYxNzgyMjM5YjA3NDRlNDg3Y2U0ZWI0MTEzMmE0NTA6RDJhMTQ4MDQ1MEM0NDQzQTg0MzE4MTUyNGMwZUMxNjA= x-forwarded-for: 64.54.198.22, 10.225.46.165 x-forwarded-host: /10.225.46.190:60294 api-key: 03308343f0004146bc35159c0b624c3c x-anypnt-app-worker: A802BD108B50D526A4D3F6A5B49CDA97 x-correlation-id: 898e3e00-0ec9-11ee-a321-02a4b434dd63 Host: mule-stage-openai-lb.ucsf.edu:443 Connection: keep-alive Content-Type: application/json Content-Length: 53 {   "prompt": "Once upon a time",   "max_tokens": 5 }

    10:48:45.564     06/19/2023     Worker-0     [stagegw-its-azure-openai-proxy].http.requester.http-request-config.01 SelectorRunner     DEBUG

    event:898e3e00-0ec9-11ee-a321-02a4b434dd63 REQUESTER HTTP/1.1 404 Resource Not Found Date: Mon, 19 Jun 2023 17:48:45 GMT Content-Type: application/json Content-Length: 56 Connection: keep-alive apim-request-id: a7f2e0b9-fd83-4d2e-a36b-71729cc18a4f Strict-Transport-Security: max-age=31536000; includeSubDomains; preload x-content-type-options: nosniff {"error":{"code":"404","message": "Resource not found"}}