Forum Discussion

msaud's avatar
msaud
Icon for Cirrus rankCirrus
Jun 19, 2023

F5 iRUule not working

This is API Application rather than web browser.   Source URL: https://mule-dev-openai-lb.ucsf.edu/tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01   Destinatio...
  • ScottE's avatar
    ScottE
    Jun 19, 2023

    Hello msaud 

    Please remove the "set" in the "set HTTP::uri ${newUri}" command so it reads "HTTP::uri ${newUri}".  I usually don't have the brackets but I doubt that makes a difference.

    Scott

  • AaronJB's avatar
    AaronJB
    Jun 19, 2023

    [edit] Ignore this, ScottE had the proper advice below 🙂

     

    What's not working for you exactly - what behaviour are you seeing?

    I did a quick test in the lab and I see the behaviour you'd expect (a 302 redirect) - obviously I've set the IP for mule-dev-openai-lb.ucsf.edu to the VIP in my lab here:

     

    $ curl -kv 'http://mule-dev-openai-lb.ucsf.edu/tccog2/openai/deployments/tccognitivedeployment/completi
ons?api-version=2022-12-01'
*   Trying 10.10.16.10:80...
* Connected to mule-dev-openai-lb.ucsf.edu (10.10.16.10) port 80 (#0)
> GET /tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01 HTTP/1.1
> Host: mule-dev-openai-lb.ucsf.edu
> User-Agent: curl/7.81.0
> Accept: */*
>
* Mark bundle as not supporting multiuse
* HTTP 1.0, assume close after body
< HTTP/1.0 302 Moved Temporarily
< Location: https://tccog2.openai.azure.com/tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01
< Server: BigIP
* HTTP/1.0 connection set to keep alive!
< Connection: Keep-Alive
< Content-Length: 0
<
* Connection #0 to host mule-dev-openai-lb.ucsf.edu left intact

     

AaronJB's avatar
AaronJB
Icon for SIRT rankSIRT

Whoops, I missed that my test hadn't rewritten the URI - I can confirm as well, remove the 'set' and it works for me:

$ curl -kv 'http://mule-dev-openai-lb.ucsf.edu/tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01'
*   Trying 10.10.16.10:80...
* Connected to mule-dev-openai-lb.ucsf.edu (10.10.16.10) port 80 (#0)
> GET /tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01 HTTP/1.1
> Host: mule-dev-openai-lb.ucsf.edu
> User-Agent: curl/7.81.0
> Accept: */*
>
* Mark bundle as not supporting multiuse
* HTTP 1.0, assume close after body
< HTTP/1.0 302 Moved Temporarily
< Location: https://tccog2.openai.azure.com/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01
< Server: BigIP
* HTTP/1.0 connection set to keep alive!
< Connection: Keep-Alive
< Content-Length: 0
<
* Connection #0 to host mule-dev-openai-lb.ucsf.edu left intact
msaud's avatar
msaud
Icon for Cirrus rankCirrus
Jun 20, 2023

Hi Aaron,

Look like iRule is working but we are getting below errors when trying to connect VIP-

"error":{"code":"404","message": "Resource not found"}}

 

Is there other things that we need to check?

10:48:45.455     06/19/2023     Worker-0     [MuleRuntime].uber.05: [stagegw-its-azure-openai-proxy].proxy.CPU_LITE @7e88db99     DEBUG

event:898e3e00-0ec9-11ee-a321-02a4b434dd63 REQUESTER POST /tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01 HTTP/1.1 x-ssl-client-verify: NONE x-real-ip: 64.54.198.22 user-agent: PostmanRuntime/7.32.2 accept: */* cache-control: no-cache postman-token: bb49fc79-8441-4426-b4ea-c7b2de2835c7 accept-encoding: gzip, deflate, br authorization: Basic MDYxNzgyMjM5YjA3NDRlNDg3Y2U0ZWI0MTEzMmE0NTA6RDJhMTQ4MDQ1MEM0NDQzQTg0MzE4MTUyNGMwZUMxNjA= x-forwarded-for: 64.54.198.22, 10.225.46.165 x-forwarded-host: /10.225.46.190:60294 api-key: 03308343f0004146bc35159c0b624c3c x-anypnt-app-worker: A802BD108B50D526A4D3F6A5B49CDA97 x-correlation-id: 898e3e00-0ec9-11ee-a321-02a4b434dd63 Host: mule-stage-openai-lb.ucsf.edu:443 Connection: keep-alive Content-Type: application/json Content-Length: 53 {   "prompt": "Once upon a time",   "max_tokens": 5 }

10:48:45.564     06/19/2023     Worker-0     [stagegw-its-azure-openai-proxy].http.requester.http-request-config.01 SelectorRunner     DEBUG

event:898e3e00-0ec9-11ee-a321-02a4b434dd63 REQUESTER HTTP/1.1 404 Resource Not Found Date: Mon, 19 Jun 2023 17:48:45 GMT Content-Type: application/json Content-Length: 56 Connection: keep-alive apim-request-id: a7f2e0b9-fd83-4d2e-a36b-71729cc18a4f Strict-Transport-Security: max-age=31536000; includeSubDomains; preload x-content-type-options: nosniff {"error":{"code":"404","message": "Resource not found"}}