Forum Discussion

Cirrus

Jun 19, 2023

F5 iRUule not working

This is API Application rather than web browser. Source URL: https://mule-dev-openai-lb.ucsf.edu/tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01 Destinatio...

ScottE
Jun 19, 2023
Hello msaud

Please remove the "set" in the "set HTTP::uri ${newUri}" command so it reads "HTTP::uri ${newUri}". I usually don't have the brackets but I doubt that makes a difference.

Scott

AaronJB

Jun 19, 2023

[edit] Ignore this, ScottE had the proper advice below 🙂

What's not working for you exactly - what behaviour are you seeing?

I did a quick test in the lab and I see the behaviour you'd expect (a 302 redirect) - obviously I've set the IP for mule-dev-openai-lb.ucsf.edu to the VIP in my lab here:

$ curl -kv 'http://mule-dev-openai-lb.ucsf.edu/tccog2/openai/deployments/tccognitivedeployment/completi
ons?api-version=2022-12-01'
*   Trying 10.10.16.10:80...
* Connected to mule-dev-openai-lb.ucsf.edu (10.10.16.10) port 80 (#0)
> GET /tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01 HTTP/1.1
> Host: mule-dev-openai-lb.ucsf.edu
> User-Agent: curl/7.81.0
> Accept: */*
>
* Mark bundle as not supporting multiuse
* HTTP 1.0, assume close after body
< HTTP/1.0 302 Moved Temporarily
< Location: https://tccog2.openai.azure.com/tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01
< Server: BigIP
* HTTP/1.0 connection set to keep alive!
< Connection: Keep-Alive
< Content-Length: 0
<
* Connection #0 to host mule-dev-openai-lb.ucsf.edu left intact

ScottE

MVP

Jun 19, 2023

Hello msaud

Please remove the "set" in the "set HTTP::uri ${newUri}" command so it reads "HTTP::uri ${newUri}". I usually don't have the brackets but I doubt that makes a difference.

Scott

AaronJB
SIRT
Jun 19, 2023
Whoops, I missed that my test hadn't rewritten the URI - I can confirm as well, remove the 'set' and it works for me:

$ curl -kv 'http://mule-dev-openai-lb.ucsf.edu/tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01' * Trying 10.10.16.10:80... * Connected to mule-dev-openai-lb.ucsf.edu (10.10.16.10) port 80 (#0) > GET /tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01 HTTP/1.1 > Host: mule-dev-openai-lb.ucsf.edu > User-Agent: curl/7.81.0 > Accept: */* > * Mark bundle as not supporting multiuse * HTTP 1.0, assume close after body < HTTP/1.0 302 Moved Temporarily < Location: https://tccog2.openai.azure.com/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01 < Server: BigIP * HTTP/1.0 connection set to keep alive! < Connection: Keep-Alive < Content-Length: 0 < * Connection #0 to host mule-dev-openai-lb.ucsf.edu left intact
- msaud
  Cirrus
  Jun 20, 2023
  Hi Aaron,
  Look like iRule is working but we are getting below errors when trying to connect VIP-
  "error":{"code":"404","message": "Resource not found"}}
  
  Is there other things that we need to check?
  10:48:45.455 06/19/2023 Worker-0 [MuleRuntime].uber.05: [stagegw-its-azure-openai-proxy].proxy.CPU_LITE @7e88db99 DEBUG
  event:898e3e00-0ec9-11ee-a321-02a4b434dd63 REQUESTER POST /tccog2/openai/deployments/tccognitivedeployment/completions?api-version=2022-12-01 HTTP/1.1 x-ssl-client-verify: NONE x-real-ip: 64.54.198.22 user-agent: PostmanRuntime/7.32.2 accept: */* cache-control: no-cache postman-token: bb49fc79-8441-4426-b4ea-c7b2de2835c7 accept-encoding: gzip, deflate, br authorization: Basic MDYxNzgyMjM5YjA3NDRlNDg3Y2U0ZWI0MTEzMmE0NTA6RDJhMTQ4MDQ1MEM0NDQzQTg0MzE4MTUyNGMwZUMxNjA= x-forwarded-for: 64.54.198.22, 10.225.46.165 x-forwarded-host: /10.225.46.190:60294 api-key: 03308343f0004146bc35159c0b624c3c x-anypnt-app-worker: A802BD108B50D526A4D3F6A5B49CDA97 x-correlation-id: 898e3e00-0ec9-11ee-a321-02a4b434dd63 Host: mule-stage-openai-lb.ucsf.edu:443 Connection: keep-alive Content-Type: application/json Content-Length: 53 { "prompt": "Once upon a time", "max_tokens": 5 }
  10:48:45.564 06/19/2023 Worker-0 [stagegw-its-azure-openai-proxy].http.requester.http-request-config.01 SelectorRunner DEBUG
  event:898e3e00-0ec9-11ee-a321-02a4b434dd63 REQUESTER HTTP/1.1 404 Resource Not Found Date: Mon, 19 Jun 2023 17:48:45 GMT Content-Type: application/json Content-Length: 56 Connection: keep-alive apim-request-id: a7f2e0b9-fd83-4d2e-a36b-71729cc18a4f Strict-Transport-Security: max-age=31536000; includeSubDomains; preload x-content-type-options: nosniff {"error":{"code":"404","message": "Resource not found"}}