AI Inference for VLLM models with F5 BIG-IP & Red Hat OpenShift

Introduction to AI inferencing  AI inferencing is the stage where a pre-trained AI model uses its learned knowledge to make predictions, decisions, or generate outputs. AI inference requests are se...
Updated Jan 27, 2026
Version 2.0
application delivery
cloud
deployment
Ulises_Alonso's avatar
Icon for Employee rankEmployee
Solutions architect in Business Development with focus in automation and integration with partner's technologies. Prior to this role I was consultant in Professional Services and escalations engineer in Technical Support. Outside F5, I worked in mobile and wired network operators as network engineer. I started my career in academic research. In all these years, no matter what I've been doing Linux has been always the best tool. Not the one in the picture :-)
View Profile
Ulises_Alonso's avatar
Ulises_Alonso
Icon for Employee rankEmployee
Feb 11, 2026

Hi lijie, apologies.

I´ve just made the repository public. Please note that you will need AS3 v3.56 and the knobs for adding the JSON/SSE profiles with the VirtualServer CRD are going to be added in upcoming CIS 2.21. With previous versions of CIS it is needed to use the AS3 ConfigMap option.

lijie's avatar
lijie
Icon for Nimbostratus rankNimbostratus
Feb 11, 2026

 Hi Ulises_Alonso​， it works， thx for your kindly help and suggestion