what does the Blue Square mean exactly under availability?

For what, the VS or the Pool?

Either way: typically seen when this or a related and dependent object (Pool or Pool Member depending on where you are looking) has no health monitor assigned or a newly assigned health monitor that is yet to run.