This reminds me of Oracle Cloud and Ubuntu’s FW. It is known to have a conflict between both. You had to drop UFW and rely on Oracle’s VPS own firewall. Otherwise, many connections would not get through, if at all.

As a personal recommendation, I’d stay far from Ubuntu.