To use an HTTPS only connection to FusionReactor, you need to go into the settings (FusionReactor top left -> settings), then configure and get the HTTPS access working.

At that point, you can disable the HTTP only access.

You can find all the FusionReactor settings and related documentation here