Let's Encrypt Certificate

Make sure the new certificate is installed under Admin → System Admin → HTTPs Setup → Settings.

Also have a read in this thread about issues with automatic certificate renewals: