The problem seems to have stemmed from a problem similar to the one here https://discourse.webflow.com/t/error-525-ssl-handshake-failed/73756/5
We had webflow provision an SSL certificate for us, and then stopped pointing that domain at webflow so they couldn’t renew it. We actually don’t need their SSL certificate, so we turned off SSL for our website in webflow and are handling it through our cloudfront distribution.
We have now turned off SSL settings in Webflow and are using our own SSL certificate, and are pointing to the SSL free Webflow proxy.