Adding these lines to the apache config for this vhost fixed it:
Header add X-Forwarded-Proto "https"
RequestHeader add X-Forwarded-Proto "https"
docker Blob Unknown when pushing to custom registry through apache proxy