http-walker: complain about non-404 loose object errors

Since commit 17966c0a6 (http: avoid disconnecting on 404s for loose objects, 2016-07-11), we turn off curl's FAILONERROR option and instead manually deal with failing HTTP codes. However, the logic to do so only recognizes HTTP 404 as a failure. This is probably the most common result, but if we were to get another code, the curl result remains CURLE_OK, and we treat it as success. We still end up detecting the failure when we try to zlib-inflate the object (which will fail), but instead of reporting the HTTP error, we just claim that the object is corrupt. Instead, let's catch anything in the 300's or above as an error (300's are redirects which are not an error at the HTTP level, but are an indication that we've explicitly disabled redirects, so we should treat them as such; we certainly don't have the resulting object content). Note that we also fill in req->errorstr, which we didn't do before. Without FAILONERROR, curl will not have filled this in, and it will remain a blank string. This never mattered for the 404 case, because in the logic below we hit the "missing_target()" branch and print nothing. But for other errors, we'd want to say _something_, if only to fill in the blank slot in the error message. Signed-off-by: Jeff King <peff@peff.net> Signed-off-by: Junio C Hamano <gitster@pobox.com>

Jeff King committed Dec 6, 2016 at 13:25 UTC 3680f16f9d6832dc78c6b80f1e8a546385d946f9
2 files changed +6 -3
http-walker.c
+5 -2
@@ -482,10 +482,13 @@ static int fetch_object(struct walker *walker, unsigned char *sha1)
482 * we turned off CURLOPT_FAILONERROR to avoid losing a
483 * persistent connection and got CURLE_OK.
484 */
485 - if (req->http_code == 404 && req->curl_result == CURLE_OK &&
485 + if (req->http_code >= 300 && req->curl_result == CURLE_OK &&
486 (starts_with(req->url, "http://") ||
487 - starts_with(req->url, "https://")))
487 + starts_with(req->url, "https://"))) {
488 req->curl_result = CURLE_HTTP_RETURNED_ERROR;
489 + xsnprintf(req->errorstr, sizeof(req->errorstr),
490 + "HTTP request failed");
491 + }
492
493 if (obj_req->state == ABORTED) {
494 ret = error("Request for %s aborted", hex);
http.c
+1 -1
@@ -1894,7 +1894,7 @@ static size_t fwrite_sha1_file(char *ptr, size_t eltsize, size_t nmemb,
1894 if (c != CURLE_OK)
1895 die("BUG: curl_easy_getinfo for HTTP code failed: %s",
1896 curl_easy_strerror(c));
1897 - if (slot->http_code >= 400)
1897 + if (slot->http_code >= 300)
1898 return size;
1899 }
1900