Raise Error when HTTPReader get 404 Response (#160)

[diegoaichele]

Fixes #160

Changes

• Add line of requests raise_for_status() will only allow 200 accepted requests

Comments

• This raise only run when the method iter of HTTPReader is called.
• It is not only raise for the 503 error, it also runs for 404, 500,501,502 ...
• I simulate them using FastAPI with the next code.

from fastapi import FastAPI, HTTPException

app = FastAPI()

@app.get("/raise/{error_int}")
async def raise_error(error_int: int):
    raise HTTPException(status_code=error_int)

[VitalyFedyunin]

Can you please add a test to https://github.com/pytorch/data/blob/main/test/test_remote_io.py#L60 which tries to load an unexisting url?

[diegoaichele]

@VitalyFedyunin
feat: Add Test HTTPError exception on the test_http_reader_iterdatapipe
shorten the error message ([:54]), but the important thing is that the 404 response comes out

[VitalyFedyunin]

Please use assertRaisesRegex it will reduce lines 91-92 to simple check.

[facebook-github-bot]

@NivekT has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

[facebook-github-bot]

@NivekT has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.