Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

added error result to http responses #1517

Merged

Conversation

nicholas-goodwin
Copy link
Contributor

@nicholas-goodwin nicholas-goodwin commented Nov 2, 2022

Ticket Link #885

Description

  • added an error handling portion for when a website will return :ok, but with an error message, which seems to break ingestion consumption.

Reminders:

  • Be mindful of impacts of changing Major/Minor/Patch versions of each elixir app
    • If updating patch version, are you sure there are no chart changes required to maintain functionality? If so, you should bump minor version instead.
      - [ ] If updating Major or Minor versions , did you update the sauron chart configuration?
  • If changing elixir code in an "app", did you update the relevant version
    in mix.exs?
    - [ ] If altering an API endpoint, was the relevant postman collection updated?
    - [ ] If a new version of smart_city is being used (new fields on a struct), were the relevant postman collections updated?

@nicholas-goodwin nicholas-goodwin marked this pull request as ready for review November 2, 2022 14:29
@@ -31,7 +31,7 @@ defmodule Reaper.DataSlurper.Http do
"Unable to retrieve data for #{ingestion_id}: #{Exception.message(error)}"
end)

reraise error, __STACKTRACE__
reraise inspect(error), __STACKTRACE__
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this came about because the HTTPError that was boiling up from the Task.Await on line 39 ended up like {{%HTTPError}} for some reason with no real way of removing it without erroring out further when another exception came through. Would gladly change this if solution could be found.

Copy link
Contributor

@c-m-duncan c-m-duncan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@nicholas-goodwin nicholas-goodwin merged commit 23fc8eb into master Nov 3, 2022
@nicholas-goodwin nicholas-goodwin deleted the 885-Reaper-not-ingesting-data-after-failing-ingestion branch November 3, 2022 17:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants