Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add simple glider data example #94

Merged
merged 4 commits into from
Feb 16, 2023

Conversation

callumrollo
Copy link
Contributor

Starting to address #58 with an example of QC for a glider dataset. This notebook can be expanded to include qc of more variables, and the process of creating qc variables for the original glider dataset

@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@callumrollo
Copy link
Contributor Author

Tests are failing due to flake8 migration to GitHub. These checks should be green once #95 is merged

@ocefpaf ocefpaf mentioned this pull request Feb 5, 2023
@ocefpaf
Copy link
Member

ocefpaf commented Feb 7, 2023

Tests are failing due to flake8 migration to GitHub. These checks should be green once #95 is merged

Do you want to rebase this to make the tests pass?

@@ -0,0 +1,567 @@
{
Copy link
Member

@ocefpaf ocefpaf Feb 7, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Line #5.    e.dataset_id = "nrt_SEA067_M37"

We should probably save this dataset somewhere so we can "freeze" this example. I guess it may change over time in the server.


Reply via ReviewNB

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, where should the dataset be uploaded? It's a netCDF around 4 MB

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can probably upload as an asset in a GitHub release. Not the best solution though. Or Maybe @kwilcox have a better place for it in an ERDDAP server were folks here have more control.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

At 4MB I don't mind including it in the repo to avoid friction. Uploading as an asset and downloading in the notebook works too!

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've reduced it to 480K and added it directly to the repo. It's a similar size to the pc02 example data already included

@callumrollo
Copy link
Contributor Author

I'm not sure what to do with the codespell failure. Should the notebook be restarted with cleared output when committed?

@ocefpaf
Copy link
Member

ocefpaf commented Feb 7, 2023

I'm not sure what to do with the codespell failure. Should the notebook be restarted with cleared output when committed?

I'm trying to avoid commiting notebooks with outputs for many reasons, that is one of them. However, if we are going to use this in the docs we need to run it before rendering the docs. for now, I would just commit it without any outputs. I can take care of the docs later.

@callumrollo
Copy link
Contributor Author

I've cleared the notebook output. Hopefully all clear now. Is the notebook itself ok as example? Do you want more detail or explanation?

@ocefpaf
Copy link
Member

ocefpaf commented Feb 9, 2023

@callumrollo let's avoid committing the netCDF file to the repo. I'll add it as an asset for you and send the URL in a bit. Hold on...

@ocefpaf
Copy link
Member

ocefpaf commented Feb 9, 2023

@callumrollo let's avoid committing the netCDF file to the repo. I'll add it as an asset for you and send the URL in a bit. Hold on...

Here you go: https://github.com/ioos/ioos_qc/releases/download/2.1.0/nrt_SEA067_M37.nc

It is versioned but I used the current release for it. Ideally, in the future, we should add it to future release via a draft release, to obtain the URLs, before making an official release.

PS: You can use pooch to manage the asset download like:

import pooch


url = f"https://github.com/ioos/ioos_qc/releases/download"
version = "2.1.0"
fname = "nrt_SEA067_M37.nc"

download = pooch.retrieve(
    url=f"{url}/{version}/{fname}",
    known_hash="sha256:06e8a79cc17a2d55bb32dbfdc85f9922c1a1cc14726df004ae971125f91b27ac",
)

@callumrollo
Copy link
Contributor Author

downloading with pooch now

@ocefpaf ocefpaf mentioned this pull request Feb 9, 2023
@callumrollo
Copy link
Contributor Author

@ocefpaf any further changes you'd like to see before we can merge?

@ocefpaf
Copy link
Member

ocefpaf commented Feb 14, 2023

@ocefpaf any further changes you'd like to see before we can merge?

Not on my side. @kwilcox is this OK to go?

@callumrollo
Copy link
Contributor Author

callumrollo commented Feb 16, 2023

Great! I'm happy for it to be merged, I don't have the rights on this repo

@kwilcox kwilcox merged commit 6b12aa7 into ioos:main Feb 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants