Add CMake option to allow data files to be found in local directory, allowing developer to keep local copy, and CI system to cache #728
Assignees
Labels
Comments
GeorgeGayno-NOAA
pushed a commit
that referenced
this issue
Dec 14, 2022
… found instead of using FTP. (#732) Add handling for the TEST_FILE_DIR option in CMake. This allows the programmer to specify a local directory to check first, before downloading test data files from the FTP site. Use this capability, and a cache, to cache the data for all CI runs as well. This prevents the CI system from downloading these test files hundreds of times per day. Part of #719. Fixes #728
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
We download a bunch of test data from the FTP site.
On the g2/g2c/grib_util projects I have added an option to CMakeLists.txt that allows a local directory to be checked for data before ftp is called. If the file is found in the local directory, then it is copied, otherwise it is fetched from FTP. This allows me to keep a local copy of the test data files. When I work on the code, cmake does not keep downloading the test files.
Also, and even better, the CI system can then cache the data files and not have to fetch them for each test run. This speeds up the CI a lot.
The text was updated successfully, but these errors were encountered: