huggingface download link

Author: PeterWang512

README.md

@@ -16,6 +16,8 @@ This repository contains models, evaluation code, and training code on datasets
 
 **Jul 24th, 2024 Update** Unfortunately, the previous Google Drive link for the dataset is no longer available. Please use this temporary download [link](https://drive.google.com/drive/folders/1RwCSaraEUctIwFgoQXWMKFvW07gM80_3?usp=drive_link). I am planning to host the dataset on Huggingface within a week.
 
+**Jul 26th, 2024 Update** The link has been fixed! Please follow the README to download the dataset. You will need to install 7z to prepare the dataset. For linux, run `sudo apt-get install p7zip-full` to install.
+
 ## (1) Setup
 
 ### Install packages
@@ -62,6 +64,12 @@ The training set used in the paper can be downloaded [here](https://drive.google
 The validation set consists of held-out ProGAN real and fake images, and can be downloaded [here](https://drive.google.com/file/d/1FU7xF8Wl_F8b0tgL0529qg2nZ_RpdVNL/view?usp=sharing). The directory structure is identical to that of the training set.
 
 ### Download the dataset
+Before downloading, install 7z if needed.
+```
+# Download script for linux
+sudo apt-get install p7zip-full
+```
+
 A script for downloading the dataset is as follows: 
 ```
 # Download the testset

dataset/test/download_testset.sh

@@ -1,8 +1,5 @@
 #!/bin/bash
-DOCUMENT_ID="1z_fD3UKgWQyOTZIBbYSaQ-hz4AzUrLC1"
-FINAL_DOWNLOADED_FILENAME="testset.zip"
+wget https://huggingface.co/datasets/sywang/CNNDetection/resolve/main/CNN_synth_testset.zip
 
-curl -c /tmp/cookies "https://drive.google.com/uc?export=download&id=$DOCUMENT_ID" > /tmp/intermezzo.html
-curl -L -b /tmp/cookies "https://drive.google.com$(cat /tmp/intermezzo.html | grep -Po 'uc-download-link" [^>]* href="\K[^"]*' | sed 's/\&/\&/g')" > $FINAL_DOWNLOADED_FILENAME
-unzip testset.zip
-rm testset.zip
+unzip CNN_synth_testset.zip
+rm CNN_synth_testset.zip

dataset/train/download_trainset.sh

@@ -1,8 +1,14 @@
 #!/bin/bash
-DOCUMENT_ID="1iVNBV0glknyTYGA9bCxT_d0CVTOgGcKh"
-FINAL_DOWNLOADED_FILENAME="trainset.zip"
+wget https://huggingface.co/datasets/sywang/CNNDetection/resolve/main/progan_train.7z.001 &
+wget https://huggingface.co/datasets/sywang/CNNDetection/resolve/main/progan_train.7z.002 &
+wget https://huggingface.co/datasets/sywang/CNNDetection/resolve/main/progan_train.7z.003 &
+wget https://huggingface.co/datasets/sywang/CNNDetection/resolve/main/progan_train.7z.004 &
+wget https://huggingface.co/datasets/sywang/CNNDetection/resolve/main/progan_train.7z.005 &
+wget https://huggingface.co/datasets/sywang/CNNDetection/resolve/main/progan_train.7z.006 &
+wget https://huggingface.co/datasets/sywang/CNNDetection/resolve/main/progan_train.7z.007 &
+wait $(jobs -p)
 
-curl -c /tmp/cookies "https://drive.google.com/uc?export=download&id=$DOCUMENT_ID" > /tmp/intermezzo.html
-curl -L -b /tmp/cookies "https://drive.google.com$(cat /tmp/intermezzo.html | grep -Po 'uc-download-link" [^>]* href="\K[^"]*' | sed 's/\&/\&/g')" > $FINAL_DOWNLOADED_FILENAME
-unzip trainset.zip
-rm trainset.zip
+7z x progan_train.7z.001
+rm progan_train.7z.*
+unzip progan_train.zip
+rm progan_train.zip

dataset/val/download_valset.sh

@@ -1,8 +1,5 @@
 #!/bin/bash
-DOCUMENT_ID="1FU7xF8Wl_F8b0tgL0529qg2nZ_RpdVNL"
-FINAL_DOWNLOADED_FILENAME="valset.zip"
+wget https://huggingface.co/datasets/sywang/CNNDetection/resolve/main/progan_val.zip
 
-curl -c /tmp/cookies "https://drive.google.com/uc?export=download&id=$DOCUMENT_ID" > /tmp/intermezzo.html
-curl -L -b /tmp/cookies "https://drive.google.com$(cat /tmp/intermezzo.html | grep -Po 'uc-download-link" [^>]* href="\K[^"]*' | sed 's/\&/\&/g')" > $FINAL_DOWNLOADED_FILENAME
-unzip valset.zip
-rm valset.zip
+unzip progan_val.zip
+rm progan_val.zip