Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Recursive copy from GCS bucket to Azure container fails when using exclude-path with cannot start job due to error: FileIgnored error #1640

Closed
pstibrany opened this issue Dec 20, 2021 · 4 comments

Comments

@pstibrany
Copy link

pstibrany commented Dec 20, 2021

Which version of the AzCopy was used?

AzCopy 10.13.0

Which platform are you using? (ex: Windows, Mac, Linux)

Mac

What command did you run?

azcopy copy 'https://storage.cloud.google.com/bucket/test' "https://account.blob.core.windows.net/container/test" --recursive --exclude-pattern bucket-index.json.gz

What problem was encountered?

failed to perform copy command due to error: cannot start job due to error: FileIgnored.

How can we reproduce the problem in the simplest way?

Whenever I try to do recursive copy from Google Storage bucket and use --exclude-* flags (tried --exclude-path, --exclude-regex and --exclude-pattern) to skip some files, I get the error failed to perform copy command due to error: cannot start job due to error: FileIgnored..

Have you found a mitigation/solution?

Removing exclusion works fine, but of course also copies objects that I would prefer not to copy.

@adreed-msft
Copy link
Member

adreed-msft commented Jan 10, 2022

This is an error that was supposed to be caught; it should not have made it here. I've fixed this in #1654 and it should hopefully make it through next release.

@pstibrany
Copy link
Author

Thank you! I will test it and report back.

@pstibrany
Copy link
Author

I confirm that with #1654 the exclude options work fine. Thank you very much!

@mohsha-msft
Copy link
Contributor

Fix released in AzCopy 10.14.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants