Code

Draft for Issue 183 list collection#342

Code

Closed

christian-monch wants to merge 30 commits intodatalad:maindatalad/datalad-next:mainfrom christian-monch:issue-183-list-collectionchristian-monch/datalad-next:issue-183-list-collectionCopy head branch name to clipboard

+1,054-4

Commits

Commits on Feb 24, 2023

• Draft of FsspecUrlOperations

  Show description for 77f959c
  mih

  committed
  77f959c

  Copy full SHA for 77f959c

• Basic smoke testing for fsspec and support github://

  mih

  committed
  40dd829

  Copy full SHA for 40dd829

• More fsspec support, in particular credential provisioning for s3://

  mih

  committed
  74bbdce

  Copy full SHA for 74bbdce

• Support arbitrary FSSPEC customizations for S3 access

  Show description for d8c655b
  mih

  committed
  d8c655b

  Copy full SHA for d8c655b

• Let FsspecUrlOperations take customizing arguments for url_to_fs()

  Show description for ce67f4c
  mih

  committed
  ce67f4c

  Copy full SHA for ce67f4c

• Update AnyUrlOperations's handler registry to include kwargs

  Show description for f34df7d
  mih

  committed
  f34df7d

  Copy full SHA for f34df7d

• Turn off version-awareness in the default S3 handler

  Show description for 72d350d
  mih

  committed
  72d350d

  Copy full SHA for 72d350d

• Avoid necessity to account for (un)chained URLs in config

  mih

  committed
  aa92043

  Copy full SHA for aa92043

• Fix undefined variable access

  mih

  committed
  36d14e1

  Copy full SHA for 36d14e1

• Support non-AWS S3 endpoints for credential lookup

  mih

  committed
  d22f6e1

  Copy full SHA for d22f6e1

• Streamline and complete dependencies

  Show description for 2366720
  mih

  committed
  2366720

  Copy full SHA for 2366720

• Introduce FsspecUrlOperations(block_size=...) parameter

  Show description for be271fe
  mih

  committed
  be271fe

  Copy full SHA for be271fe

• Revert turning off version awareness for S3

  Show description for a74b823
  mih

  committed
  a74b823

  Copy full SHA for a74b823

• Rough approximations or upload and delete for FsspecUrlOperations

  Show description for 2d6b80c
  mih

  committed
  2d6b80c

  Copy full SHA for 2d6b80c

Commits on May 3, 2023

• Merge branch 'main' into fsspec

  adswa

  authored
  6f3c678

  Copy full SHA for 6f3c678

• Remove deprecated and unused intersphinx mapping def

  

  mih

  authored and

  adswa

  committed
  5fe8122

  Copy full SHA for 5fe8122

• TST: Add a test for S3 version handling

  adswa

  committed
  a861d68

  Copy full SHA for a861d68

• TMP: Document a note to not set version_aware fs_kwargs

  Show description for 744bf8b
  adswa

  committed
  744bf8b

  Copy full SHA for 744bf8b

Commits on May 4, 2023

• Merge remote-tracking branch 'origin/main' into fsspec

  Show description for 54da154
  mih

  committed
  54da154

  Copy full SHA for 54da154

• Fix typos

  mih

  committed
  68b34b2

  Copy full SHA for 68b34b2

• Merge remote-tracking branch 'origin/main' into fsspec

  Show description for 375f7b1
  mih

  committed
  375f7b1

  Copy full SHA for 375f7b1

• Protect keyring from modification in test

  mih

  committed
  edc1a34

  Copy full SHA for edc1a34

• Merge remote-tracking branch 'origin/main' into fsspec

  mih

  committed
  4a74ad2

  Copy full SHA for 4a74ad2

• Add error handling for inaccessible URLs

  Show description for b12824c
  adswa

  committed
  b12824c

  Copy full SHA for b12824c

• TST: Add a test case for error handling in download

  adswa

  committed
  d7d3f93

  Copy full SHA for d7d3f93

• Merge branch 'fsspec' of github.com:mih/datalad-next into fsspec

  adswa

  committed
  8dd3ef8

  Copy full SHA for 8dd3ef8

• TST: skip ZIP url download tests on windows while fsspec crashes with it

  adswa

  committed
  9e9b153

  Copy full SHA for 9e9b153

• Try to broaden condition to crippledFS and windows

  adswa

  committed
  c3e3673

  Copy full SHA for c3e3673

Commits on May 5, 2023

• add a first version of list-collection

  Show description for 30d4a50
  christian-monch

  committed
  30d4a50

  Copy full SHA for 30d4a50

Commits on May 8, 2023

• add collection type detection code

  christian-monch

  committed
  4c1a9da

  Copy full SHA for 4c1a9da