You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When we do url.download I sometimes end up loading gzip files and have to write a udf to decompress it.
Describe the solution you'd like
Would like to have a builtin to do gzip decompression
When we do url.download I sometimes end up loading gzip files and have to write a udf to decompress it.
I think it might be best if we put this in a new expression but we could also roll it into url.download. Need to catch failure cases.
I havent checked if daft does this automatically if you do daft.read but could be
Describe alternatives you've considered
No response
Additional Context
No response
Would you like to implement a fix?
No
The text was updated successfully, but these errors were encountered:
Thanks for the feature request! I agree let's make this its own expression for binary strings.
What do you think about these signatures?
# decode as "gzip" and raise ERROR on failurecol("my_bytes").decode("gzip")
# decode as "gzip" or return NULL on failurecol("my_bytes").try_decode("gzip")
Could you please elaborate on needing to catch failure cases? We may also want to allow for an encode/decode context for more complicated use cases. No need to design/solve that now, but would like to be aware of things like encoding levels and encode/decode dictionaries.
Is your feature request related to a problem?
When we do url.download I sometimes end up loading gzip files and have to write a udf to decompress it.
Describe the solution you'd like
Would like to have a builtin to do gzip decompression
When we do url.download I sometimes end up loading gzip files and have to write a udf to decompress it.
I think it might be best if we put this in a new expression but we could also roll it into url.download. Need to catch failure cases.
I havent checked if daft does this automatically if you do
daft.read
but could beDescribe alternatives you've considered
No response
Additional Context
No response
Would you like to implement a fix?
No
The text was updated successfully, but these errors were encountered: