IAM role does not work for S3 Parquet format

[tuliren]

Environment

Is this your first time deploying Airbyte: Yes
OS Version / Instance: Amazon Linux 2, AWS
Memory / Disk: 4.01476 Gb / 50 Gb
Deployment: Docker
Airbyte Version: 0.35.14-alpha
Source name/version: Twilio
Destination name/version: Amazon S3
Description: I'm trying to sync using parquet output format but it give me this error:

Exception in thread "main" java.nio.file.AccessDeniedException: s3-bucket: org.apache.hadoop.fs.s3a.auth.NoAwsCredentialsException: SimpleAWSCredentialsProvider: No AWS credentials in the Hadoop configuration

Also if I when try with JSON/CSV format it works, and to mention that I attach an IAM role on the instance that runs Airbyte docker to read/write on the S3 bucket.

• Slack thread
• Relate to [kubernetes/helm] Allow authentication to AWS using roles #5942 (comment)