Apache Airflow version

3.1.0

If "Other Airflow 2 version" selected, which one?

No response

What happened?

I was using airflow 3.0.6 on kubernetes and I had setup logging to s3, everything was working completely fine, and then I upgraded to airflow 3.1.0. Now Im unable to retrieve logs from s3 when I try to view them for a task -- the UI shows 500 Internal Server Error.

Checking to api-server's logs i see:

│ api-server File "/home/airflow/.local/lib/python3.10/site-packages/botocore/signers.py", line 200, in sign │ │ api-server auth.add_auth(request) │ │ api-server File "/home/airflow/.local/lib/python3.10/site-packages/botocore/auth.py", line 422, in add_auth │ │ api-server raise NoCredentialsError() │ │ api-server botocore.exceptions.NoCredentialsError: Unable to locate credentials 

I can confirm logs are successfully added to s3 though.

What you think should happen instead?

If logs to s3 were working completely fine on 3.0.6 Id expect the same on 3.1.0

How to reproduce

Setup remote logging to s3:

 logging: remote_logging: 'True' remote_base_log_folder: s3://airflow/logs remote_log_conn_id: s3_default encrypt_s3_logs: 'False' 

Try viewing task logs on UI from DAGs

Operating System

Debian GNU/Linux 12 (bookworm)

Versions of Apache Airflow Providers

apache-airflow-providers-amazon==9.14.0
apache-airflow-providers-celery==3.12.3
apache-airflow-providers-cncf-kubernetes==10.8.0
apache-airflow-providers-common-compat==1.7.4
apache-airflow-providers-common-io==1.6.3
apache-airflow-providers-common-messaging==2.0.0
apache-airflow-providers-common-sql==1.28.1
apache-airflow-providers-docker==4.4.3
apache-airflow-providers-elasticsearch==6.3.3
apache-airflow-providers-fab==2.4.3
apache-airflow-providers-ftp==3.13.2
apache-airflow-providers-git==0.0.8
apache-airflow-providers-google==18.0.0
apache-airflow-providers-grpc==3.8.2
apache-airflow-providers-hashicorp==4.3.2
apache-airflow-providers-http==5.3.4
apache-airflow-providers-microsoft-azure==12.7.1
apache-airflow-providers-mysql==6.3.4
apache-airflow-providers-odbc==4.10.2
apache-airflow-providers-openlineage==2.7.1
apache-airflow-providers-postgres==6.3.0
apache-airflow-providers-redis==4.3.1
apache-airflow-providers-sendgrid==4.1.3
apache-airflow-providers-sftp==5.4.0
apache-airflow-providers-slack==9.3.0
apache-airflow-providers-smtp==2.2.1
apache-airflow-providers-snowflake==6.5.4
apache-airflow-providers-ssh==4.1.4
apache-airflow-providers-standard==1.8.0

Deployment

Official Apache Airflow Helm Chart

Deployment details

No response

Anything else?

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct