Skip to content

Conversation

@akashkulk
Copy link
Contributor

Currently, sources don't exit when encountering a config error, but instead default to the behavior of rethrowing. This causes AirbyteExceptionHandler to throw a system error thereby causing config errors to be reported to Sentry (potentially paging the OC rotation).

Fix here is to treat config errors the same as transient errors and exit as soon as they are encountered

@vercel
Copy link

vercel bot commented May 21, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
airbyte-docs ⬜️ Ignored (Inspect) Visit Preview May 29, 2024 9:25pm
@octavia-squidington-iii octavia-squidington-iii added area/connectors Connector related issues CDK Connector Development Kit connectors/source/postgres labels May 21, 2024
@octavia-squidington-iii octavia-squidington-iii added the area/documentation Improvements or additions to documentation label May 21, 2024
@akashkulk akashkulk marked this pull request as ready for review May 21, 2024 18:38
@akashkulk akashkulk requested review from a team as code owners May 21, 2024 18:38
@akashkulk akashkulk requested a review from xiaohansong May 21, 2024 18:38
cdkVersionRequired = '0.35.11'
features = ['db-sources']
useLocalCdk = false
useLocalCdk = true
Copy link
Contributor

@theyueli theyueli May 29, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

not sure if we need to merge this change (and the ones above and below) ?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will revert this when cdk is published and is toggled


@Test
@Throws(Exception::class)
fun testReadException() {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

could you explain why we need to remove this test?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This test fails now that we are properly exiting when catching the exception. We are changing the behavior of re-throwing the exception

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see, in this case, we might be interested in using this JUnit rule to verify the exit status:

https://stefanbirkner.github.io/system-rules/#ExpectedSystemExit

@akashkulk
Copy link
Contributor Author

akashkulk commented May 29, 2024

/publish-java-cdk

🕑 https://github.com/airbytehq/airbyte/actions/runs/9292227495
❌ Publish Java CDK <<<<<<< akash/config-errorversion=0.35.15=======version=0.36.0>>>>>>> master failed!

@akashkulk
Copy link
Contributor Author

akashkulk commented May 29, 2024

/publish-java-cdk

🕑 https://github.com/airbytehq/airbyte/actions/runs/9293239482
✅ Successfully published Java CDK version=0.36.2!

@akashkulk akashkulk enabled auto-merge (squash) May 29, 2024 21:28
@akashkulk akashkulk merged commit a2bcd49 into master May 29, 2024
@akashkulk akashkulk deleted the akash/config-error branch May 29, 2024 21:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/connectors Connector related issues area/documentation Improvements or additions to documentation CDK Connector Development Kit connectors/source/mssql connectors/source/mysql connectors/source/postgres

7 participants