Skip to content

Conversation

@monai
Copy link
Contributor

@monai monai commented Jul 26, 2022

What

This PR updates schemas to match the latest API specifications and fixes failing integration tests due to changed data types.

Recommended reading order

  1. streams.py
  2. *.json

🚨 User Impact 🚨

No breaking changes.

Pre-merge Checklist

Community member or Airbyter

  • Grant edit access to maintainers (instructions)
  • Secrets in the connector's spec are annotated with airbyte_secret
  • Unit & integration tests added and passing. Community members, please provide proof of success locally e.g: screenshot or copy-paste unit, integration, and acceptance test output. To run acceptance tests for a Python connector, follow instructions in the README. For java connectors run ./gradlew :airbyte-integrations:connectors:<name>:integrationTest.
  • Code reviews completed
  • Documentation updated
    • Connector's README.md
    • Connector's bootstrap.md. See description and examples
    • Changelog updated in docs/integrations/<source or destination>/<name>.md including changelog. See changelog example
  • PR name follows PR naming conventions

Airbyter

If this is a community PR, the Airbyte engineer reviewing this PR is responsible for the below items.

  • Create a non-forked branch based on this PR and test the below items on it
  • Build is successful
  • If new credentials are required for use in CI, add them to GSM. Instructions.
  • /test connector=connectors/<name> command is passing
  • New Connector version released on Dockerhub and connector version bumped by running the /publish command described here

Tests

Unit
~/projects/lt/airbyte/airbyte-integrations/connectors/source-flexport (fix-flexport) python -m pytest -v unit_tests [.venv] Test session starts (platform: darwin, Python 3.9.11, pytest 6.1.2, pytest-sugar 0.9.5) cachedir: .pytest_cache rootdir: /Users/juozas/projects/lt/airbyte, configfile: pytest.ini plugins: sugar-0.9.5, requests-mock-1.9.3, mock-3.6.1, timeout-1.4.2 collecting ... airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_cursor_field[Shipments-updated_at] ✓ 2% ▎ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_get_updated_state[current0-latest0-expected0] ✓ 5% ▌ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_get_updated_state[current1-latest1-expected1] ✓ 7% ▊ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_get_updated_state[current2-latest2-expected2] ✓ 10% ▉ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_get_updated_state[current3-latest3-expected3] ✓ 12% █▎ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_slices[None-None-24-2050-01-01T00:00:00+00:00-2050-01-02T00:00:01+00:00] ✓ 14% █▌ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_slices[2050-01-02T00:00:00+00:00-None-48-2050-01-01T00:00:00+00:00-2050-01-03T00:00:01+00:00] ✓ 17% █▋ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_slices[None-stream_state2-1-2050-01-04T00:00:00+00:00-2050-01-04T00:00:01+00:00] ✓ 19% █▉ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_slices[2050-01-05T00:00:00+00:00-stream_state3-48-2050-01-04T00:00:00+00:00-2050-01-06T00:00:01+00:00] ✓ 21% ██▎ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_slices[2052-01-01T00:00:00+00:00-stream_state4-25-2050-01-01T00:00:00+00:00-2052-01-02T00:00:01+00:00] ✓ 24% ██▍ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_slices[2050-04-01T00:00:00+00:00-stream_state5-13-2050-01-01T00:00:00+00:00-2050-04-02T00:00:01+00:00] ✓ 26% ██▋ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_slices[2050-01-31T00:00:00+00:00-stream_state6-5-2050-01-01T00:00:00+00:00-2050-02-01T00:00:01+00:00] ✓ 29% ██▉ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_slices[2050-01-01T23:59:59+00:00-stream_state7-24-2050-01-01T00:00:00+00:00-2050-01-02T00:00:01+00:00] ✓ 31% ███▏ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_supports_incremental ✓ 33% ███▍ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_source_defined_cursor ✓ 36% ███▋ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_checkpoint_interval ✓ 38% ███▊ airbyte-integrations/connectors/source-flexport/unit_tests/test_source.py::test_check_connection[200-response0-expected0] ✓ 40% ████▏ airbyte-integrations/connectors/source-flexport/unit_tests/test_source.py::test_check_connection[401-response1-expected1] ✓ 43% ████▍ airbyte-integrations/connectors/source-flexport/unit_tests/test_source.py::test_check_connection[401-response2-expected2] ✓ 45% ████▌ airbyte-integrations/connectors/source-flexport/unit_tests/test_source.py::test_streams ✓ 48% ████▊ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_request_params[None-expected0] ✓ 50% █████ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_request_params[next_page_token1-expected1] ✓ 52% █████▎ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_next_page_token[response0-None] ✓ 55% █████▌ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_next_page_token[response1-expected1] ✓ 57% █████▊ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_next_page_token[response2-expected2] ✓ 60% █████▉ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_next_page_token[response3-expected3] ✓ 62% ██████▎ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-None-expected0] ✓ 64% ██████▌ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[400-None-expected1] ✓ 67% ██████▋ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-string_response-expected2] ✓ 69% ██████▉ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[401-string_response-expected3] ✓ 71% ███████▎ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-response4-expected4] ✓ 74% ███████▍ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[402-response5-expected5] ✓ 76% ███████▋ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-response6-expected6] ✓ 79% ███████▉ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[403-response7-expected7] ✓ 81% ████████▏ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-response8-expected8] ✓ 83% ████████▍ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[404-response9-expected9] ✓ 86% ████████▋ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-response10-expected10] ✓ 88% ████████▊ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[405-response11-expected11] ✓ 90% █████████▏ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-response12-expected12] ✓ 93% █████████▍ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-response13-expected13] ✓ 95% █████████▌ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-response14-expected14] ✓ 98% █████████▊ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-response15-expected15] ✓ 100% ██████████ =================================================================================================================== warnings summary ==================================================================================================================== airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py: 16 warnings airbyte-integrations/connectors/source-flexport/unit_tests/test_source.py: 5 warnings airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py: 22 warnings /Users/juozas/projects/lt/airbyte/airbyte-integrations/connectors/source-flexport/.venv/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py:41: DeprecationWarning: Call to deprecated class NoAuth. (Set `authenticator=None` instead) -- Deprecated since version 0.1.20. self._authenticator: HttpAuthenticator = NoAuth() airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py: 16 warnings airbyte-integrations/connectors/source-flexport/unit_tests/test_source.py: 5 warnings airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py: 22 warnings /Users/juozas/projects/lt/airbyte/airbyte-integrations/connectors/source-flexport/.venv/lib/python3.9/site-packages/deprecated/classic.py:173: DeprecationWarning: Call to deprecated class HttpAuthenticator. (Use requests.auth.AuthBase instead) -- Deprecated since version 0.1.20. return old_new1(cls, *args, **kwargs) -- Docs: https://docs.pytest.org/en/stable/warnings.html Results (0.85s): 42 passed 
Integration
~/projects/lt/airbyte/airbyte-integrations/connectors/source-flexport (fix-flexport) python -m pytest -p integration_tests [.venv] Test session starts (platform: darwin, Python 3.9.11, pytest 6.1.2, pytest-sugar 0.9.5) cachedir: .pytest_cache rootdir: /Users/juozas/projects/lt/airbyte, configfile: pytest.ini plugins: sugar-0.9.5, requests-mock-1.9.3, mock-3.6.1, timeout-1.4.2 collecting ... airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_cursor_field[Shipments-updated_at] ✓ 2% ▎ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_get_updated_state[current0-latest0-expected0] ✓ 5% ▌ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_get_updated_state[current1-latest1-expected1] ✓ 7% ▊ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_get_updated_state[current2-latest2-expected2] ✓ 10% ▉ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_get_updated_state[current3-latest3-expected3] ✓ 12% █▎ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_slices[None-None-24-2050-01-01T00:00:00+00:00-2050-01-02T00:00:01+00:00] ✓ 14% █▌ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_slices[2050-01-02T00:00:00+00:00-None-48-2050-01-01T00:00:00+00:00-2050-01-03T00:00:01+00:00] ✓ 17% █▋ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_slices[None-stream_state2-1-2050-01-04T00:00:00+00:00-2050-01-04T00:00:01+00:00] ✓ 19% █▉ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_slices[2050-01-05T00:00:00+00:00-stream_state3-48-2050-01-04T00:00:00+00:00-2050-01-06T00:00:01+00:00] ✓ 21% ██▎ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_slices[2052-01-01T00:00:00+00:00-stream_state4-25-2050-01-01T00:00:00+00:00-2052-01-02T00:00:01+00:00] ✓ 24% ██▍ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_slices[2050-04-01T00:00:00+00:00-stream_state5-13-2050-01-01T00:00:00+00:00-2050-04-02T00:00:01+00:00] ✓ 26% ██▋ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_slices[2050-01-31T00:00:00+00:00-stream_state6-5-2050-01-01T00:00:00+00:00-2050-02-01T00:00:01+00:00] ✓ 29% ██▉ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_slices[2050-01-01T23:59:59+00:00-stream_state7-24-2050-01-01T00:00:00+00:00-2050-01-02T00:00:01+00:00] ✓ 31% ███▏ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_supports_incremental ✓ 33% ███▍ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_source_defined_cursor ✓ 36% ███▋ airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py::test_stream_checkpoint_interval ✓ 38% ███▊ airbyte-integrations/connectors/source-flexport/unit_tests/test_source.py::test_check_connection[200-response0-expected0] ✓ 40% ████▏ airbyte-integrations/connectors/source-flexport/unit_tests/test_source.py::test_check_connection[401-response1-expected1] ✓ 43% ████▍ airbyte-integrations/connectors/source-flexport/unit_tests/test_source.py::test_check_connection[401-response2-expected2] ✓ 45% ████▌ airbyte-integrations/connectors/source-flexport/unit_tests/test_source.py::test_streams ✓ 48% ████▊ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_request_params[None-expected0] ✓ 50% █████ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_request_params[next_page_token1-expected1] ✓ 52% █████▎ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_next_page_token[response0-None] ✓ 55% █████▌ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_next_page_token[response1-expected1] ✓ 57% █████▊ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_next_page_token[response2-expected2] ✓ 60% █████▉ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_next_page_token[response3-expected3] ✓ 62% ██████▎ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-None-expected0] ✓ 64% ██████▌ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[400-None-expected1] ✓ 67% ██████▋ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-string_response-expected2] ✓ 69% ██████▉ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[401-string_response-expected3] ✓ 71% ███████▎ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-response4-expected4] ✓ 74% ███████▍ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[402-response5-expected5] ✓ 76% ███████▋ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-response6-expected6] ✓ 79% ███████▉ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[403-response7-expected7] ✓ 81% ████████▏ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-response8-expected8] ✓ 83% ████████▍ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[404-response9-expected9] ✓ 86% ████████▋ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-response10-expected10] ✓ 88% ████████▊ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[405-response11-expected11] ✓ 90% █████████▏ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-response12-expected12] ✓ 93% █████████▍ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-response13-expected13] ✓ 95% █████████▌ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-response14-expected14] ✓ 98% █████████▊ airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py::test_parse_response[200-response15-expected15] ✓ 100% ██████████ =================================================================================================================== warnings summary ==================================================================================================================== airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py: 16 warnings airbyte-integrations/connectors/source-flexport/unit_tests/test_source.py: 5 warnings airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py: 22 warnings /Users/juozas/projects/lt/airbyte/airbyte-integrations/connectors/source-flexport/.venv/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py:41: DeprecationWarning: Call to deprecated class NoAuth. (Set `authenticator=None` instead) -- Deprecated since version 0.1.20. self._authenticator: HttpAuthenticator = NoAuth() airbyte-integrations/connectors/source-flexport/unit_tests/test_incremental_streams.py: 16 warnings airbyte-integrations/connectors/source-flexport/unit_tests/test_source.py: 5 warnings airbyte-integrations/connectors/source-flexport/unit_tests/test_streams.py: 22 warnings /Users/juozas/projects/lt/airbyte/airbyte-integrations/connectors/source-flexport/.venv/lib/python3.9/site-packages/deprecated/classic.py:173: DeprecationWarning: Call to deprecated class HttpAuthenticator. (Use requests.auth.AuthBase instead) -- Deprecated since version 0.1.20. return old_new1(cls, *args, **kwargs) -- Docs: https://docs.pytest.org/en/stable/warnings.html Results (0.96s): 42 passed 
Acceptance
~/projects/lt/airbyte/airbyte-integrations/connectors/source-flexport (fix-flexport) python -m pytest -p integration_tests.acceptance [.venv] Test session starts (platform: darwin, Python 3.9.11, pytest 6.1.2, pytest-sugar 0.9.5) cachedir: .pytest_cache rootdir: /Users/juozas/projects/lt/airbyte, configfile: pytest.ini plugins: sugar-0.9.5, requests-mock-1.9.3, mock-3.6.1, timeout-1.4.2 collecting ... airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestSpec.test_config_match_spec[inputs0] ✓ 3% ▍ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestSpec.test_match_expected[inputs0] ✓ 5% ▌ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestSpec.test_docker_env[inputs0] ✓ 8% ▊ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestSpec.test_oneof_usage[inputs0] ✓ 11% █▏ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestSpec.test_required[inputs0] ✓ 13% █▍ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestSpec.test_optional[inputs0] ✓ 16% █▋ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestSpec.test_has_secret[inputs0] ✓ 18% █▉ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestSpec.test_secret_never_in_the_output[inputs0] ✓ 21% ██▏ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestSpec.test_defined_refs_exist_in_json_spec_file[inputs0] ✓ 24% ██▍ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestSpec.test_oauth_flow_parameters[inputs0] ✓ 26% ██▋ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestSpec.test_additional_properties_is_true[inputs0] ✓ 29% ██▉ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestConnection.test_check[inputs0] ✓ 32% ███▎ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestConnection.test_check[inputs1] ✓ 34% ███▌ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestDiscovery.test_discover[inputs0] ✓ 37% ███▊ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestDiscovery.test_defined_cursors_exist_in_schema[inputs0] ✓ 39% ███▉ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestDiscovery.test_defined_refs_exist_in_schema[inputs0] ✓ 42% ████▎ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestDiscovery.test_defined_keyword_exist_in_schema[inputs0-allOf] ✓ 45% ████▌ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestDiscovery.test_defined_keyword_exist_in_schema[inputs0-not] ✓ 47% ████▊ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestDiscovery.test_primary_keys_exist_in_schema[inputs0] ✓ 50% █████ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestDiscovery.test_streams_has_sync_modes[inputs0] ✓ 53% █████▍ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestDiscovery.test_additional_properties_is_true[inputs0] ✓ 55% █████▌ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestBasicRead.test_read[inputs0] ✓ 58% █████▊ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestBasicRead.test_read[inputs1] ✓ 61% ██████▏ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestBasicRead.test_read[inputs2] ✓ 63% ██████▍ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestBasicRead.test_read[inputs3] ✓ 66% ██████▋ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestBasicRead.test_read[inputs4] ✓ 68% ██████▉ {"type": "LOG", "log": {"level": "ERROR", "message": "Docker container was failed, code 1, error:\n{\"type\": \"TRACE\", \"trace\": {\"type\": \"ERROR\", \"emitted_at\": 1658824108394.1692, \"error\": {\"message\": \"Something went wrong in the connector. See the logs for more details.\", \"internal_message\": \"2 validation errors for ConfiguredAirbyteCatalog\\nstreams -> 0 -> sync_mode\\n value is not a valid enumeration member; permitted: 'full_refresh', 'incremental' (type=type_error.enum; enum_values=[<SyncMode.full_refresh: 'full_refresh'>, <SyncMode.incremental: 'incremental'>])\\nstreams -> 0 -> destination_sync_mode\\n value is not a valid enumeration member; permitted: 'append', 'overwrite', 'append_dedup' (type=type_error.enum; enum_values=[<DestinationSyncMode.append: 'append'>, <DestinationSyncMode.overwrite: 'overwrite'>, <DestinationSyncMode.append_dedup: 'append_dedup'>])\", \"stack_trace\": \"Traceback (most recent call last):\\n File \\\"/airbyte/integration_code/main.py\\\", line 13, in <module>\\n launch(source, sys.argv[1:])\\n File \\\"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\\\", line 123, in launch\\n for message in source_entrypoint.run(parsed_args):\\n File \\\"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\\\", line 111, in run\\n config_catalog = self.source.read_catalog(parsed_args.catalog)\\n File \\\"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/source.py\\\", line 54, in read_catalog\\n return ConfiguredAirbyteCatalog.parse_obj(self.read_config(catalog_path))\\n File \\\"pydantic/main.py\\\", line 521, in pydantic.main.BaseModel.parse_obj\\n File \\\"pydantic/main.py\\\", line 341, in pydantic.main.BaseModel.__init__\\npydantic.error_wrappers.ValidationError: 2 validation errors for ConfiguredAirbyteCatalog\\nstreams -> 0 -> sync_mode\\n value is not a valid enumeration member; permitted: 'full_refresh', 'incremental' (type=type_error.enum; enum_values=[<SyncMode.full_refresh: 'full_refresh'>, <SyncMode.incremental: 'incremental'>])\\nstreams -> 0 -> destination_sync_mode\\n value is not a valid enumeration member; permitted: 'append', 'overwrite', 'append_dedup' (type=type_error.enum; enum_values=[<DestinationSyncMode.append: 'append'>, <DestinationSyncMode.overwrite: 'overwrite'>, <DestinationSyncMode.append_dedup: 'append_dedup'>])\\n\", \"failure_type\": \"system_error\"}}}\n"}} airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestBasicRead.test_airbyte_trace_message_on_failure[inputs0] ✓ 71% ███████▏ {"type": "LOG", "log": {"level": "ERROR", "message": "Docker container was failed, code 1, error:\n{\"type\": \"TRACE\", \"trace\": {\"type\": \"ERROR\", \"emitted_at\": 1658824110720.9448, \"error\": {\"message\": \"Something went wrong in the connector. See the logs for more details.\", \"internal_message\": \"2 validation errors for ConfiguredAirbyteCatalog\\nstreams -> 0 -> sync_mode\\n value is not a valid enumeration member; permitted: 'full_refresh', 'incremental' (type=type_error.enum; enum_values=[<SyncMode.full_refresh: 'full_refresh'>, <SyncMode.incremental: 'incremental'>])\\nstreams -> 0 -> destination_sync_mode\\n value is not a valid enumeration member; permitted: 'append', 'overwrite', 'append_dedup' (type=type_error.enum; enum_values=[<DestinationSyncMode.append: 'append'>, <DestinationSyncMode.overwrite: 'overwrite'>, <DestinationSyncMode.append_dedup: 'append_dedup'>])\", \"stack_trace\": \"Traceback (most recent call last):\\n File \\\"/airbyte/integration_code/main.py\\\", line 13, in <module>\\n launch(source, sys.argv[1:])\\n File \\\"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\\\", line 123, in launch\\n for message in source_entrypoint.run(parsed_args):\\n File \\\"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\\\", line 111, in run\\n config_catalog = self.source.read_catalog(parsed_args.catalog)\\n File \\\"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/source.py\\\", line 54, in read_catalog\\n return ConfiguredAirbyteCatalog.parse_obj(self.read_config(catalog_path))\\n File \\\"pydantic/main.py\\\", line 521, in pydantic.main.BaseModel.parse_obj\\n File \\\"pydantic/main.py\\\", line 341, in pydantic.main.BaseModel.__init__\\npydantic.error_wrappers.ValidationError: 2 validation errors for ConfiguredAirbyteCatalog\\nstreams -> 0 -> sync_mode\\n value is not a valid enumeration member; permitted: 'full_refresh', 'incremental' (type=type_error.enum; enum_values=[<SyncMode.full_refresh: 'full_refresh'>, <SyncMode.incremental: 'incremental'>])\\nstreams -> 0 -> destination_sync_mode\\n value is not a valid enumeration member; permitted: 'append', 'overwrite', 'append_dedup' (type=type_error.enum; enum_values=[<DestinationSyncMode.append: 'append'>, <DestinationSyncMode.overwrite: 'overwrite'>, <DestinationSyncMode.append_dedup: 'append_dedup'>])\\n\", \"failure_type\": \"system_error\"}}}\n"}} airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestBasicRead.test_airbyte_trace_message_on_failure[inputs1] ✓ 74% ███████▍ {"type": "LOG", "log": {"level": "ERROR", "message": "Docker container was failed, code 1, error:\n{\"type\": \"TRACE\", \"trace\": {\"type\": \"ERROR\", \"emitted_at\": 1658824114124.203, \"error\": {\"message\": \"Something went wrong in the connector. See the logs for more details.\", \"internal_message\": \"2 validation errors for ConfiguredAirbyteCatalog\\nstreams -> 0 -> sync_mode\\n value is not a valid enumeration member; permitted: 'full_refresh', 'incremental' (type=type_error.enum; enum_values=[<SyncMode.full_refresh: 'full_refresh'>, <SyncMode.incremental: 'incremental'>])\\nstreams -> 0 -> destination_sync_mode\\n value is not a valid enumeration member; permitted: 'append', 'overwrite', 'append_dedup' (type=type_error.enum; enum_values=[<DestinationSyncMode.append: 'append'>, <DestinationSyncMode.overwrite: 'overwrite'>, <DestinationSyncMode.append_dedup: 'append_dedup'>])\", \"stack_trace\": \"Traceback (most recent call last):\\n File \\\"/airbyte/integration_code/main.py\\\", line 13, in <module>\\n launch(source, sys.argv[1:])\\n File \\\"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\\\", line 123, in launch\\n for message in source_entrypoint.run(parsed_args):\\n File \\\"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\\\", line 111, in run\\n config_catalog = self.source.read_catalog(parsed_args.catalog)\\n File \\\"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/source.py\\\", line 54, in read_catalog\\n return ConfiguredAirbyteCatalog.parse_obj(self.read_config(catalog_path))\\n File \\\"pydantic/main.py\\\", line 521, in pydantic.main.BaseModel.parse_obj\\n File \\\"pydantic/main.py\\\", line 341, in pydantic.main.BaseModel.__init__\\npydantic.error_wrappers.ValidationError: 2 validation errors for ConfiguredAirbyteCatalog\\nstreams -> 0 -> sync_mode\\n value is not a valid enumeration member; permitted: 'full_refresh', 'incremental' (type=type_error.enum; enum_values=[<SyncMode.full_refresh: 'full_refresh'>, <SyncMode.incremental: 'incremental'>])\\nstreams -> 0 -> destination_sync_mode\\n value is not a valid enumeration member; permitted: 'append', 'overwrite', 'append_dedup' (type=type_error.enum; enum_values=[<DestinationSyncMode.append: 'append'>, <DestinationSyncMode.overwrite: 'overwrite'>, <DestinationSyncMode.append_dedup: 'append_dedup'>])\\n\", \"failure_type\": \"system_error\"}}}\n"}} airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestBasicRead.test_airbyte_trace_message_on_failure[inputs2] ✓ 76% ███████▋ {"type": "LOG", "log": {"level": "ERROR", "message": "Docker container was failed, code 1, error:\n{\"type\": \"TRACE\", \"trace\": {\"type\": \"ERROR\", \"emitted_at\": 1658824116398.866, \"error\": {\"message\": \"Something went wrong in the connector. See the logs for more details.\", \"internal_message\": \"2 validation errors for ConfiguredAirbyteCatalog\\nstreams -> 0 -> sync_mode\\n value is not a valid enumeration member; permitted: 'full_refresh', 'incremental' (type=type_error.enum; enum_values=[<SyncMode.full_refresh: 'full_refresh'>, <SyncMode.incremental: 'incremental'>])\\nstreams -> 0 -> destination_sync_mode\\n value is not a valid enumeration member; permitted: 'append', 'overwrite', 'append_dedup' (type=type_error.enum; enum_values=[<DestinationSyncMode.append: 'append'>, <DestinationSyncMode.overwrite: 'overwrite'>, <DestinationSyncMode.append_dedup: 'append_dedup'>])\", \"stack_trace\": \"Traceback (most recent call last):\\n File \\\"/airbyte/integration_code/main.py\\\", line 13, in <module>\\n launch(source, sys.argv[1:])\\n File \\\"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\\\", line 123, in launch\\n for message in source_entrypoint.run(parsed_args):\\n File \\\"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\\\", line 111, in run\\n config_catalog = self.source.read_catalog(parsed_args.catalog)\\n File \\\"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/source.py\\\", line 54, in read_catalog\\n return ConfiguredAirbyteCatalog.parse_obj(self.read_config(catalog_path))\\n File \\\"pydantic/main.py\\\", line 521, in pydantic.main.BaseModel.parse_obj\\n File \\\"pydantic/main.py\\\", line 341, in pydantic.main.BaseModel.__init__\\npydantic.error_wrappers.ValidationError: 2 validation errors for ConfiguredAirbyteCatalog\\nstreams -> 0 -> sync_mode\\n value is not a valid enumeration member; permitted: 'full_refresh', 'incremental' (type=type_error.enum; enum_values=[<SyncMode.full_refresh: 'full_refresh'>, <SyncMode.incremental: 'incremental'>])\\nstreams -> 0 -> destination_sync_mode\\n value is not a valid enumeration member; permitted: 'append', 'overwrite', 'append_dedup' (type=type_error.enum; enum_values=[<DestinationSyncMode.append: 'append'>, <DestinationSyncMode.overwrite: 'overwrite'>, <DestinationSyncMode.append_dedup: 'append_dedup'>])\\n\", \"failure_type\": \"system_error\"}}}\n"}} airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestBasicRead.test_airbyte_trace_message_on_failure[inputs3] ✓ 79% ███████▉ {"type": "LOG", "log": {"level": "ERROR", "message": "Docker container was failed, code 1, error:\n{\"type\": \"TRACE\", \"trace\": {\"type\": \"ERROR\", \"emitted_at\": 1658824118463.321, \"error\": {\"message\": \"Something went wrong in the connector. See the logs for more details.\", \"internal_message\": \"2 validation errors for ConfiguredAirbyteCatalog\\nstreams -> 0 -> sync_mode\\n value is not a valid enumeration member; permitted: 'full_refresh', 'incremental' (type=type_error.enum; enum_values=[<SyncMode.full_refresh: 'full_refresh'>, <SyncMode.incremental: 'incremental'>])\\nstreams -> 0 -> destination_sync_mode\\n value is not a valid enumeration member; permitted: 'append', 'overwrite', 'append_dedup' (type=type_error.enum; enum_values=[<DestinationSyncMode.append: 'append'>, <DestinationSyncMode.overwrite: 'overwrite'>, <DestinationSyncMode.append_dedup: 'append_dedup'>])\", \"stack_trace\": \"Traceback (most recent call last):\\n File \\\"/airbyte/integration_code/main.py\\\", line 13, in <module>\\n launch(source, sys.argv[1:])\\n File \\\"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\\\", line 123, in launch\\n for message in source_entrypoint.run(parsed_args):\\n File \\\"/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py\\\", line 111, in run\\n config_catalog = self.source.read_catalog(parsed_args.catalog)\\n File \\\"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/source.py\\\", line 54, in read_catalog\\n return ConfiguredAirbyteCatalog.parse_obj(self.read_config(catalog_path))\\n File \\\"pydantic/main.py\\\", line 521, in pydantic.main.BaseModel.parse_obj\\n File \\\"pydantic/main.py\\\", line 341, in pydantic.main.BaseModel.__init__\\npydantic.error_wrappers.ValidationError: 2 validation errors for ConfiguredAirbyteCatalog\\nstreams -> 0 -> sync_mode\\n value is not a valid enumeration member; permitted: 'full_refresh', 'incremental' (type=type_error.enum; enum_values=[<SyncMode.full_refresh: 'full_refresh'>, <SyncMode.incremental: 'incremental'>])\\nstreams -> 0 -> destination_sync_mode\\n value is not a valid enumeration member; permitted: 'append', 'overwrite', 'append_dedup' (type=type_error.enum; enum_values=[<DestinationSyncMode.append: 'append'>, <DestinationSyncMode.overwrite: 'overwrite'>, <DestinationSyncMode.append_dedup: 'append_dedup'>])\\n\", \"failure_type\": \"system_error\"}}}\n"}} airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_core.py::TestBasicRead.test_airbyte_trace_message_on_failure[inputs4] ✓ 82% ████████▎ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_full_refresh.py::TestFullRefresh.test_sequential_reads[inputs0] ✓ 84% ████████▌ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_full_refresh.py::TestFullRefresh.test_sequential_reads[inputs1] ✓ 87% ████████▊ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_full_refresh.py::TestFullRefresh.test_sequential_reads[inputs2] ✓ 89% ████████▉ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_full_refresh.py::TestFullRefresh.test_sequential_reads[inputs3] ✓ 92% █████████▎ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_incremental.py::TestIncremental.test_two_sequential_reads[inputs0] ✓ 95% █████████▌ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_incremental.py::TestIncremental.test_read_sequential_slices[inputs0] ✓ 97% █████████▊ airbyte-integrations/bases/source-acceptance-test/source_acceptance_test/tests/test_incremental.py::TestIncremental.test_state_with_abnormally_large_values[inputs0] ✓ 100% ██████████ {"type": "LOG", "log": {"level": "INFO", "message": "/Users/juozas/projects/lt/airbyte/airbyte-integrations/connectors/source-flexport - SAT run - 52857603201ff0e65c55c9f7ca001643953e49e3 - PASSED"}} Results (529.84s): 38 passed 
@github-actions github-actions bot added the area/connectors Connector related issues label Jul 26, 2022
@monai monai changed the title Fix flexport Source Flexport: Fix schemas Jul 26, 2022
@monai monai changed the title Source Flexport: Fix schemas Source Flexport: Update schemas Jul 26, 2022
@github-actions github-actions bot added the area/documentation Improvements or additions to documentation label Jul 26, 2022
@monai monai marked this pull request as ready for review July 26, 2022 08:55
@monai
Copy link
Contributor Author

monai commented Jul 26, 2022

This connector is merged, but the Docker container is still unpublished. I wonder whether you have made any progress with obtaining a testing account.

@marcosmarxm
Copy link
Contributor

@monai #8986 the Flexport didn't return to our contact.

@marcosmarxm marcosmarxm self-assigned this Jul 26, 2022
@marcosmarxm
Copy link
Contributor

Thanks @monai I merged this in #15584

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/connectors Connector related issues area/documentation Improvements or additions to documentation bounty community connectors/source/flexport

3 participants