Skip to content

Conversation

@mlavoie-sm360
Copy link
Contributor

@mlavoie-sm360 mlavoie-sm360 commented Aug 17, 2022

What

Solves issue #15723 by adding a custom conversions stream

How

Added required schema and stream.

User Impact

No breaking changes. Adds support for new stream.

Pre-merge Checklist

Expand the relevant checklist and delete the others.

Community member or Airbyter

  • Grant edit access to maintainers (instructions)
  • Secrets in the connector's spec are annotated with airbyte_secret
  • Unit & integration tests added and passing. Community members, please provide proof of success locally e.g: screenshot or copy-paste unit, integration, and acceptance test output. To run acceptance tests for a Python connector, follow instructions in the README. For java connectors run ./gradlew :airbyte-integrations:connectors:<name>:integrationTest.
  • Code reviews completed
  • Documentation updated
    • Connector's README.md
    • Connector's bootstrap.md. See description and examples
    • Changelog updated in docs/integrations/<source or destination>/<name>.md including changelog. See changelog example
  • PR name follows PR naming conventions

Airbyter

If this is a community PR, the Airbyte engineer reviewing this PR is responsible for the below items.

  • Create a non-forked branch based on this PR and test the below items on it
  • Build is successful
  • If new credentials are required for use in CI, add them to GSM. Instructions.
  • /test connector=connectors/<name> command is passing
  • New Connector version released on Dockerhub and connector version bumped by running the /publish command described here
@github-actions github-actions bot added the area/connectors Connector related issues label Aug 17, 2022
@mlavoie-sm360 mlavoie-sm360 changed the title Source facebook marketing added customconversions stream 🎉 Source Facebook Marketing: Added custom conversions stream Aug 17, 2022
@github-actions github-actions bot added the area/documentation Improvements or additions to documentation label Aug 17, 2022
@marcosmarxm
Copy link
Contributor

marcosmarxm commented Aug 17, 2022

/test connector=connectors/source-facebook-marketing

🕑 connectors/source-facebook-marketing https://github.com/airbytehq/airbyte/actions/runs/2876861043
❌ connectors/source-facebook-marketing https://github.com/airbytehq/airbyte/actions/runs/2876861043
🐛 https://gradle.com/s/zhr7l3vfqbwo4

Build Failed

Test summary info:

=========================== short test summary info ============================ FAILED test_core.py::TestDiscovery::test_backward_compatibility[inputs0] - so... ================== 1 failed, 28 passed in 1686.47s (0:28:06) =================== 
@sajarin sajarin added internal and removed bounty labels Aug 18, 2022
@sajarin
Copy link
Contributor

sajarin commented Aug 18, 2022

/test connector=connectors/source-facebook-marketing

🕑 connectors/source-facebook-marketing https://github.com/airbytehq/airbyte/actions/runs/2884120547
❌ connectors/source-facebook-marketing https://github.com/airbytehq/airbyte/actions/runs/2884120547
🐛 https://gradle.com/s/fpzc4t5ajttvq

Build Failed

Test summary info:

=========================== short test summary info ============================ FAILED test_core.py::TestDiscovery::test_backward_compatibility[inputs0] - so... ================== 1 failed, 28 passed in 1767.96s (0:29:27) =================== 
@mlavoie-sm360
Copy link
Contributor Author

mlavoie-sm360 commented Aug 29, 2022

What is the process for changes to be merged? Should I be doing something else at this point in the process?

@marcosmarxm marcosmarxm force-pushed the source-facebook-marketing-added-customconversions-stream branch from 052ece2 to c893c8c Compare August 29, 2022 21:46
@marcosmarxm
Copy link
Contributor

/test connector=connectors/source-facebook-marketing

@marcosmarxm
Copy link
Contributor

What is the process for changes to be merged? Should I be doing something else at this point in the process?

I rebased your branch with master to solve the test issue. Let's see the latest /test run

@marcosmarxm
Copy link
Contributor

marcosmarxm commented Aug 29, 2022

/test connector=connectors/source-facebook-marketing

🕑 connectors/source-facebook-marketing https://github.com/airbytehq/airbyte/actions/runs/2952048816
✅ connectors/source-facebook-marketing https://github.com/airbytehq/airbyte/actions/runs/2952048816
Python tests coverage:

Name Stmts Miss Cover ------------------------------------------------------------------------------- source_facebook_marketing/streams/__init__.py 2 0 100% source_facebook_marketing/spec.py 37 0 100% source_facebook_marketing/__init__.py 2 0 100% source_facebook_marketing/api.py 96 12 88% source_facebook_marketing/streams/base_streams.py 128 27 79% source_facebook_marketing/streams/common.py 40 13 68% source_facebook_marketing/source.py 42 16 62% source_facebook_marketing/streams/streams.py 117 45 62% source_facebook_marketing/utils.py 25 10 60% source_facebook_marketing/streams/base_insight_streams.py 132 54 59% source_facebook_marketing/streams/async_job.py 214 134 37% source_facebook_marketing/streams/async_job_manager.py 78 60 23% ------------------------------------------------------------------------------- TOTAL 913 371 59% Name Stmts Miss Cover ------------------------------------------------------------------------------- source_facebook_marketing/utils.py 25 0 100% source_facebook_marketing/streams/common.py 40 0 100% source_facebook_marketing/streams/async_job.py 214 0 100% source_facebook_marketing/streams/__init__.py 2 0 100% source_facebook_marketing/spec.py 37 0 100% source_facebook_marketing/__init__.py 2 0 100% source_facebook_marketing/source.py 42 1 98% source_facebook_marketing/streams/async_job_manager.py 78 3 96% source_facebook_marketing/api.py 96 9 91% source_facebook_marketing/streams/base_insight_streams.py 132 13 90% source_facebook_marketing/streams/streams.py 117 27 77% source_facebook_marketing/streams/base_streams.py 128 30 77% ------------------------------------------------------------------------------- TOTAL 913 83 91% Name Stmts Miss Cover Missing ---------------------------------------------------------------------------------- source_acceptance_test/base.py 10 4 60% 15-18 source_acceptance_test/config.py 83 6 93% 78-80, 84-86 source_acceptance_test/conftest.py 164 164 0% 6-282 source_acceptance_test/plugin.py 48 48 0% 6-104 source_acceptance_test/tests/test_core.py 329 111 66% 39, 50-58, 63-70, 74-75, 79-80, 164, 202-219, 228-236, 240-245, 251, 284-289, 327-334, 374-376, 379, 439-448, 477-478, 484, 487, 520-530, 543-568, 573-577 source_acceptance_test/tests/test_full_refresh.py 52 2 96% 34, 65 source_acceptance_test/tests/test_incremental.py 121 25 79% 21-23, 29-31, 36-43, 48-61, 208-216 source_acceptance_test/utils/asserts.py 37 2 95% 57-58 source_acceptance_test/utils/common.py 77 17 78% 15-16, 24-30, 47-54, 64, 67 source_acceptance_test/utils/compare.py 62 23 63% 21-51, 68, 97-99 source_acceptance_test/utils/connector_runner.py 110 48 56% 23-26, 32, 36, 39-64, 67-69, 72-74, 77-79, 82-84, 87-89, 92-110, 144-146 source_acceptance_test/utils/json_schema_helper.py 105 13 88% 30-31, 38, 41, 65-68, 96, 120, 190-192 ---------------------------------------------------------------------------------- TOTAL 1322 463 65% 

Build Passed

Test summary info:

All Passed 
@marcosmarxm marcosmarxm requested a review from lazebnyi August 30, 2022 16:10
@marcosmarxm
Copy link
Contributor

@lazebnyi can you do the final review for this community contribution?

@marcosmarxm marcosmarxm self-assigned this Aug 30, 2022
@marcosmarxm
Copy link
Contributor

marcosmarxm commented Sep 1, 2022

/publish connector=connectors/source-facebook-marketing

🕑 Publishing the following connectors:
connectors/source-facebook-marketing
https://github.com/airbytehq/airbyte/actions/runs/2974373675


Connector Did it publish? Were definitions generated?
connectors/source-facebook-marketing

if you have connectors that successfully published but failed definition generation, follow step 4 here ▶️

@marcosmarxm marcosmarxm force-pushed the source-facebook-marketing-added-customconversions-stream branch from b8c0734 to 1673370 Compare September 1, 2022 21:44
@marcosmarxm
Copy link
Contributor

marcosmarxm commented Sep 1, 2022

/publish connector=connectors/source-facebook-marketing

🕑 Publishing the following connectors:
connectors/source-facebook-marketing
https://github.com/airbytehq/airbyte/actions/runs/2975145386


Connector Did it publish? Were definitions generated?
connectors/source-facebook-marketing

if you have connectors that successfully published but failed definition generation, follow step 4 here ▶️

@marcosmarxm marcosmarxm force-pushed the source-facebook-marketing-added-customconversions-stream branch from 1673370 to 2231005 Compare September 6, 2022 20:21
@marcosmarxm
Copy link
Contributor

marcosmarxm commented Sep 6, 2022

/publish connector=connectors/source-facebook-marketing

🕑 Publishing the following connectors:
connectors/source-facebook-marketing
https://github.com/airbytehq/airbyte/actions/runs/3003138421


Connector Did it publish? Were definitions generated?
connectors/source-facebook-marketing

if you have connectors that successfully published but failed definition generation, follow step 4 here ▶️

@marcosmarxm marcosmarxm merged commit 8cd3880 into airbytehq:master Sep 6, 2022
@mlavoie-sm360 mlavoie-sm360 deleted the source-facebook-marketing-added-customconversions-stream branch September 7, 2022 05:46
robbinhan pushed a commit to robbinhan/airbyte that referenced this pull request Sep 29, 2022
…hq#15724) * 🎉 Source Facebook Marketing: Added support for custom conversions stream * solve md conflict and update dockerfile version * Updated test_streams test * auto-bump connector version [ci skip] Co-authored-by: marcosmarxm <marcosmarxm@gmail.com> Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
jhammarstedt pushed a commit to jhammarstedt/airbyte that referenced this pull request Oct 31, 2022
…hq#15724) * 🎉 Source Facebook Marketing: Added support for custom conversions stream * solve md conflict and update dockerfile version * Updated test_streams test * auto-bump connector version [ci skip] Co-authored-by: marcosmarxm <marcosmarxm@gmail.com> Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/connectors Connector related issues area/documentation Improvements or additions to documentation community connectors/source/facebook-marketing internal

5 participants