Skip to content

Google Analytics issue with custom reports if data does not exist #8049

@milo157

Description

@milo157

Enviroment

  • Airbyte version: 0.31.0-alpha
  • OS Version / Instance: AWS EC2
  • Deployment: Docker
  • Source Connector and version: Google Analytics 0.1.9
  • Destination Connector and version: Postgres
  • Severity: Medium
  • Step where error happened: Syncing data

Current Behavior

When adding the following custom reports to the Google analytics source

[{"name":"audience_overview","dimensions":["ga:date"],"metrics":["ga:users","ga:newUsers","ga:sessions","ga:sessionsPerUser","ga:pageviews","ga:pageviewsPerSession","avgSessionDuration","ga:bounceRate"]},{"name":"campaign_performance","dimensions":["ga:date","ga:campaign"],"metrics":["ga:users","ga:newUsers","ga:sessions","ga:bounceRate","ga:pageviewsPerSession","ga:goalConversionRateAll","ga:goalCompletionsAll","ga:goalValueAll"]},{"name":"channel_traffic","dimensions":["ga:date","ga:channelGrouping"],"metrics":["ga:users","ga:newUsers","ga:sessions","ga:percentNewSessions","ga:bounceRate","ga:pageviewsPerSession","ga:avgSessionDuration","ga:goalConversionRateAll","ga:goalCompletionsAll","ga:goalValueAll"]},{"name":"operating_system_report","dimensions":["ga:date","ga:operatingSystem","ga:browser"],"metrics":["ga:users","ga:newUsers","ga:sessions","ga:bounceRate","ga:pageviewsPerSession","ga:avgSessionDuration","ga:goalConversionRateAll","ga:goalCompletionsAll","ga:goalValueAll"]},{"name":"social_media_acquisitions","dimensions":["ga:date","ga:socialNetwork"],"metrics":["ga:sessions","ga:percentNewSessions","ga:newUsers","ga:bounceRate","ga:pageviews","ga:pageviewsPerSession","ga:avgSessionDuration","ga:transactions","ga:transactionsPerSession","ga:transactionRevenue"]},{"name":"traffic","dimensions":["ga:date","ga:pageTitle"],"metrics":["ga:users","ga:pageValue", "ga:entrances","ga:pageviews","ga:uniquePageviews","ga:avgTimeOnPage","ga:exitRate","ga:bounceRate"]},{"name":"adwords_campaigns","dimensions":["ga:date","ga:adwordsCampaignID"],"metrics":["ga:adlicks","ga:adCost","ga:CPC","ga:users","ga:sessions","ga:bounceRate","ga:goalConversionRateAll","ga:goalCompletionsAll","ga:goalValueAll"]}]

We get an error message in the logs that the streams for some of this data do not exist. This causes the whole connector to fail.

Expected Behavior

If these streams don't exist in the current users account the either two scenarios should happen:

  1. (Preferred) Create an empty table with the desired columns of the report so if data is created then it will be synced to the database
  2. Skip the custom and carry on to the next report

Logs

logs-64-0.txt

LOG

Steps to Reproduce

  1. Create Google Analytics source
  2. Add custom report JSON above

Are you willing to submit a PR?

no

Metadata

Metadata

Assignees

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions