- Notifications
You must be signed in to change notification settings - Fork 4.9k
Open
Labels
area/connectorsConnector related issuesConnector related issuesarea/databasescommunityconnectors/source/mongodbconnectors/sources-databasefrozenNot being actively worked onNot being actively worked onteam/db-dw-sourcesBacklog for Database and Data Warehouse Sources teamBacklog for Database and Data Warehouse Sources teamtype/enhancementNew feature or requestNew feature or request
Description
Tell us about the problem you're trying to solve
To make schema discovery faster #8491 limited the schema discovery step to the analysis of 10k records.
Some users might have heterogenous schema spanning on more than this hardcoded limit.
Describe the solution you’d like
We could expose DISCOVER_LIMIT as a parameter in the source configuration to allow users to customize this value, or choose to read all documents in the discovery step.
Describe the alternative you’ve considered or used
Downgrade to version 0.1.8
Additional context
Requested by a user in this Slack conversation
JCWahoo, theobolo and 11meJCWahoo, theobolo and phammer
Metadata
Metadata
Assignees
Labels
area/connectorsConnector related issuesConnector related issuesarea/databasescommunityconnectors/source/mongodbconnectors/sources-databasefrozenNot being actively worked onNot being actively worked onteam/db-dw-sourcesBacklog for Database and Data Warehouse Sources teamBacklog for Database and Data Warehouse Sources teamtype/enhancementNew feature or requestNew feature or request