Refactor provider configuration and versioning

[MaceWindu]

Fixes #1024
Fixes #3154

This PR reviews database providing versioning implementation:

• updates API to register database provider in options to use same set of methods for each provider. Old implementation had non-uniform set of registration methods for each database, often even with different names for same database provider. In new implementation each provider will have 4 overloads to register provider (except SQL CE provider, which doesn't have two last methods as it doesn't have versioning):

  • Use<DB>(optionSetter)
  • Use<DB>(connectionString, optionSetter)
  • Use<DB>(dialect and/or provider, optionSetter = null)
  • Use<DB>(dialect and/or provider, connectionString, optionSetter = )

• major cleanup of <DB>Tools classes and related code:

  • removed obsoleted BulkCopy APIs
  • removed obsoleted settings
  • moved provider detection logic to corresponding ProviderDetector classes where it wasn't done befor
  • exposed AutoDetect option property for provider detector
  • provider factories (IDataProviderFactory) were updated to support new versioning options like dialect and provider assembly (assemblyName, version attributes). (I wonder if anyone uses those factories at all)
  • unify GetDataProvider API to accept provider and dialect (where applicable) and connection string parameters
  • unify CreateDataConnection API to be 3 methods with
    • connection string/connection/transaction as first parameter
    • provider and dialect as other parameters where applicable

• added dialect/provider versioning to providers missing it:

  • all provider and dialect enums have AutoDetect value as first entry to use provider/dialect detection logic (still we recommend to specify them explicitly to not depend on it if you don't need to work in unknown environment)
  • Access: add AccessProvider provider selection enum
  • Firebird: add FirebirdVersion dialect selection enum
  • Informix: add InformixProvider provider selection enum
  • MySql/MariaDB: add MySqlProvider provider and MySqlVersion dialect selection enums
  • SQLite: add SQLiteProvider provider selection enum
  • SAP HANA: add SapHanaProvider provider selection enum
  • SAP/Sybase ASE: add SybaseProvider provider selection enum

• database connection creation logic moved from database provider to database provider adapter interface (IDynamicProviderAdapter)

• fixed issue with database dialect detection when options specify connection or transaction but not connection string

• simplify struct types registration in mapping schema: now nullable type will be registered automatically when you register struct type, so there is no need to define two same mappings anymore. Apllicable to AddScalarType and SetDataType methods.

• adds dialects support for Firebird. Instead of old implementation with generated SQL compatible with Firebird 2.5 now we support 4 dialects: 2.5, 3.0, 4.0 and 5.0

  • v3+: bool now maps to BOOLEAN type by default. To use old mapping to 1/0 chars, specify DataType.Char type hint for your mappings or use 2.5 dialect
  • v3+: switched to OFFSET/FETCH clauses
  • v4+: enabled LATERAL joins
  • v3+: increased batch size for bulk copy queries from 64Kb as query size to 10Mb
  • v5+: increased supported elements limit in IN predicate from 1 500 to 65 535 items
  • v5+: enable support for WHEN NOT MATCHED BY SOURCE merge operations
  • v5+: enable support for quarter qualifier for DatePart functions
  • more dialect-specific changes will be added later by separate PR

• adds dialects support for MySQL/MariaDB. Instead of old implementation compatible with MySQL 5.5, now we have support for 4 dialects: MySQL 5.7, MySQL 8.0 and MariaDB 10

  • MySQL 8.0/MariaDB: don't use FROM DUAL for table-less queries anymore (still needed for MySQL 5.7 table-less queries with filter)
  • MySQL 8.0/MariaDB: enabled support for CAST to FLOAT/DOUBLE types
  • MySQL 8.0: enabled LATERAL joins
  • MySQL 8.0/MariaDB: enabled native support for EXCEPT/INTERSECT ALL/DISTINCT set operators
  • All: remove generation of FLOAT(N) type. Use DbType property in your mappings if you still need it for some reason
  • more dialect-specific changes will be added later by separate PR

• enabled LATERAL joins support for SAP HANA

For developers:

• Firebird 5 added to testing
• you will need to update your test configuration configs to use new test provider names for MySQL and Firebird:
  • MySql.5.7: MySQL 5.7 using MySql.Data provider
  • MySqlConnector.5.7: MySQL 5.7 using MySqlConnector provider
  • MySql.8.0: MySQL 8.0 using MySql.Data provider
  • MySqlConnector.8.0: MySQL 8.0 using MySqlConnector provider
  • MariaDB.11: MariaDB 11 using MySqlConnector provider. Note that currently MariaDB 11 doesn't differ from 10 in SQL features, so we don't add separate MariaDB 11 dialect.
• Firebird.2.5
• Firebird.3
• Firebird.4
• Firebird.5
• we don't test MySQL 5.5 anymore and bumped lowest supported version to 5.7. This also helped to discover some tests incorrectly labeled as 5.7+ compatible while being working only with MySQL 8.0
• year(2) pre-mysql 5.7 legacy type removed from testing

Known issues (introduced or discovered by PR):

• Firebird 2.5 bool to char mapping still configured in FirebirdProvider.SetParameter method instead of MappingSchema due to a lot discovered bugs with DataParameter-based mappings. Will be re-enabled and fixed in new parser branch
• SAP HANA lateral sub-queries with parameters doesn't work as we need to convert parameters to constants (SAP HANA limitation). Will be done in new parser branch
• Some SAP HANA queries are broken after LATERAL joins were enabled (bad optimizer?). Should be already fixed in new parser branch
• EXCEPT/INTERSECT ALL set operators emulation for unsupporting databases doesn't handle duplicate records. Will be fixed in new parser/separate PR
• Some firebird tests generate CROSS APPLY for Firebird 5 after LATERAL joins enabled. Should be already fixed in new parser branch

[MaceWindu]

/azp run test-all

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[MaceWindu]

/azp run test-all

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[linq2dbot]

Test baselines changed by this PR. Don't forget to merge/close baselines PR after this pr merged/closed.

[MaceWindu]

/azp run test-all

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[linq2dbot]

Test baselines changed by this PR. Don't forget to merge/close baselines PR after this pr merged/closed.

[linq2dbot]

Test baselines changed by this PR. Don't forget to merge/close baselines PR after this pr merged/closed.

[MaceWindu]

/azp run test-all

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[MaceWindu]

/azp run test-all

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[MaceWindu]

/azp run test-all

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[MaceWindu]

/azp run test-all

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[MaceWindu]

baselines good, except one sqlite test and missing FB features (all fixed) and several bad queries generated for sap hana after lateral enabled (will be fixed in parser branch, but we really need to add asserts to those tests ) actually all good

[MaceWindu]

/azp run test-all

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).