With Event Hubs source configuration like the following:

 "source_format": "eventhub", "source_details": { "source_schema_path": "{dbfs_path}/integration-tests/resources/eventhub_iot_schema.ddl", "eventhub.accessKeyName": "{eventhub_accesskey_name}", "eventhub.name": "{eventhub_name}", "eventhub.secretsScopeName": "{eventhub_secrets_scope_name}", "kafka.sasl.mechanism": "PLAIN", "kafka.security.protocol": "SASL_SSL", "eventhub.namespace": "{eventhub_nmspace}", "eventhub.port": "{eventhub_port}" }, 

The pipeline may fail with the following error:

Connection to node -1 ({eventhub_nmspace}.servicebus.windows.net/xx.xx.xx.xx:9093) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue.
...
Unexpected error from {eventhub_nmspace}.servicebus.windows.net/xx.xx.xx.xx (channelId=-1); closing connection
java.lang.RuntimeException: non-nullable field authBytes was serialized as null