To develop and manage Hologres tasks in DataWorks, you must first attach your Hologres instance as a Hologres computing resource. After the resource is attached, you can use it in different DataWorks modules to connect to the Hologres instance. This lets you perform operations such as data synchronization, data development, and data analysis.
Prerequisites
You have purchased a Hologres instance and created a database.
ImportantWhen you purchase a Hologres instance, ensure that it is in the same region as your DataWorks workspace. Otherwise, you cannot attach the instance.
Before you attach the instance, confirm that its Running Status is Normal.
You have created a workspace in DataWorks, and your RAM user has been added to the workspace and assigned the Workspace Administrator role.
You have attached a resource group to the workspace and ensured network connectivity.
If you use a Serverless resource group, you only need to ensure that the Hologres computing resource can connect to the Serverless resource group.
If you are Using legacy exclusive resource groups, you must ensure that the Hologres computing resource can connect to the exclusive resource group for integration, exclusive resource group for scheduling, and exclusive service resource group for the relevant scenario.
Limits
Feature limits: If you enable SSL authentication when you create a computing resource, the resource cannot be used for data development or periodically scheduled tasks.
Region limits: China (Hangzhou), China (Shanghai), China (Beijing), China (Shenzhen), Japan (Tokyo), Malaysia (Kuala Lumpur), and Indonesia (Jakarta).
Permission limits:
Operator
Required permissions
Alibaba Cloud account
No additional authorization is required.
RAM user/RAM role
DataWorks management permissions: Only workspace members who have the O&M or workspace administrator role, or the
AliyunDataWorksFullAccesspermission, can create computing resources. For more information, see Grant workspace administrator permissions.Hologres service permissions:
Grant the
AliyunHologresFullAccessaccess policy. Otherwise, you cannot configure the Hologres computing resource.Add the account or role information to User Management. Otherwise, you will not be able to configure the target database during the configuration process.
New Data Development: Attach a Hologres computing resource
This section describes how to attach a Hologres computing resource to a workspace that is participating in the public preview of Data Development (DataStudio) (New).
Go to the computing resources page
Log on to the DataWorks console. Switch to the destination region. In the navigation pane on the left, click . Select the target workspace from the drop-down list and click the Go To Management Center button.
In the navigation pane on the left, click Computing Resources to go to the computing resources page.
Attach a Hologres computing resource
On the Computing Resources page, you can configure and attach a Hologres computing resource.
Select the type of computing resource to attach.
Click Attach Computing Resource. The Attach Computing Resource page appears.
On the Attach Computing Resource page, select Hologres as the computing resource type. The Attach Hologres Computing Resource configuration page appears.
Configure the Hologres computing resource.
On the Attach Hologres Computing Resource configuration page, set the parameters as described in the following table.
Parameter
Description
Hologres Instance
Select the Hologres instance that you created. You can also click Create in the drop-down menu to purchase a Hologres instance.
Hologres Compute Group
The current Hologres instance supports compute group configuration. You can also click New in the drop-down menu to create a new Hologres compute group.
Database Name
Select the database you want to use. You can also click New in the drop-down menu to create a database.
Default Access Identity
Development environment: Only access as an Executor is supported.
Production environment: Access as an Alibaba Cloud Account, RAM User, RAM Role, or Task Owner is supported.
NoteIf you are logged on with an Alibaba Cloud account: You can select any identity.
If you are logged on as a RAM user or with a RAM role:
If you have the AdministratorAccess access policy: You can select any identity.
If you do not have the AdministratorAccess access policy: You can only select your own identity.
Authentication Options
No Authentication: No other operations are required.
SSL Authentication: If you select this authentication method, you must turn on the SSL Encryption switch on the Data Security page of the Hologres instance.
NoteIf SSL authentication is enabled for the Hologres instance, it cannot be used for data development or periodically scheduled tasks.
SSL Encryption Mode
This parameter is required when Authentication Options is set to SSL Authentication. Only the require encryption mode is supported.
Computing Resource Instance Name
Enter a custom name for the computing resource instance. At runtime, you can select the computing resource for a task based on this name.
Test the connectivity.
In the Connection Configuration section, select the resource group that DataWorks uses to run Hologres tasks and click Test Connectivity to test whether the resource group can access your Hologres instance. For more information, see Network Connectivity Solution.
Click Confirm to complete the configuration.
NoteAfter the resource is attached, the system automatically creates a Hologres data source with the same name in the Data Source section of the current workspace.
Legacy Data Development: Attach a Hologres computing resource
This section describes how to attach a Hologres computing resource to a workspace that is not participating in the public preview of Data Development (DataStudio) (New).
Go to the computing resources page
Go to the DataStudio page.
Log on to the DataWorks console. In the top navigation bar, select the desired region. In the left-side navigation pane, choose . On the page that appears, select the desired workspace from the drop-down list and click Go to Data Development.
In the navigation pane on the left, click the
icon to go to the Computing Resources page.
Attach a Hologres computing resource
On the computing resources page, you can configure the settings to attach a Hologres computing resource.
Select the type of computing resource to attach.
Click New Computing Resource. The New Computing Resource page appears.
On the New Computing Resource page, select Hologres as the computing resource type. The New Computing Resource configuration page appears.
Configure the Hologres computing resource.
On the New Computing Resource configuration page, set the parameters as described in the following table.
Parameter
Description
Data Source Name
Enter a custom name for the computing resource.
Authentication Method
Only Alibaba Cloud Account And RAM Role is supported.
Owner Account
You can select Current Alibaba Cloud Account or Other Alibaba Cloud Account.
NoteIf you select Other Alibaba Cloud Account, enter the parameter information for the other account as prompted on the interface.
Region
The region where your workspace is located.
Hologres Instance
Select the Hologres instance that you created.
Database Name
Select the database that you want to use.
Default Access Identity
Development environment: Only access as an Executor is supported.
Production environment: Access as an Alibaba Cloud Account, RAM User, RAM Role, or Task Owner is supported.
NoteIf you are logged on with an Alibaba Cloud account: You can select any identity.
If you are logged on as a RAM user or with a RAM role:
If you have the AdministratorAccess access policy: You can select any identity.
If you do not have the AdministratorAccess access policy: You can only select your own identity.
Authentication Options
No Authentication: No other operations are required.
SSL Authentication: You must enable the SSL Encryption Feature switch on the Data Security page of your Hologres instance.
NoteIf SSL authentication is enabled for the Hologres instance, it cannot be used for data development or periodically scheduled tasks.
SSL Encryption Mode
This parameter is required when Authentication Options is set to SSL Authentication. Only the require encryption mode is supported.
Test the connectivity.
In the Connection Configuration section, select the resource group that DataWorks uses to run Hologres tasks and click Test Connectivity to test whether the resource group can access your Hologres instance. For more information, see Network Connectivity Solution.
Click New Computing Resource And Attach To Data Development to complete the configuration.
After the resource is attached, the system automatically creates a Hologres data source with the same name in the Data Source section of the current workspace.
What to do next
To ensure a smooth development process, we recommend that you first read the DataWorks On Hologres User Guide to learn about the development flow, related fees, environment preparation, and access control for using Hologres in DataWorks.
Data Development (New): After you configure Hologres computing resources, you can use an Offline Synchronization node to synchronize data and a Hologres-related node to develop data in Data Development.
Legacy Data Development: After you configure a Hologres computing resource, you can use the node in Data Development to synchronize data, and use legacy Hologres-related nodes to develop data.
FAQ
Error message: FAILED: Build connection error! Connection to xxx.hologres.aliyuncs.com:80 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
Solution: Go to the Hologres console and check whether the instance is running correctly. If the instance is shut down, restart it.
Error message: FAILED: An I/O error occurred while sending to the backend.
Solution: In the Data Security section of your Hologres instance, check whether the SSL Encryption switch is turned on. If it is, turn off the switch and rerun the task after 5 to 10 seconds.