Downloaded 39 times
Uploaded byMari Kupatadze
Oracle GoldenGate Microservices Overview ( with Demo )
OGG Microservices Architecture introduces new types of processes to replace those in the classic architecture. The main components are the Service Manager, Administration Server, Distribution Server, Receiver Server, and Performance Metrics Server. The Administration Server and Admin Client allow managing GoldenGate processes through a web interface and command line tool respectively. A demo is shown configuring the source and target databases, creating credentials, extract, path, and replicat to replicate a table from the source to target.
Oracle GoldenGate Microservices Overview ( with Demo )
- 1. Oracle GG MicroservicesOverview with demo • Mari Kupatadze • Senior Solutions Architect - Flashgrid • Oracle Certified Master • Oracle ACE Member
- 2. Disclaimer “The postings onthis document are my own and don’t necessarily represent my actual employer positions, strategies or opinions. The information here was edited to be useful for general purpose, specific data and identifications were removed to allow reach the generic audience and to be useful for the community.”
- 3. • Introduction • Maincomponents • Directories and env. Variables • Service Manager • Administration Server • Distribution Server • Performance Metrics Server • Admin Client • DEMO Agenda
- 4. Senior SolutionsArchitect at FlashGrid Inc. Oracle Certified Master (OCM) and many other certifications Oracle ACE Associate Expert in Oracle Technology Network (OTN) community Speaker in APAC Oracle Users Groups Community (APACOUC) Oracle Exadata hardware architecture overview & efficient resource distribution Published articles in OraWorld e-magazine Oracle Analytical Functions: Tips and Tricks CBO Artificial Intelligence CBO Artificial Intelligence: Part 2 Blogger since 2010. Published 276 posts about my experience in Oracle & Linux. My blog, dba010.com, has been entered in Top 60 Oracle Blogs Highly specialized in Exadata, Oracle 10g, 11g, 12c, 18c, 19c Databases, RAC, Data Guard, Golden Gate, Database Optimization and Tuning, EM, Cloud Control, Backup and Recovery, Database Migrations, Oracle Cloud IaaS, Oracle Database Security, Oracle Audit Vault and Database Firewall, Linux Administration. Mari Kupatadze
- 5. OGG Microservices Architecturehas been introduced from version 12.3. The older version is now called as Classic Architecture. The latest version is 19.1.0.0. The installation software can be download from Oracle Technology Network (OTN) https://www.oracle.com/technetwork/middleware/goldengate/downloads/index.html Oracle provides separate binary for MA that contains keyword Microservices. “Oracle GoldenGate 19.1.0.0.1 for Oracle on Linux x86-64” is a Classic GG. Introduction
- 6. MA introduced newtypes of processes and services to perform same tasks as GG Classic: Service Manager - Replacement of Manager process in Classic architecture. This is watchdog for other processes. Administration Server - Replacement of GGSCI console. REST API feature gives us the ability to access it from any HTTP or HTTPS client. From web-based interface you can create and manage Extract and Replicat processes. Distribution Server - Same as pump in Classic. It replaces multiple pump processes, because it is a multithreaded process that can handle multiple trail files at the same time. Receiver Server - A Receiver server coordinates and handles all received trail files. Performance Metrics Server - Extracts, replicats and other GG processes send information to this server, that can be used to query system utilization, process stats, logs, etc. Admin Client - Command line tool like GGSCI, but with additional functions. Used for creating and managing GG processes. Main components
- 7. ORACLE_HOME - TheOracle database home, which will be extracted or replicated by Golden Gate. ( /u01/app/oracle/product/18.3.0/dbhome_1 ) OGG_HOME - Oracle Golden Gate home containing binaries, libraries, etc. ( /GG_HOME/ma2 ) OGG_VAR_HOME - The location of deployment logging and reporting processing artifacts ( /GG_HOME/deploy/var ) OGG_DATA_HOME - Directory containing trail files ( $OGG_VAR_HOME/lib/data ) OGG_ETC_HOME - Contains deployment configuration and security files under conf and ssl directories( /GG_HOME/deploy2/etc ) OGG_CONF_HOME - Directory containing deployment information and configuration including parameter files. ( $OGG_ETC_HOME/conf ) OGG_SSL_HOME - Deployment security files, such as certificates and wallets are stored. ( $OGG_ETC_HOME/ssl ) Directories and env. variables
- 8. Replacement of Managerprocess in Classic architecture. This is watchdog for other processes • Port and hostname is indicated during the configuration - Figure 1 • Login to the Service Manager: https://localhost:10000 - Figure 2 Figure 1 Figure 2 Service Manager
- 10. Replacement of GGSCIconsole. REST API feature gives as the ability to access it from any HTTP or HTTPS client. From web-based interface you can create and manage Extract and Replicat processes. • Port is indicated during the configuration - Figure 1 • Login to the Administration Server: https://localhost:10001 - Figure 2 Figure 1 Figure 2 Administration Server
- 12. Same as pumpin Classic. It replaces multiple pump processes, because it is a multithreaded process that can handle multiple trail files at the same time. • Port is indicated during the configuration - Figure 1 • Login to the Distribution Server: https://localhost:10002 - Figure 2 Figure 1 Figure 2 Distribution Server
- 14. Extracts, replicats andother GG processes send information to this server, that can be used to query system utilization, process stats, logs, etc. • Port is indicated during the configuration - Figure 1 • Login to the Server: https://localhost:10004 Figure 1 Performance Metrics Server
- 16. Command line toollike GGSCI, but with additional functions. Used for creating and managing GG processes. $ export OGG_HOME=/GG_HOME/ma2 $ export JAVA_HOME=$OGG_HOME/jdk/jre $ cd $OGG_HOME/bin $ ./adminclient … OGG(not connected)> connect http://localhost:10000 as oggadmin password oggadmin Using default deployment 'MyDeployment' OGG(https://localhost:10000 MyDeployment)> Admin Client
- 17. • Configure tnsnames.orafile ( source & target ) • Table that will be replicated is called hr.ma_t ( source & target ) • Connect to the Administration Server and add necessary credentials in Credentials Store ( source & target ) • Connect to the Administration Server and create extract ( source ) • Connect to the Distribution Server and create path ( source ) • Connect to the Administration server and create replicat ( target ) • Insert data in the source table and check the result Demo
- 18.
- 19. > Connect tothe Administration Server and add necessary credentials in Credentials Store ( source & target )
- 20. > Connect tothe Administration Server and create extract ( source )
- 21. > Connect tothe Distribution Server and create path ( source )
- 22. > Connect tothe Administration server and create replicat ( target )
- 23. > Insert datain the source table and check the result
- 24. > Details ofthe PATH, shows 2 inserts:
- 25.