An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
- Updated
Mar 9, 2020 - Python
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
Oplog-based data sync tool that synchronizes data from a replica set to another deployment, e.g.: standalone, replica set, and sharded cluster.
Convert an Enpass csv export so it can be imported to a KeePass database using KeePassXC
SQLAlchemy-based cross-database migration tool
This solution is designed to help you unlock legacy mainframe data by migrating data files from mainframe systems to AWS. By migrating the data, you can make use of the powerful analytics, machine learning, and other services available in AWS to gain insights and make better decisions based on the data.
GOE: a simple and flexible way to copy data from an Oracle Database to Google BigQuery.
The AWS DMS Task Restart and Status Checker is a Python script designed to restart various AWS Database Migration Service (DMS) tasks and check their status. This script leverages AWS SDK (Boto3) and Mage.ai for DMS task integration and management, ensuring efficient and reliable task handling.
Slack to Google Chat Migration Tool
This Airflow DAG automates the process of extracting data from an Amazon Redshift database and unloading it to Amazon S3 in Parquet format. It runs daily, exporting data from the previous day based on a specified query.
Extract data from remote Hive to local Windows OS.
Production-ready Python utility for mirroring buckets and objects between S3-compatible endpoints with parallel transfers, comprehensive logging, and automation-friendly CLI.
Kraken - A distributed data transfer tool.
An open-source Python library is designed to simplify the process of migrating data to HubSpot, a powerful customer relationship management (CRM) platform. Whether you're moving contacts, companies, deals, or any other data to HubSpot, this library provides an easy-to-use interface for managing your migration tasks.
High-throughput backup tool for Cloudflare Workers KV. Features async I/O, cursor persistence, and automatic rate-limit handling.
MySQL to Clickhouse migration tool
Migrate Umami analytics data from a MySQL database to a PostgreSQL database.
Python script to migrate Stripe data (Products, Prices, Coupons, Subscriptions) between accounts.
python , django , REST API using DRF, Custom Model Fields, Mysql
Data Validation Documentation for Source and Target Tables in Databricks
This small python script extracts all your chat history of all your favourite conversations from Flock.
Add a description, image, and links to the data-migration topic page so that developers can more easily learn about it.
To associate your repository with the data-migration topic, visit your repo's landing page and select "manage topics."