☄️ Python's nested data operator (and CLI), for all your declarative restructuring needs. Got data? Glom it! ☄️
python cli data dictionaries utilities declarative data-transformation nested-structures recursion apis
- Updated
Jan 12, 2025 - Python
#
data-transformation
Here are 154 public repositories matching this topic...
🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
data-science machine-learning spark bigdata data-transformation pyspark data-extraction data-analysis data-wrangling dask data-exploration data-preparation data-cleaning data-profiling data-cleansing big-data-cleaning data-cleaner cudf dask-cudf
- Updated
Dec 2, 2024 - Python
O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian
python design data machine-learning spark algorithms bigdata transformations data-transformation design-patterns pyspark partitioning-algorithms monoid mapreduce reducers dataframes rdd mappers data-algorithms data-abstractions
- Updated
Jun 26, 2023 - Python
🤖 An automated machine learning framework for audio, text, image, video, or .CSV files (50+ featurizers and 15+ model trainers). Python 3.6 required.
machine-learning deep-learning data-transformation data-visualization machine-learning-library machine-learning-api datasets data-cleaning ludwig data-augmentation automl tpot machine-learning-models model-compression model-deployment autokeras voice-computing data-cleaning-pipeline autopytorch
- Updated
Apr 2, 2025 - Python
Python package implementing ML feature engineering and pre-processing for polars or pandas dataframes.
python data-science machine-learning scikit-learn data-transformation transformers pandas feature-engineering pre-processing polars narwhals
- Updated
Dec 12, 2025 - Python
A tool to read CSV files with CSVW metadata and transform them into other formats.
- Updated
Apr 30, 2019 - Python
Easy ETL
- Updated
Aug 12, 2022 - Python
DEPRECATED: YAML-based data transformations
- Updated
Oct 11, 2019 - Python
Reusable Python classes that extend open source PySpark capabilities. Examples of implementation is available under notebooks of repo https://github.com/bennyaustin/synapse-dataplatform
apache-spark data-transformation pyspark azure-databricks azure-synapse-analytics synapse-spark azure-synapse-sparkpool
- Updated
Nov 1, 2024 - Python
This repository is a working ETL framework which utilizes user data from Spotify API using ➲Python for Extraction and Transformation ➲SQL for Data Loading and Staging ➲Airflow for Data Orchestration and Monitoring ➲PowerBI for Reporting
scheduling data-transformation data-visualization orchestration api-call etl-pipeline data-loading data-modelling
- Updated
Apr 16, 2023 - Python
[VLDB'25] Official repo for Paper "Weak-to-Strong Prompts with Lightweight-to-Powerful LLMs for High-Accuracy, Low-Cost, and Explainable Data Transformation"
data-transformation code-generation data-cleaning self-reflection large-language-models weak-to-strong lazy-rag
- Updated
Aug 21, 2025 - Python
GUI and library made to flatten HUGE JSON files. A library and utility for exploring, analyzing, and flattening JSON files of any size (LARGE - GBs) into CSVs, along with CSV transformations, dynamic CSV filtering, and all with low memory utilization.
python json gui csv etl data-transformation pandas data-engineering awesome-list data-integration data-pipelines csv-export json-to-csv json-flattener huge-data-files pyqt5-gui
- Updated
Jun 7, 2023 - Python
fast-resource is a data transformation layer that sits between the database and the application's users, enabling quick data retrieval. It further enhances performance by caching data using Redis and Memcached.
- Updated
May 15, 2023 - Python
This project focuses on analyzing and visualizing the insurance portfolio of an anonymous company that implemented an aggressive growth plan in 2021 across the counties of Florida using Python and Power BI
python etl jupyter-notebook data-transformation power-bi data-visualization data-analytics geospatial-analysis
- Updated
Dec 29, 2021 - Python
A Holistic Platform for Automating Data Preparation
- Updated
Apr 19, 2024 - Python
NuScenes, Lyft, Waymo and a2d2 datasets parser.
- Updated
Aug 16, 2022 - Python
This project is a powerful Streamlit application designed to provide users with seamless access and analysis of data from multiple YouTube channels. This intuitive tool leverages the Google API to retrieve a comprehensive range of information, including channel details, video statistics, and viewer engagement metrics.
- Updated
Jul 13, 2023 - Python
Python scripts to process, and analyze log files using PySpark.
python sql log-monitor log-analysis apache-spark data-transformation pandas seaborn pyspark data-extraction data-analysis data-processing log-analyzer spark-ml lykmapipo apache-arrow spark-nlp pyarrow apache-spark-sql sparkml-pipelines
- Updated
Jul 13, 2024 - Python
etl data-transformation data-extraction data-integration data-processing data-pipeline extract-transform-load
- Updated
Jun 9, 2025 - Python
Web scraper for ICE (Intercontinental Exchange) Markit Settlement Prices. Transforms and inserts data into an MSSQL database.
python data-transformation web-scraping mssql ice financial-data database-integration markit-settlement-prices automated-data-fetch
- Updated
Nov 7, 2023 - Python
Improve this page
Add a description, image, and links to the data-transformation topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the data-transformation topic, visit your repo's landing page and select "manage topics."