data-profiling

Create HTML profiling reports from pandas DataFrame objects

Visualize and compare datasets, target values and associations, with one line of code.

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF and PySpark

Data validation and organization of metadata for data frames and database tables

Data profiling, testing, and monitoring for SQL accessible data.

Monitor the stability of a pandas or spark dataframe ⚙︎

🚕 A spreadsheet-like data preparation web app that works over Optimus (Pandas, Dask, cuDF, Dask-cuDF and PySpark)

a set of scripts to pull meta data and data profiling metrics from relational database systems

Dataset search engine, discovering data from a variety of sources, profiling it, and allowing advanced queries on the index

The official http://raymon.ai data profiling and logging library.

A Node.js tool to examine the correctness of Open Data Metadata and build custom dataset profiles

Data cleaning tool.

Open Data Profiling, Quality and Analysis on NYC OpenData dataset with semantic profiling using fuzzy ratio, Levenshtein distance and regex

Simplify usage of the RDS API for TypeScript/JavaScript developers

R package to simplify the usage of the RDS REST API and provide convenience in accessing data and metadata.

🔍Your Data Quality Detector / Gain insight into your data and get it ready for use before you start working with it 💡📊🛠💎

Automated exploration of files in a folder structure to extract metadata and potential usage of information.

TypeScript/JavaScript example code using the RDS API

Profile. Generate data profiles in the browser (work in progress)

HPCC Systems ECL bundle that provides some basic data profiling and research tools to an ECL programmer

The program compares two files at a time and does the following 1.Gathering metadata on the individual tables(column count,record count,list of columns with datatype etc) 2.Identifying matching columns between tables based on names as well as data. Using machine learning, we are handling syntactic as well as semantic variations of column names for accurate matching. 3. Finding duplicate columns in single table with the option to deduplicate if required 4. Finding columns with missing data/null values.

Data profiler is an attempt to model the behavior of a given operator for a set of datasets.

This is a Demo on Data Engineering using Great Expectations API

Distributable UCC Discovery Algorithm based on Akka

Project to develop R scripts to capture, validate and analyze loan information from credit unions peruvian sector.

a nix DataProfiler for deep analysis of data quality on tabular files

A R Notebook to perform basic data profiling and exploratory data analysis on the FIFA19 players dataset and create a dream-team of the top 11 players considering various player attributes.