Code as data

DataForge Cloud is backed by a relational database that combines compiled functional code, orchestration details, operational metrics, and other metadata into queryable tables to track every element of the platform. No need to rely on code scans or third party tools for observability. Now all your logs, lineage, quality rules, and cost data are in one place.

The next generation of data observability

Code as data — queryable with SQL

Upon import into DataForge Cloud, functional code is mapped into relational tables. Now, rather than relying on Ctrl-F, you can write custom SQL to analyze your code base. With a row of data for every line of code, find the exact detail you need in seconds.

Code as data — queryable with SQL

Data quality, alerts, and operational monitoring

Deploy custom data quality rules, processing alert notifications, monitor infrastructure stability, and track data profiles. All code executions, logs, and alerts are saved in the same relational database as your code, ready for query. Column-level lineage makes diagnoses and resolution of issues quick.

Data quality, alerts, and operational monitoring

Complete lineage and audit trails

DataForge tracks how every line of code touches every cell of data for every execution. Quickly identify who changed what and for what purpose, fully integrated with modern CI/CD tools and workflows. Run hyper-granular audit reports for compliance with a single query.

Complete lineage and audit trails

Cloud cost visibility and optimization

With visibility and detailed metadata across runtime, compute, and storage costs tied to every process in DataForge, it is easy to track and monitor cloud spend. Build automated alerts to detect usage spikes and use built-in tools to tweak and test different infrastructure configurations.

Cloud cost visibility and optimization

DataForge Cloud

All-in-one web platform

DataForge Cloud is the fastest and most reliable way to deploy DataForge. Develop, orchestrate, operate, and audit functional code pipelines in an all-in-one web-based UI.

Start for free

DataForge Core

Open source CLI

DataForge Core is an open source command line tool that enables teams to write functional data transformation code following software engineering best practices and principles.

View on GitHub