Two-way sync
Changes in Dremio or Pigment instantly reflect in both systems. No stale data, no manual imports.
Keep Dremio and Pigment in sync without custom scripts. Cut weeks of integration work, eliminate silent data drift, and give your team a single, reliable source of truth.
Finance data belongs in the warehouse: revenue, invoices, payments, and customers joined with everything else the business measures. Getting it there usually means an extraction pipeline that breaks quietly and delivers yesterday's numbers.
Stacksync syncs Metrics, Dimension lists, Tables, Scenarios from Pigment into tables in Dremio in real time, and the connection works in both directions: values computed in Dremio can be written back to fields in Pigment where you want them operational. Schema changes are handled, API limits are managed, and the sync is something you configure rather than code you maintain.
Invoices, payments, and customer records from Pigment arrive in Dremio as queryable tables, current within seconds instead of a day behind.
Analysts combine Pigment's financial records with product, marketing, or operational data already in Dremio for reporting the finance system cannot do alone.
Scores or segments computed in Dremio, like payment-risk flags or customer tiers, sync back onto records in Pigment where the finance team can act on them.
Representative objects on each side — any object or custom field can map to any target. Schemas are auto-detected; types are converted between the two systems.
| Dremio objects | Pigment objects | |
|---|---|---|
| Spaces and folders Namespaces that organize virtual datasets and govern access. | Dimension lists Master data like accounts, products, or employees that metrics are sliced by | |
| Reflections Materialized accelerations that make repeated extraction queries cheaper. | Tables Row-based transactional data loaded into models from source systems | |
| Jobs Query execution records useful for monitoring sync workloads. | Scenarios Versions such as budget, forecast, and actuals that give exported figures their context | |
| Sources Connected storage and database systems (S3, ADLS, relational databases) Dremio queries in place. | Data imports Scheduled loads that bring actuals from ERPs, CRMs, and HRIS into the model | |
| Physical datasets Tables and files promoted from sources; the raw data a sync ultimately reads. | Users and permissions Access controls governing which model areas a sync can touch | |
| Virtual datasets (views) SQL views layering semantics over physical data; the preferred sync target for curated extracts. | Applications Planning models organized by domain such as finance, sales, or workforce |
Real-time sync, workflow automation, event queues, EDI, and monitoring, for every Dremio–Pigment connection.
Changes in Dremio or Pigment instantly reflect in both systems. No stale data, no manual imports.
Trigger automated workflows whenever Dremio or Pigment data changes, update records, fire webhooks, or kick off sequences without brittle API scripts.
Handle millions of events per minute without losing a single Dremio or Pigment record.
Track your Dremio ⇄ Pigment sync health, view errors, and replay failed events in one click.
Transform legacy EDI complexity into simple database interactions between Dremio and Pigment.
Configure and sync within minutes, no code. Whether you sync 50k or 100M+ records, Stacksync handles the queues, infra, and plumbing. Integrations are non-invasive and need zero setup on your systems.
Authenticate Dremio and Pigment with each platform's native method — OAuth, API keys, or service accounts — plus secure options like SSH tunneling, IP whitelisting, and VPC peering.
Pick the Dremio and Pigment objects to sync — Stacksync auto-detects both schemas, including custom fields where the platform exposes them. Sync to existing tables, or let Stacksync create new ones with ideal data types.
Fields map automatically even when names and types differ. Stacksync handles transformation and type casting for you, zero configuration required.
Yes. Stacksync provides a managed, real-time two-way integration between Dremio and Pigment: authenticate both systems, choose the objects to sync (such as Dremio's Spaces and folders and Reflections), map fields visually, and changes propagate both ways in milliseconds — no code required.
On the Pigment side: Metrics, Dimension lists, Tables, Scenarios, plus custom fields where Pigment exposes them. On the Dremio side: Virtual datasets (views), Apache Iceberg tables, Spaces and folders, Reflections. Stacksync auto-detects both schemas and converts types between the two systems.
Yes. Each object mapping can be bidirectional or restricted to a single direction (both systems accept writes). Read-only mirrors, one-way pushes, and full two-way sync can be mixed in the same integration.
Common patterns for Dremio and Pigment: Finance analytics without ETL; Revenue joined with everything else; Write-back of computed fields. Invoices, payments, and customer records from Pigment arrive in Dremio as queryable tables, current within seconds instead of a day behind.
Dremio: Arrow Flight SQL, JDBC/ODBC, and a REST API. Authentication: Personal access tokens or username/password; OAuth-based SSO on Dremio Cloud. Pigment: REST-based import and export API. Authentication: API keys, issued separately for import and export. Stacksync manages authentication, retries, and rate limits on both sides.
Pigment: Pigment's model is multidimensional: metrics are sliced by dimension lists, so inbound records must map to those dimensions rather than flat columns. Dremio: Dremio queries data in place on lake storage (S3, ADLS, HDFS) rather than ingesting it, so syncs read through Dremio to underlying files and Iceberg tables. Stacksync's field mapping accounts for these differences between Dremio and Pigment without custom code.
As a data company, we understand the importance of keeping your data secure. Stacksync is built with security best practices to keep your data safe at every layer, and is DPF-certified for US, EU, UK and CH data transfers.
Let your users access Stacksync from your centralized user management systems. Works with Okta, Azure, Google SSO and more.
Immediately get alerted about record syncing issues over email, Slack, PagerDuty and WhatsApp. Resolve issues from a centralized dashboard with retry and revert options.
Securely connects to your systems with:
Every pair below is a real-time, two-way sync. Search all 386 integrations available for Dremio and Pigment.