IRIS -> Google Cloud BigQuery
IRIS→BQ
High-performance table extraction and BigQuery streaming engine for InterSystems IRIS. Stream SQL table rows directly into GCS staging (gzipped NDJSON) and trigger automated BigQuery load jobs with zero CGO dependencies.
Pure Go Driver
Native IRIS Extraction
Query IRIS SuperServer directly via caretdev/go-irisnative over port 1972 without installing unixODBC or heavy CGO drivers. Lightweight, fast, and cross-platform.
BigQuery Sync
Automated GCS & BigQuery Pipeline
Serialize table data directly to gzipped NDJSON objects in Google Cloud Storage and run native BigQuery Load Jobs with WRITE_TRUNCATE or WRITE_APPEND and automatic schema inference.
Features
High-Performance Data Pipelines
Modernize legacy Spark/Scala ETL pipelines with a zero-JVM Go utility for InterSystems IRIS.
Pure Go Driver
Native SuperServer protocol extraction via caretdev/go-irisnative (port 1972) or Atelier REST API with zero CGO dependencies.
GCS Staging
Streams table rows as gzipped NDJSON into Google Cloud Storage with auto-cleanup post BigQuery ingestion.
BigQuery Engine
Automatic dataset creation, schema auto-detection, WRITE_TRUNCATE / WRITE_APPEND support, and row metrics reporting.
Parallel Workers
Concurrent multi-table synchronization engine to maximize network throughput and minimize sync window durations.
Dry-Run Support
Validate connectivity and extraction schemas with --dry-run without creating objects in GCS or BigQuery.