IRIS -> Google Cloud BigQuery
IRIS→BQ
High-performance table extraction and BigQuery streaming engine for InterSystems IRIS. Stream SQL table rows directly into GCS staging (gzipped NDJSON) and trigger automated BigQuery load jobs with zero CGO dependencies.
Pure Go Native Driver
Zero-CGO SuperServer Protocol Extraction
Query IRIS SuperServer directly via caretdev/go-irisnative over port 1972 without installing unixODBC or heavy CGO drivers. Lightweight, fast, and cross-platform.
BigQuery Load Jobs
High-Throughput GCS Staging & Auto Schema Detection
Serialize table data directly to gzipped NDJSON objects in Google Cloud Storage and run native BigQuery Load Jobs with WRITE_TRUNCATE or WRITE_APPEND and automatic schema inference.
Key Features
Built for Speed, Reliability, and Data Warehousing Pipelines
Modernize legacy Spark/Scala ETL pipelines with a zero-JVM Go utility for InterSystems IRIS.
Pure Go IRIS Driver
Native SuperServer protocol extraction via caretdev/go-irisnative (port 1972) or Atelier REST API with zero CGO dependencies.
GCS NDJSON Staging
Streams table rows as gzipped NDJSON into Google Cloud Storage with auto-cleanup post BigQuery ingestion.
BigQuery Load Engine
Automatic dataset creation, schema auto-detection, WRITE_TRUNCATE / WRITE_APPEND support, and row metrics reporting.
Parallel Worker Pool
Concurrent multi-table synchronization engine to maximize network throughput and minimize sync window durations.
CI/CD & Dry-Run Support
Validate connectivity and extraction schemas with --dry-run without creating objects in GCS or BigQuery.