New features
GCP historical data lake (Tract 1)
QuanuX can now stream tick data from your live cluster into Google Cloud Storage as Parquet, with BigQuery External Tables registered automatically over the resulting datasets. This gives you a durable, queryable history of every market tick the engine has seen — no separate ETL job required.- Bounded-memory ingestion: payloads flush to GCS before any memory ceiling is breached, so the pipeline is safe to run alongside latency-sensitive engines.
- BigQuery registration is a single command — point it at a bucket and you get a queryable external table.
GCP_PROJECT_ID and GOOGLE_APPLICATION_CREDENTIALS entries.
DuckDB-to-BigQuery research transpiler (Tract 2)
Write research queries in DuckDB locally, then execute the same logic against your BigQuery historical lake with no rewrite. The transpiler parses your DuckDB query, validates it against an approved SQL surface, and emits BigQuery Standard SQL. Supported in this release:SELECT,FROM,WHERE,GROUP BY,ORDER BY,LIMIT- Aggregates:
COUNT,SUM,AVG,MIN,MAX - Bounded subqueries (scalar
SELECT,WHERE IN, uncorrelatedFROM) — nesting capped at depth 1 - Single inner-equality joins
TranspilationError and direct-BigQuery fallback instructions — no silent semantic drift.
quanuxctl infra gcp-sql command surface
New CLI subcommands for the research transpiler workflow:
quanuxctl infra gcp-sql validate— check a query against the approved matrix without executing.quanuxctl infra gcp-sql transpile— emit BigQuery Standard SQL for a DuckDB query.quanuxctl infra gcp-sql execute— run the transpiled query against BigQuery with--max-results,--timeout, and--dry-runbounds.
quanuxctl CLI reference.
quanuxctl infra ingest-start and table-register
New commands to start the JetStream → GCS ingestion pipeline and register a BigQuery External Table over a GCS bucket of Parquet files.
Updates
- Secrets manager now recognizes
GCP_PROJECT_IDandGOOGLE_APPLICATION_CREDENTIALS, resolved automatically from the OS keyring when environment variables are absent. See Secrets. quanuxctl infranow accepts a provider flag so the same command group serves multi-cloud deployments.- Dependency refresh:
hono,react-hook-form,lucide-react,three,@modelcontextprotocol/sdk,@tauri-apps/cli,graphql, andfigma-developer-mcphave all been bumped to their latest patch and minor releases.
Bug fixes
- Fixed a memory-overshoot edge case in the ingestion pipeline where a single high-velocity influx event could briefly exceed the configured bound before flushing.
- Tightened credential resolution in
quanuxctl infra gcp-sqlso missing GCP environment variables stop the pipeline immediately with a clear error, instead of failing partway through execution.