● Covered by 1 source · 1 reportMedium impact1 neutral
Google Cloud Data Analytics, BI, and Database Teams Announce New Features
Key points
- Stateful processing is now in preview for BigQuery continuous queries.
- A synthetic data generator tool is generally available for Managed Service for Kafka.
- Dataflow pipeline updates offer stop-and-replace and parallel migration options.
- New Lakehouse managed tables for Apache Iceberg are in preview.
BigQuery Continuous Queries Get Stateful Processing
Google Cloud has introduced stateful processing in preview for BigQuery continuous queries. This new capability allows users to incorporate functions such as JOINs, aggregations, and windowing functions directly into their streaming queries. This expansion enables the calculation of metrics over time, like 30-minute averages, to provide richer, real-time signals for downstream applications and AI agents.
Synthetic Data Generator for Managed Service for Kafka
A synthetic data generator tool is now generally available for Google Cloud's Managed Service for Kafka. This tool simplifies the process of populating a new Kafka cluster with mock data, allowing users to start streaming data in less than two minutes with minimal setup. It serves as a utility for testing clusters and new features without requiring client application modifications or virtual machine spin-ups.
Faster and More Flexible Dataflow Pipeline Updates
Dataflow pipeline updates have been enhanced with new capabilities, including a stop-and-replace option that complements the existing in-place update feature. A new parallel pipeline option accelerates migration between old and new pipelines, reducing disruption. Additionally, users can now set a timeout on drains to prevent runaway costs from stuck processing, with these features now generally available.
Lakehouse Managed Tables for Apache Iceberg in Preview
New Lakehouse managed tables for Apache Iceberg are now available in preview within the Google Cloud console. These Google-managed tables aim to eliminate the need for duplicate data pipelines and complex synchronization between BigQuery and open-source engines. This unified table format provides native, multi-engine read and write interoperability, supporting concurrent DML/DDL operations across various analytics tools on a single, shared storage layer. Automated table management handles background optimization tasks like compaction and partition tuning.
✨ This summary was generated by AI from the outlets' reporting listed below. It is not independently verified and may contain errors — check the original sources. How BrevFeed works →
The daily brief
One email each morning: the day's tech stories, clustered across outlets and summarized. No account needed.
One email a day. Unsubscribe in one click, any time.
Today's brief
Spend a few minutes, get the whole day. Every topic's top stories in one hands-free rundown — listen, watch, or read the transcript.
▶ Play today's brief
New every morning, and the back catalogue is archived by date.
Reporting from
Google Cloud has introduced several updates across its data analytics, business intelligence, and database services, including stateful processing for BigQuery continuous queries, a synthetic data generator for Managed Service for Kafka, and faster Dataflow pipeline updates. These features aim to enhance real-time data processing, simplify testing, and improve pipeline management for users.