Vodafone Czech Republic has modernized its data pipelines by migrating existing BigQuery stored procedures to Dataform pipelines. This initiative addressed challenges associated with maintaining large, legacy stored procedures, some containing thousands of lines of code that ran sequentially.
The Data Engineering Agent, which uses Gemini, was instrumental in this migration. It allowed Vodafone to transform complex stored procedures into modular Dataform pipelines. The agent accepts natural language instructions and code to build these pipelines directly within Dataform.
The adoption of Dataform pipelines through the Data Engineering Agent resulted in a 50% reduction in pipeline execution times. This improvement was achieved by the agent's ability to parallelize code into independent steps and cache intermediate results using BigQuery materialized views. Caching tables used in downstream processes further speeds up execution and reduces costs.
Modular pipelines facilitate end-to-end orchestration and dependency management, which helps meet service level agreements (SLAs). This approach provides better readability and maintainability compared to the previous system of large, monolithic stored procedures.
✨ This summary was generated by AI from the outlets' reporting listed below. It is not independently verified and may contain errors — check the original sources. How BrevFeed works →
One email each morning: the day's tech stories, clustered across outlets and summarized. No account needed.
One email a day. Unsubscribe in one click, any time.
Spend a few minutes, get the whole day. Every topic's top stories in one hands-free rundown — listen, watch, or read the transcript.
▶ Play today's briefNew every morning, and the back catalogue is archived by date.
Vodafone Czech Republic migrated legacy BigQuery stored procedures to Dataform pipelines using the Data Engineering Agent. This modernization reduced pipeline execution times by half by parallelizing code and caching intermediate results. The agent leverages Gemini to automate data pipeline workflows.