Carlos Rolo is an OpenSource Consultant at Pythian. Two times Cassandra MVP and has deep expertise in distributed
architecture technologies. He has become known and trusted by his peers for his ability to understand complex
problems and for working well under pressure. He prides himself on being a tenacious problem solver while remaining
a calm and positive presence on any team. In his spare time, he enjoys playing water polo, enjoying the local
community or playing with his family and dog.
Presentation: Automated Data Pipeline in GCP
Build a fully automated data pipeline in GCP with Terraform. In this topic I will pick-up the different tools available in GCP (Kubernetes, Dataflow, DataProc, Big Query, Pub/Sub, etc) the pros and cons of each and how to build and automate (with Terraform) a streaming and batch data pipeline. I will also showcase a real-use case for streaming and batch processing. Keywords: GCP, Terraform, Dataflow, Kubernetes