My London based client is looking for an experienced Data Engineer who is proficient in building and maintaining data pipelines on GCP stack. Proficient in ETL/ELT process, data migration from on-premise to GCP.
Dedicated, self-sufficient, experience to work independently.
· Experience in ETL/ELT process
· Experience in data visualisation
· Experience with NIFI tool
· Experience in writing and maintaining data pipelines using DataFlow (Apache Beam)
·
· Hands-on experience working with Data stack on GCP:
· Pub/Sub
· GCS
· Data Flow
· Data Composer (Airflow)
· BigQuery
· Ability to write and modify templates for DataFlow written in Java (is a must)
· Experience in writing complex SQL queries
· Experience in modifying jobs in Jenkins (on developer level, not a DevOps)
· Ability to read and modify Terraform templates ( developer level, not a DevOps)
GCS Computer Recruitment Services is acting as an Employment Business in relation to this vacancy.
