Sr Cloud Data Engineer (GCP) with SQL, Python/Java and airflow to pipe data and build out our clients enterprise data lake in a CI/CD environment.
S.i. Systems
Toronto, ON-
Number of positions available : 1
- Salary To be discussed
-
Contract job
- Published on April 8th, 2024
-
Starting date : 1 position to fill as soon as possible
Description
Our client is Canada's largest retailer. They are looking for a Sr Cloud Data Engineer (GCP) with SQL, Python/Java and airflow to pipe data and build out our clients enterprise data lake in a CI/CD environment.
Duration: Until End of year to start - strong possibility of extension
Location: Brampton/Toronto (Hybrid; 3 days onsite)
70% Engineering
30% Analysis
Responsibilities:
- Work with data analysts - understand how to land the data .. The Data Engineer will build the orchestration and pipe the data through and build out the data lake.
- Build pipelines using Airflow DAGS and design/develop the logic for building pipelines - How the data is processed and transformed from the source into the target (Enterprise data lake).
- Analyze the data and build the data models. The pipeline framework already exists, this resource will build new pipelines for the new data sources.
Must Haves:
- GCP
- SQL, and Python or Java
- Build pipelines, tables and objects (within Data lake) and document it.
- Airflow DAGS
Requirements
undetermined
undetermined
undetermined
undetermined
Other S.i. Systems's offers that may interest you
- Job posting | Senior Python developer to build an enterprise data warehouse. | Ottawa,ON
- Job posting | Senior Bilingual Project Manager to delivery a migration from Office 2016 to M365 | Montreal,QC
- Job posting | Sr. Platform Engineer with Typescript (NodeJS) experience to work in AWS environment for a banking client | Toronto,ON