Senior Data Engineer to design and implement data ingestion pipelines from multiple sources using Azure Databricks- 74443-1
S.i. Systèmes
Toronto, ON-
Nombre de poste(s) à combler : 1
- Salaire À discuter
-
Emploi Contrat
- Publié le 18 mai 2024
-
Date d'entrée en fonction : 1 poste à combler dès que possible
Description
Position Title: Data Engineer
Line of Business: Decision Science - Personal & Business banking
Target Start Date: asap
Duration: 6 months
Remote/Hybrid: Hybrid, twice a week to office
Office Location: 81st bay street, 25th floor
Job Description:
- Proven experience with Miscrosoft Azure platform: Databricks/Python/Spark/SparkSQL and ADF
- Experience with Salesforce platform, i.e: API
- Solid understanding of cloud technologies and tools
- Design and Develop custom ETL Solutions to ingest data into Azure Data Warehouse
- Code data quality and transformation logic for data movement within data warehouse
- Develop code to publish data from data warehouse to data mart for consumption by applications or BI tools
- Designing and implementing data ingestion pipelines from multiple sources using Azure
- Databricks
- Integrating the end to end data pipeline - to take data from source systems to target data
- repositories ensuring the quality and consistency of data is maintained at all times
- 8+ years of progressive work experience in data intensive work environment within finance/banking industries
- Degree in Computer Science, Engineering, Statistics, Management Analytics or a related field of study
- Team player who can effectively contribute and collaborate within a diverse, fast paced dynamic environment
- Interface with business partners to understand requirements and present solutions
- Hybrid working environment, 1 or 2 days per week in office
Must Have Requirement:
1. Experience with Azure - Databricks (preferred) or related technologies - 5 years
2. Experience with Python - 5 years
3. Experience Spark - 5 years
4. Experience with ADF (Azure Data Factory) - 5 years
5. Spark SQL experience
6. Cloud experience
Nice to Have:
1. Salesforce experience
2. Previous data architect/modeler experience will be an asset
3. Banking experience
Exigences
non déterminé
non déterminé
non déterminé
non déterminé
D'autres offres de S.i. Systèmes qui pourraient t'intéresser