Senior Data Architect to design and implement data ingestion pipelines from multiple sources using Azure Databricks- 74443-1

Position Title: Data Architect

Line of Business: Decision Science - Personal & Business banking

Target Start Date: asap

Duration: 6 months

Remote/Hybrid: Hybrid, twice a week to office

Office Location: 81st bay street, 25th floor

Job Description:

• Proven experience with Miscrosoft Azure platform: Databricks/Python/Spark/SparkSQL and ADF
• Experience with Salesforce platform, i.e: API
• Solid understanding of cloud technologies and tools
• Design and Develop custom ETL Solutions to ingest data into Azure Data Warehouse
• Code data quality and transformation logic for data movement within data warehouse
• Develop code to publish data from data warehouse to data mart for consumption by applications or BI tools
• Designing and implementing data ingestion pipelines from multiple sources using Azure
• Databricks
• Integrating the end to end data pipeline - to take data from source systems to target data
• repositories ensuring the quality and consistency of data is maintained at all times
• 8+ years of progressive work experience in data intensive work environment within finance/banking industries
• Degree in Computer Science, Engineering, Statistics, Management Analytics or a related field of study
• Team player who can effectively contribute and collaborate within a diverse, fast paced dynamic environment
• Interface with business partners to understand requirements and present solutions
• Hybrid working environment, 1 or 2 days per week in office

Must Have Requirement:

1. Experience with Azure - Databricks (preferred) or related technologies - 5 years

2. Experience with Python - 5 years

3. Experience Spark - 5 years

4. Experience with ADF (Azure Data Factory) - 5 years

5. Spark SQL experience

6. Cloud experience

Nice to Have:

1. Salesforce experience

2. Previous data architect/modeler experience will be an asset

3. Banking experience