Senior Azure Data Engineer with Databricks experience to lead designs and implement data solutions to enable business analytics for an insurance client

Senior Azure Data Engineer with Databricks experience to lead designs and implement data solutions to enable business analytics for an insurance client

**Hybrid in Alberta**

Must haves:

• 5+ years of experience working as a Data Engineer with Databricks
• 5+ years of progressive experience with analysis, design, development, testing, and deployment.
• 5+ years of experience implementing distributed systems and data architecture - design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning, and MPP of high-level data structures.
• Experience working with and building data pipelines, applications to stream and process datasets at low latencies leveraging Databricks and Python.
• Experience with ETL development tools (e.g. Talend, Informatica, Databricks).
• Applied knowledge of data storage and BI technologies such as Data Lakes, Data Warehouse, and Data Lakehouses.
• Ability to write efficient, complex SQL queries against very large data sets, perform ETL optimizations, and work with big data processes.
• A bachelor’s degree or diploma in Computer Science or related technical discipline.

Nice to haves:

• Experience in Oracle database development and PL/SQL would be an asset.