Onsite - Databricks Administrator to admin and support Azure-based data platform, with focus on Databricks, data pipeline orchestration (Azure Data Factory

S.i. Systems global client is seeking a Onsite - Databricks Administrator to admin and support Azure-based data platform, with focus on Databricks, data pipeline orchestration (Azure Data Factory) and environment management (Unity Catalog)

Onsite 5 days / week in downtown Vancouver (3 days / wk after probation period)

2 - 3 weeks vacation

Full benefits

$95,000 - $115,000 / annum and 8 - 12% annual bonus

MUST HAVE SKILLS

• Databricks, data pipeline orchestration using tools like Azure Data Factory (ADF), and environment management using Unity Catalog.
• A strong foundation in data engineering, cloud data administration, and data governance
• Development experience using SQL and Python (Pyspark) is required.

Experience ADMINISTERING DATABRICKS ENVIRONMENT - Must love ops!

• Unity catalogue governance
• Pipeline monitoring
• Ensuring jobs running performantly, thinking how to reduce costs
• Cluster creation
• Role based access
• Setting up right compute for different workloads
• Knowledge of databricks best practices

NICE TO HAVE:

• Knowledge or experience with APIM

We are seeking a highly skilled and versatile Cloud Data Administrator to join our Data Operations team.

Reporting to the Team Lead, Data Operations, the Cloud Data Administrator plays a key role in the administration and support of our Azure-based data platform, with a particular focus on Databricks, data pipeline orchestration using tools like Azure Data Factory (ADF), and environment management using Unity Catalog.

A strong foundation in data engineering, cloud data administration, and data governance is essential.

Development experience using SQL and Python is required. Knowledge or experience with APIM is nice to have.