Sr Data Engineer to help a strategic banking client in various data transformation activities

Our valued client is currently seeking a Senior Data Engineer to help a strategic banking client in various data transformation activities.

This position is hybrid - 3 times a week onsite in Montreal.

As a senior data engineer in CDRT, you'll be part of an agile team dedicated to breaking the norm and pushing the limits of innovation. You will be involved in detailed technical design, development and implementation of applications using emerging technology platforms.

Tasks include:

• Proven track record of a minimum of 4 years in management, in a space with strong focus on large scale data processing and instrumentation.
• Previous working experience in large-scale distributed systems.
• Strong familiarity with software engineering principles, including object-oriented and functional programming paradigms, design patterns, and quality code practices.
• Excellent communication skills, with the ability to effectively collaborate with cross-functional teams and explain technical concepts to non-technical stakeholders.
• Collaborating and leading part of a cross-functional Agile team to create and enhance software for data ingestion and entity resolution platform
• Expertise in application, data and infrastructure architecture disciplines
• Working with large, complex data sets from a variety of sources
• Participate in the rapid development of user-driven prototypes to identify technical options and inform multiple architectural approaches
• Building efficient storage and search functions over structured and unstructured data
• Utilizing programming languages Python, Java, Scala, Relational and NoSQL databases
• Learning newer technologies for entity resolution such as Quantexa platform

Must Haves:

• Strong coding background, ideally in Java/ Python / Scala
• Experience in at least one big data product: Databricks, Elasticsearch, Snowflake
• Experience building batch / real time data pipelines for production systems.
• Experience with Relational and Non-Relational DBs like DB2, MongoDB
• Experience with various data formats: Parquet, CSV, JSON, XML, Relational Data
• Strong familiarity with Kafka, Spark, Hadoop, Iceberg, Airflow, Data Modeling, relational databases, columnar databases

• Nice-to-Haves:
• Experience with Rest based applications
• Experience with Databricks/ Delta Lake
• Experience with client reference data sources from vendors