Intermediate Data Engineer to enhance data availability, readiness, and reliability, empowering other units to utilize the data effectively

Contract: 12 months + 9 months

Hybrid of three (3) days in the office and two (2) days work from home. This is the standard and can be adjusted depending on what is required for the project. The client would also like the professional resource to be flexible with their schedule and be onsite when needed.

35 billable hours a week

Must Haves:

• 7 to 10 years of strong technical experience in building and maintaining cloud data warehouses

• Must have previous experience with development in the Microsoft ecosystem (.Net framework) and specifically in the Microsoft Azure and Power BI.

• 7+ years of experience in designing and building scalable and efficient data pipelines with Microsoft Fabric or Azure technologies (Data Factory, Synapse Notebooks, Python, etc.)

• Expert in Python and SQL

• Hands-on working experience with SSIS Package Design and Development

• Solid background in data modeling (dimensional/star/snowflake schemas) and experience with BI tools like Power BI

• Ability to work cross-functionally and translate complex business requirements into scalable data solutions

• Experience with CI/CD for data pipelines and infrastructure-as-code tools (e.g., Terraform)

The work to be carried out includes a comprehensive assessment of the client's current reporting environment, identification of areas for improvement, and implementation of modern solutions.

This will involve:

• Conducting a thorough analysis of the existing reporting systems and processes.

• Designing and developing a modernized reporting framework that leverages the latest technologies.

• Integrating the new framework with existing systems to ensure seamless data flow and compatibility.

• Testing and validating the new reporting environment to ensure it meets the required standards and performance metrics.

• Providing training and support to the staff to ensure smooth transition and adoption of the new system. This includes utilizing problem-solving skills to understand requirements and troubleshoot as challenges arise. This individual will apply proven development skills to design, test and knowledge share developed products.

The deliverables for this project include:

• A detailed assessment report of the current client's reporting environment.

• A comprehensive design document outlining the new reporting framework along with security and privacy controls and data models.

The developed and integrated modernized reporting system to ensure the designs adhere to data management standards and best practices in collaboration with data analysts, data governance and business partners.

• The development of robust, reusable, and scalable data solutions and pipelines for automating the ingestion, processing, and delivery of batch and real-time or near real-time data.

• Test and validation reports demonstrating the performance and reliability of the new system and benchmarking for the data quality.

• Training materials and sessions for the staff.

• Data literacy, data mapping, data quality monitoring and lineage artifacts to ensure that all stakeholders understand the data and its implications.

• Documentation of ETL (Extract, Transform, Load) processes, including detailed descriptions of data extraction, transformation, validation and loading procedures.

• Documentation of business rules and transformations applied to the data to ensure consistency and accuracy.

• A final project report summarizing the work carried out, the outcomes achieved, and recommendations for future improvements.