Senior Data Engineer (AWS/Python) to build lakehouse pipelines and revenue data products
S.i. Systèmes
Toronto, ON- Salaire À discuter
-
Emploi Contrat
-
Publié il y a 6 jour(s)
-
1 poste à combler dès que possible
Description
Job Title: Senior Data Engineer (AWS/Python) to build lakehouse pipelines for airline customer and revenue data products
Overview: Our client seeks Senior Data Engineers to design and implement production-grade data pipelines in AWS lakehouse supporting Customer, Revenue, and Operations 360° initiatives.
Responsibilities:
- Build scalable data ingestion pipelines from external sources
- Implement CDC patterns for operational system integration
- Develop PySpark transformations for Customer and Revenue 360 products
- Optimize existing Redshift/Matillion workloads
- Create automated data quality monitoring and alerting
- Support Revenue 360 production deployment
Must Haves:
- 7+ years building production data pipelines in cloud environments
- Expert-level Python and SQL for data transformation
- Hands-on experience with AWS Glue, EMR, Lambda, and Step Functions
- Strong background in Spark/PySpark for large-scale data processing
- Experience building CDC pipelines and real-time data ingestion
- Track record delivering data products from ingestion to consumption
Nice to Haves:
- Airline industry experience with reservation, revenue, or operational data
- Infrastructure as Code (Terraform/CloudFormation)
- Experience with streaming platforms (Kafka, Kinesis)
AI may be used in evaluating candidates.
Exigences
non déterminé
non déterminé
non déterminé
non déterminé
non déterminé
D'autres offres de S.i. Systèmes qui pourraient t'intéresser