Sr. Data Engineer (Python & Spark)

As a Senior Data Engineer, you will build distributed data processing solutions and highly loaded database solutions for various business cases including reporting, product analytics, marketing optimization and financial reporting. Contribute as part of a self-organized team of experienced data engineers working in a challenging, innovative environment for our client, creating the foundation for decision-making at a company dealing with billions of events per day. Investigate, create, and implement solutions for existing technical challenges. Provide guidance, instruction, direction, and leadership to a development team with the purpose of achieving project goals.

• Obtain tasks from the project lead or Team Lead and prepare functional and design specifications
• Ensure assigned areas are delivered within deadlines and quality objectives.
• Provide estimations, agree on task duration, and contribute to project planning.
• Analyze alternative solutions and make implementation decisions based on experience and expertise.
• Lead functional and architectural design of assigned areas ensuring compliance with requirements.
• Address area-level risks and implement mitigation plans.
• Design, develop, and implement large-scale, high-performance data models and pipelines for Data Lake and Data Warehouse.
• Develop and implement data quality checks, conduct QA, and improve ETL reliability and scalability.

• University degree in Computer Science or related field.
• 5+ years of experience in data engineering or business intelligence roles.
• Proficiency in Python and strong coding skills for data migration.
• Expertise in database fundamentals and advanced SQL for distributed computing.
• Experience with ETL orchestration tools like Airflow, Flink, Oozie, or Azkaban on AWS/GCP.
• Hands-on experience with Spark, Snowflake, and Databricks.
• Ability to debug Spark jobs and work with DBMS platforms such as Snowflake, Redshift, PostgreSQL.
• Excellent communication skills and ability to work with technical and non-technical teams.

• Flexible work
• Healthcare including dental, vision, mental health, and well-being programs
• Financial well-being programs such as 401(k) and Employee Share Ownership Plan
• Paid time off and paid holidays
• Paid parental leave
• Family building benefits like adoption assistance, surrogacy, and cryopreservation
• Social well-being benefits like subsidized back-up child/elder care and tutoring
• Mentoring, coaching and learning programs
• Employee Resource Groups
• Disaster Relief

Capgemini is a global business and technology transformation partner, helping organizations accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. The Group reported 2024 global revenues of 22.1 billion. Get the future you want | www.capgemini.com

Disclaimer

Capgemini is an Equal Opportunity Employer encouraging inclusion in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law. Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact. Applicants for employment in the US must have valid work authorization that does not now and/or will not in the future require sponsorship of a visa for employment authorization in the US by Capgemini.