Back to listing

Senior Data Engineer
France (Paris)

Date posted: 29.03.2024

Job type: Full time

France (Paris)

Full time

Job perks: Professional team; AI software

About the project

How we hire:
At Pentalog, excellence is what you'll do. We're guided by a mission to positively impact the software development world.

Are you ready to be part of a revolutionary team that is reimagining content creation and using cutting-edge technology to drive the future of the creator economy? Our client is using technology, data and expertise to turn today's talented video creators into tomorrow's digital icons.

As a Senior Data Engineer, you'll be working on one or more key projects that drive innovation in content creation. Your role will empower creators to reach their full potential across social platforms such as Facebook, Instagram, Pinterest, Snapchat, TikTok, YouTube and beyond.

The majority tech stack is: Python/FastAPI and React with some projects in Node.js, Rust, React Native. Mandatory knowledge: Git, Docker. Nice to haves: AWS, Terraform.
 

Job requirements

  • At least 6 years of experience in similar environments;
  • Proficiency in Python and familiarity with the data engineering tool landscape, particularly tools such as Airflow and DBT;
  • Knowledge of SQL and NoSQL databases;
  • Streaming pipeline experience with Kafka, Kinesis, Beam or Flink;
  • Big data infrastructure deployment experience, with proven ability to use tools such as Terraform on platforms such as AWS;
  • Familiarity with managed services such as S3, Redshift, EMR or others;
  • Architecture and systems design experience;
  • Experience with platforms such as Spark and Hadoop is a plus;
  • Rigorous, resourceful and curious, with a flair for problem solving;
  • Good communicator, with the ability to teach others;
  • Good team working skills;
  • Fluent in English.
     
Amazon Web Services (AWS)AWS KafkaAWS KinesisAWS RedshifhtHadoopNode.JsNoSQLPythonReact jsReact nativeRustSPARKSQL

Responsibilities

  • Develop, deploy, and maintain ETL processes in Python and Spark;
  • Implement and manage data pipelines utilizing tools such as Airflow, AWS Glue, and Kinesis;
  • Oversee and manage the data stores, including Redshift and RDS;
  • Implement and maintain data lake archiving strategies using S3, Parquet, and Iceberg;
  • Drive data modeling initiatives and implement schema governance tooling to ensure data integrity and consistency.
     

Benefits

  • Foreign language classes;
  • Competitive salary and bonuses;
  • Free pass to learning platforms;
  • A multicultural, friendly work environment;
  • Working in a company with an Agile mindset: continuous knowledge sharing and validated learning;
  • The possibility to bring your own creative and innovative ideas to life;
  • Mentorship programs that encourage and enable your professional development;
  • Great career development opportunities;
  • Improvement of your hard and soft skills through workshops, knowledge sharing sessions and presentations on multiple IT-related topics.
     

About Pentalog

As a leading European Software Services company operating internationally in France, Romania, Germany, Moldova, UK, Vietnam, Mexico, Morocco and USA, we employ over 1,300 engineers and IT experts who work in a very dynamic, multicultural working environment.

At Pentalog, your talents & ambitions are recognized and rewarded; we offer plenty of opportunities to develop, both individually, as well as a professional, and we reward our collaborators who understand the importance of self-improvement.

Apply now

Super humans

Blog articles

Design Patterns

The Flyweight Chronicles: How to Make Your Code Weightless!

The Flyweight Design Pattern is a structural pattern used to minimize memory usage or computational expenses by sharing as much as possible with related objects. It is beneficial when many similar objects need to be created, and the overhead of creating and maintaining each object individually is too high. The key idea behind the Flyweight […]
Eduard Ghergu
by Eduard Ghergu
Software Architect

Design Patterns

Facade Design Pattern: Streamlining Complexity in Code

What is facade design pattern?   The Facade Design Pattern is a structural design pattern that provides a simplified interface to a set of interfaces in a subsystem (a library, a framework, or any other complex set of classes), making it easier to use. It involves creating a facade class that represents a higher-level, unified […]
Eduard Ghergu
by Eduard Ghergu
Software Architect

Tech Trends

Innovation in Practice: Navigating Through Proof of Concept, Prototypes, Pilots, and MVPs

1. Common Terms Understanding the “Lingo of Innovation”   Proof of Concept, Prototype, Pilot, MVP… sound familiar? These terms are often tossed around in innovation discussions, but do we really know what they mean? Here, we’ll unpack these buzzwords and set the record straight on their distinct roles in the innovation process.   2. Proof […]
Alexandru Hutanu
by Alexandru Hutanu
Engineering Manager