DATA ENGINEER (Python, Spark, Docker )
BK Search
Yverdon-les-Bains
Mandated by one of our clients, an international company , we are recruiting an DATA ENGINEER
As a Data Engineer within the Data Platform Team, your mission will be to develop, deploy, and maintain critical data pipelines.
These pipelines are integral to supporting various data consumption scenarios, including business intelligence analytical tools and applications.
RESPONSABILITIES :
- Develop, deploy, and maintain data pipelines from diverse sources to serve data scientists, systems, and end users.
- Serve as a technical reference for data scientists and business intelligence developers, conducting code reviews and ensuring best practices.
- Collaborate closely with business IT teams, data scientists, and external providers to deploy, maintain, and monitor data processing and machine learning pipelines.
- Design and maintain advanced CI / CD pipelines to facilitate continuous integration, testing, and deployment of data pipelines.
- Document the data architecture and management processes to ensure clarity and consistency.
PROFILE :
- Master’s degree in Computer Science
- Deep interest in data infrastructure, data management landscapes, and related technologies.
- Experience in developing and deploying Python or Spark pipelines using Docker containers.
- Proficiency with data storage solutions such as data lakes, data warehouses, and relational databases.
- Experience building CI / CD pipelines using tools like Jenkins, Gitlab, or similar platforms (preferred).
- Familiarity with orchestrator tools such as Airflow.
- Strong skills in Linux, Python, and SQL.
- Ability to communicate effectively and collaborate within a team environment, as well as with external stakeholders.
LANGUAGES
English : Fluent
BK Search is a recruitment agency specialized on the field of IT & DIGITAL. Located in Geneva, we support our clients through recruitment missions in
European market
Il y a plus de 30 jours