Our customer based in Zurich is looking for a Senior Data Engineer (m/w/d) 100%.
Key responsability:
- Implementation of production ready data pipelines using PySpark running on Databricks based on specification provided by business analysts.
- Interaction with other data engineers and solution architects to meet functional and non functional requirements
requirements:
- PySpark (Python is not enough, Spark is a must)
- Delta Lake and Databricks
- Azure fundamentals
About You
You are a result-driven experienced software engineer, passionate about your craft and eager to grow further, comfortable meeting (sometimes tight) deadlines and confidently taking ownership of features. You have an accomplished record in delivering sustainable solutions and you desire to develop your skills and knowledge about the platforms which you will be working on, both the technical aspects and how they are used by our business partners. You are comfortable working in multi-dimensional agile teams with direct involvement from business subject matter experts
and care about security, quality, user experience, documentation, testing, team spirit and the overall big picture. Finally, you want to put clean code principles into practice on large code bases.
- Bachelor's or master's degree in computer science, or any other related field
- Strong software engineering skills, including familiarity and application of design patterns, and engineering best practices.
- Proven experience developing complex software systems as a software engineer (at least 5 years)
- Strong understanding of data engineering techniques with high level programming languages (e.g., Java, C#, or Python) and analytical frameworks
- Strong core Python software engineering experience
- At least 3 years for hands on experience with Apache Spark (PySpark), developing applications using an IDE such as VS Code or PyCharm
- Experience of working with delta lakes and optimizing Spark workloads running on it.
- Have a good understanding and significant experience with projects using relational data models and SQL.
- Good work ethic and self-starter. You look out for issues, opportunities and address them when you can, raise them when you cannot.
- Good analytical skills and the ability to understand complexity and break it down into smaller, achievable steps.
- Highly proficient in English (written and verbal)