senior data engineer with python (databricks, aws)

Data Software Engineering, Amazon Web Services, Databricks, Python, Big Data, Apache Spark, Python.Core, Apache Hive

Poland

Facebook LinkedIn Twitter Send via email

Senior Data Engineer with Python (Databricks, AWS)

Facebook LinkedIn Twitter Send via email

We are looking for an experienced remote Senior Data Engineer with Python, Databricks and AWS skills to join our team. The right candidate enjoys working collaboratively to solve complex data engineering challenges that support our business needs.

responsibilities

Design, implement and maintain large-scale data pipelines using Python, Databricks
Work with cross-functional teams to integrate solutions that meet our data processing and analysis needs
Ensure performance, reliability, security and maintainability of data pipelines
Develop monitoring and alerting mechanisms to proactively identify and resolve issues
Continuously look for opportunities to improve data engineering processes and practices

requirements

Minimum of 3+ years with expertise in designing and maintaining large-scale data pipelines
Strong proficiency in Python and Databricks, (AWS) in production environments
Excellent understanding of Big Data technologies, primarily Spark
Strong understanding of data architecture and modelling concepts
Highly knowledgeable about data warehousing principles and practices
Upper-Intermediate level of English (B2+)

nice to have