lead data engineer with databricks
We are seeking a remote Lead Data Engineer with expertise in Databricks to join our team.
The ideal candidate will be responsible for designing, developing, and implementing data engineering solutions using Azure Data Factory, Databricks, Python, and SQL. The candidate must have excellent analytical and problem-solving skills, as well as strong communication and collaboration skills. The successful candidate will work with big data technologies such as Hadoop, Hive, Spark, or Kafka.
- Design, develop, and implement data engineering solutions using Azure Data Factory, Databricks, Python, and SQL
- Build and optimize data pipelines, data ingestion, and data transformation processes
- Create technical documentation for data engineering solutions, data flows, and data models
- Collaborate with the team to identify and resolve complex data engineering issues
- Provide coaching and guidance for junior data engineers on the team
- Minimum of 5 years of experience in developing Data Software Engineering solutions using Azure Data Factory, Python, and SQL
- 1+ years of relevant leadership experience
- Experience with cloud-based platforms and technologies such as Azure, AWS, or GCP
- Strong proficiency in Databricks
- Experience working with Big Data technologies such as Hadoop, Hive, Spark, or Kafka
- Upper-Intermediate English level (B2+)
nice to have
- Experience with NoSQL databases
- Experience with machine learning frameworks
Find a vacancy that works for you. Send us your CV to receive a personalized offer.