backgo to search

lead big data engineer with databricks

Data Software Engineering, Amazon Web Services, Apache Airflow, Apache Spark, Data Warehousing, Databricks, SQL
Sorry the job is no longer available.

We are seeking a remote Lead Big Data Engineer with expertise in Databricks to join our team.

The successful candidate will be responsible for designing and implementing solutions utilizing Data Lake and stream processing engines like Kafka and Spark. The Lead Big Data Engineer will have experience in the Financial services domain and will be proficient in software development lifecycle (SDLC) methodologies like Agile and Test-driven development.

  • Designing and implementing solutions utilizing Data Lake and stream processing engines like Kafka and Spark
  • Providing technical leadership and guidance to team members
  • Collaborating with cross-functional teams to drive projects to completion
  • Developing and implementing SDLC methodologies like Agile and Test-driven development
  • Maintaining and improving the performance of existing solutions
  • Bachelor's/Master's Degree in Computer Science, Information Systems or equivalent
  • 5+ years of relevant experience in Data Software Engineering
  • 1+ years of relevant leadership experience
  • Expertise in Databricks, Python, AWS, Apache Spark, and Data Warehousing
  • Experience with Big Data platforms such as Apache Hadoop
  • Advanced SQL coding skills with both SQL and NoSQL databases
  • B2+ English level
nice to have
  • Experience with Apache Airflow, and Relational Database Design

These jobs are for you

benefits for locations

For you
  • Insurance Coverage 
  • Paid Leaves – including maternity, bereavement, paternity, and special COVID-19 leaves. 
  • Financial assistance for medical crisis 
  • Retiral Benefits – VPF and NPS 
  • Customized Mindfulness and Wellness programs 
  • EPAM Hobby Clubs
For your comfortable work
  • Hybrid Work Model 
  • Soft loans to set up workspace at home 
  • Stable workload 
  • Relocation opportunities with ‘EPAM without Borders’ program

For your growth
  • Certification trainings for technical and soft skills 
  • Access to unlimited LinkedIn Learning platform 
  • Access to internal learning programs set up by world class trainers 
  • Community networking and idea creation platforms 
  • Mentorship programs 
  • Self-driven career progression tool

get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
a smiling man wearing sunglasses