lead big data engineer with databricks

Data Software Engineering, Amazon Web Services, Apache Airflow, Apache Spark, Data Warehousing, Databricks, SQL

Colombia

Sorry the job is no longer available.

Lead Big Data Engineer with Databricks

Hidden job

We are seeking a remote Lead Big Data Engineer with expertise in Databricks to join our team.

The successful candidate will be responsible for designing and implementing solutions utilizing Data Lake and stream processing engines like Kafka and Spark. The Lead Big Data Engineer will have experience in the Financial services domain and will be proficient in software development lifecycle (SDLC) methodologies like Agile and Test-driven development.

responsibilities

Designing and implementing solutions utilizing Data Lake and stream processing engines like Kafka and Spark
Providing technical leadership and guidance to team members
Collaborating with cross-functional teams to drive projects to completion
Developing and implementing SDLC methodologies like Agile and Test-driven development
Maintaining and improving the performance of existing solutions

requirements

Bachelor's/Master's Degree in Computer Science, Information Systems or equivalent
5+ years of relevant experience in Data Software Engineering
1+ years of relevant leadership experience
Expertise in Databricks, Python, AWS, Apache Spark, and Data Warehousing
Experience with Big Data platforms such as Apache Hadoop
Advanced SQL coding skills with both SQL and NoSQL databases
B2+ English level

nice to have

Experience with Apache Airflow, and Relational Database Design

benefits for locations

For you

Prepaid Medicine with Colsanitas for you and your legal dependents
MetLife Life Insurance for you
Thousands of projects for top brands
Stable income

For your comfortable work

100% remote work forever
Free licensed software
Possibility to work on your own device (BYOD)
Stable workload
Relocation opportunities
Flexible engagement models

For your growth

Free trainings for technical and soft skills
Free access to LinkedIn Learning platform
Support from a personal Skill Advisor
Language courses
Free access to internal and external e-Libraries
Access to internal communities and competency centers
Certification opportunities

get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals

looking for something else?

Find a vacancy that works for you. Send us your CV to receive a personalized offer.