go to searchlead data software engineer (python, azure)
Lead Data Software Engineer (Python, Azure)
We are seeking a highly skilled remote Lead Data Software Engineer to join our team and contribute to the development of cutting-edge data solutions for our clients.
In this position, you will be responsible for designing and implementing complex data processing pipelines using Apache Spark and Databricks. You will work closely with cross-functional teams to design, develop, and deploy scalable and efficient data solutions that meet our clients' needs. If you are passionate about Big Data Engineering and have a proven track record of delivering high-quality data solutions, we invite you to apply for this exciting opportunity.
responsibilities
- Design and implement complex data processing pipelines using Apache Spark and Databricks
- Work closely with cross-functional teams to design, develop, and deploy scalable and efficient data solutions that meet our clients' needs
- Develop and maintain data architectures that support data processing, storage, and retrieval at scale
- Collaborate with Data Scientists to implement machine learning models on Big Data platforms
- Develop and maintain data quality checks and monitoring processes to ensure data accuracy and integrity
- Lead and mentor a team of Big Data Engineers, providing guidance and support in their daily tasks
- Stay up-to-date with the latest Big Data technologies and trends, and continuously improve our data engineering practices
requirements
- Minimum of 5 years of experience in Data Software Engineering, with a focus on Big Data processing and analytics
- 1+ years of relevant leadership experience
- Expertise in Apache Spark and Databricks, with demonstrated experience in designing and implementing complex data processing pipelines
- Proficiency in at least one programming language, such as Python or Scala, and experience in building scalable and efficient data solutions
- Experience in designing and implementing data architectures that support data processing, storage, and retrieval at scale
- Strong understanding of data modeling, data warehousing, and ETL processes
- Experience in working with large datasets and distributed systems
- Excellent communication and team management skills, with a proven track record of leading cross-functional teams
- Fluent spoken and written English at an Upper-Intermediate level or higher
- Spanish language proficiency is a must-have
nice to have
- Completed Databricks Data Engineering Professional certification
- Experience with cloud technologies, such as Azure or AWS
- Experience in data visualization and reporting tools, such as Tableau or Power BI
- Experience in data security and compliance, including GDPR and HIPAA regulations
benefits for locations
Chile
For you
- Paid time off
- Paid sick leave days
- Medical insurance
- Stable income
- Lunch allowance
- Bonuses for holidays celebration
For your comfortable work
- Remote-forever work
- Free licensed software
- Stable workload
- Relocation opportunities
- Flexible engagement models
For your growth
- Free trainings for technical and soft skills
- Free access to LinkedIn Learning platform
- Language courses
- Free access to internal and external e-Libraries
- Certification opportunities
- Skill advisory service
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
