go to searchlead big data engineer
Sorry the job is no longer available.
Lead Big Data Engineer
We are seeking a highly skilled remote Lead Big Data Engineer to join our team, working with a leading provider of cloud-based solutions for the financial services industry.
In this position, you will be responsible for managing and developing the company's big data infrastructure, collaborating with cross-functional teams to design and implement scalable and reliable data solutions. You will also be responsible for driving the adoption of new technologies and tools to enhance the company's data processing capabilities. If you are passionate about big data and have experience in managing complex data systems, we invite you to join our team.
responsibilities
- Design and develop big data solutions using Apache Spark and Databricks, ensuring scalability and reliability
- Collaborate with cross-functional teams to understand business requirements and design data solutions to meet them
- Optimize data processing and analytics performance using advanced techniques and tools
- Develop and maintain data pipelines and ETL processes using Python and Scala
- Ensure the quality and integrity of data by implementing data validation and testing processes
- Drive the adoption of new technologies and tools to enhance the company's data processing capabilities
- Manage and mentor junior engineers, providing guidance and support in their daily tasks
- Ensure compliance with data privacy and security regulations
requirements
- A minimum of 5 years of experience in Data Software Engineering
- Strong experience in Apache Spark and Databricks, highlighting your proficiency in big data processing and analytics
- Proficiency in programming languages such as Python and Scala, enabling you to develop and maintain data pipelines and ETL processes
- Hands-on experience in Microsoft Azure, including Azure Data Factory, Azure Databricks, and Azure Blob Storage
- Completed Databricks Data Engineering Professional certification, demonstrating your in-depth knowledge of Databricks and its features
- Strong problem-solving skills and attention to detail, allowing you to identify and resolve complex data issues
- Experience in managing and mentoring junior engineers, showcasing your leadership skills and ability to work with cross-functional teams
- Fluent spoken and written English at an Upper-Intermediate level or higher, enabling effective communication with international teams
nice to have
- Experience with other big data technologies such as Hadoop, Hive, and Kafka
- Knowledge of data visualization tools such as Tableau or Power BI
- Experience with data warehousing and data modeling techniques
These jobs are for you
benefits for locations
Chile
For you
- Paid time off
- Paid sick leave days
- Medical insurance
- Stable income
- Lunch allowance
- Bonuses for holidays celebration
For your comfortable work
- Remote-forever work
- Free licensed software
- Stable workload
- Relocation opportunities
- Flexible engagement models
For your growth
- Free trainings for technical and soft skills
- Free access to LinkedIn Learning platform
- Language courses
- Free access to internal and external e-Libraries
- Certification opportunities
- Skill advisory service
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
