lead data engineer
Lead Data Engineer
We are looking for a passionate remote Lead Data Engineer to join the Customer Success and Support (CSS) Data Engineering team.
In this role, you will be responsible for building world-class data solutions and applications that power crucial decisions throughout the organization. You should be someone who is excited about building services that scale.
responsibilities
- Build tables and datamarts with separate data models for analytics purposes, working in sprints. Data Scientists will give requirements by the end of the quarter, with ad-hoc requests as needed (on-call support is expected)
- Support Data Science teams by building scalable data solutions and applications that enable them to derive insights from large datasets
- Build ingestion pipelines, and be responsible for supporting and improving existing pipelines
- Ensure the quality and integrity of data through testing and monitoring of data solutions
- Publish good documentation to help users understand the information provided
- Work in collaboration with cross-functional teams to deliver quality solutions on time
- Provide mentoring to junior team members as needed
requirements
- 5+ years of relevant experience in Data Software Engineering
- 1+ years of relevant leadership experience
- High proficiency in SQL (must-have), with most tasks in Databrick SQL. Experience with DataBricks is a plus and can be trained
- Extensive knowledge of Spark and experience with PySpark
- Experience with Python and writing on top of Airflow
- Experience with data integration and modeling
- General knowledge of big data, AWS suite, and Airflow
- Some ETL experience, including building ETL pipelines
- Experience with data modeling and using REST APIs
- Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)
- Must be a team player with a positive attitude and willingness to learn new technologies on the fly
- Experience with on-call support is preferred
- If you are a self-motivated and skilled data engineer who is passionate about building world-class data solutions, we encourage you to apply
- Strong communication and documentation skills
- B2+ English level
benefits for locations
Colombia
For you
- Prepaid Medicine with Colsanitas for you and your legal dependents
- MetLife Life Insurance for you
- Thousands of projects for top brands
- Stable income
For your comfortable work
- 100% remote work forever
- Free licensed software
- Possibility to work on your own device (BYOD)
- Stable workload
- Relocation opportunities
- Flexible engagement models
For your growth
- Free trainings for technical and soft skills
- Free access to LinkedIn Learning platform
- Support from a personal Skill Advisor
- Language courses
- Free access to internal and external e-Libraries
- Access to internal communities and competency centers
- Certification opportunities
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
looking for something else?
Find a vacancy that works for you. Send us your CV to receive a personalized offer.