senior data engineer
Data Software Engineering, Amazon Web Services, Apache Airflow, Apache Spark, CI/CD, Python, SQL, Databricks
Senior Data Engineer
We are seeking a passionate remote Senior Data Engineer to join the Customer Success and Support (CSS) Data Engineering team, who will be responsible for designing and building world-class data solutions and applications. The ideal candidate must have 3+ years of relevant production experience in building services that scale.
You will work with a dynamic team of professionals to provide high-quality data-driven insights and support to the Data Science teams.
responsibilities
- Work closely with Data Scientists to understand their needs and help build tables and data models for analytics purposes
- Develop and maintain ingestion pipelines and ETL processes that can handle large amounts of data
- Collaborate with the existing FTE team to provide mentorship and support to junior team members
- Build robust and scalable data solutions that can handle complex business requirements.
- Ensure data quality, consistency, and accuracy by implementing quality checks and data validation processes
- Create and maintain documentation to help end-users understand the data and insights provided
requirements
- 3+ years of relevant production experience in building world-class data solutions and applications
- High proficiency in SQL with extensive knowledge of Databrick SQL (DataBricks is nice to have, and can be trained)
- Strong expertise in Spark, Python (PySpark, writing on top of Airflow), data integration, and modeling
- Experience with AWS suite, data modeling, and using REST APIs
- Some ETL experience (how to build ETL pipeline)
- Ability to work in a fast-paced and dynamic environment with tight deadlines
- Experience working collaboratively in a team environment
- B2+ English level
nice to have
- Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)
benefits for locations
Colombia
For you
- Prepaid Medicine with Colsanitas for you and your legal dependents
- MetLife Life Insurance for you
- Thousands of projects for top brands
- Stable income
For your comfortable work
- 100% remote work forever
- Free licensed software
- Possibility to work on your own device (BYOD)
- Stable workload
- Relocation opportunities
- Flexible engagement models
For your growth
- Free trainings for technical and soft skills
- Free access to LinkedIn Learning platform
- Support from a personal Skill Advisor
- Language courses
- Free access to internal and external e-Libraries
- Access to internal communities and competency centers
- Certification opportunities
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
looking for something else?
Find a vacancy that works for you. Send us your CV to receive a personalized offer.