backgo to search

lead data engineer

bullets
Data Software Engineering, Amazon Web Services, Apache Airflow, Apache Spark, CI/CD, Python, SQL

We are looking for a passionate remote Lead Data Engineer to join the Customer Success and Support (CSS) Data Engineering team.

In this role, you will be responsible for building world-class data solutions and applications that power crucial decisions throughout the organization. You should be someone who is excited about building services that scale.

responsibilities
  • Build tables and datamarts with separate data models for analytics purposes, working in sprints. Data Scientists will give requirements by the end of the quarter, with ad-hoc requests as needed (on-call support is expected)
    • Support Data Science teams by building scalable data solutions and applications that enable them to derive insights from large datasets
      • Build ingestion pipelines, and be responsible for supporting and improving existing pipelines
        • Ensure the quality and integrity of data through testing and monitoring of data solutions
          • Publish good documentation to help users understand the information provided
            • Work in collaboration with cross-functional teams to deliver quality solutions on time
              • Provide mentoring to junior team members as needed
                requirements
                • 5+ years of relevant experience in Data Software Engineering
                  • 1+ years of relevant leadership experience
                    • High proficiency in SQL (must-have), with most tasks in Databrick SQL. Experience with DataBricks is a plus and can be trained
                      • Extensive knowledge of Spark and experience with PySpark
                        • Experience with Python and writing on top of Airflow
                          • Experience with data integration and modeling
                            • General knowledge of big data, AWS suite, and Airflow
                              • Some ETL experience, including building ETL pipelines
                                • Experience with data modeling and using REST APIs
                                  • Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)
                                    • Must be a team player with a positive attitude and willingness to learn new technologies on the fly
                                      • Experience with on-call support is preferred
                                        • If you are a self-motivated and skilled data engineer who is passionate about building world-class data solutions, we encourage you to apply
                                          • Strong communication and documentation skills
                                            • B2+ English level

                                              benefits for locations

                                              location.svg
                                              For you
                                              • Prepaid Medicine with Colsanitas for you and your legal dependents 
                                              • MetLife Life Insurance for you 
                                              • Thousands of projects for top brands
                                              • Stable income
                                              For your comfortable work
                                              • 100% remote work forever
                                              • Free licensed software
                                              • Possibility to work on your own device (BYOD)
                                              • Stable workload
                                              • Relocation opportunities
                                              • Flexible engagement models
                                              For your growth
                                              • Free trainings for technical and soft skills
                                              • Free access to LinkedIn Learning platform
                                              • Support from a personal Skill Advisor
                                              • Language courses
                                              • Free access to internal and external e-Libraries
                                              • Access to internal communities and competency centers
                                              • Certification opportunities
                                              get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
                                              Girl in front of laptop
                                              looking for something else?

                                              Find a vacancy that works for you. Send us your CV to receive a personalized offer.