backgo to search

lead big data engineer

Data Software Engineering, Amazon Web Services, SQL, Python, Apache Spark, Apache Airflow, CI/CD

We are seeking a remote Lead Big Data Engineer to join the team, responsible for building world-class data solutions and applications that power crucial decisions throughout our customer's organization.

The ideal candidate should be passionate about building services that scale and have at least 5+ years of work experience in data engineering.

  • Support the Data Science teams by building tables, looking at incoming support tickets, and providing mentorship to existing FTE team
    • Build datamarts, separate data models used for analytics purposes, and work in sprints
      • Handle ad-hoc requests and be available for on-call support
        • Build ingestion pipeline
          • Publish documentation to help people use the information provided
            • Work in a 12/5 support mode
              • 5+ years of relevant work experience in Data Engineering
                • 1+ years of relevant leadership experience
                  • High proficiency in SQL, specifically with Databrick SQL (DataBricks is nice to have, and can be trained)
                    • Extensive knowledge in Spark, Python (PySpark, writing on top of Airflow), and data integration and modeling
                      • General knowledge of Big Data, AWS suite, and Airflow
                        • Experience with data modeling and using REST APIs
                          • Some ETL experience in building ETL pipelines
                            • Excellent communication and documentation skills
                              • Ability to work well in a team environment
                                • Willingness to receive constructive feedback
                                  • Enthusiasm for learning new technology on the fly and adapting to changes
                                    • B2+ English level
                                      nice to have
                                      • Experience working with varied forms of data infrastructure, including relational databases (e.g., SQL), Spark, and column stores (e.g., Redshift)

                                        benefits for locations

                                        For you
                                        • Prepaid Medicine with Colsanitas for you and your legal dependents 
                                        • MetLife Life Insurance for you 
                                        • Thousands of projects for top brands
                                        • Stable income
                                        For your comfortable work
                                        • 100% remote work forever
                                        • Free licensed software
                                        • Possibility to work on your own device (BYOD)
                                        • Stable workload
                                        • Relocation opportunities
                                        • Flexible engagement models
                                        For your growth
                                        • Free trainings for technical and soft skills
                                        • Free access to LinkedIn Learning platform
                                        • Support from a personal Skill Advisor
                                        • Language courses
                                        • Free access to internal and external e-Libraries
                                        • Access to internal communities and competency centers
                                        • Certification opportunities
                                        get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
                                        Girl in front of laptop
                                        looking for something else?

                                        Find a vacancy that works for you. Send us your CV to receive a personalized offer.