backgo to search

lead data software engineer

bullets
Data Software Engineering, Amazon Web Services, Apache Airflow, Apache Spark, CI/CD, Python, SQL
warning.png
Sorry the job is no longer available.

We are in search of a highly skilled Lead Data Software Engineer to join our team remotely, contributing valuable support to our Data Science teams.

As the Lead Data Software Engineer, you'll assume a pivotal role in crafting and sustaining datamarts, ensuring the delivery of effective and scalable data solutions tailored to our clients' needs.

Your primary focus involves constructing and managing data pipelines, delivering on-call assistance, and fostering collaborative efforts with Data Science teams to achieve top-notch solutions. Additionally, you'll lead a team of adept professionals, providing mentorship and direction to empower them in delivering cutting-edge solutions.

responsibilities
  • Lead and nurture the Data Software Engineering team, cultivating a culture of continuous learning and growth within the group
    • Collaborate with diverse teams to produce top-tier data solutions aligned with project objectives and timelines
      • Forge and sustain efficient Data Software Engineering processes and practices, emphasizing automation, innovation, and efficiency
        • Ensure the establishment and upkeep of effective, scalable data solutions utilizing AWS services
          • Supervise the enhancement of data processing and workflow management through Apache Airflow and Apache Spark
            • Regularly assess industry trends and best practices, refining and implementing optimal Data Software Engineering strategies
              • Offer on-call support for data pipelines and datamarts
                • Direct the team in developing and deploying REST APIs for seamless data integration and communication
                  • Engage directly with clients to comprehend their requirements and deliver tailored, effective solutions
                    • Manage the organization and structure of the team, guaranteeing the prompt and efficient delivery of projects
                      • Collaborate with stakeholders, showcasing exceptional communication and leadership skills
                        requirements
                        • A minimum of 5 years' experience as a Data Software Engineer, having worked on large-scale projects with intricate data infrastructures
                          • At least 1 year of demonstrable leadership experience, effectively managing and motivating a team of Data Software Engineers
                            • Expertise in Amazon Web Services, including designing and implementing scalable, efficient data solutions
                              • Robust experience in Apache Airflow and Apache Spark, ensuring streamlined data processing and workflow management
                                • Advanced proficiency with at least one CI/CD tool, preferably Jenkins, for the efficient delivery of data pipelines
                                  • Fluency in Python and SQL, involved in developing and maintaining data pipelines and ETL processes
                                    • Familiarity with Databricks and PySpark for data processing and analysis
                                      • Knowledge of REST APIs for seamless data integration and communication
                                        • Strong analytical skills for effective problem-solving and decision-making in complex environments
                                          • Exceptional client-facing skills, promoting clear communication and collaboration to meet project objectives
                                            • Outstanding organizational and structuring abilities, facilitating the efficient delivery of projects
                                              • Upper-intermediate proficiency in the English language, enabling clear collaboration, presentation, and discussion with the team and stakeholders
                                                nice to have
                                                • Hands-on experience with Redshift for data warehousing and analysis

                                                  These jobs are for you

                                                  benefits for locations

                                                  india.svg
                                                  For you
                                                  • Insurance Coverage 
                                                  • Paid Leaves – including maternity, bereavement, paternity, and special COVID-19 leaves. 
                                                  • Financial assistance for medical crisis 
                                                  • Retiral Benefits – VPF and NPS 
                                                  • Customized Mindfulness and Wellness programs 
                                                  • EPAM Hobby Clubs
                                                  For your comfortable work
                                                  • Hybrid Work Model 
                                                  • Soft loans to set up workspace at home 
                                                  • Stable workload 
                                                  • Relocation opportunities with ‘EPAM without Borders’ program

                                                  For your growth
                                                  • Certification trainings for technical and soft skills 
                                                  • Access to unlimited LinkedIn Learning platform 
                                                  • Access to internal learning programs set up by world class trainers 
                                                  • Community networking and idea creation platforms 
                                                  • Mentorship programs 
                                                  • Self-driven career progression tool

                                                  get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
                                                  a smiling man wearing sunglasses