go to searchlead data software engineer
Lead Data Software Engineer
We are in search of a skilled Lead Data Software Engineer for a remote position, ready to contribute to our team's success and bolster our Data Science endeavors.
As the Lead Data Software Engineer, you'll be instrumental in crafting and sustaining datamarts, ensuring the delivery of efficient and scalable data solutions that meet the unique needs of our clients.
Your primary focus will revolve around constructing and maintaining data pipelines, offering on-call support, and fostering collaboration with Data Science teams to deliver top-tier solutions. Additionally, you'll be tasked with steering a group of proficient professionals, providing mentorship and guidance to empower them to produce cutting-edge solutions for the industry.
responsibilities
- Guide and nurture the Data Software Engineering team, cultivating a culture of continual learning and growth within the unit
- Collaborate with interdisciplinary teams to furnish top-notch data solutions aligning with project objectives and timelines
- Forge and uphold robust Data Software Engineering processes and practices emphasizing automation, innovation, and efficiency
- Ensure the realization and upkeep of streamlined and scalable data solutions utilizing AWS services
- Supervise the fine-tuning of data processing and workflow management through Apache Airflow and Apache Spark
- Consistently assess industry trends and best practices to enhance and implement the most potent Data Software Engineering strategies
- Provide on-call assistance for data pipelines and datamarts
- Direct the team in crafting and deploying REST APIs for seamless data integration and communication
- Engage directly with clients to comprehend their requirements and deliver tailored, effective solutions
- Steer the organization and structure of the team, guaranteeing the prompt and efficient delivery of projects
- Collaborate with stakeholders, showcasing excellent communication and leadership skills
requirements
- A minimum of 5 years of experience as a Data Software Engineer, engaged in substantial projects and intricate data infrastructures
- At least 1 year of confirmed leadership experience, adeptly managing and motivating a team of Data Software Engineers
- Proficiency in Amazon Web Services, encompassing the design and implementation of scalable and effective data solutions
- Substantial expertise in Apache Airflow and Apache Spark, ensuring streamlined data processing and workflow management
- Advanced familiarity with at least one CI/CD tool, preferably Jenkins, for the efficient delivery of data pipelines
- Proficiency in Python and SQL, facilitating the creation and upkeep of data pipelines and ETL processes
- Experience with Databricks and PySpark for data processing and analysis
- Acquaintance with REST APIs for seamless data integration and communication
- Robust analytical skills, empowering adept problem-solving and decision-making in intricate environments
- Effective client-facing skills, facilitating clear communication and collaboration to attain project objectives
- Exceptional organizational and structuring abilities, championing the efficient delivery of projects
- Upper-intermediate proficiency in the English language, enabling clear collaboration, presentation, and discussion with the team and stakeholders
nice to have
- Background with Redshift for data warehousing and analysis
benefits for locations
India
For you
- Insurance Coverage
- Paid Leaves – including maternity, bereavement, paternity, and special COVID-19 leaves.
- Financial assistance for medical crisis
- Retiral Benefits – VPF and NPS
- Customized Mindfulness and Wellness programs
- EPAM Hobby Clubs
For your comfortable work
- Hybrid Work Model
- Soft loans to set up workspace at home
- Stable workload
- Relocation opportunities with ‘EPAM without Borders’ program
For your growth
- Certification trainings for technical and soft skills
- Access to unlimited LinkedIn Learning platform
- Access to internal learning programs set up by world class trainers
- Community networking and idea creation platforms
- Mentorship programs
- Self-driven career progression tool
don't have time? Apply later!We send you a link to the job in your e-mail
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
