backgo to search

lead data engineer

bullets
Data Software Engineering, Python, Amazon Web Services, Databricks, Apache Spark, CI/CD, SQL, Terraform, Amazon Redshift, Apache Kafka, Agile
warning.png
Sorry the job is no longer available.

We are in search of a dynamic remote Lead Data Engineer to join our Corporate Data Engineering team. In this role, you will spearhead the development of cutting-edge data solutions and applications that empower crucial business decisions organization-wide. If you are a forward-thinking and structured thinker with a passion for scalable system development, we invite you to apply and be a key player in shaping our data engineering initiatives.

responsibilities
  • Lead the design, development, and implementation of world-class data solutions and applications, ensuring scalability and high performance
    • Collaborate closely with cross-functional teams to understand business requirements and translate them into innovative data engineering strategies
      • Provide mentorship and guidance to the data engineering team, fostering professional growth and knowledge sharing
        • Oversee end-to-end data pipeline development, from data ingestion to transformation and storage
          • Establish and enforce best practices for data engineering, ensuring data quality, security, and compliance
            • Contribute to the continuous improvement of data engineering processes by adopting Agile methodologies and driving CI/CD
              requirements
              • Minimum of 5 years of relevant experience in Data Engineering or a similar role, showcasing expertise in building and optimizing data solutions
                • At least 1 year of direct leadership and team management experience, demonstrating the ability to lead and inspire a technical team
                  • Proficiency in Python for the development of efficient and scalable data solutions
                    • Strong familiarity with AWS, utilizing cloud resources to optimize data processing and storage
                      • Experience with data warehousing solutions like Amazon Redshift or Snowflake
                        • Expertise in Databricks, contributing to efficient data processing and analysis
                          • Proficiency in either Apache Spark or Hive for large-scale data processing and analysis
                            • Knowledge of streaming data processing technologies like Apache Kafka or Apache Flink
                              • Familiarity with CI/CD practices, promoting efficient and reliable software development processes
                                • Proficiency in SQL for effective data querying and manipulation
                                  • Experience with Terraform, enhancing the ability to manage and automate infrastructure
                                    • Strong understanding of Agile methodologies, enabling collaborative work within dynamic teams
                                      • Fluent English communication skills at a B2+ level, facilitating effective collaboration and communication
                                        nice to have
                                        • Familiarity with containerization and orchestration tools such as Docker and Kubernetes
                                          • Understanding of machine learning concepts and their integration into data engineering pipelines

                                            These jobs are for you

                                            benefits for locations

                                            india.svg
                                            For you
                                            • Insurance Coverage 
                                            • Paid Leaves – including maternity, bereavement, paternity, and special COVID-19 leaves. 
                                            • Financial assistance for medical crisis 
                                            • Retiral Benefits – VPF and NPS 
                                            • Customized Mindfulness and Wellness programs 
                                            • EPAM Hobby Clubs
                                            For your comfortable work
                                            • Hybrid Work Model 
                                            • Soft loans to set up workspace at home 
                                            • Stable workload 
                                            • Relocation opportunities with ‘EPAM without Borders’ program

                                            For your growth
                                            • Certification trainings for technical and soft skills 
                                            • Access to unlimited LinkedIn Learning platform 
                                            • Access to internal learning programs set up by world class trainers 
                                            • Community networking and idea creation platforms 
                                            • Mentorship programs 
                                            • Self-driven career progression tool

                                            get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
                                            a smiling man wearing sunglasses