Lead Big Data Engineer remote vacancies | EPAM Anywhere
Back icon

Lead Big Data Engineer for a Multinational Retail Company

Lead Big Data Engineer for a Multinational Retail Company 40 hrs/week, 12+ months
Error.svg
Sorry, the job is expired

We are currently looking for a remote Lead Big Data Engineer with experience in running, using and troubleshooting industry standard data technologies such as Spark, HDFS, Cassandra, Kafka to join our team.

The customer is an American multinational retail corporation that operates a chain of hypermarkets, discount department stores, and grocery stores.

This role will be responsible for utilizing industry best technologies and practices to enable analysis, intelligence, and processing of some of the largest datasets. As a Lead Big Data Engineer, this role will be counted on to have a deep understanding of technology internals in order to tune and troubleshoot individual jobs, as well as a high-level understanding of the landscape to drive value-adding features to the platform.

Responsibilities

  • Collaborate with Product Owners and Team Leads to identify, design, and implement new features to support the growing real time data needs of the customer
    • Assist and mentor Junior Engineers in troubleshooting and tuning of high volume, distributed applications, primarily on Spark
      • Identify and suggest or implement remediation of cases where we diverge from industry best practices
        • Evangelize and practice an extremely high standard of code quality, system reliability, and performance to ensure SLAs are met for uptime, data freshness, data correctness, and quality
          • Display sense of ownership over assigned work, requiring minimal direction and driving to completion in a sometimes fuzzy and uncharted environment
            • Focus on enabling developers and analysts through self-service and automated tooling, rather than manual requests and acting as a gatekeeper
              • Participate in on-call rotation, including continuously seeking to reduce noise, improve monitoring coverage, and improve quality-of-life for on-call engineers

                Requirements

                • Experience in running, using and troubleshooting industry standard data technologies such as Spark, HDFS, Cassandra, Kafka
                  • Deep development experience, ideally in Scala but we are open to other experience if you’re willing to learn the languages we use
                    • Proficient scripting skills i.e. Bash, Python, Ruby
                      • Experience processing large amounts of structured and unstructured data in streaming and batch
                        • Experience with cloud infrastructure. We use Azure, specifically, but any will do
                          • A focus on automation and providing leverage-based solutions to enable sustainable and scalable growth in an ever-changing ecosystem
                            • Experience building and maintaining a centralized platform or services, to be consumed by other teams, is ideal, but not necessary
                              • A passion for Operational Excellence and SRE/DevOps mindset, including an eye for monitoring, alerting, self-healing, and automation
                                • Experience in an Agile environment, able to manage scope and iterate quickly to consistently deliver value to the customer
                                  • 1+ year of relevant leadership experience

                                    Benefits in eligible locations

                                    location.svg
                                    ImageImage

                                    For you

                                    • Voluntary health insurance for you (100% covered) and your family (with corporate discount)
                                    • Individual sessions with professional psychologists and coaches
                                    • Free corporate sports and wellness programs
                                    • Stable income
                                    • Paid time off
                                    ImageImage

                                    For your comfortable work

                                    • 100% remote work forever
                                    • Free licensed software
                                    • Possibility to work on your own device (BYOD)
                                    • Stable workload
                                    • Relocation opportunities
                                    • Flexible engagement models
                                      ImageImage

                                      For your growth

                                      • Free trainings for technical and soft skills
                                      • Access to LinkedIn Learning platform
                                      • Language courses
                                      • Access to internal and external e-Libraries
                                      • Certification opportunities
                                      • Skill advisory service

                                        40 hrs/week

                                        Hours per week

                                        12+ months

                                        Project length

                                        Belarus, Russia, Ukraine

                                        Locations eligible for the position