backgo to search

lead big data software engineer for a multinational retail company

We are currently looking for a remote Lead Big Data Software Engineer with extensive experience in running, using and troubleshooting industry standard data technologies such as Spark, HDFS, Cassandra, Kafka to join our team.

The customer is an American multinational retail corporation that operates a chain of hypermarkets, discount department stores, and grocery stores.

In this role you will utilize industry best technologies and practices to enable analysis, intelligence, and processing of some of the largest datasets.

responsibilities
  • Collaborate with product owners and team leads to identify, design, and implement new features to support the growing real time data needs of the customer
    • Identify and suggest or implement remediation of cases where we diverge from industry best practices
      • Evangelize and practice an extremely high standard of code quality, system reliability, and performance to ensure SLAs are met for uptime, data freshness, data correctness, and quality
        • Display sense of ownership over assigned work, requiring minimal direction and driving to completion in a sometimes fuzzy and uncharted environment
          • Focus on enabling developers and analysts through self-service and automated tooling, rather than manual requests and acting as a gatekeeper
            • Participate in on-call rotation, including continuously seeking to reduce noise, improve monitoring coverage, and improve quality-of-life for on-call engineers
              requirements
              • Extensive experience in running, using and troubleshooting industry standard data technologies such as Spark, HDFS, Cassandra, Kafka
                • Deep development experience, ideally in Scala but we are open to other experience if you’re willing to learn the languages we use
                  • Bash, Python, Ruby proficient scripting skills
                    • Hands-on experience processing large amounts of structured and unstructured data in streaming and batch
                      • Extensive experience with cloud infrastructure (preferably Azure, but any other is also welcomed)
                        • Have focus on automation and providing leverage-based solutions to enable sustainable and scalable growth in an ever-changing ecosystem
                          • Passion for Operational Excellence and SRE/DevOps mindset, including an eye for monitoring, alerting, self-healing, and automation
                            • Experience in an Agile environment
                              • Ability to manage scope and iterate quickly to consistently deliver value to the customer
                                • 1+ year of relevant leadership experience
                                  • English level - B2
                                    nice to have
                                    • Experience building and maintaining a centralized platform or services

                                      benefits for locations

                                      location.svg

                                      For you

                                      • Paid time off
                                      • Paid sick leave days
                                      • Stable income
                                      • Meal and home office compensation

                                      For your comfortable work

                                      • 100% remote work 
                                      • Hybrid work opportunities
                                      • Free licensed software
                                      • Possibility to work on your own device (BYOD)
                                      • Stable workload
                                      • Relocation opportunities
                                      • Flexible engagement models

                                      For your growth

                                      • Free trainings for technical and soft skills
                                      • Free access to LinkedIn Learning platform
                                      • Free access to internal and external e-Libraries
                                      • Certification opportunities
                                      • Skill advisory service
                                      • Language courses
                                      subscribe to EPAM Anywhere vacancies!Hundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
                                      Girl in front of laptop

                                      looking for something else?

                                      Find a vacancy that works for you. Send us your CV to receive a personalized offer.