Senior Big Data Developer (Scala) remote vacancies | EPAM Anywhere
Back icon

Senior Big Data Developer (Scala) for Retail Project

Senior Big Data Developer (Scala) for Retail Project 40 hrs/week, 12+ months
Error.svg
Sorry, the job is expired

As a remote Senior Big Data Developer (Scala), you will live on the front lines of the products we create, and build features used by millions of people every day.

Our customer is one of the biggest multi-brand online retailers in the UK. It is our long-playing customer and now they aim to enhance the use of its existing data by improving its storage capabilities and accessibility. The goal of the project is to build a system from the scratch based on Data Lake architecture with Query Layer which provides the ability for multiple data consumer systems to query data from the lake. An additional challenge in Query Layer design is to make it auto-scalable to handle peaks in demand with high uptime percentage as for HA characteristic.

Project technologies and tools

  • AWS Services - EMR, S3, Lambda, EC2, RDS, CloudFormation, etc.
    • Hortonworks Data Platform (HDP)
      • Hive
        • Spark, Spark Streaming
          • Yarn
            • Apache Knox
              • Kafka
                • Scala as programming language

                  Requirements

                  • 3+ years of experience with Big Data stack: Spark, Hive, HDFS
                    • Basic Scala knowledge
                      • Experience with AWS Cloud services
                        • Knowledge of Linux will be a plus
                          • Knowledge of scripting will be a plus
                            • Excellent communication skills, team player
                              • English level: Intermediate+ (B1+)

                                Benefits in eligible locations

                                location.svg
                                ImageImage

                                For you

                                • Voluntary health insurance for you (100% covered) and your family (with corporate discount)
                                • Individual sessions with professional psychologists and coaches
                                • Free corporate sports and wellness programs
                                • Stable income
                                • Paid time off
                                ImageImage

                                For your comfortable work

                                • 100% remote work forever
                                • Free licensed software
                                • Possibility to work on your own device (BYOD)
                                • Stable workload
                                • Relocation opportunities
                                • Flexible engagement models
                                  ImageImage

                                  For your growth

                                  • Free trainings for technical and soft skills
                                  • Access to LinkedIn Learning platform
                                  • Language courses
                                  • Access to internal and external e-Libraries
                                  • Certification opportunities
                                  • Skill advisory service

                                    40 hrs/week

                                    Hours per week

                                    12+ months

                                    Project length

                                    Belarus, Russia, Ukraine

                                    Locations eligible for the position