Senior Big Data Engineer work from home | EPAM Anywhere
Back icon

Senior Big Data Engineer for Data Analytics Company

Senior Big Data Engineer for Data Analytics Company 40 hrs/week, 12+ months

Our customer exposes an API for other businesses to be able to access risks associated with a person, e.g. understand their credit score. Behind the scene there is sophisticated decisioning system and large data volumes. Currently back-end of this API has number of legacy versions, serving hundreds of clients, with individual installations for most clients.

We need to create a data lake for one of the biggest data analytics company working with personal information both domestically and internationally. In a nutshell, this includes replatforming of on-premises Enterprise Data Hub from Hadoop cluster into GCP. Day to day tasks include but not limited to creating spark application which manipulate with data from different sources including Oracle, Google Cloud Storage, BigQuery; creating pipelines via GCP Dataflow; working with Jenkins and AirFlow.

Requirements

  • 5+ years of experience as a Java Developer
    • Proficiency in data engineering
      • Expertise in Big Data: Hadoop, Spark, Kafka
        • Strong knowledge of Scala
          • Expertise in Microservices Architecture
            • Ability to work with high volumes of data
              • Experience in working with AWS
                • Experience in working with GCP: Dataproc (Apache Spark), Dataflow (Apache Beam), BigQuery, Cloud Storage
                  • Good understanding of Design Patterns, Clean Code, Unit testing
                    • Experience working in Agile environment
                      • Data modelling skills would be a plus
                        • Experience in Jenkins, AirFlow with Groovy and Python
                          • Excellent written and verbal communication skills
                            • Intermediate or higher English level, both verbal and written (B1+)

                              We offer

                              • Competitive compensation depending on experience and skills
                                • Work on enterprise-level projects on a long-term basis
                                  • Full-time remote work
                                    • Unlimited access to learning resources (EPAM training courses, English classes, Internal Library)
                                      • Community of 38,000+ industry's top professionals

                                        Benefits in eligible locations

                                        location.svg
                                        ImageImage

                                        For you

                                        • Voluntary health insurance for you (100% covered) and your family (with corporate discount)
                                        • Individual sessions with professional psychologists and coaches
                                        • Free corporate sports and wellness programs
                                        • Stable income
                                        • Paid time off
                                        ImageImage

                                        For your comfortable work

                                        • 100% remote work forever
                                        • Free licensed software
                                        • Possibility to work on your own device (BYOD)
                                        • Stable workload
                                        • Relocation opportunities
                                        • Flexible engagement models
                                          ImageImage

                                          For your growth

                                          • Free trainings for technical and soft skills
                                          • Access to LinkedIn Learning platform
                                          • Language courses
                                          • Access to internal and external e-Libraries
                                          • Certification opportunities
                                          • Skill advisory service

                                            40 hrs/week

                                            Hours per week

                                            12+ months

                                            Project length

                                            Belarus, Russia, Ukraine

                                            Locations eligible for the position