Lead Big Data Engineer remote position | EPAM Anywhere
Back icon

Lead Big Data Engineer for a Business Services Company

Lead Big Data Engineer for a Business Services Company 40 hrs/week, 12+ months

We are currently looking for a remote Lead Big Data Engineer with strong experience with ETL, knowledge of Spark and familiarity with Databricks to join our team.

The customer is a provider of high-quality business services in such areas as IT, Procurement, HR, Product Lifecycle Services, Financial Reporting and Analytics, and Real Estate and Facility Services.

Responsibilities

  • Understand requirements, clarify with BA and data analysts when necessary
    • Automating data ingestion processes
      • Enhance data sets by creating automated match rules
        • Automating data pre-processing, cleansing and verifying the integrity
          • Developing ETL transformations for data from various data sources
            • Working in a feature team of developers and test engineers, deliver results every sprint in accordance with sprint and release plans; report about activities via agreed project tools, timely report about risks/issues/dependencies, apply efforts to resolve and move the work forward

              Requirements

              • 5+ years of hands-on experience in a Data Engineer (or similar) role
                • Strong experience with ETL
                  • Knowledge of Spark
                    • Familiarity with Databricks
                      • Experience with Redshift
                        • S3 knowledge
                          • Knowledge of Python
                            • Experience with SQL
                              • Proficient working in AWS cloud environment
                                • 1+ year of relevant leadership experience

                                  Benefits in eligible locations

                                  location.svg
                                  ImageImage

                                  For you

                                  • Voluntary health insurance for you (100% covered) and your family (with corporate discount)
                                  • Individual sessions with professional psychologists and coaches
                                  • Free corporate sports and wellness programs
                                  • Stable income
                                  • Paid time off
                                  ImageImage

                                  For your comfortable work

                                  • 100% remote work forever
                                  • Free licensed software
                                  • Possibility to work on your own device (BYOD)
                                  • Stable workload
                                  • Relocation opportunities
                                  • Flexible engagement models
                                    ImageImage

                                    For your growth

                                    • Free trainings for technical and soft skills
                                    • Access to LinkedIn Learning platform
                                    • Language courses
                                    • Access to internal and external e-Libraries
                                    • Certification opportunities
                                    • Skill advisory service

                                      40 hrs/week

                                      Hours per week

                                      12+ months

                                      Project length

                                      Belarus, Russia, Ukraine

                                      Locations eligible for the position