Lead Big Data Engineer remote position | EPAM Anywhere

This website uses cookies for analytics, personalization and advertising. Click here to learn more or change your cookie settings. By continuing to browse, you agree to our use of cookies.

Back icon

Lead Big Data Engineer for a Business Services Company

Lead Big Data Engineer for a Business Services Company 40 hrs/week, 12+ months

We are currently looking for a remote Lead Big Data Engineer with strong experience with ETL, knowledge of Spark and familiarity with Databricks to join our team.

The customer is a provider of high-quality business services in such areas as IT, Procurement, HR, Product Lifecycle Services, Financial Reporting and Analytics, and Real Estate and Facility Services.

Please note that even though you are applying for this position, you may be offered other projects to join within EPAM Anywhere.

Responsibilities

  • Understand requirements, clarify with BA and data analysts when necessary
    • Automating data ingestion processes
      • Enhance data sets by creating automated match rules
        • Automating data pre-processing, cleansing and verifying the integrity
          • Developing ETL transformations for data from various data sources
            • Working in a feature team of developers and test engineers, deliver results every sprint in accordance with sprint and release plans; report about activities via agreed project tools, timely report about risks/issues/dependencies, apply efforts to resolve and move the work forward

              Requirements

              • 5+ years of hands-on experience in a Data Engineer (or similar) role
                • Strong experience with ETL
                  • Knowledge of Spark
                    • Familiarity with Databricks
                      • Experience with Redshift
                        • S3 knowledge
                          • Knowledge of Python
                            • Experience with SQL
                              • Proficient working in AWS cloud environment
                                • 1+ year of relevant leadership experience

                                  We offer

                                  • Competitive compensation depending on experience and skills
                                    • Work on enterprise-level projects on a long-term basis
                                      • Full-time remote work
                                        • Unlimited access to learning resources (EPAM training courses, English classes, Internal Library)
                                          • Community of 38,000+ industry's top professionals
                                            Big Data

                                            40 hrs/week

                                            Hours per week

                                            12+ months

                                            Project length

                                            Belarus, Brazil, Chile, China, Colombia, India, Italy, Russia, Ukraine

                                            Locations eligible for the position