Remote Lead Big Data Engineer vacancy | EPAM Anywhere

This website uses cookies for analytics, personalization and advertising. Click here to learn more or change your cookie settings. By continuing to browse, you agree to our use of cookies.

Back icon

Lead Big Data Engineer for a Design Company

Lead Big Data Engineer for a Design Company 40 hrs/week, 12+ months

Currently, we are looking for a remote Lead Big Data Engineer with 5+ years of Big Data engineering experience, and excessive knowledge of Airflow, Spark (pySpark), and Hive to join our team.

The customer is an American multinational corporation that is engaged in the design, development, manufacturing, and worldwide marketing and sales of footwear, apparel, equipment, accessories, and services.

The team is focused on implementation of ELT processes, preparing Data Marts, optimized for BI/Reporting.

Please note that even though you are applying for this position, you may be offered other projects to join within EPAM Anywhere.

We accept CVs only in English.

Responsibilities

  • Collaborate with Client's SMEs and help to reverse-engineer existing data flow (Teradata, Informatica) to discover and investigate Data Sources, Data Flow related requirements (NFR, Validation, Ingestion, Consumers etc.)
    • Participate building new Data Platform Foundation as per provided Architecture, Policies and Engineering Standards
      • Understand and implement certain platform capabilities
        • Understand coding standards and implement them within code being developed
          • Design & Implement ELT processes (pySpark, Airflow, Hive).
            • Proactively adopt EngX practices, e.g., Automated Testing, CI/CD etc.
              • Review and Supervise L1/L2 Developers

                Requirements

                • 5+ years of experience in Big Data Engineering
                  • Experience (or excessive knowledge) and descent understanding of Architecture, Usage Patterns, Tuning & Troubleshooting capabilities of Apache Airflow, Apache Spark (pySpark), Apache Hive
                    • Knowledge of Python (or ability to learn it quickly)
                      • Strong Troubleshooting skills; problem-solving mindset
                        • Experience working with CI/CD; understanding and following main principles
                          • Eager to learn; collaboration focused
                            • Strong Team Player; able to prioritize work
                              • Good command of English (B1+)

                                Nice to have

                                • Cloud Experience: AWS
                                  • DevOps experience

                                    We offer

                                    • Competitive compensation depending on experience and skills
                                      • Work on enterprise-level projects on a long-term basis
                                        • Full-time remote work
                                          • Unlimited access to learning resources (EPAM training courses, English classes, Internal Library)
                                            • Community of 38,000+ industry's top professionals
                                              Big Data
                                              Python.Core

                                              40 hrs/week

                                              Hours per week

                                              12+ months

                                              Project length

                                              Belarus, Georgia, Kazakhstan, Russia, Ukraine

                                              Locations eligible for the position