Design Lead Big Data Engineer remote vacancies | EPAM Anywhere

Unfortunately, this page is currently not available in English. We are actively working on localization and will update it very soon.

Back icon

Lead Big Data Engineer for a Design Company

Lead Big Data Engineer for a Design Company 40 часов в неделю, 12+ месяцев

Currently, we are looking for a remote Lead Big Data Engineer with 5+ years of Big Data engineering experience, and excessive knowledge of Airflow, Spark (pySpark), and Hive to join our team.

The customer is an American multinational corporation that is engaged in the design, development, manufacturing, and worldwide marketing and sales of footwear, apparel, equipment, accessories, and services.

The team is focused on implementation of ELT processes, preparing Data Marts, optimized for BI/Reporting.

Responsibilities

  • Collaborate with Client's SMEs and help to reverse-engineer existing data flow (Teradata, Informatica) to discover and investigate Data Sources, Data Flow related requirements (NFR, Validation, Ingestion, Consumers etc.)
    • Participate building new Data Platform Foundation as per provided Architecture, Policies and Engineering Standards
      • Understand and implement certain platform capabilities
        • Understand coding standards and implement them within code being developed
          • Design & Implement ELT processes (pySpark, Airflow, Hive).
            • Proactively adopt EngX practices, e.g., Automated Testing, CI/CD etc.
              • Review and Supervise L1/L2 Developers

                Requirements

                • 5+ years of experience in Big Data Engineering
                  • Experience (or excessive knowledge) and descent understanding of Architecture, Usage Patterns, Tuning & Troubleshooting capabilities of Apache Airflow, Apache Spark (pySpark), Apache Hive
                    • Knowledge of Python (or ability to learn it quickly)
                      • Strong Troubleshooting skills; problem-solving mindset
                        • Experience working with CI/CD; understanding and following main principles
                          • Eager to learn; collaboration focused
                            • Strong Team Player; able to prioritize work
                              • Good command of English (B1+)

                                Nice to have

                                • Cloud Experience: AWS
                                  • DevOps experience
                                    Big Data
                                    Python.Core

                                    Бенефиты в поддерживаемых странах

                                    location.svg
                                    ImageImage

                                    Для тебя

                                      • ДМС для тебя и скидки на медицинские услуги для твоей семьи
                                      • Бесплатные сессии с профессиональными психологами и коучами
                                      • Бесплатные спортивные и оздоровительные онлайн-программы
                                      • Стабильный заработок
                                      • Оплачиваемый отпуск
                                    ImageImage

                                    Для твоей комфортной работы

                                    • 100% удаленная работа
                                    • Бесплатный лицензионный софт
                                    • Возможность работать на личном оборудовании (BYOD)
                                    • Стабильная загрузка
                                    • Возможности релокации
                                    • Разные форматы трудоустройства
                                      ImageImage

                                      Для твоего роста

                                      • Бесплатные тренинги по hard и soft skills
                                      • Доступ к LinkedIn Learning платформе
                                      • Курсы иностранных языков
                                      • Доступ к внутренним и внешним электронным библиотекам
                                      • Программа поддержки в сертификации
                                      • Персональный менеджер по карьерному развитию

                                        40 часов в неделю

                                        Нагрузка в неделю

                                        12+ месяцев

                                        Продолжительность проекта

                                        Belarus, Russia, Ukraine

                                        Локации, доступные для позиции