backgo to search

senior big data engineer for a design company

Big DataPython.Core
Sorry, the job is expired

Currently, we are looking for a remote Senior Big Data Engineer with 3+ years of Big Data engineering experience, and excessive knowledge of Airflow, Spark (pySpark), and Hive to join our team.

The customer is an American multinational corporation that is engaged in the design, development, manufacturing, and worldwide marketing and sales of footwear, apparel, equipment, accessories, and services.

The team is focused on implementation of ELT processes, preparing Data Marts, optimized for BI/Reporting.

  • Collaborate with Client's SMEs and help to reverse-engineer existing data flow (Teradata, Informatica) to discover and investigate Data Sources, Data Flow related requirements (NFR, Validation, Ingestion, Consumers etc.)
    • Participate building new Data Platform Foundation as per provided Architecture, Policies and Engineering Standards
      • Understand and implement certain platform capabilities
        • Understand coding standards and implement them within code being developed
          • Design & Implement ELT processes (pySpark, Airflow, Hive).
            • Proactively adopt EngX practices, e.g., Automated Testing, CI/CD etc.
              • Review and Supervise L1/L2 Developers
                • 3+ years of experience in Big Data Engineering
                  • Experience (or excessive knowledge) and descent understanding of Architecture, Usage Patterns, Tuning & Troubleshooting capabilities of Apache Airflow, Apache Spark (pySpark), Apache Hive
                    • Knowledge of Python (or ability to learn it quickly)
                      • Strong Troubleshooting skills; problem-solving mindset
                        • Experience working with CI/CD; understanding and following main principles
                          • Eager to learn; collaboration focused
                            • Strong Team Player; able to prioritize work
                              • Good command of English (B1+)
                                nice to have
                                • Cloud Experience: AWS
                                  • DevOps experience

                                    benefits for locations


                                    For you

                                    • Insurance Coverage 
                                    • Paid Leaves – including maternity, bereavement, paternity, and special COVID-19 leaves. 
                                    • Financial assistance for medical crisis 
                                    • Retiral Benefits – VPF and NPS 
                                    • Customized Mindfulness and Wellness programs 
                                    • EPAM Hobby Clubs

                                    For your comfortable work

                                    • Hybrid Work Model 
                                    • Soft loans to set up workspace at home 
                                    • Stable workload 
                                    • Relocation opportunities with ‘EPAM without Borders’ program

                                    For your growth

                                    • Certification trainings for technical and soft skills 
                                    • Access to unlimited LinkedIn Learning platform 
                                    • Access to internal learning programs set up by world class trainers 
                                    • Community networking and idea creation platforms 
                                    • Mentorship programs 
                                    • Self-driven career progression tool

                                    subscribe to EPAM Anywhere vacancies!Hundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
                                    Girl in front of laptop

                                    looking for something else?

                                    Find a vacancy that works for you. Send us your CV to receive a personalized offer.