Remote Lead Big Data Software Engineer | EPAM Anywhere

This website uses cookies for analytics, personalization and advertising. Click here to learn more or change your cookie settings. By continuing to browse, you agree to our use of cookies.

Back icon

Lead Big Data Software Engineer for a Computer Software Company

Lead Big Data Software Engineer for a Computer Software Company 40 hrs/week, 12+ months

We are currently looking for a remote Lead Big Data Software Engineer with 7+ years of relevant experience in Big Data engineering area to join our team.

The customer is a provider of software as a service and cloud-based remote connectivity services for collaboration, IT management and customer engagement. The company's products give users and administrators access to remote computers.

Please note that even though you are applying for this position, you may be offered other projects to join within EPAM Anywhere.

Responsibilities

  • Apply broad knowledge of technology options, technology platforms, design techniques and approaches across the data warehouse lifecycle phases to design an integrated quality solution that address requirements
    • Ensure completeness and compatibility of the technical infrastructure required to support system performance, availability and architecture requirements
      • Design and plan for the integration for all data warehouse technical components
        • Provide input and recommendations on technical issues to the team
          • Develop implementation and operation support plans
            • Provide data design, data extracts and transforms
              • Build robust and scalable data integration (ETL) pipelines using AWS Services, EMR, Python, Pig and Spark
                • Mentor and develop other junior data engineers
                  • Contribute to the high-quality data architecture to support business analysts, data scientists and customer reporting needs
                    • Interface with other technology teams to extract, transform, and load data from a wide variety of data sources

                      Requirements

                      • 7+ years of hands-on experience in writing complex, highly optimized SQL queries across large data sets
                        • Bachelor's degree in Computer Science
                          • 7+ years of relevant experience in Big Data engineering area
                            • Demonstrated strength in data modeling, ETL development and data warehousing
                              • Solid skills with AWS services, including S3, EMR, Kinesis and RDS
                                • Familiarity with big data stack of technologies, including Hadoop, HDFS, Hive, Spark, Pig, Presto
                                  • Experience with using Airflow, creating and maintaining DAGs, Operators and Hooks
                                    • Knowledge of distributed systems as it pertains to data storage and computing
                                      • Exceptional problem solving and analytical skills
                                        • Knowledge of software engineering best practices across the development lifecycle, including Agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
                                          • 1+ year of relevant leadership experience
                                            • English level - B1

                                              Nice to have

                                              • Master’s degree in Computer Science

                                                We offer

                                                • Competitive compensation depending on experience and skills
                                                  • Work on enterprise-level projects on a long-term basis
                                                    • Full-time remote work
                                                      • Unlimited access to learning resources (EPAM training courses, English classes, Internal Library)
                                                        • Community of 38,000+ industry's top professionals
                                                          Big Data

                                                          40 hrs/week

                                                          Hours per week

                                                          12+ months

                                                          Project length

                                                          Belarus, Russia, Ukraine

                                                          Locations eligible for the position