Remote Lead Big Data Software Engineer job in Tech | EPAM Anywhere
Back icon

Lead Big Data Software Engineer for a Computer Software Company

Lead Big Data Software Engineer for a Computer Software Company 40 hrs/week, 12+ months

We are currently looking for a remote Lead Big Data Software Engineer with 7+ years of relevant experience in Big Data engineering area to join our team.

The customer is a provider of software as a service and cloud-based remote connectivity services for collaboration, IT management and customer engagement. The company's products give users and administrators access to remote computers.

Responsibilities

  • Apply broad knowledge of technology options, technology platforms, design techniques and approaches across the data warehouse lifecycle phases to design an integrated quality solution that address requirements
    • Ensure completeness and compatibility of the technical infrastructure required to support system performance, availability and architecture requirements
      • Design and plan for the integration for all data warehouse technical components
        • Provide input and recommendations on technical issues to the team
          • Develop implementation and operation support plans
            • Provide data design, data extracts and transforms
              • Build robust and scalable data integration (ETL) pipelines using AWS Services, EMR, Python, Pig and Spark
                • Mentor and develop other junior data engineers
                  • Contribute to the high-quality data architecture to support business analysts, data scientists and customer reporting needs
                    • Interface with other technology teams to extract, transform, and load data from a wide variety of data sources

                      Requirements

                      • 7+ years of hands-on experience in writing complex, highly optimized SQL queries across large data sets
                        • Bachelor's degree in Computer Science
                          • 7+ years of relevant experience in Big Data engineering area
                            • Demonstrated strength in data modeling, ETL development and data warehousing
                              • Solid skills with AWS services, including S3, EMR, Kinesis and RDS
                                • Familiarity with big data stack of technologies, including Hadoop, HDFS, Hive, Spark, Pig, Presto
                                  • Experience with using Airflow, creating and maintaining DAGs, Operators and Hooks
                                    • Knowledge of distributed systems as it pertains to data storage and computing
                                      • Exceptional problem solving and analytical skills
                                        • Knowledge of software engineering best practices across the development lifecycle, including Agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
                                          • 1+ year of relevant leadership experience
                                            • English level - B1

                                              Nice to have

                                              • Master’s degree in Computer Science

                                                Benefits in eligible locations

                                                location.svg
                                                ImageImage

                                                For you

                                                • Voluntary health insurance for you (100% covered) and your family (with corporate discount)
                                                • Individual sessions with professional psychologists and coaches
                                                • Free corporate sports and wellness programs
                                                • Stable income
                                                • Paid time off
                                                ImageImage

                                                For your comfortable work

                                                • 100% remote work forever
                                                • Free licensed software
                                                • Possibility to work on your own device (BYOD)
                                                • Stable workload
                                                • Relocation opportunities
                                                • Flexible engagement models
                                                  ImageImage

                                                  For your growth

                                                  • Free trainings for technical and soft skills
                                                  • Access to LinkedIn Learning platform
                                                  • Language courses
                                                  • Access to internal and external e-Libraries
                                                  • Certification opportunities
                                                  • Skill advisory service

                                                    40 hrs/week

                                                    Hours per week

                                                    12+ months

                                                    Project length

                                                    Belarus, Russia, Ukraine

                                                    Locations eligible for the position