backgo to search

senior big data software engineer for a software company

We are currently looking for a remote Senior Big Data Engineer with 7+ years of relevant experience in one of the following areas: Big Data Engineering, Datawarehouse, Business Intelligence or Business Analytics to join our team.

The customer is a provider of software as a service and cloud-based remote connectivity services for collaboration, IT management and customer engagement. The company's products give users and administrators access to remote computers.

responsibilities
  • Apply your broad knowledge of technology options, technology platforms, design techniques and approaches across the data warehouse lifecycle phases to design an integrated quality solution that address requirements
    • Ensure completeness and compatibility of the technical infrastructure required to support system performance, availability and architecture requirements
      • Design and plan for the integration for all data warehouse technical components
        • Provide input and recommendations on technical issues to the team
          • Responsible for data design, data extracts and transforms
            • Develop implementation and operation support plans
              • Lead architecture design and implementation of next generation BI solution
                • Build robust and scalable data integration (ETL) pipelines using AWS Services, EMR, Python, PiG and Spark
                  • Mentor and develop other Junior Data Engineers
                    • Build and deliver high quality data architecture to support Business Analysts, Data Scientists and customer reporting needs
                      • Interface with other technology teams to extract, transform, and load data from a wide variety of data sources
                        requirements
                        • Bachelor's degree in Computer Science required; Master’s degree preferred
                          • 7+ years of relevant experience in one of the following areas: Big Data Engineering, Datawarehouse, Business Intelligence or Business Analytics
                            • 7+ years of hands-on experience in writing complex, highly optimized SQL queries across large data sets
                              • Demonstrated strength in data modelling, ETL development, and Data Warehousing
                                • Experience with AWS services including S3, EMR, Kinesis and RDS
                                  • Experience with big data stack of technologies, including Hadoop, HDFS, Hive, Spark, Pig, Presto
                                    • Experience with delivering end-to-end projects independently
                                      • Experience with using AirFlow, creating and maintaining DAGs, Operators, and Hooks
                                        • Knowledge of distributed systems as it pertains to data storage and computing
                                          • Exceptional Problem solving and analytical skills
                                            • Knowledge of software engineering best practices across the development lifecycle; including, Agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
                                              • Proficient English (written and spoken) B2

                                                benefits for locations

                                                location.svg

                                                For you

                                                • Paid time off
                                                • Paid sick leave days
                                                • Medical insurance
                                                • Stable income

                                                For your comfortable work

                                                • 100% remote work forever
                                                • Free licensed software
                                                • Possibility to work on your own device (BYOD)
                                                • Stable workload
                                                • Relocation opportunities
                                                • Flexible engagement models

                                                For your growth

                                                • Free trainings for technical and soft skills
                                                • Free access to LinkedIn Learning platform
                                                • Language courses
                                                • Free access to internal and external e-Libraries
                                                • Certification opportunities
                                                • Skill advisory service
                                                subscribe to EPAM Anywhere vacancies!Hundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
                                                Girl in front of laptop

                                                looking for something else?

                                                Find a vacancy that works for you. Send us your CV to receive a personalized offer.