backgo to search

senior big data software engineer for a computer software company

bullets
Data Software Engineering, Big Data
warning.png
Sorry the job is no longer available.

We are currently looking for a remote Senior Big Data Software Engineer with 5+ years of relevant experience in Big Data engineering area to join our team.

The customer is a provider of software as a service and cloud-based remote connectivity services for collaboration, IT management and customer engagement. The company's products give users and administrators access to remote computers.

responsibilities
  • Apply broad knowledge of technology options, technology platforms, design techniques and approaches across the data warehouse lifecycle phases to design an integrated quality solution that address requirements
    • Ensure completeness and compatibility of the technical infrastructure required to support system performance, availability and architecture requirements
      • Design and plan for the integration for all data warehouse technical components
        • Provide input and recommendations on technical issues to the team
          • Develop implementation and operation support plans
            • Provide data design, data extracts and transforms
              • Build robust and scalable data integration (ETL) pipelines using AWS Services, EMR, Python, Pig and Spark
                • Mentor and develop other junior data engineers
                  • Contribute to the high-quality data architecture to support business analysts, data scientists and customer reporting needs
                    • Interface with other technology teams to extract, transform, and load data from a wide variety of data sources
                      requirements
                      • 5+ years of experience in writing complex, highly optimized SQL queries across large data sets
                        • Bachelor's degree in Computer Science
                          • 5+ years of relevant experience in Big Data engineering area
                            • Skills in data modeling, ETL development and data warehousing
                              • Skills with AWS services, including S3, EMR, Kinesis and RDS
                                • Knowledge of big data stack of technologies, including Hadoop, HDFS, Hive, Spark, Pig, Presto
                                  • Experience with using Airflow, creating and maintaining DAGs, Operators and Hooks
                                    • Knowledge of distributed systems as it pertains to data storage and computing
                                      • Good problem solving and analytical skills
                                        • Knowledge of software engineering best practices across the development lifecycle, including Agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
                                          • English level - B1
                                            nice to have
                                            • Master’s degree in Computer Science

                                              These jobs are for you

                                              benefits for locations

                                              india.svg
                                              For you
                                              • Insurance Coverage 
                                              • Paid Leaves – including maternity, bereavement, paternity, and special COVID-19 leaves. 
                                              • Financial assistance for medical crisis 
                                              • Retiral Benefits – VPF and NPS 
                                              • Customized Mindfulness and Wellness programs 
                                              • EPAM Hobby Clubs
                                              For your comfortable work
                                              • Hybrid Work Model 
                                              • Soft loans to set up workspace at home 
                                              • Stable workload 
                                              • Relocation opportunities with ‘EPAM without Borders’ program

                                              For your growth
                                              • Certification trainings for technical and soft skills 
                                              • Access to unlimited LinkedIn Learning platform 
                                              • Access to internal learning programs set up by world class trainers 
                                              • Community networking and idea creation platforms 
                                              • Mentorship programs 
                                              • Self-driven career progression tool

                                              get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
                                              a smiling man wearing sunglasses