backgo to search

lead big data engineer for a business services company

bullets
Big Data
bullets
India
warning.png
Sorry, the job is expired

We are currently looking for a remote Lead Big Data Engineer with strong experience with ETL, knowledge of Spark and familiarity with Databricks to join our team.

The customer is a provider of high-quality business services in such areas as IT, Procurement, HR, Product Lifecycle Services, Financial Reporting and Analytics, and Real Estate and Facility Services.

responsibilities
  • Understand requirements, clarify with BA and data analysts when necessary
    • Automating data ingestion processes
      • Enhance data sets by creating automated match rules
        • Automating data pre-processing, cleansing and verifying the integrity
          • Developing ETL transformations for data from various data sources
            • Working in a feature team of developers and test engineers, deliver results every sprint in accordance with sprint and release plans; report about activities via agreed project tools, timely report about risks/issues/dependencies, apply efforts to resolve and move the work forward
              requirements
              • 5+ years of hands-on experience in a Data Engineer (or similar) role
                • Strong experience with ETL
                  • Knowledge of Spark
                    • Familiarity with Databricks
                      • Experience with Redshift
                        • S3 knowledge
                          • Knowledge of Python
                            • Experience with SQL
                              • Proficient working in AWS cloud environment
                                • 1+ year of relevant leadership experience
                                  • Proficient English (written and spoken) B2

                                    benefits for locations

                                    location.svg

                                    For you

                                    • Insurance Coverage 
                                    • Paid Leaves – including maternity, bereavement, paternity, and special COVID-19 leaves. 
                                    • Financial assistance for medical crisis 
                                    • Retiral Benefits – VPF and NPS 
                                    • Customized Mindfulness and Wellness programs 
                                    • EPAM Hobby Clubs

                                    For your comfortable work

                                    • Hybrid Work Model 
                                    • Soft loans to set up workspace at home 
                                    • Stable workload 
                                    • Relocation opportunities with ‘EPAM without Borders’ program

                                    For your growth

                                    • Certification trainings for technical and soft skills 
                                    • Access to unlimited LinkedIn Learning platform 
                                    • Access to internal learning programs set up by world class trainers 
                                    • Community networking and idea creation platforms 
                                    • Mentorship programs 
                                    • Self-driven career progression tool

                                    subscribe to EPAM Anywhere vacancies!Hundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
                                    Girl in front of laptop

                                    looking for something else?

                                    Find a vacancy that works for you. Send us your CV to receive a personalized offer.