Lead Big Data Engineer for a Business Services Provider

Currently, we are looking for a remote Lead Big Data Engineer with 5+ years of experience in software development with Big Data technologies and SQL skills to join our global team.

The customer is a provider of high-quality business services in such areas as IT, Procurement, HR, Product Lifecycle Services, Financial Reporting and Analytics, and Real Estate and Facility Services.

Please note that even though you are applying for this position, you may be offered other projects to join within EPAM Anywhere.

Responsibilities

• Develop ETL transformations for data from various data sources (IQUVIA, SCOUT, SAP, unstructured files)
• Automate data pre-processing, cleansing and verifying the integrity
• Automate data ingestion processes
• Enhance data sets by creating automated match rules
• Understand client requirements, clarify with BA and data analysts when necessary
• Working in a feature team of developers and test engineers, deliver results every sprint in accordance with sprint and release plans
• Report activities via agreed project tools, timely report about risks/issues/dependencies, apply efforts to resolve and move the work forward

Requirements

• 5+ years of experience in software development with Big Data technologies
• 1+ years of relevant leadership experience
• Strong skills in Big Data – ETL, Spark, DataBricks, Redshift, S3, Python, SQL
• Ability to work independently as well as in a team of professionals, that may include not only EPAM colleagues, but also client’s engineers and managers as well as third-party vendors
• Proficiency working in AWS cloud environment

We offer

• Competitive compensation depending on experience and skills
• Work on enterprise-level projects on a long-term basis
• Full-time remote work
• Unlimited access to learning resources (EPAM training courses, English classes, Internal Library)
• Community of 38,000+ industry's top professionals