Lead DevOps with Big Data expertise

Currently we are looking for a remote Lead DevOps (Big Data) to make the team even stronger.

We are seeking an experienced Architect/Developer for the implementation of a complex cloud solution (Data Governance Tool, Metadata Catalog of the Data Lake objects) using Amazon Web Services (AWS).

Project description

Design and development of Data Lake infrastructure including:
•Governance tool to access data;
•Data Lake Catalog with metadata;
•Crawler to search and categorize data in file-based and relational table-based stores.

Welcome to our enthusiastic team with an awesome working atmosphere!

Please note that even though you are applying for this position, you still can be offered other projects to join within EPAM Anywhere.

Responsibilities

• Analysis and design of IT concepts
• Technical implementation of those based on the Amazon Web Services (AWS)
• Participation in the creParticipation in the creation and validation of new solutions and their coordination with IT Architects ation and validation of new solutions and their coordination with IT Architects

Requirements

• 5+ years of experience in requirements engineering, solution architecture, design, development, deployment and maintenance
• Development and operation of applications with / in AWS Operation of cloud-based databases based on AWS (S3, RDS, Redshift, Lambda, IAM). Experience with AWS Glue Data Catalog, AWS Macie would be a bonus
• Experience in Business Intelligence or Big Data projects (platform, data, etc.), as well as in the environment of Big Data technologies like Kafka, Storm, Hadoop, Hive, Spark, HBase, etc
• English level: Upper-Intermediate+ (B2+)

We offer

• Competitive compensation depending on experience and skills
• Work on enterprise-level projects on a long-term basis
• Full-time remote work
• Unlimited access to learning resources (EPAM training courses, English classes, Internal Library)
• Community of 38,000+ industry's top professionals