Remote Senior Big Data DevOps work | EPAM Anywhere
Back icon

Senior Big Data DevOps Engineer

Senior Big Data DevOps Engineer 40 hrs/week, 12+ months

We’re looking for a remote Senior Big Data DevOps who will be responsible for developing and maintaining the development operations environment for one of our projects.

You will work on continuous integration process improvements to make deploys consistently successful, fast, simpler to maintain as well as streamlining/automating content migration from Prod to DEV/QA environments. This is a great opportunity to join early and influence the technology selection, design, and have ownership of the infrastructure.

Responsibilities

  • Design, build and maintain highly available production systems
    • Integrate solutions with other applications and platforms outside the framework
      • Provide consulting services to application teams looking to build Cloud-based applications
        • Design and implement build, deployment, and configuration management systems
          • Analyze, organize, and provide in-depth code reviews to improve applications dynamically and ensure the timely completion of projectsPerform script updates due to changes in requirements or implementations
            • Design, implement and improve monitoring and alerting system
              • Troubleshoot production issues and coordinate with the development team to streamline code deployment
                • Optimize system performance, availability and scalability
                  • Assist in production support
                    • Collaborate with team members to improve developed tools, systems and procedures, and data security
                      • Brainstorm for new ideas and ways to improve development delivery
                        • Create Infrastructure diagrams
                          • Create Procedures and Plocies
                            • Manage the Data DevOPs team
                              • Write the project documentation and conduct knowledge transfers

                                Requirements

                                • 6+ years of professional experience
                                  • 4+ years hands-on experience with a variety of Amazon AWS services
                                    • Intermediate skill in one cloud platform: GCP, Azure
                                      • Solid Linux/Unix systems administration background
                                        • General network administration related knowledge and skills
                                          • Expert in infrastructure troubleshooting, performance tuning, optimization and bottleneck problem analysis
                                            • 3 years of hands-on experience with Python
                                              • 3 years of hands-on experience in one scripting language: Bash, Perl, Groovy;Expert in Hadoop HDFS and YARN
                                                • Advanced skill in one of Hadoop distributions(Cloudera, Hortonworks)
                                                  • Advanced skill in Hadoop managing tools(Ambari, Cloudera Manager)
                                                    • Advanced skill in HUE, Hive, Spark
                                                      • Advanced skill in Hadoop Security;Expert in Kafka
                                                        • Advanced skill in ElasticSearch
                                                          • Solid experience in managing production infrastructure with Terraform, AWS CloudFormation, etc.
                                                            • Expert in one configuration management tool: Chef, Puppet, Ansible or similar
                                                              • Advanced skill in one build automation tool: Jenkins, TeamCity, Bamboo, GoCD, etc.
                                                                • Solid knowledge of Monitoring Best Practices
                                                                  • Advanced skill in one monitoring tool and dashboard: Zabbix, Nagios, DataDog, Prometheus, Grafana, etc.
                                                                    • Solid knowledge of Security Best Practices;Expert in one Authentication and Authorization protocols: LDAP, Kerberos, SAML, etc.
                                                                      • Solid organizational, analytical and problem solving skills
                                                                        • Ability to present and communicate the architecture in a visual form
                                                                          • English language – ability to direct communicate with customer. B2+ level is required
                                                                            • Bachelor’s degree in Computer Science or a related technical field, or equivalent work experience

                                                                              Nice to have

                                                                              • Operating Systems: Debian/Ubuntu, RedHat/Centos, Windows

                                                                                Benefits in eligible locations

                                                                                location.svg
                                                                                ImageImage

                                                                                For you

                                                                                • Voluntary health insurance for you (100% covered) and your family (with corporate discount)
                                                                                • Individual sessions with professional psychologists and coaches
                                                                                • Free corporate sports and wellness programs
                                                                                • Stable income
                                                                                • Paid time off
                                                                                ImageImage

                                                                                For your comfortable work

                                                                                • 100% remote work forever
                                                                                • Free licensed software
                                                                                • Possibility to work on your own device (BYOD)
                                                                                • Stable workload
                                                                                • Relocation opportunities
                                                                                • Flexible engagement models
                                                                                  ImageImage

                                                                                  For your growth

                                                                                  • Free trainings for technical and soft skills
                                                                                  • Access to LinkedIn Learning platform
                                                                                  • Language courses
                                                                                  • Access to internal and external e-Libraries
                                                                                  • Certification opportunities
                                                                                  • Skill advisory service

                                                                                    40 hrs/week

                                                                                    Hours per week

                                                                                    12+ months

                                                                                    Project length

                                                                                    Belarus, Russia, Ukraine

                                                                                    Locations eligible for the position