backgo to search

lead big data engineer for a video game development company

We are looking for a remote Lead Big Data Engineer with 5+ years of experience in Data Intelligence and Big Data to help build and manage big data streaming technologies.

The customer is an American video game and software developer and publisher, developing commercially available game engine which also powers their internally developed video games.

The main pool of tasks is associated with optimizing our existing streaming services, evaluating new technologies, managing cloud infrastructure, and more. The ingestion pipelines peak at over 90GB per minute.

responsibilities
  • Building and supporting highly available streaming services, written in Java/Scala using Apache Flink
    • Operating and developing applications on distributed NoSQL key-value stores such as HBase, DynamoDB or FoundationDB
      • Managing cloud infrastructure launched in AWS via Terraform
        • Participating in an on-call rotation for Epic Games streaming tech stack
          • Evaluating new technologies and components of the big data ecosystem that are not yet part of our environment
            requirements
            • 5+ years of experience in Data Intelligence and Big Data
              • 1+ years of relevant leadership experience
                • Experience building high throughput Java/Scala streaming services using technologies such as Flink or Spark
                  • Strong understanding of distributed message brokers such as Kafka and Kinesis
                    • Experience with performance tuning of distributed computing technologies at massive scale
                      • Experience working with AWS services such as Kinesis, EC2, EMR, RDS via infrastructure as code technologies
                        • Experience working with high throughput, distributed NoSQL databases
                          • Capable of independently performing root cause analysis on high throughput systems

                            benefits for locations

                            location.svg

                            For you

                            • Paid time off
                            • Paid sick leave days
                            • Stable income
                            • Meal and home office compensation

                            For your comfortable work

                            • 100% remote work 
                            • Hybrid work opportunities
                            • Free licensed software
                            • Possibility to work on your own device (BYOD)
                            • Stable workload
                            • Relocation opportunities
                            • Flexible engagement models

                            For your growth

                            • Free trainings for technical and soft skills
                            • Free access to LinkedIn Learning platform
                            • Free access to internal and external e-Libraries
                            • Certification opportunities
                            • Skill advisory service
                            • Language courses
                            subscribe to EPAM Anywhere vacancies!Hundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
                            Girl in front of laptop

                            looking for something else?

                            Find a vacancy that works for you. Send us your CV to receive a personalized offer.