Empleos de Big Data Desarrollador

EPAM Anywhere busca Desarrolladores de Big Data

Remuneración competitiva

Respaldamos todos los pagos y operamos de conformidad con las normas laborales específicas de cada país.

Numerosos beneficios

Aprovecha más de 1500 beneficios, en línea y específicos de la ubicación, situados en más de 30 países, que incluyen programas de salud y deportes para ti y tu familia.

Oportunidades ilimitadas de crecimiento profesional

Recibe acceso a un ecosistema de gran escala que consiste en servicios de desarrollo educativo y profesional creados para tu crecimiento. Un asesor personal de habilidades te apoyará en cada paso de este viaje.

senior big data developer

Big Data

Management

40 hrs/week

12+ months

Armenia, Kazakhstan,

and others

Armenia, Georgia, Kazakhstan, Poland, Uzbekistan

Learn more

We’re looking for a Senior Big Data Developer with 5+ years of experience in enterprise software development with solid background in Big Data and distributed computing.

requirements

Engineering experience and practice in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Operation, Security.
Strong experience building data ingestion pipelines (simulating Extract, Transform, Load workload), Data Warehouse or Database architecture.
Strong experience with data modeling; hands-on development experience with modern Big Data components.
Cloud: experience in designing, automation, provisioning, deploying and administering scalable, available and fault tolerant systems.
Solid skills in infrastructure troubleshooting, support and practical experience in performance tuning and optimization, bottleneck problem analysis.
Advanced understanding of distributed computing principles.
Proficient English (written and spoken) B2

technologies

Programming Languages: Java/ Scala
Big Data stack: Hadoop, MapReduce, Spark, Kafka
Queues and Stream processing: Kafka Streams; Flink; Spark Streaming; Storm
ETL & Streaming Pipelines: Pentaho
Version Control Systems (Git)

senior big data devops developer

Data DevOps

Jenkins, Unix, Perl

40 hrs/week

12+ months

Armenia, Kazakhstan,

and others

Armenia, Georgia, Kazakhstan, Uzbekistan

Learn more

We’re looking for a remote Senior Big Data DevOps who will be responsible for developing and maintaining the development operations environment for one of our projects.

You will work on continuous integration process improvements to make deploys consistently successful, fast, and simpler to maintain as well as streamlining/automating content migration from Prod to DEV/QA environments. This is a great opportunity to join early and influence the technology selection, design, and ownership of the infrastructure.

responsibilities

Designing, building and maintaining highly available production systems
Integrating solutions with other applications and platforms outside the framework
Providing consulting services to application teams looking to build Cloud-based applications
Designing and implementing build, deployment, and configuration management systems
Analyzing, organizing, and providing in-depth code reviews to improve applications dynamically and ensure the timely completion of projectsPerform script updates due to changes in requirements or implementations
Designing, implementing and improving monitoring and alerting system
Troubleshooting production issues and coordinating with the development team to streamline code deployment
Optimizing system performance, availability and scalability
Assisting in production support
Collaborating with team members to improve developed tools, systems and procedures, and data security
Brainstorming for new ideas and ways to improve development delivery
Creating Infrastructure diagrams
Creating Procedures and Plocies
Managing the Data DevOPs team
Writing the project documentation and conducting knowledge transfers

requirements

6+ years of professional experience
4+ years hands-on experience with a variety of Amazon AWS services
3 years of hands-on experience in one scripting language: Bash, Perl, Groovy;Expert in Hadoop HDFS and YARN
3 years of hands-on experience with Python
Solid experience in managing production infrastructure with Terraform, AWS CloudFormation, etc.
Intermediate skill in one cloud platform: GCP, Azure
Solid Linux/Unix systems administration background
General network administration related knowledge and skills
Expert in infrastructure troubleshooting, performance tuning, optimization and bottleneck problem analysis
Advanced skill in one of Hadoop distributions(Cloudera, Hortonworks)
Advanced skill in Hadoop managing tools(Ambari, Cloudera Manager)
Advanced skill in HUE, Hive, Spark
Advanced skill in Hadoop Security;Expert in Kafka
Advanced skill in ElasticSearch
Expert in one configuration management tool: Chef, Puppet, Ansible or similar
Advanced skill in one build automation tool: Jenkins, TeamCity, Bamboo, GoCD, etc.
Solid knowledge of Monitoring Best Practices
Advanced skill in one monitoring tool and dashboard: Zabbix, Nagios, DataDog, Prometheus, Grafana, etc.
Solid knowledge of Security Best Practices;Expert in one Authentication and Authorization protocols: LDAP, Kerberos, SAML, etc.
Solid organizational, analytical and problem solving skills
Ability to present and communicate the architecture in a visual form
Bachelor’s degree in Computer Science or a related technical field, or equivalent work experience
English language – ability to direct communicate with customer. B2+ level is required

nice to have

Operating Systems: Debian/Ubuntu, RedHat/Centos, Windows

senior big data developer for retail company

Big Data

Apache Spark, Scala, Machine Learning Model Development

40 hrs/week

12+ months

Armenia, Kazakhstan,

and others

Armenia, Georgia, Kazakhstan, Uzbekistan

Learn more

Currently, we are looking for a remote Senior Big Data Developer to join our team.

responsibilities

Understanding requirements, clarifying with BA and data analysts when necessary
Automating data ingestion processes
Enhancing data sets by creating automated match rules
Automating data pre-processing, cleansing and verifying the integrity
Developing ETL transformations for data from various data sources (IQUVIA, SCOUT, SAP, unstructured files)
Besides the development of predictive models your responsibility is in the entire lifecycle of product development from research investigation to production deployment, monitoring, and evaluation

requirements

3+ years of experience in Data Analytics
Experienced in Scala and Spark
Experience with any cloud is required (preferable GCP)
Experience in Kafka, Airflow, Looker, understanding of ML. Understanding of Hadoop, Hive
Experience in statistical models, logistic regression, and real-time predictions
Less application for deep learning, and NLP solutions
Proficient English (written and spoken) B2

nice to have

Machine Learning Model Development

senior big data developer for a healthcare company

Big Data

Apache Spark, PySpark, Python

40 hrs/week

12+ months

Armenia, Kazakhstan,

and others

Armenia, Georgia, Kazakhstan, Uzbekistan

Learn more

Currently, we are looking for a remote Senior Big Data Developer to join our team.

The customer is a global pharmaceutical research organization that is focused on discovering innovative medicines that cure diseases and improve human health.

responsibilities

Acting as a field expert, leading a team of 2 engineers
Coordinating the activities that support automation of anonymization

requirements

3+ years of experience in Big Data
Experience in Python, PySpark, Java, REST API
Good personal skills in visionary, strategic thinking, problem solving
Excellent communication skills
Knowledge of AWS: S3, EC2, EMR, IAM, KMS, MongoDB, DocumentDB
English level B2+

nice to have

Basic understanding of anonymization
Knowledge of file formats: Parquet/Avro, SAS
Experience in Pharma domain

senior big data developer (scala) for retail project

Big Data

Scala, Linux

40 hrs/week

12+ months

Armenia, Kazakhstan,

and others

Armenia, Georgia, Kazakhstan, Uzbekistan

Learn more

We are looking for a Senior Big Data Developer (Scala) with 3+ years of experience with Big Data stack: Spark, Hive, HDFS, basic Scala knowledge, experience with AWS Cloud services, to join our team remotely.

As a remote Senior Big Data Developer (Scala) , you will live on the front lines of the products we create, and build features used by millions of people every day. Our customer is one of the biggest multi-brand online retailers in the UK. It is our long-playing customer and now they aim to enhance the use of its existing data by improving its storage capabilities and accessibility. The goal of the project is to build a system from the scratch based on Data Lake architecture with Query Layer which provides the ability for multiple data consumer systems to query data from the lake. An additional challenge in Query Layer design is to make it auto-scalable to handle peaks in demand with high uptime percentage as for HA characteristic.

requirements

3+ years of experience with Big Data stack: Spark, Hive, HDFS
Basic Scala knowledge
Experience with AWS Cloud services
Knowledge of Linux will be a plus
Knowledge of scripting will be a plus
Excellent communication skills, team player
English level: Intermediate+ (B1+)

senior big data developer with sql databases experience

Big Data

Microsoft SQL Server, Java, Scala

40 hrs/week

12+ months

Kazakhstan

Learn more

We are looking for a Senior Big Data Developer with 3+ years of experience in Java or Scala, experience in SQL databases, Linux experience, to join our team remotely.

Currently, we are looking for remote Senior Big Data Developer to make the team even stronger. We are looking for people with strive for self-development who are keen on data science and eager to work with Big Data tools and frameworks, SQL databases, and cutting edge technologies.

responsibilities

Work on high-quality architecture and implementation design, collaborating with the customer, system/business analysts and onshore architects

requirements

3+ years of experience in Java or Scala
Experience in SQL databases
Linux experience
English level: Intermediate+ (B1+)

nice to have

Knowledge of AWS, Azure
Experience in Big Data (Hadoop, Spark, Kafka, etc.)
Experience building scalable, high-performance distributed systems, systems that deal with large data volumes, n-tier, client/server, cluster and load balanced architectures, web applications
Experience working in Agile Continuous Integration/DevOps paradigm and toolset (Jira, Git, TDD, Test Automation, Jenkins)
Working experience with scripting languages – Bash, Python, Groovy
Machine learning experience

senior big data developer for a canadian retail company

Data Software Engineering

Data Modeling, Java, Python

40 hrs/week

12+ months

Armenia

Learn more

Currently, we are looking for a Remote Senior Big Data Developer to join our team.

The customer is a Canadian vehicle retailer operating online.

responsibilities

Creating and maintaining scalable, maintainable and reliable pipelines that process large quantities of structured and unstructured data
Unifying streaming and batch processing modes into one cohesive framework of processing including monitoring and alerting that fits into a unified and reliable data platform infrastructure
Participating in the design and implementation of data models as part of modern data lake, data warehouse and ETL/ELT approaches
Building streaming data pipelines that enable the business to engage consumers in real-time
Identifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Regularly reviewing work with/from peers with a goal of improving personal knowledge of the systems, ensuring that code changes meet business goals and technology best practices
Regularly interacting and collaborating with personnel across functions (product, technology, analytics, operations) within the assigned team and technology chapter
Working with stakeholders including the Executive, Product, and Data teams to assist with data-related technical issues and support their data infrastructure needs

requirements

3+ years of experience in Big Data Engineering
Experience with DataOps: improve quality and reduce cycle time of data analytics
Experience working with data that is constantly generated by different data source
Experience with ETL / ELT tools: knowledge and experience of tools to complete ETL / ELT process (e.g. Fivetran, Talend, Airflow, dbt, FlyData, or similar tools)
Excellent problem solving, troubleshooting, and communication skills
Good understanding of ETL / ELT process: collecting data from multiple sources and loading it into a centralized data warehouse
Knowledge of data pipeline management: ensure consistent and reliable data, monitoring for failures
Deep understanding of data modeling: creating a visual representation of an information system, defining and analyzing data requirements
Familiarity with Query optimization: analyzing queries and choosing the most efficient means to execute SQL
Knowledge of API design: handling dependencies, 3rd party integration, versioning
Programming experience: Python, Java, Scala, etc.
Knowledge of cloud data warehouse: snowflake, AWS
B2+ level of English

nice to have

Demonstrated ability to design and write maintainable software
Understanding of software engineering best practices, object oriented analysis & design, and design patterns & algorithms

senior big data developer for a beauty products manufacturer

Big Data

Microsoft SQL Server, Scala, SQL

40 hrs/week

12+ months

Armenia, Georgia, Kazakhstan

Learn more

We are looking for a Senior Big Data Engineer with 3+ years' experience, good knowledge of Scala, expertise in SQL, and an understanding of data platform concepts in Cloud environments to join our team remotely.

Currently, we are looking for a remote Senior Big Data Developer , who has strong experience in implementing data pipelines (both real-time and batch) using Spark. Our Customer is an American multinational manufacturer and marketer of prestige skincare, makeup, fragrance and hair care products, based in Midtown Manhattan, New York City. The company owns a diverse portfolio of brands, distributed internationally through both digital commerce and retail channels.

requirements

3+ years of commercial experience
Good knowledge of Scala
Experience in SQL
Understanding of data platform concepts in Cloud environments
Experience in building data processing pipelines
MS Azure Cloud – nice to have
Proficient English (written and spoken) B2

senior big data devops developer for a multinational television company

Data DevOps

Amazon Web Services, DevOps.CI/CD

40 hrs/week

12+ months

Armenia, Kazakhstan,

and others

Armenia, Georgia, Kazakhstan, Uzbekistan

Learn more

We are inviting a Senior Big Data DevOps Developer with practical experience in support & development for relational database systems, to join our team remotely.

We are currently looking for a remote Senior Big Data DevOps Developer with practical experience in support & development for relational database systems to join our team. The customer provides Direct-to-Consumer services encompassing global entertainment and news TV properties, TV stations group, and radio businesses.

responsibilities

Helping to provide support & engineering services for MySQL Aurora-based systems
Helping the data services team with support and automation
Communicating with the customer

requirements

3+ years of professional experience
Practical experience in support & development for relational (MySQL, RDS PostgreSQL) database systems
Practical skills with Linux systems
Strong background in CI/CD (Jenkins and/or GitLab)
Clear understanding of AWS cloud infrastructure
Good communication skills
English - B2

nice to have

Kubernetes, Terraform, Ansible, Airflow and Snowflake expertise
Practical experience with or willingness to study Amazon MySQL Aurora

senior big data software developer for a multinational television company

Big Data

40 hrs/week

12+ months

Poland, Uzbekistan

Learn more

We are currently looking for a Remote Senior Software Developer with practical experience in support and development for scalable cloud-native Data Platforms with batch and streaming processing using Kafka and Spark to join our team.

The customer provides Direct-to-Consumer services encompassing global entertainment and news TV properties, TV stations group and radio businesses.

responsibilities

Implementing data ingest, processing and serving technologies in near real-time basis
Working with data scientists to operationalize machine learning models and build apps to make use of the power of machine learning

requirements

4-6+ years of experience with Java, Scala or Python
Practical data engineering experience (data ingestion, storage and processing) in batch and streaming solutions using Kafka and Spark
Understand reactive programming and dependency injection such as Spring to develop REST services
Good understanding and practical experience with AWS
At least Intermediate level of both spoken and written English (B1 and higher)