Big Data Developer remote jobs

EPAM Anywhere is looking for remote Big Data Developers.

Competitive compensation

We back all payments and operate in compliance with country-specific labor regulations. Your annual paycheck can range from $15k to $200k.

Numerous benefits

Make use of 1,500+ online and location-specific benefits across 30+ countries that also include healthcare and sports programs for you and your family.

Limitless career growth opportunities

Get access to a large-scale ecosystem that consists of educational and career development services created for your growth. A personal skill advisor will support you on each step of this journey.

looking for a big data engineer job?

Let us find one for you! Send us your CV and we'll get back with your personalized best-match job at Anywhere

find me a job

senior big data developer

Big Data

ETL/ELT Solutions, Amazon Web Services, Java

40 hrs/week

12+ months

Armenia, Kazakhstan,

and others

Armenia, Georgia, Kazakhstan, Uzbekistan

Learn more

Currently, we are looking for a remote Senior Big Data Developer for a Media Company

Currently, we are looking for a remote Senior Big Data Developer . The customer provides Direct-to-Consumer services encompassing global entertainment and news TV properties, TV stations group, and radio businesses.

responsibilities

Build data collection schema for a product
Create scripts/ETL jobs to filter and transform input and output data sets and logs between different formats (JSON, CSV, XML, txt, …) to make it suitable for further visualization
Create scripts/applications to capture the latest input data (e.g.: save them to S3)
Create scripts to automate repetitive tasks

requirements

3+ years of experience as Big Data Developer
Knowledge of AWS in general
Understanding of ETL
Good English skill for communication
Experience with Big data technologies like EMR, Spark

senior big data devops developer

Data DevOps

Jenkins, Unix, Perl

40 hrs/week

12+ months

Armenia, Kazakhstan,

and others

Armenia, Georgia, Kazakhstan, Uzbekistan

Learn more

We’re looking for a remote Senior Big Data DevOps who will be responsible for developing and maintaining the development operations environment for one of our projects.

You will work on continuous integration process improvements to make deploys consistently successful, fast, and simpler to maintain as well as streamlining/automating content migration from Prod to DEV/QA environments. This is a great opportunity to join early and influence the technology selection, design, and ownership of the infrastructure.

responsibilities

Designing, building and maintaining highly available production systems
Integrating solutions with other applications and platforms outside the framework
Providing consulting services to application teams looking to build Cloud-based applications
Designing and implementing build, deployment, and configuration management systems
Analyzing, organizing, and providing in-depth code reviews to improve applications dynamically and ensure the timely completion of projectsPerform script updates due to changes in requirements or implementations
Designing, implementing and improving monitoring and alerting system
Troubleshooting production issues and coordinating with the development team to streamline code deployment
Optimizing system performance, availability and scalability
Assisting in production support
Collaborating with team members to improve developed tools, systems and procedures, and data security
Brainstorming for new ideas and ways to improve development delivery
Creating Infrastructure diagrams
Creating Procedures and Plocies
Managing the Data DevOPs team
Writing the project documentation and conducting knowledge transfers

requirements

6+ years of professional experience
4+ years hands-on experience with a variety of Amazon AWS services
3 years of hands-on experience in one scripting language: Bash, Perl, Groovy;Expert in Hadoop HDFS and YARN
3 years of hands-on experience with Python
Solid experience in managing production infrastructure with Terraform, AWS CloudFormation, etc.
Intermediate skill in one cloud platform: GCP, Azure
Solid Linux/Unix systems administration background
General network administration related knowledge and skills
Expert in infrastructure troubleshooting, performance tuning, optimization and bottleneck problem analysis
Advanced skill in one of Hadoop distributions(Cloudera, Hortonworks)
Advanced skill in Hadoop managing tools(Ambari, Cloudera Manager)
Advanced skill in HUE, Hive, Spark
Advanced skill in Hadoop Security;Expert in Kafka
Advanced skill in ElasticSearch
Expert in one configuration management tool: Chef, Puppet, Ansible or similar
Advanced skill in one build automation tool: Jenkins, TeamCity, Bamboo, GoCD, etc.
Solid knowledge of Monitoring Best Practices
Advanced skill in one monitoring tool and dashboard: Zabbix, Nagios, DataDog, Prometheus, Grafana, etc.
Solid knowledge of Security Best Practices;Expert in one Authentication and Authorization protocols: LDAP, Kerberos, SAML, etc.
Solid organizational, analytical and problem solving skills
Ability to present and communicate the architecture in a visual form
Bachelor’s degree in Computer Science or a related technical field, or equivalent work experience
English language – ability to direct communicate with customer. B2+ level is required

nice to have

Operating Systems: Debian/Ubuntu, RedHat/Centos, Windows

senior big data developer with nosql

Big Data

Java

40 hrs/week

12+ months

Armenia, Kazakhstan,

and others

Armenia, Georgia, Kazakhstan, Uzbekistan

Learn more

We are looking for a Senior Big Data Engineer with 3+ years' experience in Java, expertise in Big Data (Hadoop, Spark, Kafka, etc.), and good written and spoken English (B2+) to join our team remotely.

Currently we are looking for a remote Senior Big Data Developer. EPAM invites talented and ambitious engineers to become part of our Big Data Solution Practice. We are looking for people with strive for self-development who are keen on data science and eager to work with Big Data tools and frameworks, NoSQL databases, and cutting edge technologies. This project is about building microservices-oriented E-commerce solution and API layer in front of IT. We are not building everything from scratch, we are starting to build each service on top of the customer`s existing systems (order management system, customers storages, and CRMs, etc.), but some services like a catalog where we have the freedom to provide storage and code architecture from the very beginning.

responsibilities

Work on high-quality architecture and implementation design, collaborating with the customer, system/business analysts and onshore architects
Design and implement production Big Data environments using modern technologies
Work with the team on modelling complex relationships in heterogeneous data environments
Build, validate and optimize large-scale, corporate-wide Big Data solutions
Work with business stakeholders to translate their data/reporting needs to algorithms, analyses and reports

requirements

3+ years' experience in Java
Experience with Big Data (Hadoop, Spark, Kafka, etc.)
Good command of English (B2)
Desire to develop professionally in Big Data practice

senior big data developer for retail company

Big Data

Apache Spark, Scala, Machine Learning Model Development

40 hrs/week

12+ months

Armenia, Kazakhstan,

and others

Armenia, Georgia, Kazakhstan, Uzbekistan

Learn more

Currently, we are looking for a remote Senior Big Data Developer to join our team.

responsibilities

Understanding requirements, clarifying with BA and data analysts when necessary
Automating data ingestion processes
Enhancing data sets by creating automated match rules
Automating data pre-processing, cleansing and verifying the integrity
Developing ETL transformations for data from various data sources (IQUVIA, SCOUT, SAP, unstructured files)
Besides the development of predictive models your responsibility is in the entire lifecycle of product development from research investigation to production deployment, monitoring, and evaluation

requirements

3+ years of experience in Data Analytics
Experienced in Scala and Spark
Experience with any cloud is required (preferable GCP)
Experience in Kafka, Airflow, Looker, understanding of ML. Understanding of Hadoop, Hive
Experience in statistical models, logistic regression, and real-time predictions
Less application for deep learning, and NLP solutions
Proficient English (written and spoken) B2

nice to have

Machine Learning Model Development

senior big data developer for healthcare company

Big Data

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

Armenia, Kazakhstan,

and others

Armenia, Georgia, Kazakhstan, Uzbekistan

Learn more

Currently, we are looking for a remote Senior Big Data Developer to join our team.

responsibilities

Enable production of valuable business insights
Understand requirements, clarify with BA and data analysts when necessary
Automating data ingestion processes
Enhance data sets by creating automated match rules
Automating data pre-processing, cleansing and verifying the integrity
Developing ETL transformations for data from various data sources (IQUVIA, SCOUT, SAP, unstructured files)
Working in a feature team of developers and test engineers
Deliver results every sprint in accordance with sprint and release plans
Report about activities via agreed project tools
Timely report about risks/issues/dependencies
Apply efforts to resolve and move the work forward

requirements

3+ years of relevant experience
Ability to work independently as well as in a team of professionals, that may include not only EPAM colleagues, but also client’s engineers and managers as well as third-party vendors
Strong skills in Big Data - AWS, Databricks, Spark, Python, Airflow, + (Scala or Java)
Proficient working in AWS cloud environment
English level B2 and higher

senior big data developer (scala) for retail project

Big Data

Scala, Linux

40 hrs/week

12+ months

Armenia, Kazakhstan,

and others

Armenia, Georgia, Kazakhstan, Uzbekistan

Learn more

We are looking for a Senior Big Data Developer (Scala) with 3+ years of experience with Big Data stack: Spark, Hive, HDFS, basic Scala knowledge, experience with AWS Cloud services, to join our team remotely.

As a remote Senior Big Data Developer (Scala) , you will live on the front lines of the products we create, and build features used by millions of people every day. Our customer is one of the biggest multi-brand online retailers in the UK. It is our long-playing customer and now they aim to enhance the use of its existing data by improving its storage capabilities and accessibility. The goal of the project is to build a system from the scratch based on Data Lake architecture with Query Layer which provides the ability for multiple data consumer systems to query data from the lake. An additional challenge in Query Layer design is to make it auto-scalable to handle peaks in demand with high uptime percentage as for HA characteristic.

requirements

3+ years of experience with Big Data stack: Spark, Hive, HDFS
Basic Scala knowledge
Experience with AWS Cloud services
Knowledge of Linux will be a plus
Knowledge of scripting will be a plus
Excellent communication skills, team player
English level: Intermediate+ (B1+)

senior big data developer for a canadian retail company

Data Software Engineering

Data Modeling, Java, Python

40 hrs/week

12+ months

Armenia

Learn more

Currently, we are looking for a Remote Senior Big Data Developer to join our team.

The customer is a Canadian vehicle retailer operating online.

responsibilities

Creating and maintaining scalable, maintainable and reliable pipelines that process large quantities of structured and unstructured data
Unifying streaming and batch processing modes into one cohesive framework of processing including monitoring and alerting that fits into a unified and reliable data platform infrastructure
Participating in the design and implementation of data models as part of modern data lake, data warehouse and ETL/ELT approaches
Building streaming data pipelines that enable the business to engage consumers in real-time
Identifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Regularly reviewing work with/from peers with a goal of improving personal knowledge of the systems, ensuring that code changes meet business goals and technology best practices
Regularly interacting and collaborating with personnel across functions (product, technology, analytics, operations) within the assigned team and technology chapter
Working with stakeholders including the Executive, Product, and Data teams to assist with data-related technical issues and support their data infrastructure needs

requirements

3+ years of experience in Big Data Engineering
Experience with DataOps: improve quality and reduce cycle time of data analytics
Experience working with data that is constantly generated by different data source
Experience with ETL / ELT tools: knowledge and experience of tools to complete ETL / ELT process (e.g. Fivetran, Talend, Airflow, dbt, FlyData, or similar tools)
Excellent problem solving, troubleshooting, and communication skills
Good understanding of ETL / ELT process: collecting data from multiple sources and loading it into a centralized data warehouse
Knowledge of data pipeline management: ensure consistent and reliable data, monitoring for failures
Deep understanding of data modeling: creating a visual representation of an information system, defining and analyzing data requirements
Familiarity with Query optimization: analyzing queries and choosing the most efficient means to execute SQL
Knowledge of API design: handling dependencies, 3rd party integration, versioning
Programming experience: Python, Java, Scala, etc.
Knowledge of cloud data warehouse: snowflake, AWS
B2+ level of English

nice to have

Demonstrated ability to design and write maintainable software
Understanding of software engineering best practices, object oriented analysis & design, and design patterns & algorithms

senior big data developer for a business services company

Big Data

Data Integration, Python.Core, SQL

40 hrs/week

12+ months

Armenia, Kazakhstan,

and others

Armenia, Georgia, Kazakhstan, Uzbekistan

Learn more

Currently, we're looking for a remote Senior Big Data Developer with 3+ years of experience in Data Analytics to join our team.

The customer is a provider of high-quality business services in such areas as IT, Procurement, HR, Product Lifecycle Services, Financial Reporting and Analytics, and Real Estate and Facility Services. The focus of the project is the migration and refactoring of existing applications to a special platform. The main task is to enable the production of valuable business insights.

responsibilities

Understanding requirements, clarifying with BA and data analysts when necessary
Automating data ingestion processes
Enhancing data sets by creating automated match rules
Automating data pre-processing, cleansing and verifying the integrity
Developing ETL transformations for data from various data sources (IQUVIA, SCOUT, SAP, unstructured files)
Working in a feature team of developers and test engineers, deliver results every sprint in accordance with sprint and release plans; report about activities via agreed project tools, timely report about risks/issues/dependencies, apply efforts to resolve and move the work forward

requirements

3+ years of experience in Data Analytics
Strong skills in Big Data - ETL, Spark, Databricks, Redshift, S3, Python, SQL
Proficient working in AWS cloud environment
Ability to work independently as well as in a team of professionals, which may include not only EPAM colleagues, but also client’s engineers and managers as well as third-party vendors
Proficient English (written and spoken) B2

senior big data developer for building e-commerce solution

Big Data

Java

40 hrs/week

12+ months

Armenia, Kazakhstan,

and others

Armenia, Georgia, Kazakhstan, Uzbekistan

Learn more

We are looking for a remote Senior Big Data Engineer to join our team.

Currently, we are looking for a remote Senior Big Data Developer to join our team. This project is about building a micro services-oriented E-commerce solution and API layer in front of IT. We are not building everything from scratch, we are starting to build each service on top of the customer`s existing systems (order management system, customers storages, and CRMs, etc.), but some services like a catalog where we have the freedom to provide storage and code architecture from the very beginning.

responsibilities

Working on high-quality architecture and implementation design, collaborating with the customer, system/business analysts and onshore architects
Designing and implementing production Big Data environments using modern technologies
Working with the team on modelling complex relationships in heterogeneous data environments
Building, validating and optimizing large-scale, corporate-wide Big Data solutions
Working with business stakeholders to translate their data/reporting needs to algorithms, analyses and reports

requirements

3+ years of experience in Java
Experience with Big Data (Hadoop, Spark, Kafka, etc.)
Desire to develop professionally in Big Data practice
English level B2+

senior big data devops developer for a multinational television company

Data DevOps

Amazon Web Services, DevOps.CI/CD

40 hrs/week

12+ months

Armenia, Kazakhstan,

and others

Armenia, Georgia, Kazakhstan, Uzbekistan

Learn more

We are inviting a Senior Big Data DevOps Developer with practical experience in support & development for relational database systems, to join our team remotely.

We are currently looking for a remote Senior Big Data DevOps Developer with practical experience in support & development for relational database systems to join our team. The customer provides Direct-to-Consumer services encompassing global entertainment and news TV properties, TV stations group, and radio businesses.

responsibilities

Helping to provide support & engineering services for MySQL Aurora-based systems
Helping the data services team with support and automation
Communicating with the customer

requirements

3+ years of professional experience
Practical experience in support & development for relational (MySQL, RDS PostgreSQL) database systems
Practical skills with Linux systems
Strong background in CI/CD (Jenkins and/or GitLab)
Clear understanding of AWS cloud infrastructure
Good communication skills
English - B2

nice to have

Kubernetes, Terraform, Ansible, Airflow and Snowflake expertise
Practical experience with or willingness to study Amazon MySQL Aurora

Remote Big Data Developer jobs at EPAM Anywhere

With technological progress, infrastructure development for analysis of Big Data, and expanding the accessibility of data, Big Data Software Developer's role becomes increasingly significant. Big Data is considered to be a powerful technology that helps businesses get valuable insights and use those to address numerous consumer-focused needs.

Initially, a Big Data Software Developer evolved from a database administrator, a data architect, or a data analyst. Thus, Big Data Developer jobs may often include a mixture of responsibilities from all these areas. Still, mostly Big Data in-house developers cope with dataset modeling, optimizing data storage, creating data pipelines, and programming Big Data execution.

Core skills and technologies typical for Big Data Developer jobs

While this role is highly paid and desirable for many contenders, what does it take to be a rockstar Big Data Software Developer? Here's the list of skills and technologies, required in most Big Data Developer jobs:

Hands-on machine learning approaches
Experience in working with databases
Proficiency in several programming languages
(i.e., ideally, a Java Big Data Developer needs to have hands-on Python, etc.)
Knowledge of Hadoop, the open-source compendium of libraries
Substantive expertise in Apache tools: Kafka, Spark, and Hive
High competence in cloud computing

Big Data developers running for senior-level roles, also need to have under their belt:

Strong knowledge of code review process, release strategy, and other essential software development practices
Proficiency in Big Data general and serialization
Understanding of data formats, compression, codecs, and splitability
Hands-on Big Data ecosystem key technologies: HDFS, Spark, Kafka
being competent in cloud services: Amazon Web Services Google Cloud Platform, Azure

What you will do as a Big Data remote Developer

Typically Big Data Developer jobs indicate the following set of responsibilities:

Designing, implementing, testing, and maintaining the complete data management and processing systems
Hand-picking and implementing enlisted Big Data tools
Managing ETL (Extract, Transform & Load) process
Observing the performance of current infrastructure and planning of all the future upgrades
Building data models allowing to reduce systems complexity and cost, and make it more efficient
Ensuring the systems is highly scalable, robust and fault-tolerant
Establishing data retention policies and coping with all the questions about Big Data security

Explore Big Data Developer remote jobs at EPAM Anywhere

If you're exploring Big Data Developer remote jobs, take an overview of openings available for Big Data Developers on EPAM Anywhere platform. Apply for the one that suits you best and turbocharge your career in the teams of the industry's top talents!

Big Data Developer remote jobs

Remote Big Data Developer jobs at EPAM Anywhere

Core skills and technologies typical for Big Data Developer jobs

What you will do as a Big Data remote Developer

Explore Big Data Developer remote jobs at EPAM Anywhere

Related skills