Remote Big Data Developer Jobs

EPAM Anywhere is looking for remote Big Data Developers.

Be well paid

Do what you love in one of our Backend Developer remote jobs and get a guaranteed competitive compensation that grows together with you.

Explore corporate perks

Explore enterprise-level corporate benefits to support your comfortable journey at EPAM Anywhere.

Manage your career the way you want to

Land an ideal remote Backend Developer job and seize your chance to deepen your expertise or change your career path whenever it's comfortable for you.

senior big data developer with nosql

Big Data

Java

40 hrs/week

12+ months

Georgia

Learn more

We are looking for a Senior Big Data Engineer with 3+ years' experience in Java, expertise in Big Data (Hadoop, Spark, Kafka, etc.), and good written and spoken English (B2+) to join our team remotely.

Currently we are looking for a remote Senior Big Data Developer. EPAM invites talented and ambitious engineers to become part of our Big Data Solution Practice. We are looking for people with strive for self-development who are keen on data science and eager to work with Big Data tools and frameworks, NoSQL databases, and cutting edge technologies. This project is about building microservices-oriented E-commerce solution and API layer in front of IT. We are not building everything from scratch, we are starting to build each service on top of the customer`s existing systems (order management system, customers storages, and CRMs, etc.), but some services like a catalog where we have the freedom to provide storage and code architecture from the very beginning.

responsibilities

Work on high-quality architecture and implementation design, collaborating with the customer, system/business analysts and onshore architects
Design and implement production Big Data environments using modern technologies
Work with the team on modelling complex relationships in heterogeneous data environments
Build, validate and optimize large-scale, corporate-wide Big Data solutions
Work with business stakeholders to translate their data/reporting needs to algorithms, analyses and reports

requirements

3+ years' experience in Java
Experience with Big Data (Hadoop, Spark, Kafka, etc.)
Good command of English (B2)
Desire to develop professionally in Big Data practice

senior big data developer for retail company

Big Data

Apache Spark, Scala, Machine Learning Model Development

40 hrs/week

12+ months

Georgia

Learn more

Currently, we are looking for a remote Senior Big Data Developer to join our team.

responsibilities

Understanding requirements, clarifying with BA and data analysts when necessary
Automating data ingestion processes
Enhancing data sets by creating automated match rules
Automating data pre-processing, cleansing and verifying the integrity
Developing ETL transformations for data from various data sources (IQUVIA, SCOUT, SAP, unstructured files)
Besides the development of predictive models your responsibility is in the entire lifecycle of product development from research investigation to production deployment, monitoring, and evaluation

requirements

3+ years of experience in Data Analytics
Experienced in Scala and Spark
Experience with any cloud is required (preferable GCP)
Experience in Kafka, Airflow, Looker, understanding of ML. Understanding of Hadoop, Hive
Experience in statistical models, logistic regression, and real-time predictions
Less application for deep learning, and NLP solutions
Proficient English (written and spoken) B2

nice to have

Machine Learning Model Development

senior big data developer with sql databases experience

Big Data

Microsoft SQL Server, Java, Scala

40 hrs/week

12+ months

Georgia

Learn more

We are looking for a Senior Big Data Developer with 3+ years of experience in Java or Scala, experience in SQL databases, Linux experience, to join our team remotely.

Currently, we are looking for remote Senior Big Data Developer to make the team even stronger. We are looking for people with strive for self-development who are keen on data science and eager to work with Big Data tools and frameworks, SQL databases, and cutting edge technologies.

responsibilities

Work on high-quality architecture and implementation design, collaborating with the customer, system/business analysts and onshore architects

requirements

3+ years of experience in Java or Scala
Experience in SQL databases
Linux experience
English level: Intermediate+ (B1+)

nice to have

Knowledge of AWS, Azure
Experience in Big Data (Hadoop, Spark, Kafka, etc.)
Experience building scalable, high-performance distributed systems, systems that deal with large data volumes, n-tier, client/server, cluster and load balanced architectures, web applications
Experience working in Agile Continuous Integration/DevOps paradigm and toolset (Jira, Git, TDD, Test Automation, Jenkins)
Working experience with scripting languages – Bash, Python, Groovy
Machine learning experience

senior big data developer (scala) for retail project

Big Data

Scala, Linux

40 hrs/week

12+ months

Georgia

Learn more

We are looking for a Senior Big Data Developer (Scala) with 3+ years of experience with Big Data stack: Spark, Hive, HDFS, basic Scala knowledge, experience with AWS Cloud services, to join our team remotely.

As a remote Senior Big Data Developer (Scala) , you will live on the front lines of the products we create, and build features used by millions of people every day. Our customer is one of the biggest multi-brand online retailers in the UK. It is our long-playing customer and now they aim to enhance the use of its existing data by improving its storage capabilities and accessibility. The goal of the project is to build a system from the scratch based on Data Lake architecture with Query Layer which provides the ability for multiple data consumer systems to query data from the lake. An additional challenge in Query Layer design is to make it auto-scalable to handle peaks in demand with high uptime percentage as for HA characteristic.

requirements

3+ years of experience with Big Data stack: Spark, Hive, HDFS
Basic Scala knowledge
Experience with AWS Cloud services
Knowledge of Linux will be a plus
Knowledge of scripting will be a plus
Excellent communication skills, team player
English level: Intermediate+ (B1+)

senior big data developer for a beauty products manufacturer

Big Data

Microsoft SQL Server, Scala, SQL

40 hrs/week

12+ months

Georgia

Learn more

We are looking for a Senior Big Data Engineer with 3+ years' experience, good knowledge of Scala, expertise in SQL, and an understanding of data platform concepts in Cloud environments to join our team remotely.

Currently, we are looking for a remote Senior Big Data Developer , who has strong experience in implementing data pipelines (both real-time and batch) using Spark. Our Customer is an American multinational manufacturer and marketer of prestige skincare, makeup, fragrance and hair care products, based in Midtown Manhattan, New York City. The company owns a diverse portfolio of brands, distributed internationally through both digital commerce and retail channels.

requirements

3+ years of commercial experience
Good knowledge of Scala
Experience in SQL
Understanding of data platform concepts in Cloud environments
Experience in building data processing pipelines
MS Azure Cloud – nice to have
Proficient English (written and spoken) B2

senior big data developer for a business services company

Big Data

Data Integration, Python.Core, SQL

40 hrs/week

12+ months

Georgia

Learn more

Currently, we're looking for a remote Senior Big Data Developer with 3+ years of experience in Data Analytics to join our team.

The customer is a provider of high-quality business services in such areas as IT, Procurement, HR, Product Lifecycle Services, Financial Reporting and Analytics, and Real Estate and Facility Services. The focus of the project is the migration and refactoring of existing applications to a special platform. The main task is to enable the production of valuable business insights.

responsibilities

Understanding requirements, clarifying with BA and data analysts when necessary
Automating data ingestion processes
Enhancing data sets by creating automated match rules
Automating data pre-processing, cleansing and verifying the integrity
Developing ETL transformations for data from various data sources (IQUVIA, SCOUT, SAP, unstructured files)
Working in a feature team of developers and test engineers, deliver results every sprint in accordance with sprint and release plans; report about activities via agreed project tools, timely report about risks/issues/dependencies, apply efforts to resolve and move the work forward

requirements

3+ years of experience in Data Analytics
Strong skills in Big Data - ETL, Spark, Databricks, Redshift, S3, Python, SQL
Proficient working in AWS cloud environment
Ability to work independently as well as in a team of professionals, which may include not only EPAM colleagues, but also client’s engineers and managers as well as third-party vendors
Proficient English (written and spoken) B2

senior big data developer for a canadian retail company

Data Software Engineering

Data Modeling, Java, Python

40 hrs/week

12+ months

Georgia

Learn more

Currently, we are looking for a Remote Senior Big Data Developer to join our team.

The customer is a Canadian vehicle retailer operating online.

responsibilities

Creating and maintaining scalable, maintainable and reliable pipelines that process large quantities of structured and unstructured data
Unifying streaming and batch processing modes into one cohesive framework of processing including monitoring and alerting that fits into a unified and reliable data platform infrastructure
Participating in the design and implementation of data models as part of modern data lake, data warehouse and ETL/ELT approaches
Building streaming data pipelines that enable the business to engage consumers in real-time
Identifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Regularly reviewing work with/from peers with a goal of improving personal knowledge of the systems, ensuring that code changes meet business goals and technology best practices
Regularly interacting and collaborating with personnel across functions (product, technology, analytics, operations) within the assigned team and technology chapter
Working with stakeholders including the Executive, Product, and Data teams to assist with data-related technical issues and support their data infrastructure needs

requirements

3+ years of experience in Big Data Engineering
Experience with DataOps: improve quality and reduce cycle time of data analytics
Experience working with data that is constantly generated by different data source
Experience with ETL / ELT tools: knowledge and experience of tools to complete ETL / ELT process (e.g. Fivetran, Talend, Airflow, dbt, FlyData, or similar tools)
Excellent problem solving, troubleshooting, and communication skills
Good understanding of ETL / ELT process: collecting data from multiple sources and loading it into a centralized data warehouse
Knowledge of data pipeline management: ensure consistent and reliable data, monitoring for failures
Deep understanding of data modeling: creating a visual representation of an information system, defining and analyzing data requirements
Familiarity with Query optimization: analyzing queries and choosing the most efficient means to execute SQL
Knowledge of API design: handling dependencies, 3rd party integration, versioning
Programming experience: Python, Java, Scala, etc.
Knowledge of cloud data warehouse: snowflake, AWS
B2+ level of English

nice to have

Demonstrated ability to design and write maintainable software
Understanding of software engineering best practices, object oriented analysis & design, and design patterns & algorithms

senior big data devops developer for a multinational television company

Data DevOps

Amazon Web Services, DevOps.CI/CD

40 hrs/week

12+ months

Georgia

Learn more

We are inviting a Senior Big Data DevOps Developer with practical experience in support & development for relational database systems, to join our team remotely.

We are currently looking for a remote Senior Big Data DevOps Developer with practical experience in support & development for relational database systems to join our team. The customer provides Direct-to-Consumer services encompassing global entertainment and news TV properties, TV stations group, and radio businesses.

responsibilities

Helping to provide support & engineering services for MySQL Aurora-based systems
Helping the data services team with support and automation
Communicating with the customer

requirements

3+ years of professional experience
Practical experience in support & development for relational (MySQL, RDS PostgreSQL) database systems
Practical skills with Linux systems
Strong background in CI/CD (Jenkins and/or GitLab)
Clear understanding of AWS cloud infrastructure
Good communication skills
English - B2

nice to have

Kubernetes, Terraform, Ansible, Airflow and Snowflake expertise
Practical experience with or willingness to study Amazon MySQL Aurora

senior java big data developer for a ticket marketing platform

Big Data

Microsoft SQL Server, Java, SQL

40 hrs/week

12+ months

Georgia

Learn more

We are looking for a remote Senior Big Data Developer to join our team.

The goal of the platform is to manage ticket pricing according to market demand, giving the possibility to set up prices, hold them before the sale, and adjust the price according to market behavior. Giving the ability for convenient changes for different events, venues, time slots in batches or separately.

responsibilities

Developing and evolving the solution responsible for the collecting and aggregation of events information (Storm, Kafka, Avrora)
Automatically generating Ad Campaigns on AdWords, Bing, and Facebook target platforms
Collecting and augmenting actual and historical ad performance data (AWS Lambda, Athena, Spark, Adwords/Bing API)
Implementing scripts and configuration responsible for the deployment of solutions to the AWS platform, Terraform, Shell scripts

requirements

3+ years of software development experience
Experience with AWS: Athena/Hive, Lambda, Datapipeline, EMR, S3
Experience with Maven and Git
Advanced knowledge of Java 8
Experience with Spark
Hands-on experience in SQL
Knowledge of Terraform
Experience with Docker
Experience with Linux, Shell scripting
English level B2+

senior big data software developer for a multinational television company

Big Data

40 hrs/week

12+ months

Georgia

Learn more

We are currently looking for a Remote Senior Software Developer with practical experience in support and development for scalable cloud-native Data Platforms with batch and streaming processing using Kafka and Spark to join our team.

The customer provides Direct-to-Consumer services encompassing global entertainment and news TV properties, TV stations group and radio businesses.

responsibilities

Implementing data ingest, processing and serving technologies in near real-time basis
Working with data scientists to operationalize machine learning models and build apps to make use of the power of machine learning

requirements

4-6+ years of experience with Java, Scala or Python
Practical data engineering experience (data ingestion, storage and processing) in batch and streaming solutions using Kafka and Spark
Understand reactive programming and dependency injection such as Spring to develop REST services
Good understanding and practical experience with AWS
At least Intermediate level of both spoken and written English (B1 and higher)

Big Data Developer Remote Jobs

Big data developers are universal specialists. In carrying out their duties, they work with different programming languages and create products using different methods. The goal of such a developer is to create software that can handle high volumes of data that conventional services cannot cope with. Big data specialists provide businesses with tools for optimizing work with a large data flow. The main application for the developer of this specialization is the Hadoop ecosystem.

Modern businesses require the most reliable software, especially one that makes it possible to work with data arrays. The task of the big data developer is to make sure that this data helps the business achieve its goals. The specialty is complex in that it requires knowledge of many technologies and the skill to develop an optimal solution for each of them. Today there are a lot of remote big data developer jobs, so applicants for such a vacancy need to know what to write in their resume.

Duties of a big data developer

When applying for a job at a prestigious company, a specialist must be ready to perform the following scope of work:

Create software that can process large data streams.
Conduct continuous analysis of the received data.
Set up software for the fastest possible processing, which will provide solutions to business problems.
Maintain, improve and scale the product.
Detail complex tasks.
Build and run Hadoop applications.
Develop a security system for data storage.
Work with automation settings and provide quick access to the database.

According to their qualifications, specialists are divided into several levels, and the number and complexity of tasks for big data developer remote jobs depend on this. Junior developers will have fewer than half of the above duties. They work under the supervision of more experienced colleagues and gain experience in routine tasks. The above duties are for those in higher levels. In addition to those duties, top-level specialists must supervise the work of junior team members.

Requirements of a big data developer

Each company has its own requirements, but big data developers who work from home typically must meet the following:

2+ years of experience
Full knowledge of the necessary programming languages, as well as Hadoop
Ability to work with large volumes of data
Skill in working with tools for analysis and visual presentation of data
Possession of all processes that allow modeling and structuring of data
Experience with streaming frameworks and automation tools
Bachelor’s or master's degree in a specialized field
Knowledge of ETL and Agile
Experience in developing products on open source systems

If you want to work remotely, add organization, time management, punctuality, and responsibility to the above requirements. Working from home, a specialist should not lose their connection to the team.

Remote Big Data Developer Jobs

Big Data Developer Remote Jobs

Duties of a big data developer

Requirements of a big data developer

Other skills