Remote Big Data Developer Jobs

EPAM Anywhere is looking for remote Big Data Developers.

Be well paid

Do what you love in one of our Backend Developer remote jobs and get a guaranteed competitive compensation that grows together with you.

Explore corporate perks

Explore enterprise-level corporate benefits to support your comfortable journey at EPAM Anywhere.

Manage your career the way you want to

Land an ideal remote Backend Developer job and seize your chance to deepen your expertise or change your career path whenever it's comfortable for you.

lead big data developer (python)

Data Software Engineering

Amazon Web Services, PySpark, Python

40 hrs/week

12+ months

Colombia

We are seeking a highly skilled remote Lead Big Data Engineer to join our team, working on a cutting-edge project that leverages computer vision and machine learning to provide innovative solutions for our clients.

In this position, you will be responsible for designing and implementing data pipelines, developing and maintaining data infrastructure, and collaborating with cross-functional teams to ensure seamless integration with the company's products and services. If you are passionate about data engineering and have a strong background in computer vision and machine learning, we invite you to apply for this exciting opportunity.

responsibilities

Design and implement data pipelines, data infrastructure, and data storage solutions, ensuring scalability and performance
Collaborate with cross-functional teams to integrate data solutions with the company's products and services
Develop and maintain data infrastructure, ensuring data quality, consistency, and reliability
Lead and mentor a team of data engineers, providing guidance and support to ensure high-quality deliverables
Optimize data processing and analysis using PySpark and Python, and develop and deploy computer vision and machine learning models
Conduct code reviews and ensure adherence to best practices and coding standards

requirements

A minimum of 5 years of experience in Data Software Engineering, showcasing your expertise in designing and implementing data pipelines, data infrastructure, and data storage solutions
1+ years of relevant leadership experience
In-depth knowledge of Amazon Web Services, including experience with core services such as EC2, S3, and Lambda
Expertise in PySpark and Python, with a solid understanding of data processing and analysis
Strong background in computer vision and machine learning engineering, with experience in building and deploying models
Experience with distributed computing frameworks such as Apache Spark and Hadoop, and the ability to optimize performance and scalability
Excellent communication skills and the ability to collaborate effectively with cross-functional teams, including data scientists, product managers, and software engineers
Ability to lead and mentor a team of data engineers, providing guidance and support to ensure high-quality deliverables
Fluent spoken and written English at an upper-intermediate level or higher

nice to have

Experience with data visualization tools such as Tableau or Power BI
Knowledge of natural language processing and text analytics
Experience with containerization and orchestration technologies such as Docker and Kubernetes

lead big data engineer

Data Software Engineering

Apache Spark, Databricks, Python

40 hrs/week

12+ months

Chile, Colombia

We are seeking a highly skilled remote Lead Big Data Engineer to join our team, working on a cutting-edge project that leverages the latest technologies to deliver innovative solutions in the field of data engineering.

In this role, you will lead a team of engineers in the development, implementation, and maintenance of large-scale data processing systems, ensuring the highest levels of performance, reliability, and scalability. If you are a creative problem solver with a passion for data engineering and a proven track record of delivering complex projects, we invite you to apply for this exciting opportunity.

responsibilities

Lead a team of engineers in the design, development, and maintenance of large-scale data processing systems
Collaborate with stakeholders to identify business requirements and translate them into technical specifications
Develop and implement data processing pipelines using technologies such as Apache Spark and Databricks
Optimize data processing performance and scalability, ensuring high levels of reliability and availability
Provide technical guidance and mentorship to team members, fostering a culture of continuous learning and development
Conduct code reviews and ensure adherence to coding standards and best practices
Stay up-to-date with emerging trends and technologies in data engineering, and make recommendations for their adoption

requirements

A minimum of 5 years of experience in Data Software Engineering, with expertise in designing and building large-scale data processing systems
A minimum of 1 year of experience in leading a team of engineers, providing technical guidance and mentorship, and driving successful project outcomes
Expertise in Apache Spark and Databricks, showcasing your proficiency in distributed computing and data processing
In-depth knowledge of programming languages such as Python and Scala, enabling you to write efficient and effective code
Strong understanding of data modeling and database design principles, including experience with SQL and NoSQL databases
Experience with cloud-based data processing platforms such as AWS, Azure, or Google Cloud Platform
Excellent communication skills and the ability to work collaboratively with cross-functional teams
Fluent spoken and written English at an Upper-Intermediate level or higher
Spanish language proficiency is a must-have

nice to have

Completed Databricks Data Engineering Professional certification
Experience with machine learning and data analytics tools and frameworks such as TensorFlow, PyTorch, or Apache Flink
Experience with data visualization tools such as Tableau, Power BI, or QlikView

lead big data engineer

Data Software Engineering

Apache Spark, Databricks, Python

40 hrs/week

12+ months

Chile, Colombia

responsibilities

Lead a team of engineers in the design, development, and maintenance of large-scale data processing systems
Collaborate with stakeholders to identify business requirements and translate them into technical specifications
Develop and implement data processing pipelines using technologies such as Apache Spark and Databricks
Optimize data processing performance and scalability, ensuring high levels of reliability and availability
Provide technical guidance and mentorship to team members, fostering a culture of continuous learning and development
Conduct code reviews and ensure adherence to coding standards and best practices
Stay up-to-date with emerging trends and technologies in data engineering, and make recommendations for their adoption

requirements

A minimum of 5 years of experience in Data Software Engineering, with expertise in designing and building large-scale data processing systems
A minimum of 1 year of experience in leading a team of engineers, providing technical guidance and mentorship, and driving successful project outcomes
Expertise in Apache Spark and Databricks, showcasing your proficiency in distributed computing and data processing
In-depth knowledge of programming languages such as Python and Scala, enabling you to write efficient and effective code
Strong understanding of data modeling and database design principles, including experience with SQL and NoSQL databases
Experience with cloud-based data processing platforms such as AWS, Azure, or Google Cloud Platform
Excellent communication skills and the ability to work collaboratively with cross-functional teams
Fluent spoken and written English at an Upper-Intermediate level or higher
Spanish language proficiency is a must-have

nice to have

Completed Databricks Data Engineering Professional certification
Experience with machine learning and data analytics tools and frameworks such as TensorFlow, PyTorch, or Apache Flink
Experience with data visualization tools such as Tableau, Power BI, or QlikView

big data solution architect

Data Software Engineering

Apache Spark, Databricks, Python

40 hrs/week

12+ months

Chile, Colombia

We are seeking a skilled Big Data Solution Architect to join our remote team, working on a cutting-edge project in the software architecture industry.

We are seeking a skilled Databricks Solution Architect to join our remote team, working on a cutting-edge project in the software architecture industry. As a Big Data Solution Architect, you will be responsible for designing and implementing data engineering solutions using Apache Spark and Databricks. The ideal candidate will have completed the Databricks Data Engineering Professional certification and have hands-on experience in data engineering and programming with Databricks. Spanish fluency is a must-have for this role.

responsibilities

Design and implement data engineering solutions using Apache Spark and Databricks
Collaborate with cross-functional teams to understand project requirements and provide technical expertise
Develop and execute data engineering workflows and pipelines
Optimize and troubleshoot Apache Spark on Databricks for performance and scalability
Provide technical guidance and mentorship to junior team members
Create and maintain technical documentation for data engineering solutions

requirements

Minimum of 7 years of practical hands-on experience in Data Software Engineering
At least 2+ projects in a technical team lead role with constant hands-on work during the last 3 years
1+ years of experience as a Data Solution Architect
Completed Databricks Data Engineering Professional certification
Proficiency in programming languages such as Python and Scala
Strong communication skills and the ability to work effectively in a team environment
Fluent spoken and written English at an Upper-Intermediate level or higher (B2+)
Fluent spoken and written Spanish

nice to have

Experience in cloud-based data engineering solutions, such as AWS or Azure
Familiarity with data warehousing and ETL processes
Knowledge of machine learning and data science concepts and tools

senior big data engineer (python)

Data Software Engineering

Amazon Web Services, PySpark, Python

40 hrs/week

12+ months

Colombia

We are looking for a highly skilled remote Senior Big Data Engineer to join our team and work on complex data engineering projects.

In this position, you will be responsible for building and maintaining data pipelines and infrastructure, integrating data within Kubeflow and Databricks using PyTorch and its ecosystem, and creating data tools for analytics and data scientist team members. The ideal candidate will have extensive experience in AWS, Python, Computer Vision, Machine Learning Engineering, SQL and NoSQL databases, and Terraform, and will be comfortable working in a fast-paced, dynamic environment.

responsibilities

Create and maintain optimal data pipelines for ingesting machine logs, image data, and various other types of datasets
Assemble large, complex data sets that meet functional and non-functional business requirements
Identify, design, and implement internal process improvements, such as automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Python, SQL, Databricks Spark, and AWS 'big data' technologies
Build and enhance CVML pipelines, integrate data within Kubeflow and Databricks using PyTorch and its ecosystem
Work with stakeholders from the Product, Data, and Infra teams to assist with data-related technical issues and support their data infrastructure needs
Create data tools for analytics and data scientist team members that assist them in building and optimizing their workflows
Triage and fix support issues related to data anomalies

requirements

A minimum of 3 years of experience in Data Software Engineering, with a proven track record of delivering high-quality results
Extensive experience in Amazon Web Services (AWS), including EC2, S3, Lambda, and EMR
Expertise in PySpark, Python, and SQL databases, with a deep understanding of data structures and algorithms
Strong knowledge of Computer Vision and Machine Learning Engineering, with experience in building and enhancing CVML pipelines
Experience with Apache Kafka and NoSQL databases, such as MongoDB or Cassandra
Proficiency in Terraform for infrastructure as code
Excellent problem-solving skills and ability to work independently
Strong communication skills and ability to collaborate effectively with cross-functional teams
Fluent spoken and written English at an Upper-Intermediate level or higher

nice to have

Experience with other big data technologies, such as Hadoop or Hive
Expertise in data visualization tools, such as Tableau or Power BI
Knowledge of DevOps practices and tools, such as Jenkins or GitLab
Experience with containerization and orchestration tools, such as Docker or Kubernetes
Familiarity with data privacy and security regulations, such as GDPR or CCPA

senior data analyst (power bi)

Data Analytics and Visualization

ETL/ELT Solutions, Microsoft Power BI, SQL

40 hrs/week

12+ months

India

We are looking for a remote Senior Data Analyst with extensive experience in Power BI development and data analytics.

In this position, you will be responsible for designing, developing, and maintaining Power BI dashboards and reports, extracting, transforming, and loading (ETL) data from various sources into Power BI, building robust and reusable models in Power BI to support reporting needs, and optimizing and refining models and dashboards for performance and scalability.

responsibilities

Designing, developing, and maintaining Power BI dashboards and reports
Extracting, transforming, and loading (ETL) data from various sources into Power BI
Building robust and reusable models in Power BI to support reporting needs
Optimizing and refining models and dashboards for performance and scalability
Collaborating with stakeholders to understand their needs and translate them into functional, insightful visualizations
Troubleshooting and resolving data integrity issues, discrepancies, and system issues
Ensuring compliance with data privacy regulations and best practices
Providing training and technical support to users of the Power BI dashboards and reports
Continually improving technical skills and staying up-to-date with Power BI developments

requirements

At least 3 years of professional experience in the field of Information Technology
2+ years of experience in Power BI development and data analytics
Strong knowledge of SQL and relational databases
Proficiency in DAX and M query languages for advanced calculations and data manipulations
Experience with data extraction and transformation (ETL) processes
Understanding of data visualization best practices and principles
Excellent problem-solving skills and attention to detail
Strong analytical skills and ability to work with large amounts of data
Excellent communication skills with the ability to translate complex technical concepts into understandable terms
Ability to work independently and in a team
Microsoft Certified: Data Analyst Associate or similar certification is a plus

senior data analyst (power bi)

Data Analytics and Visualization

Microsoft Power BI, Market Data, Power BI Report Development

40 hrs/week

12+ months

India

We are looking for a remote Senior Data Analyst with extensive experience in Data Analytics and Visualization, particularly with Power BI.

The candidate should possess a solid understanding of brick and mortar Sales Analytics and P&L calculation. A very good understanding of, or experience with, data sources such as Microsoft Azure, IRI/Nielsen, and SAP Analytics Cloud is also required.

responsibilities

Analyze complex data sets using Power BI to identify key trends, relationships, and insights
Design and develop interactive data visualizations of complex data sets for non-technical users
Collaborate with the team to produce reports that support business objectives
Work with cross-functional teams to deliver complex data analysis projects
Provide advice and guidance on best practices for data visualization and analytics

requirements

Minimum of 3 years experience in Data Analytics and Visualization
Strong expertise in MS Power BI
In-depth knowledge and practical experience of Power BI Report Development
Familiarity with Market Data, SQL, and Azure Data Lake Analytics
Knowledge of Marketing/Brand Analytics in CPG/FMCG companies for both offline and online advertising
Excellent communication skills and the ability to work collaboratively with peers and clients
B2+ English level

nice to have

Experience with Data sources such as Azure Databricks, IRI/Nielsen, and SAP Analytics Cloud
Understanding of Marketing Analytics in the CPG/FMCG industry for offline and online advertising

senior data analyst (power bi)

Data Analytics and Visualization

Microsoft Power BI, Snowflake

40 hrs/week

12+ months

India

We are seeking a remote Senior Data Analyst with exceptional skills in Microsoft Power BI to join our team.

The primary responsibilities will include analyzing complex data sets, creating visually appealing dashboards and reports, and collaborating with stakeholders to ensure data accuracy and integrity. Furthermore, the candidate will support the migration and extension of the legacy software. If you have experience in Financial Services, it will be considered a plus.

responsibilities

Analyze complex data sets and provide insights and recommendations
Create visually appealing dashboards and reports using Microsoft Power BI
Collaborate with stakeholders to ensure data accuracy and integrity
Support the migration and extension of the legacy software

requirements

At least 3 years of experience in Data Analytics and Visualization
Proficiency in Microsoft Power BI
Hands-on experience in Snowflake
An Upper-Intermediate level of English (B2+)

nice to have

Experience in Financial Services is a plus

data solution architect

Data Software Engineering

Apache Spark, Databricks, Python

40 hrs/week

12+ months

Chile, Colombia

We are seeking a talented remote Data Solution Architect to join our team and work on a cutting-edge project in the field of data analytics.

In this role, you will lead a team of engineers in the development of advanced data solutions using Apache Spark, Databricks, Python, and Scala. You will be responsible for designing and implementing scalable and reliable data pipelines, as well as optimizing data processing and storage. If you have a passion for big data and the skills to lead a team to success, we invite you to apply for this exciting opportunity.

responsibilities

Lead a team of engineers in the development of advanced data solutions using Apache Spark, Databricks, Python, and Scala
Design and implement scalable and reliable data pipelines, optimizing data processing and storage
Collaborate with cross-functional teams to understand business and data requirements, and develop solutions that meet those needs
Troubleshoot and optimize data pipelines and processing, ensuring high performance and reliability
Mentor and train junior engineers, providing guidance and support in their professional development
Stay up-to-date with the latest trends and technologies in big data processing and analytics, and share knowledge with the team
Ensure the quality and accuracy of data solutions, and maintain high standards of code quality and documentation

requirements

Minimum of 7 years of practical hands-on experience in Data Software Engineering
At least 2+ projects in a technical team lead role with constant hands-on work during the last 3 years
1+ years of experience as a Data Solution Architect
Expertise in Apache Spark and Databricks, with experience in developing and optimizing Spark jobs and clusters
Proficiency in Python and Scala, with experience in developing data pipelines and ETL processes
Experience in designing and implementing scalable and reliable data solutions, including data processing, storage, and retrieval
Strong leadership skills, with experience in leading and mentoring a team of engineers
Excellent communication skills and the ability to work collaboratively with cross-functional teams
Ability to troubleshoot and optimize data pipelines and processing, ensuring high performance and reliability
Fluent spoken and written English at an Upper-Intermediate level or higher
Spanish language proficiency is a must

nice to have

Completed Databricks Data Engineering Professional certification
Experience with cloud-based data solutions, such as AWS or Azure
Experience with data visualization tools, such as Tableau or Power BI

data solution architect

Data Software Engineering

Apache Spark, Databricks, Python

40 hrs/week

12+ months

Chile, Colombia

We are seeking a talented remote Data Solution Architect to join our team and work on a cutting-edge project in the field of data analytics.

responsibilities

Lead a team of engineers in the development of advanced data solutions using Apache Spark, Databricks, Python, and Scala
Design and implement scalable and reliable data pipelines, optimizing data processing and storage
Collaborate with cross-functional teams to understand business and data requirements, and develop solutions that meet those needs
Troubleshoot and optimize data pipelines and processing, ensuring high performance and reliability
Mentor and train junior engineers, providing guidance and support in their professional development
Stay up-to-date with the latest trends and technologies in big data processing and analytics, and share knowledge with the team
Ensure the quality and accuracy of data solutions, and maintain high standards of code quality and documentation

requirements

Minimum of 7 years of practical hands-on experience in Data Software Engineering
At least 2+ projects in a technical team lead role with constant hands-on work during the last 3 years
1+ years of experience as a Data Solution Architect
Expertise in Apache Spark and Databricks, with experience in developing and optimizing Spark jobs and clusters
Proficiency in Python and Scala, with experience in developing data pipelines and ETL processes
Experience in designing and implementing scalable and reliable data solutions, including data processing, storage, and retrieval
Strong leadership skills, with experience in leading and mentoring a team of engineers
Excellent communication skills and the ability to work collaboratively with cross-functional teams
Ability to troubleshoot and optimize data pipelines and processing, ensuring high performance and reliability
Fluent spoken and written English at an Upper-Intermediate level or higher
Spanish language proficiency is a must

nice to have

Completed Databricks Data Engineering Professional certification
Experience with cloud-based data solutions, such as AWS or Azure
Experience with data visualization tools, such as Tableau or Power BI

Big Data Developer Remote Jobs

Big data developers are universal specialists. In carrying out their duties, they work with different programming languages and create products using different methods. The goal of such a developer is to create software that can handle high volumes of data that conventional services cannot cope with. Big data specialists provide businesses with tools for optimizing work with a large data flow. The main application for the developer of this specialization is the Hadoop ecosystem.

Modern businesses require the most reliable software, especially one that makes it possible to work with data arrays. The task of the big data developer is to make sure that this data helps the business achieve its goals. The specialty is complex in that it requires knowledge of many technologies and the skill to develop an optimal solution for each of them. Today there are a lot of remote big data developer jobs, so applicants for such a vacancy need to know what to write in their resume.

Duties of a big data developer

When applying for a job at a prestigious company, a specialist must be ready to perform the following scope of work:

Create software that can process large data streams.
Conduct continuous analysis of the received data.
Set up software for the fastest possible processing, which will provide solutions to business problems.
Maintain, improve and scale the product.
Detail complex tasks.
Build and run Hadoop applications.
Develop a security system for data storage.
Work with automation settings and provide quick access to the database.

According to their qualifications, specialists are divided into several levels, and the number and complexity of tasks for big data developer remote jobs depend on this. Junior developers will have fewer than half of the above duties. They work under the supervision of more experienced colleagues and gain experience in routine tasks. The above duties are for those in higher levels. In addition to those duties, top-level specialists must supervise the work of junior team members.

Requirements of a big data developer

Each company has its own requirements, but big data developers who work from home typically must meet the following:

2+ years of experience
Full knowledge of the necessary programming languages, as well as Hadoop
Ability to work with large volumes of data
Skill in working with tools for analysis and visual presentation of data
Possession of all processes that allow modeling and structuring of data
Experience with streaming frameworks and automation tools
Bachelor’s or master's degree in a specialized field
Knowledge of ETL and Agile
Experience in developing products on open source systems

If you want to work remotely, add organization, time management, punctuality, and responsibility to the above requirements. Working from home, a specialist should not lose their connection to the team.

Remote Big Data Developer Jobs

Big Data Developer Remote Jobs

Duties of a big data developer

Requirements of a big data developer

Other skills