Remote Big Data Developer Jobs

EPAM Anywhere is looking for remote Big Data Developers.

Be well paid

Do what you love in one of our Backend Developer remote jobs and get a guaranteed competitive compensation that grows together with you.

Explore corporate perks

Explore enterprise-level corporate benefits to support your comfortable journey at EPAM Anywhere.

Manage your career the way you want to

Land an ideal remote Backend Developer job and seize your chance to deepen your expertise or change your career path whenever it's comfortable for you.

senior big data engineer

Data Software Engineering

Amazon Web Services, Python, Apache Spark

40 hrs/week

12+ months

Poland

We are looking for a Senior Big Data Engineer to join our team and help us create and adjust analytics data pipelines.

The ideal candidate should have hands-on experience in Cloud computing on AWS, developing scripts using Python and developing ETL processes whilst displaying a strong understanding of query execution plans and query optimization.

responsibilities

Develop analytics data pipelines
Develop ETL processes and scripts in Python for data integration, from multiple sources
Optimize and tune both SQL and NoSQL queries to ensure efficient and seamless data processing and delivery across our data pipelines
Develop and maintain data architecture standards, principles, and models for efficient data integration and management
Effectively communicate with stakeholders to understand business needs and translate them into technical requirements

requirements

2+ years of experience in Cloud computing on AWS
Experience with Spark
Knowledge of Databricks
2+ years of experience in developing scripts using Python
Strong knowledge and expertise with SQL and NoSQL Databases
Experience with Data architecture

senior data software engineer

Data Software Engineering

Databricks, Python, PySpark

40 hrs/week

12+ months

Poland

Join our remote team as a Senior Data Software Engineer.

Join our remote team as a Senior Data Software Engineer within a global leader in digital transformation and technology services. We are looking for an experienced software developer with a strong background in data engineering to join our team. The ideal candidate will be responsible for implementing reusable DataBricks components for data ingestion and data analytics. They will have experience ingesting data into a data lake via batch, streaming, and replication and making data available for reporting and predictive modeling, as well as establishing security controls, integration with data governance, and clear auditable data lineage. The Senior Data Software Engineer will work collaboratively with architects, technical leads, and key individuals within other functional groups to develop and test solutions that meet best practice specifications.

responsibilities

Implementing reusable DataBricks components for data ingestion and data analytics
Ingesting data into a data lake via batch, streaming, and replication and making data available for reporting and predictive modeling
Establishing security controls, integration with data governance, and clear auditable data lineage
Collaborating with architects, technical leads, and key individuals within other functional groups to develop and test solutions that meet best practice specifications
Participating in code review and testing solutions to ensure they meet best practice specifications
Writing project documentation to ensure that other developers can easily understand and use the code
Building collaborative partnerships with architects, technical leads, and key individuals within other functional groups
Continuously updating skills and knowledge to keep up with industry trends and best practices

requirements

At least 3+ years of experience in software engineering with a focus on data engineering
Proficient in Python coding and PySpark development
Experience building data ingestion pipelines, Data Warehouse or Database architecture.
Hands-on experience with modern Big Data components like Databricks, SQL Azure, and Microsoft Azure
Experience in designing, deploying, and administering scalable, available, and fault-tolerant systems in a cloud environment
Strong ability to write clean, maintainable, and well-documented code
Experience in data modeling and working with data-oriented personality and compliance awareness, such as PI, GDPR, and HIPAA
Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

nice to have

Experience with Power BI, Azure Synapse Analytics, and ADLS is a plus

senior data structures/algorithms developer with java

Java

Clean Code, Kotlin, Scala

40 hrs/week

12+ months

India

We are seeking a Senior Data Structures/Algorithms Developer with Java to join our remote team, who will demonstrate ownership and a proactive attitude towards problem-solving and working in the cloud environment.

We are seeking a Senior Data Structures/Algorithms Developer with Java to join our remote team. The successful candidate will work on the development and improvement of the product, focused on quality and delivering high-quality products that meet or exceed customer expectations.

responsibilities

Design, develop, and maintain high-quality software solutions using Java and its related frameworks
Collaborate with cross-functional teams to identify and solve complex problems
Participate in code reviews, ensuring code quality and adherence to industry standards
Develop and maintain technical documentation
Ensure timely delivery of high-quality code
Contribute to the improvement of the development process
Stay up-to-date with emerging trends and technologies in software development

requirements

Minimum of 4 years of experience with Java and its related frameworks
Expertise in data structures and algorithms
Experience with Kotlin/Scala/Go
Knowledge of React.js
Experience with AWS
Knowledge of Clean Code
Experience with System Design
Proficiency with Microservices and Spring
Experience with API and Integration Standards
Experience with SQL and NoSQL tools
Proficiency with CI/CD
Excellent communication skills, both written and verbal
Ownership mindset and ability to take the big picture view of the project
Experience with requirement elicitation
B2+ English level

nice to have

Experience with cloud technologies other than AWS

senior data software engineer

Data Software Engineering

Databricks, Python, Microsoft Azure

40 hrs/week

12+ months

Poland

We are seeking a remote Senior Data Software Engineer to join our team and help build our Enterprise Data Platform and Data Products.

This role offers the opportunity to work with cutting-edge technologies and make a significant impact on the company's data strategy. The ideal candidate will have extensive experience in building data platforms and implementing high-performance big data solutions. They should also possess strong development skills, along with knowledge of Azure and Databricks.

responsibilities

Designing and developing enterprise data platforms and data products
Collaborating with cross-functional teams to understand business requirements and design data solutions that meet those needs
Implementing high-performance big data solutions using Databricks and Microsoft Azure technologies
Working with event-driven architecture to build scalable and reliable data pipelines
Developing and maintaining data processing pipelines and workflows
Ensuring data quality and integrity throughout the data lifecycle
Troubleshooting and resolving issues related to data processing and storage
Developing and maintaining documentation related to data platforms and data products
Staying up-to-date with the latest trends and technologies in data engineering and big data
Providing technical guidance and mentorship to junior team members

requirements

Minimum of 3 years of experience in data software engineering
Experience building data platforms at large companies
Proven experience in implementing high-performance big data solutions
Expertise in Databricks and Microsoft Azure technologies
Strong development skills, including Python
Experience with event-driven architecture
Excellent problem-solving and analytical skills
Ability to work collaboratively with cross-functional teams
Excellent communication skills in English, both written and verbal (B2+ level)

nice to have

Experience with machine learning and data science technologies
Familiarity with data governance and regulatory compliance
Experience with other big data technologies, such as Hadoop or Spark

senior data developer (databricks and devops skills)

Data Software Engineering

Amazon Web Services, Databricks, Python

40 hrs/week

12+ months

Poland

We are looking for a remote Senior Data Developer with Databricks and DevOps skills to join our company.

The ideal candidate will be responsible for developing data-intensive applications and platforms using DBT, Azure cloud services, and CI/CD pipelines.

responsibilities

Developing data-intensive applications and platforms using DBT
Working with scripting languages such as Python, SQL and PySpark
Handling big data sets and big data technologies
Working with Agile and Kanban methodologies
Communication skills to engage technical developers, architects, and stakeholders

requirements

University degree in any IT discipline
Minimum 3+ years of experience in the IT industry
Proven experience as a Data Engineer or similar role in software development
Expertise in Databricks and DevOps skills
Strong knowledge of CI/CD pipelines and experience in a cloud environment
Proven experience in working with data engineering technologies such as ADLS, Azure SQL and AWS
Good written and verbal communication skills in English (B2+)

nice to have

Experience with Big Data tools such as Kafka, Hadoop and Spark

senior java developer (algorithms and data structures)

Java

Clean Code, Kotlin, Scala

40 hrs/week

12+ months

India

We are looking for a Senior Java Developer (Algorithms and Data Structures) to join our remote team and work on an innovative product that utilizes cloud technology.

As a Senior Java Developer, you will be responsible for delivering high-quality products that meet or exceed customer expectations. You will demonstrate ownership and a proactive attitude toward problem-solving and possess a big-picture view mindset. You will work with a cross-functional team to develop and improve the product, with a focus on quality and scalability.

responsibilities

Develop and maintain high-quality Java applications for the cloud-based product
Collaborate with cross-functional teams to design, develop and integrate APIs and microservices
Ensure that the system design meets the scalability, availability, and performance requirements of the product
Participate in code reviews and mentor junior developers
Collaborate with the product team to understand requirements and provide technical solutions
Work with DevOps engineers to streamline the CI/CD pipeline and ensure smooth deployments

requirements

4+ years of experience with Java and a strong understanding of data structures, algorithms, and system design
Knowledge of Kotlin/Scala/Go languages
Hands-on experience with AWS services and CI/CD pipelines, including deployment and release management
Experience with microservices, APIs, and integration standards
Strong knowledge of SQL and NoSQL tools
Experience with React.js
Ability to write clean code and adhere to best practices
B2+ English level

nice to have

Knowledge of containerization technologies like Docker and Kubernetes

senior data integration engineer

Data Integration

ETL/ELT Solutions, Azure Data Lake Storage, Databricks

40 hrs/week

12+ months

Poland

We are seeking a skilled Senior Data Integration Engineer to join our remote team.

We are looking for an experienced Senior Data Integration Engineer to join our team. As a Senior Engineer with 3+ years of relevant production experience, you will play a key role in designing, developing, and implementing data integration solutions. You will leverage your expertise in ETL/ELT solutions, Azure Data Lake Storage, Databricks, Azure Data Factory, MySQL, PostgreSQL, MS SQL.SQL, Oracle, SQL, and Python to deliver high-quality and scalable data integration processes. If you thrive in a challenging environment and have a passion for data integration, we want to hear from you.

responsibilities

Lead the design and development of data integration solutions, including ETL/ELT processes and data pipelines
Collaborate with stakeholders to gather and analyze data integration requirements
Provide technical guidance and mentorship to junior team members
Ensure data quality and consistency across integrated systems
Optimize data integration workflows for performance and scalability
Troubleshoot and resolve complex data integration issues
Stay up-to-date with industry trends and emerging technologies in data integration

requirements

Bachelor's degree in Computer Science, Information Systems, or a related field
3+ years of relevant production experience in data integration
In-depth knowledge of ETL/ELT solutions and data integration best practices
Strong proficiency in Azure Data Lake Storage, Databricks, and Azure Data Factory
Extensive experience with MySQL, PostgreSQL, MS SQL.SQL, and Oracle
Expert-level skills in SQL and Python for data manipulation and transformation
Solid understanding of data modeling and database design principles
Proven track record of successfully delivering complex data integration projects
Strong problem-solving and analytical skills
Excellent communication and leadership abilities
B2+ English level

nice to have

Experience with cloud-based data integration platforms such as AWS Glue or Google Cloud Dataflow
Familiarity with big data technologies like Hadoop and Spark
Knowledge of data warehousing concepts and tools
Understanding of data governance and data management practices
Ability to architect and implement real-time data integration solutions

senior data software engineer

Data Software Engineering

Databricks, Python, Microsoft Azure

40 hrs/week

12+ months

Poland

Join our remote team as a Senior Data Software Engineer.

Join our remote team as a Senior Data Software Engineer within a leading technology company that specializes in building enterprise data platforms and products. In this role, you will be responsible for designing, developing, and implementing high-performance big data solutions that meet the needs of our clients. You will work closely with other technical staff, product leadership, and development peers to create innovative and impactful solutions. This position offers an opportunity to contribute significantly to the design, development, and optimization of features in a dynamic Agile development environment.

responsibilities

Designing and developing high-performance big data solutions that meet the needs of our clients
Collaborating with development peers, product leadership, and other technical staff to create innovative and impactful solutions
Ensuring reliability, availability, performance, and scalability of systems
Working closely with clients to understand their data requirements and recommend appropriate solutions
Leading the development of new features using the Agile development process (Scrum)
Providing technical input for new feature requirements, partnering with business owners and architects
Ensuring continuous improvement by staying abreast of industry trends and emerging technologies
Driving the implementation of solutions aligned with business objectives.
Mentoring and guiding less experienced team members, helping them enhance their skills and grow their careers
Participating in code reviews, ensuring code quality and adherence to standards
Collaborating with cross-functional teams to achieve project goals

requirements

At least 3+ years of experience in data software engineering
Experience in implementing successful big data high-performance solutions
Strong knowledge of big data technologies and data background
Expertise in Databricks and Microsoft Azure for building scalable and high-performance big data solutions
Hands-on experience with Python programming language for data manipulation and analysis
Familiarity with event-driven architecture for designing and building scalable applications
Excellent knowledge of Azure Big Data Services for data management and storage
Experience with development methodologies and version control systems
Ability to work independently as well as collaboratively with a team of diverse technical staff
Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

nice to have

Familiarity with other big data technologies such as Hadoop, Spark, Kafka, or Hive
Experience in building data products on top of enterprise data platforms

senior java developer (algorithms and data structures)

Java

Algorithms & Data structures, Kotlin, Scala

40 hrs/week

12+ months

India

We are seeking a Senior Java Developer who holds AWS proficiency, alongside comprehensive knowledge in Data Structures and Algorithms, to join our remote team.

The Product Engineer role would require you to design and develop scalable, maintainable software solutions, utilizing diverse technologies like Java, Kotlin, Scala, or Go Language, plus Spring and Java Microservice Infrastructure. You will collaborate with various developers, testers, and stakeholders to ensure timely and successful product delivery.

responsibilities

Collaboration with cross-functional teams for understanding project requirements and formulating solutions
Development and execution of scalable, maintainable software solutions
Generation and maintenance of clean, principle adhering code
Execution of code reviews for coding standard compliance
Creation and maintenance of automated tests for deliverable quality verification
Active participation in Agile/Scrum development processes and ceremonies
Assurance of punctual, high quality code delivery
Documentation for code and system architecture
Contribution to system design and architecture discussions
Provision of technical guidance and mentorship for junior developers

requirements

Holder of a Bachelor's degree in Computer Science, Information Technology, Software Engineering, or a related field
Minimum 4 years of experience in software development with specific experience in Java
Previous experience with Amazon Web Services (AWS)
Proficiency in Data Structures and Algorithms
Previous experience in Kotlin, Scala, or Go Language
Fluency in SQL and NoSQL tools, APIs, and Integration
Familiarity with CI/CD processes and tools
Proficiency in Spring and Java Microservice Infrastructure
A strong sense of ownership and a proactive problem-solving approach
Fluent English speaking of Upper-Intermediate level or higher, with excellent verbal and written communication skills for seamless collaboration with remote teams

nice to have

Previous experience with Docker and Kubernetes containerization technologies
Familiarity with Big Data technologies like Hadoop and Spark
Knowledge of Machine Learning and Artificial Intelligence technologies

senior data software engineer

Data Software Engineering

Databricks, Python, PySpark

40 hrs/week

12+ months

Poland

Join our remote team as a Senior Data Software Engineer.

Join our remote team as a Senior Data Software Engineer within a global leader in data-driven solutions. We are seeking a highly skilled and experienced individual to take ownership of building and implementing reusable DataBricks components for data ingestion and analytics. The successful candidate will collaborate closely with architects, technical leads, and other functional groups to ensure the creation of effective and efficient solutions. This role presents an opportunity to drive innovation and contribute to the optimization of the company's data solutions.

responsibilities

Design and implement reusable DataBricks components for data ingestion and analytics
Ingest data via batch, streaming, and replication into data lake and make data available for reporting and predictive modeling
Establish security controls, integration with data governance and clear auditable data lineage
Build collaborative partnerships with architects, technical leads, and key individuals within other functional groups
Participate in code review and test solutions to ensure they meet best practice specifications
Write project documentation
Provide technical input for new feature requirements, partnering with business owners and architects
Ensure continuous improvement by staying abreast of industry trends and emerging technologies
Drive the implementation of solutions aligned with business objectives
Collaborate with cross-functional teams to achieve project goals

requirements

At least 3+ years of experience in Data Software Engineering
Expertise in Databricks and PySpark for building and managing Big Data analytics applications
Hands-on experience with Microsoft Azure, including Azure Synapse Analytics, SQL Azure, and ADLS for designing and deploying scalable, available and fault-tolerant systems
Experience in building data ingestion pipelines, data warehousing or database architecture
Deep understanding of data modeling concepts and experience with modern Big Data components
Strong coding experience with Python for building data solutions
Understanding of compliance awareness, such as PI, GDPR, HIPAA for data security and privacy
Experience in actively participating in code review and testing solutions to ensure they meet best practice specifications
Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

nice to have

Experience with Power BI for data visualization and reporting

Big Data Developer Remote Jobs

Big data developers are universal specialists. In carrying out their duties, they work with different programming languages and create products using different methods. The goal of such a developer is to create software that can handle high volumes of data that conventional services cannot cope with. Big data specialists provide businesses with tools for optimizing work with a large data flow. The main application for the developer of this specialization is the Hadoop ecosystem.

Modern businesses require the most reliable software, especially one that makes it possible to work with data arrays. The task of the big data developer is to make sure that this data helps the business achieve its goals. The specialty is complex in that it requires knowledge of many technologies and the skill to develop an optimal solution for each of them. Today there are a lot of remote big data developer jobs, so applicants for such a vacancy need to know what to write in their resume.

Duties of a big data developer

When applying for a job at a prestigious company, a specialist must be ready to perform the following scope of work:

Create software that can process large data streams.
Conduct continuous analysis of the received data.
Set up software for the fastest possible processing, which will provide solutions to business problems.
Maintain, improve and scale the product.
Detail complex tasks.
Build and run Hadoop applications.
Develop a security system for data storage.
Work with automation settings and provide quick access to the database.

According to their qualifications, specialists are divided into several levels, and the number and complexity of tasks for big data developer remote jobs depend on this. Junior developers will have fewer than half of the above duties. They work under the supervision of more experienced colleagues and gain experience in routine tasks. The above duties are for those in higher levels. In addition to those duties, top-level specialists must supervise the work of junior team members.

Requirements of a big data developer

Each company has its own requirements, but big data developers who work from home typically must meet the following:

2+ years of experience
Full knowledge of the necessary programming languages, as well as Hadoop
Ability to work with large volumes of data
Skill in working with tools for analysis and visual presentation of data
Possession of all processes that allow modeling and structuring of data
Experience with streaming frameworks and automation tools
Bachelor’s or master's degree in a specialized field
Knowledge of ETL and Agile
Experience in developing products on open source systems

If you want to work remotely, add organization, time management, punctuality, and responsibility to the above requirements. Working from home, a specialist should not lose their connection to the team.

Remote Big Data Developer Jobs

Big Data Developer Remote Jobs

Duties of a big data developer

Requirements of a big data developer

Other skills