Data Engineer Jobs

EPAM Anywhere is looking for Data Engineers.

Competitive compensation

We back all payments and operate in compliance with country-specific labor regulations. Your annual paycheck can range from $15k to $200k.

Numerous benefits

Make use of 1,500+ online and location-specific benefits across 30+ countries that also include healthcare and sports programs for you and your family.

Limitless career growth opportunities

Get access to a large-scale ecosystem that consists of educational and career development services created for your growth. A personal skill advisor will support you on each step of this journey.

senior data software engineer

Data Software Engineering

Python, PySpark, Amazon Web Services

40 hrs/week

12+ months

Poland

We are seeking a highly skilled Senior Data Software Engineer to join our team, working with a leading provider of automotive solutions that simplify the trusted exchange and mobility of vehicles.

We are seeking a highly skilled Senior Data Software Engineer to join our remote team, working with a leading provider of automotive solutions that simplify the trusted exchange and mobility of vehicles. As a Senior Data Software Engineer, you will play a crucial role in developing and implementing data-driven solutions that lead our Client's business forward. You will work closely with cross-functional teams to design, develop, and deploy scalable data pipelines and machine learning models, leveraging your expertise in Python, PySpark, and Amazon Web Services.

responsibilities

Design and develop scalable data pipelines and machine learning models, leveraging your expertise in Python and PySpark
Implement data ingestion from multiple sources, including databases, APIs, and streaming platforms, ensuring data quality and reliability
Ensure data security and compliance by implementing best practices and following industry standards
Participate in code reviews and contribute to the development of best practices and standards for data engineering
Mentor junior engineers and provide guidance and support to help them grow their skills and expertise

requirements

A minimum of 3 years of experience in Data Software Engineering, showcasing your proficiency in developing and deploying data-driven solutions
Expertise in Python and PySpark, enabling you to design and implement complex data pipelines and machine learning models
Experience with Amazon Web Services, including Lambda, S3, SageMaker, Glue Job, VPC, and API Gateways
Strong understanding of containerized models and their deployment in production environments
Fluent spoken and written English at an upper-intermediate level or higher

senior data engineer

Data Software Engineering

Amazon Web Services, Apache Spark, Python

40 hrs/week

12+ months

Poland

We are seeking a talented Senior Data Engineer to join our team, working with a leading agriculture company that helps to improve global food security by enabling millions of farmers to make better use of available resources.

We are seeking a talented Senior Data Software Engineer to join our remote team, working with a leading agriculture company that helps to improve global food security by enabling millions of farmers to make better use of available resources. As a Senior Data Software Engineer, you will be responsible for designing and implementing data processing pipelines, ensuring data quality, and optimizing data delivery. You will work with an AWS platform for running data pipelines, which is a serverless AWS-based data lake that loads data from numerous DBs. If you are passionate about data engineering and have a strong background in AWS, Apache Spark, and Python, we invite you to join our team.

responsibilities

Design and implement data processing pipelines, ensuring data quality and optimizing data delivery
Develop and maintain data processing infrastructure using AWS services
Optimize data processing pipelines for performance and scalability
Troubleshoot and resolve issues with data processing pipelines
Ensure data security and compliance with data protection regulations
Document data processing pipelines and related processes
Collaborate with cross-functional teams to understand business requirements and develop data solutions that meet those requirements

requirements

A minimum of 3 years of experience in Data Software Engineering, demonstrating your expertise in designing and implementing data processing pipelines
Strong experience with Amazon Web Services, including AWS Lambda, S3, EC2, Athena and Redshift
Proficiency in Apache Spark, Python, and SQL, enabling you to develop robust and scalable data processing solutions
Excellent communication skills and strong critical thinking capabilities, enabling you to collaborate effectively with cross-functional teams
Ability to work independently and manage stress effectively, maintaining a high level of performance even under pressure
Fluent spoken and written English at an Upper-Intermediate level or higher, enabling effective communication

nice to have

Experience with other AWS services, such as AWS Glue, AWS EMR, and AWS Kinesis
Familiarity with machine learning and data science concepts

senior data engineer

Data Integration

AWS Simple Storage Service (S3), Amazon Web Services, SQL

40 hrs/week

12+ months

Poland

Currently, we are looking for a remote Senior Data Engineer to join our global team

Currently, we are looking for a remote Senior Data Engineer to join our global team. The customer is an online travel agency and metasearch engine that helps book airline tickets, hotel reservations, car rentals, cruise ships, and vacation packages.

responsibilities

Develop and support ETL pipelines written in Python and SQL (+HiveQL) and orchestrated by a 3rd party tool
Build all data layers (landing, staging, warehouse, datamarts) in S3, Qubole Hive and AWS Redshift
Collaborate with report developer to deliver dashboards in time and compliance with business requirements
Analyze business requirements and make technical decisions to drive the development process
Negotiate with customers on requirements and technical restrictions
Be a development stream coordinator (consult junior team member, monitor progress and troubleshoot issues)
Be a proactive developer who can provide expertise on technical and business matter

requirements

3+ years of experience as Data Engineer
Knowledge of Python (intermediate)
Knowledge of OOP, decorators
ETL/ELT development experience, preferably with Python
SQL Knowledge (intermediate+)
Experience with Data warehousing (Kimball)
Experience with AWS services (S3, Redshift, EC2)
Self-driven, self-coordinating
No supervisor needed
Able to drive development process of small team
Able to negotiate and collaborate with customers, drive discussion

lead data software engineer

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

India

We are in search of a skilled Lead Data Software Engineer for a remote position, ready to contribute to our team's success and bolster our Data Science endeavors.

As the Lead Data Software Engineer, you'll be instrumental in crafting and sustaining datamarts, ensuring the delivery of efficient and scalable data solutions that meet the unique needs of our clients. Your primary focus will revolve around constructing and maintaining data pipelines, offering on-call support, and fostering collaboration with Data Science teams to deliver top-tier solutions. Additionally, you'll be tasked with steering a group of proficient professionals, providing mentorship and guidance to empower them to produce cutting-edge solutions for the industry.

responsibilities

Guide and nurture the Data Software Engineering team, cultivating a culture of continual learning and growth within the unit
Collaborate with interdisciplinary teams to furnish top-notch data solutions aligning with project objectives and timelines
Forge and uphold robust Data Software Engineering processes and practices emphasizing automation, innovation, and efficiency
Ensure the realization and upkeep of streamlined and scalable data solutions utilizing AWS services
Supervise the fine-tuning of data processing and workflow management through Apache Airflow and Apache Spark
Consistently assess industry trends and best practices to enhance and implement the most potent Data Software Engineering strategies
Provide on-call assistance for data pipelines and datamarts
Direct the team in crafting and deploying REST APIs for seamless data integration and communication
Engage directly with clients to comprehend their requirements and deliver tailored, effective solutions
Steer the organization and structure of the team, guaranteeing the prompt and efficient delivery of projects
Collaborate with stakeholders, showcasing excellent communication and leadership skills

requirements

A minimum of 5 years of experience as a Data Software Engineer, engaged in substantial projects and intricate data infrastructures
At least 1 year of confirmed leadership experience, adeptly managing and motivating a team of Data Software Engineers
Proficiency in Amazon Web Services, encompassing the design and implementation of scalable and effective data solutions
Substantial expertise in Apache Airflow and Apache Spark, ensuring streamlined data processing and workflow management
Advanced familiarity with at least one CI/CD tool, preferably Jenkins, for the efficient delivery of data pipelines
Proficiency in Python and SQL, facilitating the creation and upkeep of data pipelines and ETL processes
Experience with Databricks and PySpark for data processing and analysis
Acquaintance with REST APIs for seamless data integration and communication
Robust analytical skills, empowering adept problem-solving and decision-making in intricate environments
Effective client-facing skills, facilitating clear communication and collaboration to attain project objectives
Exceptional organizational and structuring abilities, championing the efficient delivery of projects
Upper-intermediate proficiency in the English language, enabling clear collaboration, presentation, and discussion with the team and stakeholders

nice to have

Background with Redshift for data warehousing and analysis

senior data engineer

Data Software Engineering

Python, Databricks, Amazon Web Services

40 hrs/week

12+ months

Poland

We are seeking a highly skilled Senior Data Engineer to join our team and work remotely with one of the biggest American athletic footwear and apparel corporations.

In this role, you will be responsible for developing, constructing, testing and maintaining high-performance data architecture. You will be required to have a deep understanding of data analysis, data modeling, and data warehousing. If you have a passion for data engineering, we encourage you to apply.

responsibilities

Design, develop and maintain data-driven applications and systems
Develop and maintain data pipelines to facilitate efficient data processing and analysis
Create and execute data modeling and analysis strategies
Collaborate with cross-functional teams to analyze business requirements and design solutions that meet the needs of our clients
Identify and troubleshoot data integration and processing issues to maintain data integrity
Optimize and fine-tune data software solutions to ensure enhanced performance and scalability
Develop and maintain technical documentation for data software solutions

requirements

Minimum of 3 years of experience in data engineering
Strong programming skills in Python
Solid understanding of database technologies, data integration and ETL processes
Proficiency in Amazon Web Services (AWS) and Databricks
Strong command of data analysis and modeling techniques
Ability to work remotely with excellent communication and collaboration skills
Proven track record in designing and implementing scalable, high-performance data-driven applications and systems
Fluent English language skills with an upper-intermediate level or higher

nice to have

Experience with big data technologies such as Hadoop, Spark and Kafka
Experience with data governance and security best practices

senior data integration engineer

Data Integration

ETL/ELT Solutions, Azure Data Lake Storage, Databricks

40 hrs/week

12+ months

Poland

We are seeking a skilled Senior Data Integration Engineer to join our remote team.

We are looking for an experienced Senior Data Integration Engineer to join our team. As a Senior Engineer with 3+ years of relevant production experience, you will play a key role in designing, developing, and implementing data integration solutions. You will leverage your expertise in ETL/ELT solutions, Azure Data Lake Storage, Databricks, Azure Data Factory, MySQL, PostgreSQL, MS SQL.SQL, Oracle, SQL, and Python to deliver high-quality and scalable data integration processes. If you thrive in a challenging environment and have a passion for data integration, we want to hear from you.

responsibilities

Lead the design and development of data integration solutions, including ETL/ELT processes and data pipelines
Collaborate with stakeholders to gather and analyze data integration requirements
Provide technical guidance and mentorship to junior team members
Ensure data quality and consistency across integrated systems
Optimize data integration workflows for performance and scalability
Troubleshoot and resolve complex data integration issues
Stay up-to-date with industry trends and emerging technologies in data integration

requirements

Bachelor's degree in Computer Science, Information Systems, or a related field
3+ years of relevant production experience in data integration
In-depth knowledge of ETL/ELT solutions and data integration best practices
Strong proficiency in Azure Data Lake Storage, Databricks, and Azure Data Factory
Extensive experience with MySQL, PostgreSQL, MS SQL.SQL, and Oracle
Expert-level skills in SQL and Python for data manipulation and transformation
Solid understanding of data modeling and database design principles
Proven track record of successfully delivering complex data integration projects
Strong problem-solving and analytical skills
Excellent communication and leadership abilities
B2+ English level

nice to have

Experience with cloud-based data integration platforms such as AWS Glue or Google Cloud Dataflow
Familiarity with big data technologies like Hadoop and Spark
Knowledge of data warehousing concepts and tools
Understanding of data governance and data management practices
Ability to architect and implement real-time data integration solutions

senior data engineer

Data Integration

Microsoft SQL Server, SQL, SQL SSIS

40 hrs/week

12+ months

Poland

We are seeking a highly skilled remote Senior Data Engineer to join our team.

The successful candidate will have 3+ years of relevant work experience and will be a key developer responsible for developing complex solutions for our clients using Microsoft SQL Server. They will participate in the analysis, design, implementation, and maintenance of our projects, ensuring database performance, security, and availability.

responsibilities

Implement Data Integration solutions using SQL SSIS
Participate in the design, development, and testing of database solutions
Ensure database performance, security, and availability
Collaborate with team members and stakeholders to implement solutions that meet business requirements
Provide guidance and support to junior team members

requirements

3+ years of relevant work experience
Hands-on experience with Data Integration tools, particularly SQL SSIS
Bachelor's or higher degree in Computer Science or related field is preferred
Strong SQL skills and proficiency in Microsoft SQL Server
Strong analytical and problem-solving skills
Excellent communication and interpersonal skills
B2+ English level

nice to have

Experience working with remote teams and clients
Experience providing technical guidance and support to junior team members
Familiarity with additional database platforms and technologies
Knowledge of Agile methodologies and best practices
Ability to adapt to a fast-paced and dynamic work environment

senior data engineer

Data Software Engineering

Python, Amazon Web Services, AWS Glue

40 hrs/week

12+ months

Poland

We are seeking a highly skilled Senior Data Software Engineer to join our remote team, working with a British-American publicly traded analytics company that operates a collection of subscription-based services.

As a Senior Data Software Engineer, you will be responsible for developing and deploying production-grade ETL pipelines using Apache Spark. If you are passionate about data software engineering and have a keen eye for detail, we invite you to be part of our team.

responsibilities

Develop and deploy production-grade ETL pipelines using Apache Spark (PySpark) to handle large data volumes
Contribute to the design, development, and deployment of scalable and reliable data pipelines
Perform data analysis and data quality checks to ensure data accuracy and integrity
Create and maintain technical documentation for all ETL processes and data pipelines
Collaborate with cross-functional teams to review software requirements and ensure seamless integration with other systems
Provide technical guidance and mentorship to junior team members

requirements

Minimum of 3 years of experience in Data Software Engineering, showcasing your expertise in Python scripting for data handling (usage of pandas, numpy)
Strong expertise of Apache Spark (PySpark) for handle large data volumes (few hundred GBs)
Experience in writing UDFs in Spark
Experience with Relational DB, PostgreSQL/Snowflake preferred
Basic knowledge of Big data technologies like HBase and Hive
Hands-on experience with AWS Cloud, AWS Glue, Amazon EMR, and Databricks
Fluent spoken and written English at an Upper-Intermediate level or higher

nice to have

Prior experience on Apache Airflow is desirable
Experience in AWS data services like Glue & EMR

senior data software engineer

Data Software Engineering

Python, PySpark, SQL

40 hrs/week

12+ months

Poland

Join our team as a Senior Data Software Engineer, where you will be the foremost technical authority in the Data Engineering team within the Data Solutions Centre of Excellence

Our client, which is a leading provider of business management software for over 30 years, is seeking a Senior Data Software Engineer to join their remote Data Solutions Centre of Excellence. As the foremost technical authority in the Data Engineering team, you will drive the development of the data platform, including system architecture and efficient data products and pipelines within an agile working environment. You will work closely with cross-functional teams to identify and address complex data engineering challenges, developing robust solutions that meet business and user needs. This is a career-defining opportunity to make a significant impact within a fast-growing organisation.

responsibilities

Develop and maintain data models, pipelines, and ETL processes to ensure data quality, consistency, and accuracy
Keep the development of the data platform, including system architecture and efficient data products and pipelines within an agile working environment
Collaborate with cross-functional teams to identify and address complex data engineering challenges, developing robust solutions that meet business and user needs
Contribute to the development of data governance policies and procedures, ensuring compliance with relevant regulations and standards
Keep up-to-date with the latest data engineering technologies and trends, contributing to the continuous improvement of the data platform

requirements

A minimum of 3 years of experience in Data Software Engineering, demonstrating expertise in developing large-scale data products and pipelines
Proficiency in Python and PySpark, enabling you to develop efficient and scalable data processing solutions
In-depth knowledge of Databricks, Amazon Web Services and Microsoft Azure, showcasing your expertise in cloud-based data engineering technologies
Experience in developing and maintaining data models, pipelines, and ETL processes, demonstrating your comprehensive skill set
Strong focus on teamwork and exceptional interpersonal skills, allowing you to collaborate effectively with cross-functional teams
Fluent spoken and written English at an Upper-Intermediate level or higher

nice to have

Hands-on experience in developing data products and pipelines using other programming languages, such as Java or Scala
Experience in deploying machine learning models in production environments and in implementing data security and privacy measures

senior data software engineer

Data Software Engineering

Big Data, Python, Amazon Web Services

40 hrs/week

12+ months

Poland

We are seeking a talented Senior Data Software Engineer to join our team and work on innovative projects that aim to improve people's lives through vision and eye care products.

We are seeking a talented Senior Data Software Engineer to join our remote team and work on innovative project that aims to improve people's lives through vision and eye care products. As a senior member of our team, you will be responsible for designing and implementing scalable data software solutions that leverage Big Data technologies and Amazon Web Services. If you have a passion for using data to drive business decisions and a strong background in data engineering, we encourage you to apply.

responsibilities

Design, develop and implement data software engineering solutions for our client
Collaborate with cross-functional teams to identify data-driven business requirements and translate them into technical solutions
Perform data analysis and develop data pipelines to support data-driven decision-making processes
Ensure data quality and integrity by implementing appropriate data governance policies and procedures
Optimize data processing and storage solutions for performance and scalability
Create and maintain ETL processes to extract, transform and load data from various sources

requirements

Minimum of 3 years of experience in Data Software Engineering
Strong proficiency in Python and experience with Apache Spark (PySpark)
Expertise in working with Amazon Web Services, including CLI, S3, Glue, Lambda, Athena
Comprehensive understanding of columnar-based file types and unit testing
Experience with SQL and relational databases
Fluent English language skills with an Upper-Intermediate level

nice to have

Experience implementing solutions in accordance with IaC (Infrastructure as Code) principles

Data engineer full-time jobs

Are you an enthusiastic and experienced data engineer seeking engaging full-time employment? The perfect opportunity awaits you at EPAM Anywhere. Our world-class team is committed to constructing, installing, and managing scalable data architecture systems. Your expertise in platforms like AWS, Azure, and Hadoop, coupled with your programming knowledge in Python, Scala, and Java, makes you the ideal candidate for our diverse team.

In this rewarding role, your primary responsibility will extend beyond just maintaining data structures. You will be at the forefront of designing and implementing innovative solutions to meet complex computing needs. With an emphasis on constructing high-quality software and systems, we provide a stage for you to display and expand your technical skills.

At EPAM Anywhere, we treasure proficiency and creativity. Our work environment is dynamic, challenging, and supportive, perfect for individuals ready to take their career to a new level.

Data engineer job openings at EPAM Anywhere

At EPAM Anywhere, we're seeking dedicated, talented individuals for data engineer positions. Our employees are responsible for handling databases efficiently while keeping the design user-friendly. Using cutting-edge technology such as Spark and NoSQL, the ability to construct, install, and test systems is a must. Your role as a data engineer would extend to integrating new data management technologies and software engineering tools into existing structures, augmenting our clients’ current capabilities while ensuring system usability.

Data engineer positions globally

Our opportunities are global, inviting professionals from all walks of life to apply. In keeping with our mission to build and maintain robust, scalable systems, we look for individuals who can readily familiarize themselves with new platforms and proficiently manage intricate database structures. Our engineers impact the overall system design, from the architecture layout to the coding languages used. Subsequently, these roles demand individuals with a sharp understanding of various integral platforms like AWS, Azure, and Hadoop and languages like Java, Scala, and Python.

At EPAM Anywhere, we offer you the chance to dive into the deep end, challenging your skills and expanding your horizons. If this aligns with your career aspirations, take the bold step to bring your skills and commitment to our team. We envisage a future that’s shaped by your contribution. We look forward to welcoming you to fill our data engineering vacancies, where you will have the platform to test your knowledge and skills while maintaining world-class systems within rapidly growing digital infrastructures. Your success here depends as much on your design and testing skills as it does on your ability to work and evolve. Thus, we encourage you to take on the responsibility and apply for the position. Whether an experienced data engineer or a passionate beginner, we welcome you to apply.

Data Engineer Jobs

Data engineer full-time jobs

Data engineer job openings at EPAM Anywhere

Data engineer positions globally

Other skills