Data Engineering Jobs

EPAM Anywhere is looking for Data Engineering Specialists.

Enjoy transparent promotions

Land your ideal Hybris job and get a guaranteed competitive pay that grows together with you. With no limits.

Access enterprise-level perks

SAP remote specialists get a country-specific pack of corporate benefits that includes many disounts, health coverage and relocation opportunities.

Grow your expertise

Get support from a dedicated Skill Advisor, make use of a wide set of education, career growth and personal development services to hit your next career targets.

senior data engineer

Data Integration

BigQuery Datasets, Cloud Composer, Google Cloud Platform

40 hrs/week

12+ months

Georgia

Learn more

Currently, we are looking for a remote Senior Data Engineer to join our global team

Currently, we are looking for a remote Senior Data Engineer to join our global team. The customer is a telemedicine company based in Boston that connects patients with doctors over secure video.

responsibilities

Manage, utilize, move and transform data to create reports for senior management and clients
Conduct business analysis on data requests to ensure clarity on the need and proper data usage adherent to security mandates
Build various ETL pipelines among the various tools in play to surface data for consumption by our Reporting Tool
Competing requests from internal and external stakeholders in addition to keeping the reporting infrastructure on par with new product functionality and release cycles
Become a Subject Matter Expert in data classification within the platform and utilize your expertise to identify the most efficient path to deliver data from A to B as needed
Working hand in hand with Hosting, Analytics and Product
Be accountable for the delivery of accurate and timely reporting solutions

requirements

3+ years of experience as Data Engineer
Strong knowledge of GCP Databases
Strong knowledge of Google BigQuery
Strong knowledge of SQL

senior data engineer

Data Integration

AWS Simple Storage Service (S3), Amazon Web Services, SQL

40 hrs/week

12+ months

Georgia

Learn more

Currently, we are looking for a remote Senior Data Engineer to join our global team

Currently, we are looking for a remote Senior Data Engineer to join our global team. The customer is an online travel agency and metasearch engine that helps book airline tickets, hotel reservations, car rentals, cruise ships, and vacation packages.

responsibilities

Develop and support ETL pipelines written in Python and SQL (+HiveQL) and orchestrated by a 3rd party tool
Build all data layers (landing, staging, warehouse, datamarts) in S3, Qubole Hive and AWS Redshift
Collaborate with report developer to deliver dashboards in time and compliance with business requirements
Analyze business requirements and make technical decisions to drive the development process
Negotiate with customers on requirements and technical restrictions
Be a development stream coordinator (consult junior team member, monitor progress and troubleshoot issues)
Be a proactive developer who can provide expertise on technical and business matter

requirements

3+ years of experience as Data Engineer
Knowledge of Python (intermediate)
Knowledge of OOP, decorators
ETL/ELT development experience, preferably with Python
SQL Knowledge (intermediate+)
Experience with Data warehousing (Kimball)
Experience with AWS services (S3, Redshift, EC2)
Self-driven, self-coordinating
No supervisor needed
Able to drive development process of small team
Able to negotiate and collaborate with customers, drive discussion

nice to have

Knowledge of AWS Elastic Beanstalk
Knowledge of AWS Simple Notification Service
Knowledge of AWS Simple Queue Service
Knowledge of Amazon Redshift
Knowledge of Java
Knowledge of Python.Core
Knowledge of Spring Boot
REST API data source understanding
HiveQL experience
Experience building DW architecture in Hive cluster or MPP database
Tableau or general reporting experience

lead data engineer

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

Colombia, Mexico

Learn more

We are seeking a passionate remote Lead Data Engineer to join the Customer Success and Support (CSS) Data Engineering team, who will be responsible for designing and building world-class data solutions and applications.

The ideal candidate must have 5+ years of relevant production experience and at least 1 year of relevant leadership experience in building scalable and high-performance data-driven solutions. You will lead a team of experienced Data Engineers to provide high-quality data insights and support to our customers.

responsibilities

Lead and manage a team of experienced Data Engineers to build and maintain scalable data solutions and applications
Collaborate with cross-functional teams including Data Scientists, Product Managers, and Business Analysts to design and implement data-driven solutions
Develop and maintain ingestion pipelines, ETL processes, and data models that can handle large amounts of data
Ensure data quality, consistency, and accuracy by implementing quality checks and data validation processes
Manage and optimize AWS resources and services to ensure cost-effective and efficient use of resources
Create and maintain documentation to help end-users understand the data and insights provided

requirements

5+ years of relevant production experience in building world-class data solutions and applications
1+ years of relevant leadership experience
Strong proficiency in SQL with extensive knowledge of Databricks SQL (Databricks is nice to have, and can be trained)
Strong expertise in Spark, Python (PySpark, writing on top of Airflow), data integration, and modeling
Experience with AWS suite, data modeling, and using REST APIs
Some ETL experience (how to build ETL pipeline)
Proven leadership experience managing and mentoring a team of Data Engineers
Ability to work in a fast-paced and dynamic environment with tight deadlines
Experience working collaboratively in a team environment
B2+ English level

nice to have

Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)

senior data engineer

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

Colombia, Mexico

Learn more

We are seeking a passionate remote Senior Data Engineer to join the Customer Success and Support (CSS) Data Engineering team, who will be responsible for designing and building world-class data solutions and applications.

The ideal candidate must have 3+ years of relevant production experience in building services that scale. You will work with a dynamic team of professionals to provide high-quality data-driven insights and support to the Data Science teams.

responsibilities

Work closely with Data Scientists to understand their needs and help build tables and data models for analytics purposes
Develop and maintain ingestion pipelines and ETL processes that can handle large amounts of data
Collaborate with the existing FTE team to provide mentorship and support to junior team members
Build robust and scalable data solutions that can handle complex business requirements.
Ensure data quality, consistency, and accuracy by implementing quality checks and data validation processes
Create and maintain documentation to help end-users understand the data and insights provided

requirements

3+ years of relevant production experience in building world-class data solutions and applications
High proficiency in SQL with extensive knowledge of Databrick SQL (DataBricks is nice to have, and can be trained)
Strong expertise in Spark, Python (PySpark, writing on top of Airflow), data integration, and modeling
Experience with AWS suite, data modeling, and using REST APIs
Some ETL experience (how to build ETL pipeline)
Ability to work in a fast-paced and dynamic environment with tight deadlines
Experience working collaboratively in a team environment
B2+ English level

nice to have

Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)

senior data engineer

Data Software Engineering

Apache Spark, Databricks, SQL

40 hrs/week

12+ months

Greece

Learn more

We are looking for a remote Senior Data Engineer to make the team even stronger.

responsibilities

Develop, monitor, and operate the most used and most critical curated data pipeline - Sales Order Data (incl. Post-order information, e.g. shipment, return, payment). This pipeline is processing hundreds of millions of records to provide high-quality datasets for analytical and machine learning use-cases
Consulting with analysts, data scientists, and product managers to build and continuously improve "Single Source of Truth" KPI for business steering such as the central Profit Contribution measurement (PC II)
Leverage and improve a cloud-based tech stack that includes AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala

requirements

3+ years of relevant experience
Expertise in Apache Spark along with Spark streaming & Spark SQL
Good hands on experience with Databricks and delta-lake
Fluency in Scala programming language
Good understanding & hands-on experience with CI/CD
Rich working experience with Github
Fluency working with AWS landscape
Ability to build Apache Airflow pipelines
Upper-intermediate or higher English level, both spoken and written (B2+)

nice to have

Presto
Superset
Starburst
Exasol

senior data engineer

Data Software Engineering

Databricks, MicroStrategy Analytics, Apache Spark

40 hrs/week

12+ months

Greece

Learn more

We are looking for a remote Data Engineer to make the team even stronger.

responsibilities

Gather business requirements, analyze them, join the dots using data and drive the implementation
Design, develop, monitor and visualize Customer Data Access Overhaul data product
Integrate high-quality datasets for analytical use-cases
Support in designing incident management process
Enable other data teams to follow the customer's standards
Testing (preparation and execution)
Operations of data pipelines incl. alerting, bug fixing, etc

requirements

3+ years hands-on experience in Databricks or similar
3+ years hands-on experience in MicroStrategy
Strong skills in data visualisation and data modelling
Good understanding of ETL concepts
Apache Spark, PySpark and Python, SQL
AWS Glue + Amazon S3
GitHub + CI/CD
Team player (easy & respectful communications, shares responsibilities for the team overall success)
Communication skills
Organisational skills
Mastery in Engineering
Upper-intermediate or higher English level, both spoken and written (B2+) (is able to communicate fluently with English speaking stakeholders, able to share ideas and provide reasoning)

nice to have

Advanced Databricks skills like delta, cluster configuration or Databricks APIs
Experience in new technologies like BigQuery, Airflow, Redshift or Apache NiFi

senior big data engineer

Data Software Engineering

Data Analytics and Visualization, Databricks, AWS Glue

40 hrs/week

12+ months

Georgia

Learn more

We are seeking a remote Senior Big Data Engineer to join our team.

The candidate should be able to work closely with business stakeholders and technical teams to design, develop and deliver high-quality data products that meet the business requirements. The role involves end-to-end responsibility for data integration, data modeling, and reporting on MicroStrategy, with the option to work with Databricks as well.

responsibilities

Gather business requirements and translate them into technical solutions
Design, develop, monitor, and visualize Customer Data Access Overhaul data product
Integrate high-quality datasets for analytical use-cases
Support in designing incident management process
Enable other data teams to follow the customer standards
Testing (preparation and execution)
Operations of data pipelines including alerting, bug fixing, etc.

requirements

3+ years of hands-on experience in Databricks or similar
3+ years of hands-on experience in MicroStrategy
Bachelor's or Master's degree in Computer Science, Engineering or a related field
Strong skills in data visualization and data modeling
Good understanding of ETL concepts
Apache Spark, PySpark and Python, SQL
AWS Glue + Amazon S3
GitHub + CI/CD
Team player (easy & respectful communications, shares responsibilities for the team's overall success)
Ability to work independently
Communication skills
Organizational skills
Strong problem-solving skills and attention to detail
Ability to handle multiple tasks in a fast-paced environment
Willingness to learn and stay up-to-date with emerging technologies

nice to have

Advanced Databricks skills like delta, cluster configuration, or Databricks APIs
Experience in new technologies like BigQuery, Airflow, Redshift, or Apache NiFi

data platform support engineer

Data Software Engineering

Apache Spark, Databricks, SQL

40 hrs/week

12+ months

Greece

Learn more

We are looking for a remote Data Platform Support Engineer to make the team even stronger.

As a Data Engineer in Data Platform, you will be supporting 1000+ stakeholders focusing on data transformation and pipeline orchestration technologies. By constantly challenging the status quo, you will ensure stakeholder teams to deliver high-performance data processing solutions that are efficient and remain reliable at scale.

responsibilities

Automation of support activities (e.g cluster creations, configuration changes)
Improving documentation to address user inquiries
Prioritizing customer queries and escalating serious technical issues to 2nd level
Operational Excellence:
Stakeholder support through chat and support tickets
Troubleshooting user issues related to Databricks (Spark) / Airflow and suggesting optimizations for long running or resource intensive jobs
Guiding users on best practices of Databricks and Airflow cluster management
Consult and help our diverse teams to develop, implement and maintain sustainable, high-performance, growth-ready data-processing and data integration systems
Having documentation focus to improve user journey

requirements

3+ years of relevant experience
Basic understanding of distributed data processing frameworks like Apache Spark
Understanding of relational database management systems
Hands-on experience with Databricks
Hands-on experience with Apache Airflow/Amazon Managed Workflows for Apache Airflow
Hands-on experience with Python combined with SQL knowledge
Hands-on experience in cloud technologies (AWS services like S3, EC2, IAM, Cloudformation)
Hands-on experience in container/orchestration tools (Kubernetes, Docker, Podman)
Engineering craftsmanship with an experience in software development processes focusing on testing, continuous integration/continuous delivery (CI/CD), monitoring and writing documentation
Upper-intermediate or higher English level, both spoken and written (B2+)

nice to have

Knowledge on AWS Step Functions, Cloudwatch, Lambda

senior big data engineer

Data Software Engineering

Amazon Web Services, SQL, Python

40 hrs/week

12+ months

Colombia, Mexico

Learn more

We are seeking a remote Senior Big Data Engineer to join the team, responsible for building world-class data solutions and applications that power crucial decisions throughout our customer's organization.

The ideal candidate should be passionate about building services that scale and have at least 3+ years of work experience in data engineering.

responsibilities

Support the Data Science teams by building tables, looking at incoming support tickets, and providing mentorship to existing FTE team
Build datamarts, separate data models used for analytics purposes, and work in sprints
Handle ad-hoc requests and be available for on-call support
Build ingestion pipeline
Publish documentation to help people use the information provided
Work in a 12/5 support mode

requirements

3+ years of relevant work experience in Data Engineering
High proficiency in SQL, specifically with Databrick SQL (DataBricks is nice to have, and can be trained)
Extensive knowledge in Spark, Python (PySpark, writing on top of Airflow), and data integration and modeling
General knowledge of Big Data, AWS suite, and Airflow
Experience with data modeling and using REST APIs
Some ETL experience in building ETL pipelines
Excellent communication and documentation skills
Ability to work well in a team environment
Willingness to receive constructive feedback
Enthusiasm for learning new technology on the fly and adapting to changes
B2+ English level

nice to have

Experience working with varied forms of data infrastructure, including relational databases (e.g., SQL), Spark, and column stores (e.g., Redshift)

lead big data engineer

Data Software Engineering

Data Analytics and Visualization, Databricks, AWS Glue

40 hrs/week

12+ months

Georgia

Learn more

We are seeking a remoteWe are currently hiring for the position of Lead Big Data Engineer for a remote work setup.

We are currently hiring for the position of Lead Big Data Engineer for a remote work setup. The ideal candidate will work closely with technical teams and business stakeholders in developing, designing, and delivering high-quality data products that meet business requirements. The role is responsible for end-to-end data integration, modeling, and reporting on MicroStrategy and Databricks platforms.

responsibilities

Translate business requirements into technical solutions
Design, develop, monitor, and visualize Customer Data Access Overhaul data product
Integrate high-quality datasets for analytical use-cases
Design incident management process
Help other data teams follow the customer standards
Conduct testing (preparation and execution)
Operate data pipelines and address alerts, bugs, etc.

requirements

Bachelor's or Master's degree in Computer Science, Engineering, or related field
Minimum of 5 years of experience in Databricks or similar
Minimum of 5 years of experience in MicroStrategy
1+ years of relevant leadership experience
Strong skills in data visualization and data modeling
Good understanding of ETL concepts
Proficient in Apache Spark, PySpark, Python, and SQL
Familiarity with AWS Glue, Amazon S3, GitHub, and CI/CD
Ability to work independently and as a team player
Strong communication and organizational skills
Strong problem-solving skills and attention to detail
Ability to multitask in a fast-paced environment
Willingness to learn and keep updated with emerging technologies

nice to have

Advanced Databricks skills like delta, cluster configuration, or Databricks APIs
Experience in new technologies like BigQuery, Airflow, Redshift, or Apache NiFi

Data Engineering Jobs

Related skills