Big Data Engineer Jobs

EPAM Anywhere is looking for Big Data Engineers.

Competitive compensation

We back all payments and operate in compliance with country-specific labor regulations. Your annual paycheck can range from $15k to $200k.

Numerous benefits

Make use of 1,500+ online and location-specific benefits across 30+ countries that also include healthcare and sports programs for you and your family.

Limitless career growth opportunities

Get access to a large-scale ecosystem that consists of educational and career development services created for your growth. A personal skill advisor will support you on each step of this journey.

senior data engineer (python, databricks)

Data Software Engineering

Amazon Web Services, Databricks, Python

40 hrs/week

12+ months

Poland

We are seeking a talented remote Senior Data Engineer with strong experience in Data Software Engineering.

The ideal candidate will have Big Data technologies, primarily Spark, work with cross-functional teams to design, develop, and deploy high-performance data pipelines.

responsibilities

Design, develop and deploy high-performance data pipelines
Work with cross-functional teams to deliver complex projects
Develop, maintain and optimize ETL processes
Troubleshoot and optimize data pipeline processes
Create and maintain data models and databases

requirements

3+ years of software engineering experience
Good knowledge of Big Data technologies, primarily Spark
Experience with DSE Python, AWS, and Databricks
Familiarity with Python
Upper-Intermediate English level (B2+)

nice to have

Knowledge of Apache Spark and Apache Hive

senior data engineer with python (databricks, aws)

Data Software Engineering

Amazon Web Services, Databricks, Python

40 hrs/week

12+ months

Poland

We are looking for an experienced remote Senior Data Engineer with Python, Databricks and AWS skills to join our team.

The right candidate enjoys working collaboratively to solve complex data engineering challenges that support our business needs.

responsibilities

Design, implement and maintain large-scale data pipelines using Python, Databricks
Work with cross-functional teams to integrate solutions that meet our data processing and analysis needs
Ensure performance, reliability, security and maintainability of data pipelines
Develop monitoring and alerting mechanisms to proactively identify and resolve issues
Continuously look for opportunities to improve data engineering processes and practices

requirements

Minimum of 3+ years with expertise in designing and maintaining large-scale data pipelines
Strong proficiency in Python and Databricks, (AWS) in production environments
Excellent understanding of Big Data technologies, primarily Spark
Strong understanding of data architecture and modelling concepts
Highly knowledgeable about data warehousing principles and practices
Upper-Intermediate level of English (B2+)

nice to have

Experience with Apache Hive

senior data quality engineer (databricks, aws)

Data Software Engineering

Amazon Web Services, Databricks, Python

40 hrs/week

12+ months

Poland

We are looking for a remote Senior Data Quality Engineer with experience in DSE Python and AWS Databricks.

The successful candidate need have someone with strong analytical skills, excellent communication skills.

responsibilities

Ensure data quality and integrity across all platforms and systems
Collaborate with cross-functional teams to design and implement data management
Develop and execute test scenarios to validate data management systems
Provide technical guidance and mentorship to junior team members
Work directly with customers to validate data requirements and manage data quality issues

requirements

3+ years of experience in Data Software Engineering
Strong working knowledge of DSE Python, AWS Databricks and Apache Spark
Familiarity with testing methods (TDD, BDT, DDT)
Experience with data ingestion pipelines, data warehousing and data lakes
Understanding of CI/CD principles and best practices in data processing
Upper-intermediate English language skills (B2+)

nice to have

Familiarity with Amazon QuickSight, Microsoft PowerBI,
Experience with Big data technologies such as Apache Hadoop and Apache Hive

Big Data Engineer Jobs

Other skills