Вакансии для Big Data инженеров

В EPAM Anywhere открыты удаленные вакансии для Big Data инженеров.

Достойная оплата

Подавай заявку на одну из открытых удаленных вакансий, становись частью нашей глобальной команды и занимайся любимой работой, получая достойное вознаграждение.

Безграничные возможности для роста

Получи доступ к широкому набору обучающих ресурсов, возможностям профессиональной сертификации и поддержке персонального менеджера по карьерному развитию.

Корпоративные преимущества

В EPAM Anywhere ты получаешь больше, чем просто работу! Мы заботимся о твоем здоровье и комфортной жизни, предоставляя множество корпоративных преимуществ, которые уникальны для каждой страны.

lead big data engineer with databricks

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

Colombia

We are seeking a remote Lead Big Data Engineer with expertise in Databricks to join our team.

The successful candidate will be responsible for designing and implementing solutions utilizing Data Lake and stream processing engines like Kafka and Spark. The Lead Big Data Engineer will have experience in the Financial services domain and will be proficient in software development lifecycle (SDLC) methodologies like Agile and Test-driven development.

responsibilities

Designing and implementing solutions utilizing Data Lake and stream processing engines like Kafka and Spark
Providing technical leadership and guidance to team members
Collaborating with cross-functional teams to drive projects to completion
Developing and implementing SDLC methodologies like Agile and Test-driven development
Maintaining and improving the performance of existing solutions

requirements

Bachelor's/Master's Degree in Computer Science, Information Systems or equivalent
5+ years of relevant experience in Data Software Engineering
1+ years of relevant leadership experience
Expertise in Databricks, Python, AWS, Apache Spark, and Data Warehousing
Experience with Big Data platforms such as Apache Hadoop
Advanced SQL coding skills with both SQL and NoSQL databases
B2+ English level

nice to have

Experience with Apache Airflow, and Relational Database Design

senior big data engineer with databricks

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

Poland

We are looking for an experienced remote Senior Big Data Engineer with expertise in Databricks to lead our team of data engineers and take responsibility for designing and implementing data management solutions.

The successful candidate will be familiar with cloud-based data pipeline development and have experience building optimal data infrastructure solutions.

responsibilities

Lead a team of data engineers, organize teamwork, and solve technical and non-technical challenges
Design key software components of the data platform, and build collaborative partnerships with architects and technical leads
Create and maintain optimal on-prem and cloud-based data pipeline architectures capable of ingesting structured and unstructured data using batch & streaming methods
Assemble large, complex data sets that meet functional and technical requirements, and develop data flows that can leverage both on-premise and cloud architectures
Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs

requirements

Bachelor's degree in Computer Science, Information Systems, or another applicable field is preferred
At least 3 years of experience in a Data Engineer role
Advanced working knowledge of cloud-based data pipeline development, particularly on AWS
Experience building and optimizing data pipelines for data acquisition and management
Expertise in Databricks, Python, SQL, and AWS
B2+ English level

nice to have

Understanding of message queuing, stream processing, and Change Data Capture mechanisms

senior big data engineer with databricks

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

Poland

We are seeking a highly proficient remote Senior Big Data Engineer with extensive experience in Databricks, Python, AWS, and Data Warehousing.

The ideal candidate should be well-versed in software development lifecycle methodologies and proficient in advanced SQL coding. As a Senior Big Data Engineer, you will be responsible for developing and implementing scalable and resilient systems, utilizing data lake solutions, and stream processing engines to meet business goals.

responsibilities

Develop and implement scalable, resilient systems utilizing Data Lake solutions
Participate in the full software development lifecycle (SDLC) utilizing Agile methodologies
Build and maintain data pipelines using stream processing engines such as Kafka, Spark, etc.
Perform advanced data analysis and modeling using relevant programming languages
Ensure data quality and integrity through proper testing and validation techniques

requirements

Bachelor's/Master's Degree in Computer Science, Information Systems, or equivalent
At least 3 years of relevant experience in Data Software Engineering
Proficient with software development lifecycle (SDLC) methodologies like Agile, Test-driven development
Extensive experience in Databricks, Python, AWS, and Data Warehousing
Advanced SQL coding skills
B2+ English level

nice to have

Experience with Apache Airflow and Apache Spark
Expertise in Relational Database Design

senior big data engineer with python

Data Software Engineering

Databricks, Amazon Web Services, Python

40 hrs/week

12+ months

Poland

We are looking for an experienced remote Senior Big Data Engineer with a passion for data to develop, monitor, and operate the curated data pipeline for our project.

The ideal candidate has a strong background in Data Software Engineering and extensive experience with DSE Python AWS Databricks and SQL. In this position, you will be responsible for redeveloping legacy pipelines into new, advanced, and scalable versions, consulting with data scientists and product managers, building and improving KPIs, and maintaining our cloud-based tech stack.

responsibilities

Develop, monitor, and operate the most critical curated data pipeline in the project
Consult with data scientists and product managers to improve KPIs for business steering
Redevelop legacy pipelines into advanced, scalable versions that are easy to maintain
Leverage and improve our cloud-based tech stack that includes AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala
Build, monitor, and maintain Apache Airflow pipelines

requirements

Minimum of 3 years of experience in Data Software Engineering
Expertise in Apache Spark, Spark streaming, and Databricks
Fluency in Scala programming language and SQL
Experienced working with AWS landscape and Github
Ability to build Apache Airflow pipelines
B2+ English level

nice to have

Knowledge of Presto, Superset, and Starburst
Experience with Oracle & Exasol

lead data engineer with databricks

Data Software Engineering

Databricks, Amazon Web Services, Python

40 hrs/week

12+ months

Colombia

We are seeking a remote Lead Data Engineer with expertise in Databricks to join our team.

The ideal candidate will be responsible for designing, developing, and implementing data engineering solutions using Azure Data Factory, Databricks, Python, and SQL. The candidate must have excellent analytical and problem-solving skills, as well as strong communication and collaboration skills. The successful candidate will work with big data technologies such as Hadoop, Hive, Spark, or Kafka.

responsibilities

Design, develop, and implement data engineering solutions using Azure Data Factory, Databricks, Python, and SQL
Build and optimize data pipelines, data ingestion, and data transformation processes
Create technical documentation for data engineering solutions, data flows, and data models
Collaborate with the team to identify and resolve complex data engineering issues
Provide coaching and guidance for junior data engineers on the team

requirements

Minimum of 5 years of experience in developing Data Software Engineering solutions using Azure Data Factory, Python, and SQL
1+ years of relevant leadership experience
Experience with cloud-based platforms and technologies such as Azure, AWS, or GCP
Strong proficiency in Databricks
Experience working with Big Data technologies such as Hadoop, Hive, Spark, or Kafka
Upper-Intermediate English level (B2+)

nice to have

Experience with NoSQL databases
Experience with machine learning frameworks

senior data engineer (python, databricks)

Data Software Engineering

Amazon Web Services, Databricks, Python

40 hrs/week

12+ months

Poland

We are seeking a talented remote Senior Data Engineer with strong experience in Data Software Engineering.

The ideal candidate will have Big Data technologies, primarily Spark, work with cross-functional teams to design, develop, and deploy high-performance data pipelines.

responsibilities

Design, develop and deploy high-performance data pipelines
Work with cross-functional teams to deliver complex projects
Develop, maintain and optimize ETL processes
Troubleshoot and optimize data pipeline processes
Create and maintain data models and databases

requirements

3+ years of software engineering experience
Good knowledge of Big Data technologies, primarily Spark
Experience with DSE Python, AWS, and Databricks
Familiarity with Python
Upper-Intermediate English level (B2+)

nice to have

Knowledge of Apache Spark and Apache Hive

senior data software engineering with databricks

Data Software Engineering

Amazon Web Services, Apache Spark, Databricks

40 hrs/week

12+ months

Georgia

We are looking for a remove Data Software Engineer with a strong background in Scala, AWS, and Databricks to join our team.

As a Data Software Engineer, you will be responsible for developing and implementing data processing solutions using Databricks and other big data platforms. You will collaborate with cross-functional teams to design, implement and deliver highly scalable and resilient systems.

responsibilities

Design and implement data processing solutions using Databricks
Collaborate with cross-functional teams to deliver highly scalable and resilient systems
Optimize data processing workflows for enterprise-level data processing systems
Implement data integration strategies between systems and data stores
Ensure data security, reliability

requirements

Master’s Degree in Computer Science, Information Systems, or equivalent
3 years of experience in Data Software Engineering with Databricks
Strong experience in Data Warehousing design and Advanced SQL coding
Strong experience in building solutions using Databricks, Scala, and AWS
Experience with stream processing engines like Kafka, Spark
Upper-Intermediate English level (B2+)

nice to have

Experience with Google Cloud Platform, Apache Airflow, Snowflake
Familiarity with Google Cloud BigQuery

senior data engineer (databricks)

Data Software Engineering

Amazon Web Services, Databricks, Python

40 hrs/week

12+ months

Poland

We are looking for a remoted Senior Data Engineer with strong experience in Databricks to join our project.

The ideal candidate will have knowledge of Big Data technologies, primarily Spark.

responsibilities

Design and implement efficient data pipelines and ETL processes
Collaborate with cross-functional teams to develop and implement data-driven solutions
Optimize data models and queries for performance
Develop and maintain data documentation and data lineage
Mentor and provide technical leadership to junior team members

requirements

3+ years of software engineering experience
Strong experience in Databricks
Experience with AWS, Python, Big Data
Hands-on knowledge of Spark
Good leadership skills
Upper-Intermediate level of English (B2+)

nice to have

Familiarity with Apache Hive

senior big data developer

Data Software Engineering

Apache Spark, Amazon Web Services, Snowflake

40 hrs/week

12+ months

Colombia

We are looking for an experienced remote Senior Big Data Developer to join our team.

As an ideal candidate, you should have extensive knowledge of Data Software Engineering, Snowflake, AWS, Python, and Apache Spark. You will be responsible for developing PySpark ETL pipelines, configuring Kafka connectors, and building Jenkins pipelines.

responsibilities

Develop PySpark ETL pipelines and configure Kafka connectors
Build Jenkins pipelines for schedulers, CI/CD, etc.
Work with Kafka UI and other relevant tools such as Python 3.7, PySpark SQL, Jenkins, Artifactory, Sonar, and Atlassian tools
Collaborate with cross-functional teams to determine project requirements and deliverables
Troubleshoot and debug applications as needed

requirements

3+ years of relevant experience as a Big Data Developer or Data Engineer
Strong skills in Snowflake, AWS, and Spark
Knowledge of Python
Hands-on experience with Kubernetes/Docker and Jenkins pipeline
Knowledge of Kafka Connect Cluster and Atlassian tools (Bitbucket, Jira, Confluence)
Good English communication skills (B2+)

nice to have

Familiarity with PyCharm IDE

senior data engineer

Data Software Engineering

Amazon Web Services, Apache Spark, Apache Hadoop

40 hrs/week

12+ months

Georgia

We are looking for an experienced remote Senior Data Engineer to join our team.

You will be responsible for expanding and optimizing our data and data pipeline design, as well as optimizing data flow and collection for cross-functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.

responsibilities

Create and maintain optimal data pipeline design
Assemble large, complex data sets that meet functional/non-functional business requirements
Identify, design, and implement internal process improvements
Build the infrastructure required for optimal ETL process of data from a wide variety of data sources using SQL and AWS Big Data technologies or it can be Databricks as well
Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs

requirements

3+ years of experience in a Data Engineer role
Good experience in Apache Spark and Hadoop technologies
Hands-on experience in Databricks platform
Must have experience in PySpark or Scala programming languages
Experience with AWS cloud services: EC2, EMR, RDS, Aurora DB services
Advanced working SQL knowledge and experience working with relational databases
B2+ English level

nice to have

Good to have Java and related programming language experience
Experience building and optimizing big data data pipelines
Experience supporting and working with cross-functional teams in a dynamic environment

get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals

Отзывы Anywhere People
“Я ценю удалённую работу за возможность поддерживать баланс между работой и личной жизнью. Для меня EPAM Anywhere - идеальный выбор из-за удаленного формата работы и грамотного организационного процесса, поэтому я приняла предложение не раздумывая. EPAM - это компания, которая накопила одну из самых обширных, хорошо структурированных баз знаний, с которыми я когда-либо сталкивалась. Я также выбрала Anywhere за стабильность, прозрачность ожиданий для обеих сторон, уважение к каждому человеку, вкладывающему свое время и энергию в компанию, а также за возможности обучения, которые предлагает EPAM, которые качественно отличаются от многих других компаний”.
ЮлияSenior Software Testing Engineer, Украина, Киев

Вакансии для Big Data инженеров

Похожие специализации