Empleos de Ingeniero de Datos

EPAM Anywhere busca Data Ingenieros

Remuneración competitiva

Respaldamos todos los pagos y operamos de conformidad con las normas laborales específicas de cada país.

Numerosos beneficios

Aprovecha más de 1500 beneficios, en línea y específicos de la ubicación, situados en más de 30 países, que incluyen programas de salud y deportes para ti y tu familia.

Oportunidades ilimitadas de crecimiento profesional

Recibe acceso a un ecosistema de gran escala que consiste en servicios de desarrollo educativo y profesional creados para tu crecimiento. Un asesor personal de habilidades te apoyará en cada paso de este viaje.

¿buscas empleos para ingenieros de datos?

¡Encontraremos uno para ti! Envíanos tu CV y nos pondremos en contacto con el empleo que mejor se ajuste a ti.

encuéntrame un trabajo

lead big data engineer

Data Software Engineering

Apache Spark, Databricks, Python

40 hrs/week

12+ months

Chile, Colombia

We are seeking a highly skilled remote Lead Big Data Engineer to join our team, working on a cutting-edge project that leverages the latest technologies to deliver innovative solutions in the field of data engineering.

In this role, you will lead a team of engineers in the development, implementation, and maintenance of large-scale data processing systems, ensuring the highest levels of performance, reliability, and scalability. If you are a creative problem solver with a passion for data engineering and a proven track record of delivering complex projects, we invite you to apply for this exciting opportunity.

responsibilities

Lead a team of engineers in the design, development, and maintenance of large-scale data processing systems
Collaborate with stakeholders to identify business requirements and translate them into technical specifications
Develop and implement data processing pipelines using technologies such as Apache Spark and Databricks
Optimize data processing performance and scalability, ensuring high levels of reliability and availability
Provide technical guidance and mentorship to team members, fostering a culture of continuous learning and development
Conduct code reviews and ensure adherence to coding standards and best practices
Stay up-to-date with emerging trends and technologies in data engineering, and make recommendations for their adoption

requirements

A minimum of 5 years of experience in Data Software Engineering, with expertise in designing and building large-scale data processing systems
A minimum of 1 year of experience in leading a team of engineers, providing technical guidance and mentorship, and driving successful project outcomes
Expertise in Apache Spark and Databricks, showcasing your proficiency in distributed computing and data processing
In-depth knowledge of programming languages such as Python and Scala, enabling you to write efficient and effective code
Strong understanding of data modeling and database design principles, including experience with SQL and NoSQL databases
Experience with cloud-based data processing platforms such as AWS, Azure, or Google Cloud Platform
Excellent communication skills and the ability to work collaboratively with cross-functional teams
Fluent spoken and written English at an Upper-Intermediate level or higher
Spanish language proficiency is a must-have

nice to have

Completed Databricks Data Engineering Professional certification
Experience with machine learning and data analytics tools and frameworks such as TensorFlow, PyTorch, or Apache Flink
Experience with data visualization tools such as Tableau, Power BI, or QlikView

lead big data engineer

Data Software Engineering

Apache Spark, Databricks, Python

40 hrs/week

12+ months

Chile, Colombia

We are seeking a highly skilled remote Lead Big Data Engineer to join our team, working with a global leader in the technology industry.

In this role, you will be responsible for leading a team of engineers to design and develop data solutions using Databricks and other Big Data technologies. You will work closely with cross-functional teams to ensure the delivery of high-quality solutions that meet business requirements. In this position, you will play a crucial role in driving innovation and growth in our organization. Fluency in Spanish and Databricks Data Engineering Professional certification are required.

responsibilities

Lead the design and development of data solutions using Databricks and other Big Data technologies
Collaborate with cross-functional teams to understand business requirements and provide technical guidance and support
Mentor and lead a team of engineers to ensure the delivery of high-quality solutions
Identify and resolve technical issues, ensuring the timely delivery of projects
Contribute to the development of best practices and standards for data engineering
Stay up-to-date with the latest Big Data technologies and trends, sharing knowledge with the team
Provide technical guidance and support to other teams within the organization

requirements

Minimum of 5 years of experience in Data Software Engineering, with a focus on Big Data technologies
1+ years of relevant leadership experience
Expertise in Apache Spark and Databricks, with a proven track record of designing and developing complex data solutions
Proficiency in programming languages such as Python and Scala, enabling you to write efficient and scalable code
Experience with Microsoft Azure, including Azure Data Factory, Azure Databricks, Azure Data Lake Storage, and Azure Synapse Analytics
Excellent leadership skills, including the ability to mentor and lead a team of engineers
Strong problem-solving skills, with the ability to identify and resolve complex technical issues
Fluent spoken and written English at an Upper-Intermediate level or higher
Spanish language proficiency is a must-have

nice to have

Experience with data streaming technologies such as Kafka or Kinesis
Familiarity with machine learning and data science concepts and tools
Experience with cloud-based data solutions such as AWS or Google Cloud Platform
Experience with distributed computing and containerization technologies such as Kubernetes or Docker

senior data science engineer

Data Science

Amazon Redshift, Amazon Web Services, Data Mining

40 hrs/week

12+ months

Colombia

We are looking for a talented Senior Data Science Engineer to join our remote team. You will be responsible for developing and implementing machine learning models and working with our data scientists and software engineers to create predictive models.

We are looking for a talented remote Senior Data Science Engineer to help us create predictive models that can be used to improve our understanding of healthcare pricing and help people find affordable services As a Data Scientist, you will develop and implement machine learning models, work with our data scientists and software engineers to create predictive models that can be used by healthcare providers and consumers, and develop and refine algorithms to identify healthcare trends and predict healthcare costs. Additionally, you will develop personalization and recommendation models, analyze product performance and customer insights, and work to perform other data alignment and compatibility tasks to drive product recommendations within tightly constrained requirements.

responsibilities

Develop and implement machine learning models
Work with our data scientists and software engineers to create predictive models that can be used by healthcare providers and consumers
Develop and refine algorithms to identify healthcare trends and predict healthcare costs
Develop personalization and recommendation models, analyze product performance and customer insights
Perform other data alignment and compatibility tasks to drive product recommendations within tightly constrained requirements
Price comparison and price recommendations
Demand forecasting/supply shortage
Customer segmentation/analytical atop of web analytics data

requirements

3+ years of experience in Data Science
Must have skills in Amazon Redshift, Amazon Web Services
Experience with Data Mining, Machine Learning Model Development
Knowledge of PostgreSQL
Familiarity with Predictive Analysis
Experience with data management and modeling
Expertise in statistical analysis and modeling
Strong communication skills in English (Upper-Intermediate level)

nice to have

Experience with Amazon EMR and Apache Spark
Experience with recommendation systems
Knowledge of Python

lead data software engineer

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

India

We are seeking a talented remote Lead Data Software Engineer to join our team and support our Data Science teams.

As a Lead Data Software Engineer, you will play a key role in the development and maintenance of datamarts, ensuring efficient and scalable data solutions for our clients. Your main focus will be on building and maintaining data pipelines, providing on-call support, and working collaboratively with Data Science teams to deliver high-quality solutions. You will also be responsible for leading a group of talented professionals, providing mentorship and guidance to enable them to deliver industry-leading solutions.

responsibilities

Lead and mentor the Data Software Engineering team, fostering a culture of growth and continuous learning within the group
Collaborate with cross-functional teams to deliver high-quality data solutions in line with project goals and timelines
Develop and maintain effective Data Software Engineering processes and practices that focus on automation, innovation, and efficiency
Ensure the implementation and maintenance of efficient and scalable data solutions using AWS services
Oversee the optimization of data processing and workflow management using Apache Airflow and Apache Spark
Continuously evaluate industry trends and best practices to refine and implement the most effective Data Software Engineering strategies
Provide on-call support for data pipelines and datamarts
Guide the team in the development and deployment of REST APIs for data integration and communication
Work directly with clients to understand their needs and deliver effective, tailored solutions
Drive the team's organization and structure, ensuring the efficient and timely delivery of projects
Collaborate with stakeholders, demonstrating excellent communication and leadership skills

requirements

Minimum of 5 years of experience as a Data Software Engineer, working with large-scale projects and complex data infrastructures
At least 1 years of proven leadership experience, successfully managing and inspiring a team of Data Software Engineers
Expertise in Amazon Web Services, designing and implementing scalable and efficient data solutions
Solid experience in Apache Airflow and Apache Spark, ensuring efficient data processing and workflow management
Advanced experience with at least one CI/CD tool, preferably Jenkins, for efficient delivery of data pipelines
Proficiency in Python and SQL, developing and maintaining data pipelines and ETL processes
Experience with Databricks and PySpark for data processing and analysis
Knowledge of REST APIs for data integration and communication
Strong analytical skills, enabling effective problem-solving and decision-making in complex environments
Strong client-facing skills, enabling effective communication and collaboration to meet project objectives
Excellent organizational and structuring abilities, promoting the efficient delivery of projects
Upper-intermediate English language proficiency level, enabling clear collaboration, presentation, and discussion with the team and stakeholders

nice to have

Experience with Redshift for data warehousing and analysis

lead big data engineer

Data Software Engineering

Apache Spark, Databricks, Python

40 hrs/week

12+ months

Chile, Colombia

We are seeking a highly skilled remote Lead Big Data Engineer to join our team, working with a leading provider of cloud-based solutions for the financial services industry.

In this position, you will be responsible for managing and developing the company's big data infrastructure, collaborating with cross-functional teams to design and implement scalable and reliable data solutions. You will also be responsible for driving the adoption of new technologies and tools to enhance the company's data processing capabilities. If you are passionate about big data and have experience in managing complex data systems, we invite you to join our team.

responsibilities

Design and develop big data solutions using Apache Spark and Databricks, ensuring scalability and reliability
Collaborate with cross-functional teams to understand business requirements and design data solutions to meet them
Optimize data processing and analytics performance using advanced techniques and tools
Develop and maintain data pipelines and ETL processes using Python and Scala
Ensure the quality and integrity of data by implementing data validation and testing processes
Drive the adoption of new technologies and tools to enhance the company's data processing capabilities
Manage and mentor junior engineers, providing guidance and support in their daily tasks
Ensure compliance with data privacy and security regulations

requirements

A minimum of 5 years of experience in Data Software Engineering
Strong experience in Apache Spark and Databricks, highlighting your proficiency in big data processing and analytics
Proficiency in programming languages such as Python and Scala, enabling you to develop and maintain data pipelines and ETL processes
Hands-on experience in Microsoft Azure, including Azure Data Factory, Azure Databricks, and Azure Blob Storage
Completed Databricks Data Engineering Professional certification, demonstrating your in-depth knowledge of Databricks and its features
Strong problem-solving skills and attention to detail, allowing you to identify and resolve complex data issues
Experience in managing and mentoring junior engineers, showcasing your leadership skills and ability to work with cross-functional teams
Fluent spoken and written English at an Upper-Intermediate level or higher, enabling effective communication with international teams

nice to have

Experience with other big data technologies such as Hadoop, Hive, and Kafka
Knowledge of data visualization tools such as Tableau or Power BI
Experience with data warehousing and data modeling techniques

senior data engineer

Data Integration

Databricks, MicroStrategy Analytics, Apache Spark

40 hrs/week

12+ months

Greece

We are looking for a remote Data Engineer to make the team even stronger.

responsibilities

Gather business requirements, analyze them, join the dots using data and drive the implementation
Design, develop, monitor and visualize Customer Data Access Overhaul data product
Integrate high-quality datasets for analytical use-cases
Support in designing incident management process
Enable other data teams to follow the customer's standards
Testing (preparation and execution)
Operations of data pipelines incl. alerting, bug fixing, etc

requirements

3+ years hands-on experience in Databricks or similar
3+ years hands-on experience in MicroStrategy
Strong skills in data visualisation and data modelling
Good understanding of ETL concepts
Apache Spark, PySpark and Python, SQL
AWS Glue + Amazon S3
GitHub + CI/CD
Team player (easy & respectful communications, shares responsibilities for the team overall success)
Communication skills
Organisational skills
Mastery in Engineering
Upper-intermediate or higher English level, both spoken and written (B2+) (is able to communicate fluently with English speaking stakeholders, able to share ideas and provide reasoning)

nice to have

Advanced Databricks skills like delta, cluster configuration or Databricks APIs
Experience in new technologies like BigQuery, Airflow, Redshift or Apache NiFi

senior data engineer

Data Software Engineering

Apache Spark, Databricks, SQL

40 hrs/week

12+ months

Greece

We are looking for a remote Senior Data Engineer to make the team even stronger.

responsibilities

Develop, monitor, and operate the most used and most critical curated data pipeline - Sales Order Data (incl. Post-order information, e.g. shipment, return, payment). This pipeline is processing hundreds of millions of records to provide high-quality datasets for analytical and machine learning use-cases
Consulting with analysts, data scientists, and product managers to build and continuously improve "Single Source of Truth" KPI for business steering such as the central Profit Contribution measurement (PC II)
Leverage and improve a cloud-based tech stack that includes AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala

requirements

3+ years of relevant experience
Expertise in Apache Spark along with Spark streaming & Spark SQL
Good hands on experience with Databricks and delta-lake
Fluency in Scala programming language
Good understanding & hands-on experience with CI/CD
Rich working experience with Github
Fluency working with AWS landscape
Ability to build Apache Airflow pipelines
Upper-intermediate or higher English level, both spoken and written (B2+)

nice to have

Presto
Superset
Starburst
Exasol

senior data software engineer

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

India

We are seeking a highly skilled Senior Data Software Engineer to join our team and provide critical support to our remote Data Science teams.

As a Senior Data Software Engineer, you will be responsible for building datamarts and providing ad-hoc support in a fast-paced, dynamic environment. You will work closely with Data Scientists and other stakeholders to understand their needs and develop solutions that meet their requirements.

responsibilities

Build datamarts and data pipelines to support the Data Science teams
Provide ad-hoc support to Data Scientists and other stakeholders, ensuring the seamless operation of data pipelines and processes
Collaborate with cross-functional teams to understand their needs and develop solutions that meet their requirements
Design, develop, and maintain efficient and scalable ETL processes
Optimize complex SQL queries and database operations
Ensure the implementation of CI/CD pipelines for data engineering tasks
Develop and maintain REST APIs for data processing and consumption
Collaborate with stakeholders to define project requirements and timelines
Provide technical guidance and mentorship to junior team members

requirements

Minimum of 4 years of experience as a Data Software Engineer, working with large datasets and complex data pipelines
Expertise in Amazon Web Services, specifically with services such as S3 and EC2
Advanced experience with Apache Airflow and Apache Spark for data processing and workflow orchestration
Proficient in Python programming language, with experience in writing efficient and scalable code
Strong understanding of SQL and relational databases, with experience in designing and optimizing complex queries
Experience in CI/CD pipelines, with experience in tools such as Jenkins or GitLab
Experience in PySpark and REST APIs for data engineering tasks
Strong understanding of ETL processes and data modeling
Excellent communication skills, with the ability to effectively collaborate with technical and non-technical stakeholders
Upper-intermediate English language proficiency, enabling clear communication and collaboration with the team and stakeholders

nice to have

Experience with Redshift and Databricks for data processing and analysis

senior data software engineer

Data Software Engineering

Databricks, Python, PySpark

40 hrs/week

12+ months

India

We are seeking a remote Senior Data Software Engineer to join our team.

The ideal candidate should have solid/hands-on experience in Azure, PySpark, Python, Python web services, Databrics, and Advanced SQL. Moreover, the candidate must possess excellent communication skills with an upper-intermediate English level.

responsibilities

Build a POC for replacement of the external vendor
Scope the setup of the required Azure services
Extract data from data lake (EDL) and process data based on application requirements and architecture
Build service layer and mimic the current existing application
Work collaboratively with the team and report technical challenges and bugs in a timely and efficient manner

requirements

Minimum of 3 years of experience in Data Software Engineering
Strong knowledge of Azure, PySpark, Python, Python web services, Databrics, and Advanced SQL
Familiarity and ability to use Azure services
Strong knowledge on how to extract data from data lakes (EDL) and process data
Excellent communication skills with an upper-intermediate English level

nice to have

Excellent organizational skills

lead data software engineer

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

India

We are seeking a highly skilled Lead Data Software Engineer to join our remote team and provide critical support to our Data Science teams.

As a key figure within the team, you will be responsible for building datamarts, developing REST APIs, and providing on-call support for ad-hoc requests. You will play a pivotal role in driving the success of our projects, which focus on delivering industry-leading solutions for our clients in the healthcare sector.

responsibilities

Lead and mentor the Data Software Engineering team, fostering a culture of growth and continuous learning within the group
Collaborate with cross-functional teams to deliver high-quality software solutions in line with project goals and timelines
Build and maintain datamarts, ensuring efficient and scalable data management
Develop REST APIs, enabling seamless integration with other applications and systems
Provide on-call support for ad-hoc requests, ensuring the efficient resolution of issues
Design and implement data pipelines using Apache Airflow and Apache Spark
Work closely with Data Science teams, providing technical support and guidance
Ensure the implementation and maintenance of CI/CD pipelines for efficient delivery of application releases
Continuously evaluate industry trends and best practices to refine and implement the most effective software engineering strategies
Collaborate with stakeholders, demonstrating excellent communication and leadership skills

requirements

Minimum of 5 years of experience in Data Software Engineering, working with complex infrastructures and large-scale projects
At least 1 years of demonstrated leadership experience, managing and guiding a team of Data Software Engineers
Expertise in Amazon Web Services, designing and implementing scalable solutions in the cloud environment
Strong experience in Apache Airflow and Apache Spark for building and scheduling data pipelines
Proficiency in Python and SQL for ETL and data manipulation tasks
Experience with CI/CD pipelines for efficient delivery of application releases
Excellent analytical and problem-solving skills, enabling effective decision-making in complex environments
Strong English language proficiency at the Upper-Intermediate level, enabling clear communication and collaboration with the team and stakeholders

nice to have

Experience with Redshift and Databricks for data processing and analysis