Empleos de Ingeniero de Datos

EPAM Anywhere busca Data Ingenieros

Remuneración competitiva

Respaldamos todos los pagos y operamos de conformidad con las normas laborales específicas de cada país.

Numerosos beneficios

Aprovecha más de 1500 beneficios, en línea y específicos de la ubicación, situados en más de 30 países, que incluyen programas de salud y deportes para ti y tu familia.

Oportunidades ilimitadas de crecimiento profesional

Recibe acceso a un ecosistema de gran escala que consiste en servicios de desarrollo educativo y profesional creados para tu crecimiento. Un asesor personal de habilidades te apoyará en cada paso de este viaje.

¿buscas empleo como ingeniero de datos?

¡Te ayudamos a encontrarlo! Envíanos tu CV y te apoyamos a encontrar un trabajo que se ajusté a ti.

quiero saber más

senior data engineer

Data Integration

AWS Simple Storage Service (S3), Amazon Web Services, SQL

40 hrs/week

12+ months

Poland

Currently, we are looking for a remote Senior Data Engineer to join our global team

Currently, we are looking for a remote Senior Data Engineer to join our global team. The customer is an online travel agency and metasearch engine that helps book airline tickets, hotel reservations, car rentals, cruise ships, and vacation packages.

responsibilities

Develop and support ETL pipelines written in Python and SQL (+HiveQL) and orchestrated by a 3rd party tool
Build all data layers (landing, staging, warehouse, datamarts) in S3, Qubole Hive and AWS Redshift
Collaborate with report developer to deliver dashboards in time and compliance with business requirements
Analyze business requirements and make technical decisions to drive the development process
Negotiate with customers on requirements and technical restrictions
Be a development stream coordinator (consult junior team member, monitor progress and troubleshoot issues)
Be a proactive developer who can provide expertise on technical and business matter

requirements

3+ years of experience as Data Engineer
Knowledge of Python (intermediate)
Knowledge of OOP, decorators
ETL/ELT development experience, preferably with Python
SQL Knowledge (intermediate+)
Experience with Data warehousing (Kimball)
Experience with AWS services (S3, Redshift, EC2)
Self-driven, self-coordinating
No supervisor needed
Able to drive development process of small team
Able to negotiate and collaborate with customers, drive discussion

senior data integration engineer

Data Integration

ETL/ELT Solutions, Azure Data Lake Storage, Databricks

40 hrs/week

12+ months

Poland

We are seeking a skilled Senior Data Integration Engineer to join our remote team.

We are looking for an experienced Senior Data Integration Engineer to join our team. As a Senior Engineer with 3+ years of relevant production experience, you will play a key role in designing, developing, and implementing data integration solutions. You will leverage your expertise in ETL/ELT solutions, Azure Data Lake Storage, Databricks, Azure Data Factory, MySQL, PostgreSQL, MS SQL.SQL, Oracle, SQL, and Python to deliver high-quality and scalable data integration processes. If you thrive in a challenging environment and have a passion for data integration, we want to hear from you.

responsibilities

Lead the design and development of data integration solutions, including ETL/ELT processes and data pipelines
Collaborate with stakeholders to gather and analyze data integration requirements
Provide technical guidance and mentorship to junior team members
Ensure data quality and consistency across integrated systems
Optimize data integration workflows for performance and scalability
Troubleshoot and resolve complex data integration issues
Stay up-to-date with industry trends and emerging technologies in data integration

requirements

Bachelor's degree in Computer Science, Information Systems, or a related field
3+ years of relevant production experience in data integration
In-depth knowledge of ETL/ELT solutions and data integration best practices
Strong proficiency in Azure Data Lake Storage, Databricks, and Azure Data Factory
Extensive experience with MySQL, PostgreSQL, MS SQL.SQL, and Oracle
Expert-level skills in SQL and Python for data manipulation and transformation
Solid understanding of data modeling and database design principles
Proven track record of successfully delivering complex data integration projects
Strong problem-solving and analytical skills
Excellent communication and leadership abilities
B2+ English level

nice to have

Experience with cloud-based data integration platforms such as AWS Glue or Google Cloud Dataflow
Familiarity with big data technologies like Hadoop and Spark
Knowledge of data warehousing concepts and tools
Understanding of data governance and data management practices
Ability to architect and implement real-time data integration solutions

senior data engineer

Data Integration

Microsoft SQL Server, SQL, SQL SSIS

40 hrs/week

12+ months

Poland

We are seeking a highly skilled remote Senior Data Engineer to join our team.

The successful candidate will have 3+ years of relevant work experience and will be a key developer responsible for developing complex solutions for our clients using Microsoft SQL Server. They will participate in the analysis, design, implementation, and maintenance of our projects, ensuring database performance, security, and availability.

responsibilities

Implement Data Integration solutions using SQL SSIS
Participate in the design, development, and testing of database solutions
Ensure database performance, security, and availability
Collaborate with team members and stakeholders to implement solutions that meet business requirements
Provide guidance and support to junior team members

requirements

3+ years of relevant work experience
Hands-on experience with Data Integration tools, particularly SQL SSIS
Bachelor's or higher degree in Computer Science or related field is preferred
Strong SQL skills and proficiency in Microsoft SQL Server
Strong analytical and problem-solving skills
Excellent communication and interpersonal skills
B2+ English level

nice to have

Experience working with remote teams and clients
Experience providing technical guidance and support to junior team members
Familiarity with additional database platforms and technologies
Knowledge of Agile methodologies and best practices
Ability to adapt to a fast-paced and dynamic work environment

senior data engineer

Data Software Engineering

Python, Amazon Web Services, AWS Glue

40 hrs/week

12+ months

Poland

We are seeking a highly skilled Senior Data Software Engineer to join our remote team, working with a British-American publicly traded analytics company that operates a collection of subscription-based services.

As a Senior Data Software Engineer, you will be responsible for developing and deploying production-grade ETL pipelines using Apache Spark. If you are passionate about data software engineering and have a keen eye for detail, we invite you to be part of our team.

responsibilities

Develop and deploy production-grade ETL pipelines using Apache Spark (PySpark) to handle large data volumes
Contribute to the design, development, and deployment of scalable and reliable data pipelines
Perform data analysis and data quality checks to ensure data accuracy and integrity
Create and maintain technical documentation for all ETL processes and data pipelines
Collaborate with cross-functional teams to review software requirements and ensure seamless integration with other systems
Provide technical guidance and mentorship to junior team members

requirements

Minimum of 3 years of experience in Data Software Engineering, showcasing your expertise in Python scripting for data handling (usage of pandas, numpy)
Strong expertise of Apache Spark (PySpark) for handle large data volumes (few hundred GBs)
Experience in writing UDFs in Spark
Experience with Relational DB, PostgreSQL/Snowflake preferred
Basic knowledge of Big data technologies like HBase and Hive
Hands-on experience with AWS Cloud, AWS Glue, Amazon EMR, and Databricks
Fluent spoken and written English at an Upper-Intermediate level or higher

nice to have

Prior experience on Apache Airflow is desirable
Experience in AWS data services like Glue & EMR

senior data software engineer

Data Software Engineering

Python, PySpark, SQL

40 hrs/week

12+ months

Poland

Join our team as a Senior Data Software Engineer, where you will be the foremost technical authority in the Data Engineering team within the Data Solutions Centre of Excellence

Our client, which is a leading provider of business management software for over 30 years, is seeking a Senior Data Software Engineer to join their remote Data Solutions Centre of Excellence. As the foremost technical authority in the Data Engineering team, you will drive the development of the data platform, including system architecture and efficient data products and pipelines within an agile working environment. You will work closely with cross-functional teams to identify and address complex data engineering challenges, developing robust solutions that meet business and user needs. This is a career-defining opportunity to make a significant impact within a fast-growing organisation.

responsibilities

Develop and maintain data models, pipelines, and ETL processes to ensure data quality, consistency, and accuracy
Keep the development of the data platform, including system architecture and efficient data products and pipelines within an agile working environment
Collaborate with cross-functional teams to identify and address complex data engineering challenges, developing robust solutions that meet business and user needs
Contribute to the development of data governance policies and procedures, ensuring compliance with relevant regulations and standards
Keep up-to-date with the latest data engineering technologies and trends, contributing to the continuous improvement of the data platform

requirements

A minimum of 3 years of experience in Data Software Engineering, demonstrating expertise in developing large-scale data products and pipelines
Proficiency in Python and PySpark, enabling you to develop efficient and scalable data processing solutions
In-depth knowledge of Databricks, Amazon Web Services and Microsoft Azure, showcasing your expertise in cloud-based data engineering technologies
Experience in developing and maintaining data models, pipelines, and ETL processes, demonstrating your comprehensive skill set
Strong focus on teamwork and exceptional interpersonal skills, allowing you to collaborate effectively with cross-functional teams
Fluent spoken and written English at an Upper-Intermediate level or higher

nice to have

Hands-on experience in developing data products and pipelines using other programming languages, such as Java or Scala
Experience in deploying machine learning models in production environments and in implementing data security and privacy measures

senior data software engineer

Data Software Engineering

Big Data, Python, Amazon Web Services

40 hrs/week

12+ months

Poland

We are seeking a talented Senior Data Software Engineer to join our team and work on innovative projects that aim to improve people's lives through vision and eye care products.

We are seeking a talented Senior Data Software Engineer to join our remote team and work on innovative project that aims to improve people's lives through vision and eye care products. As a senior member of our team, you will be responsible for designing and implementing scalable data software solutions that leverage Big Data technologies and Amazon Web Services. If you have a passion for using data to drive business decisions and a strong background in data engineering, we encourage you to apply.

responsibilities

Design, develop and implement data software engineering solutions for our client
Collaborate with cross-functional teams to identify data-driven business requirements and translate them into technical solutions
Perform data analysis and develop data pipelines to support data-driven decision-making processes
Ensure data quality and integrity by implementing appropriate data governance policies and procedures
Optimize data processing and storage solutions for performance and scalability
Create and maintain ETL processes to extract, transform and load data from various sources

requirements

Minimum of 3 years of experience in Data Software Engineering
Strong proficiency in Python and experience with Apache Spark (PySpark)
Expertise in working with Amazon Web Services, including CLI, S3, Glue, Lambda, Athena
Comprehensive understanding of columnar-based file types and unit testing
Experience with SQL and relational databases
Fluent English language skills with an Upper-Intermediate level

nice to have

Experience implementing solutions in accordance with IaC (Infrastructure as Code) principles

senior data software engineer

Data Software Engineering

Databricks, Python, PySpark

40 hrs/week

12+ months

Poland

Join our remote team as a Senior Data Software Engineer.

Join our remote team as a Senior Data Software Engineer within a global leader in providing innovative solutions for data management and analytics. We are looking for a highly skilled and experienced engineer who will be responsible for developing and implementing data solutions, as well as ensuring the quality, performance, and scalability of data systems. This role offers an opportunity to work with cutting-edge technologies and to contribute to the continued growth of our company and its clients.

responsibilities

Designing, developing, and implementing data solutions in collaboration with stakeholders
Ensuring the quality, performance, and scalability of data systems through regular maintenance and optimization
Identifying and resolving issues related to data quality, data processing, and data integration
Providing support for data-related issues and incidents
Collaborating with cross-functional teams to deliver customer-centric solutions
Defining and implementing data management best practices and standards
Creating and maintaining technical documentation for data systems and solutions
Ensuring compliance with data security and privacy regulations
Leading and mentoring less experienced team members to enhance their skills and grow their careers
Participating in code reviews and ensuring adherence to coding standards
Staying up-to-date with emerging data technologies and trends

requirements

At least 3+ years of solid/hands-on experience in Data Software Engineering
Expertise in PySpark for data processing and analysis
Experience working with Azure Data Factory for building and managing data pipelines
Advanced SQL knowledge for designing and managing database schema, including procedures, triggers, and views
Proficiency in Python for data manipulation and scripting
Experience with cloud-based data management tools such as hdinishght, Azure Data Lake, and Data API
Knowledge of Spark, Scala, and Kafka for distributed computing and real-time data processing
Expertise in Databricks for data engineering and analytics
Experience with EDL changes in DB Views/Stored procedures
Experience in data analysis and troubleshooting
Ability to provide integration testing support
Ability to plan and implement new requirements/data entities on EDL
Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

nice to have

Experience with Hadoop, Hive, and MapReduce is a plus
Familiarity with AWS, GCP, or other cloud platforms is a plus

senior data software engineer

Data Software Engineering

Databricks, Microsoft Azure, PySpark

40 hrs/week

12+ months

Poland

Join our remote team as a Senior Data Software Engineer.

Join our remote team as a Senior Data Software Engineer to work on exciting projects involving Databricks workflows, APIs, and analytical development. You will be an integral part of our team and must possess expertise in building and deploying production solutions using Azure, Python, Spark, PySpark, and SQL. We require a thoughtful and knowledgeable candidate who can create robust data pipelines and tie together loose ends for solutions across systems.

responsibilities

Collaborate with stakeholders to design, develop, and deploy data pipelines for various use cases
Develop and maintain robust ETL processes to extract, transform, and load data from various sources
Design and develop data models to support reporting and analytics use cases
Ensure data quality and reliability by implementing data validation and error handling mechanisms
Optimize data pipelines for performance and scalability
Troubleshoot and resolve data pipeline issues in a timely manner
Develop and maintain technical documentation for data pipelines and data processes
Contribute to the development of data engineering best practices and standards

requirements

At least 3 years of relevant experience in data software engineering and development
Proven track record of building end-to-end production solutions
Expertise in one of the languages (Python, Spark, PySpark, SQL) with knowledge on how to build both within dev and enabling deployment to production
Experience using Databricks for data engineering
Ability to analyze, troubleshoot, and optimize data pipelines for performance and reliability
Experience working on one or more cloud platforms (Azure, GCP, AWS), with a strong preference for Azure
Ability to design and develop robust, scalable, and efficient data pipelines
Experience using Azure DevOps, GitHub, (or others) and version control
Ability to write and maintain technical documentation for data pipelines and data processes
Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

nice to have

Experience with RESTful APIs and other data transfer protocols
Experience with data visualization tools like Power BI
Experience with Agile software development methodologies

senior data software engineer

Data Software Engineering

Databricks, Python, PySpark

40 hrs/week

12+ months

Poland

Join our remote team as a Senior Data Software Engineer.

Join our remote team as a Senior Data Software Engineer within a global leader in digital transformation and technology services. We are looking for an experienced software developer with a strong background in data engineering to join our team. The ideal candidate will be responsible for implementing reusable DataBricks components for data ingestion and data analytics. They will have experience ingesting data into a data lake via batch, streaming, and replication and making data available for reporting and predictive modeling, as well as establishing security controls, integration with data governance, and clear auditable data lineage. The Senior Data Software Engineer will work collaboratively with architects, technical leads, and key individuals within other functional groups to develop and test solutions that meet best practice specifications.

responsibilities

Implementing reusable DataBricks components for data ingestion and data analytics
Ingesting data into a data lake via batch, streaming, and replication and making data available for reporting and predictive modeling
Establishing security controls, integration with data governance, and clear auditable data lineage
Collaborating with architects, technical leads, and key individuals within other functional groups to develop and test solutions that meet best practice specifications
Participating in code review and testing solutions to ensure they meet best practice specifications
Writing project documentation to ensure that other developers can easily understand and use the code
Building collaborative partnerships with architects, technical leads, and key individuals within other functional groups
Continuously updating skills and knowledge to keep up with industry trends and best practices

requirements

At least 3+ years of experience in software engineering with a focus on data engineering
Proficient in Python coding and PySpark development
Experience building data ingestion pipelines, Data Warehouse or Database architecture.
Hands-on experience with modern Big Data components like Databricks, SQL Azure, and Microsoft Azure
Experience in designing, deploying, and administering scalable, available, and fault-tolerant systems in a cloud environment
Strong ability to write clean, maintainable, and well-documented code
Experience in data modeling and working with data-oriented personality and compliance awareness, such as PI, GDPR, and HIPAA
Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

nice to have

Experience with Power BI, Azure Synapse Analytics, and ADLS is a plus

senior data software engineer

Data Software Engineering

Python, PySpark, Amazon Web Services

40 hrs/week

12+ months

Poland

We are seeking a highly skilled Senior Data Software Engineer to join our team, working with a leading provider of automotive solutions that simplify the trusted exchange and mobility of vehicles.

We are seeking a highly skilled Senior Data Software Engineer to join our remote team, working with a leading provider of automotive solutions that simplify the trusted exchange and mobility of vehicles. As a Senior Data Software Engineer, you will play a crucial role in developing and implementing data-driven solutions that lead our Client's business forward. You will work closely with cross-functional teams to design, develop, and deploy scalable data pipelines and machine learning models, leveraging your expertise in Python, PySpark, and Amazon Web Services.

responsibilities

Design and develop scalable data pipelines and machine learning models, leveraging your expertise in Python and PySpark
Implement data ingestion from multiple sources, including databases, APIs, and streaming platforms, ensuring data quality and reliability
Ensure data security and compliance by implementing best practices and following industry standards
Participate in code reviews and contribute to the development of best practices and standards for data engineering
Mentor junior engineers and provide guidance and support to help them grow their skills and expertise

requirements

A minimum of 3 years of experience in Data Software Engineering, showcasing your proficiency in developing and deploying data-driven solutions
Expertise in Python and PySpark, enabling you to design and implement complex data pipelines and machine learning models
Experience with Amazon Web Services, including Lambda, S3, SageMaker, Glue Job, VPC, and API Gateways
Strong understanding of containerized models and their deployment in production environments
Fluent spoken and written English at an upper-intermediate level or higher