Empleos de Data Ingeniero en Colombia

EPAM Anywhere busca Ingenieros de Datos en Colombia

Remuneración competitiva

Respaldamos todos los pagos y operamos de conformidad con las normas laborales específicas de cada país.

Numerosos beneficios

Aprovecha más de 1500 beneficios, en línea y específicos de la ubicación, situados en más de 30 países, que incluyen programas de salud y deportes para ti y tu familia.

Oportunidades ilimitadas de crecimiento profesional

Recibe acceso a un ecosistema de gran escala que consiste en servicios de desarrollo educativo y profesional creados para tu crecimiento. Un asesor personal de habilidades te apoyará en cada paso de este viaje.

senior data engineer

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

Colombia, Mexico

Learn more

We are looking for a passionate remote Senior Data Engineer to join the Customer Success and Support (CSS) Data Engineering team.

In this role, you will be responsible for building world-class data solutions and applications that power crucial decisions throughout the organization. You should be someone who is excited about building services that scale.

responsibilities

Build tables and datamarts with separate data models for analytics purposes, working in sprints. Data Scientists will give requirements by the end of the quarter, with ad-hoc requests as needed (on-call support is expected)
Support Data Science teams by building scalable data solutions and applications that enable them to derive insights from large datasets
Build ingestion pipelines, and be responsible for supporting and improving existing pipelines
Ensure the quality and integrity of data through testing and monitoring of data solutions
Publish good documentation to help users understand the information provided
Work in collaboration with cross-functional teams to deliver quality solutions on time
Provide mentoring to junior team members as needed

requirements

3+ years of relevant experience in Data Software Engineering
High proficiency in SQL (must-have), with most tasks in Databrick SQL. Experience with DataBricks is a plus and can be trained
Extensive knowledge of Spark and experience with PySpark
Experience with Python and writing on top of Airflow
Experience with data integration and modeling
General knowledge of big data, AWS suite, and Airflow
Some ETL experience, including building ETL pipelines
Experience with data modeling and using REST APIs
Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)
Must be a team player with a positive attitude and willingness to learn new technologies on the fly
Experience with on-call support is preferred
If you are a self-motivated and skilled data engineer who is passionate about building world-class data solutions, we encourage you to apply
Strong communication and documentation skills
B2+ English level

lead data engineer

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

Colombia, Mexico

Learn more

We are looking for a passionate remote Lead Data Engineer to join the Customer Success and Support (CSS) Data Engineering team.

responsibilities

Build tables and datamarts with separate data models for analytics purposes, working in sprints. Data Scientists will give requirements by the end of the quarter, with ad-hoc requests as needed (on-call support is expected)
Support Data Science teams by building scalable data solutions and applications that enable them to derive insights from large datasets
Build ingestion pipelines, and be responsible for supporting and improving existing pipelines
Ensure the quality and integrity of data through testing and monitoring of data solutions
Publish good documentation to help users understand the information provided
Work in collaboration with cross-functional teams to deliver quality solutions on time
Provide mentoring to junior team members as needed

requirements

5+ years of relevant experience in Data Software Engineering
1+ years of relevant leadership experience
High proficiency in SQL (must-have), with most tasks in Databrick SQL. Experience with DataBricks is a plus and can be trained
Extensive knowledge of Spark and experience with PySpark
Experience with Python and writing on top of Airflow
Experience with data integration and modeling
General knowledge of big data, AWS suite, and Airflow
Some ETL experience, including building ETL pipelines
Experience with data modeling and using REST APIs
Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)
Must be a team player with a positive attitude and willingness to learn new technologies on the fly
Experience with on-call support is preferred
If you are a self-motivated and skilled data engineer who is passionate about building world-class data solutions, we encourage you to apply
Strong communication and documentation skills
B2+ English level

lead data quality engineer for a business services company

Python.Core

SQL, Management

40 hrs/week

12+ months

Colombia

Learn more

We are currently looking for a remote Lead Data Quality Engineer with 5+ years of experience in Data Quality Engineering and advanced Data Analysis skills using T-SQL, Python to join our team.

The customer is a provider of high-quality business services in such areas as IT, Procurement, HR, Product Lifecycle Services, Financial Reporting and Analytics, and Real Estate and Facility Services.

responsibilities

Design, lead, and manage a data implementation strategy
Manage and maintain data assets in alignment with data management processes
Ensure data governance and compliance through appropriate processes
Participate in mapping business data sources to appropriate repositories of data
Identify new critical data elements and metadata
Coordinate and ensure the implementation of data asset management standards and policies in close collaboration with the providers of the data
Accountable for data discrepancies and mitigation, data availability and consistency
Drive compliance risk mitigations for regional data privacy and security
Participate in mapping business data needs to appropriate sources of data; provide guidance and coordinate/resolve data issues
Collaborate with internal data governance teams and ensure the implementation of data governance and data asset management standards and policies

requirements

5+ years of experience in Data Quality Engineering
Advanced Data Analysis using T-SQL, Python (familiarity with Pandas); should be able to write complex scripts
Expert at doing Data Profiling and documenting the results
Expert at identifying common data issues related to data types, formats, missing values, duplicate data, etc.
Concrete experience working with various file formats more specifically CSV, Parquet, Any other Delimited, XML, JSON
Expert at working with relational tables in SQL Server Management Studio
Good understanding of time series and historical data. Good understanding
Good understanding of OLTP (Normalized tables in 3NF) and OLAP (Star Schema and Snowflake schema dimension and fact tables) systems
Familiarity with various encodings like ASCII and UNICODE and their implications on data quality
Good understanding of QA and Testing best practices
Be able to create test plans and test cases to do end-to-end testing of data pipelines, and appropriately identify data quality issues, and document them for bug fixes; once the bugs are fixed should be able to go back and do regression testing
Good with designing test harness for automated testing
Ideally good exposure to Azure DevOps
Good understanding of various ETL Tools especially ADF and Databricks
Proficient English (written and spoken) B2

lead devops for a publishing company

Data DevOps

Ansible, Google Cloud Dataproc, Google Cloud Platform

40 hrs/week

12+ months

Colombia

Learn more

We are currently looking for a remote Lead DevOps Engineer to become a part of the team.

The customer is a leading provider of consumer, financial, and property data, analytics, and services to businesses and governments.

responsibilities

Configuration and Maintaining of Cloud environments
Design, implement, and configure the BigData toolset and make them production ready
Work with DevTeam on troubleshooting and improvements

requirements

7+ years of experience as DevOps Engineer
1+ years of relevant leadership experience
Proficient with GCP/AWS
Solid experience in Ansible and Terraform, for GCP and AWS environments
Strong knowledge of Linux
Familiar with Messaging systems (Kafla, ActionMQ, RabbitMQ) and data Dataprocessing approaches
Ability to effectively communicate with business decision-makers, colleagues, and others
Understanding of IaaC best practices and Agile, Scrum, and XP methodologies
B2+ English level

nice to have

GCP certification
Knowledge and experience with BigData toolset: Dataproc/EMR/Hadoop, Hive, HDFS, Apache Livy, etc.
Knowledge of Dataprep
Familiarity with Python/Java

senior devops for a publishing company

Data DevOps

Ansible, Google Cloud Dataproc, Google Cloud Platform

40 hrs/week

12+ months

Colombia

Learn more

We are currently looking for a remote Senior DevOps Engineer to become a part of the team.

The customer is a leading provider of consumer, financial, and property data, analytics, and services to businesses and governments.

responsibilities

Configuration and Maintaining of Cloud environments
Design, implement, and configure the BigData toolset and make them production ready
Work with DevTeam on troubleshooting and improvements

requirements

5+ years of experience as DevOps Engineer
Proficient with GCP/AWS
Solid experience in Ansible and Terraform, for GCP and AWS environments
Strong knowledge of Linux
Familiar with Messaging systems (Kafla, ActionMQ, RabbitMQ) and data Dataprocessing approaches
Ability to effectively communicate with business decision-makers, colleagues, and others
Understanding of IaaC best practices and Agile, Scrum, and XP methodologies
B2+ English level

nice to have

GCP certification
Knowledge and experience with BigData toolset: Dataproc/EMR/Hadoop, Hive, HDFS, Apache Livy, etc.
Knowledge of Dataprep
Familiarity with Python/Java

senior devops for a publishing company

DevOps.CI/CD

Ansible, Bash, Groovy

40 hrs/week

12+ months

Colombia

Learn more

Currently, we are looking for a Senior DevOps Engineer to become a part of the global team.

The customer is a leading provider of consumer, financial, and property data, analytics, and services to businesses and governments.

responsibilities

Implement infrastructure-as-code principles on at least one of the major IaaS providers
Provide support for a development team from Ops perspective
Configure Secure Continuous Integration and Delivery pipelines
Configure new and already existing environments
Configure management and automation of systems maintenance
Participate in discussions, influences outcomes, and makes recommendations on feasibility and processes and architecture
Devise/modify procedures to solve problems considering computer equipment capacity and limitations, operating time, and desired results
Consult with users and develop business relationships and integrate activities with other IT departments to ensure successful implementation
Foster and maintain good relationships with customers and IT colleagues to meet expected customer service levels

requirements

5+ years of experience as a DevOps Engineer
Solid experience with Google Cloud Platform or Amazon Web Services
Experience with Jenkins(pipeline, groovy)
Experience with Terraform
Experience with Scripting (bash or python)
Knowledge of Ansible
Knowledge of Docker
B2+ English level

senior gcp cloud engineer for a publishing company

Google Cloud Platform

Google Anthos, Google Kubernetes Engine, Kubernetes

40 hrs/week

12+ months

Colombia

Learn more

We are currently looking for a remote Senior GCP Cloud Engineer to become a part of the global team.

The customer is a leading provider of consumer, financial, and property data, analytics, and services to businesses and governments.

responsibilities

Articulate and grasp ideas with onsite team
Manage configurations using Ansible, Puppet, Chef or Salt Stack
Manage pipelines, branches, CI/CD Workflow usage

requirements

5+ years of experience with Google Cloud Platform
Experience with Kubernetes
Solid experience with GKE and GKE Anthos
Hands-on Terraform and Ansible experience
Good spoken and written English (B2 or higher level)
Experience with Infrastructure as code automation with Terraform (preferred) or CloudFormation, Deployment Manager (GCP), Plum
Experience with CI/CD using Jenkins (preferred) or GitLab, TFS, Github Actions

nice to have

Experience with Lift & Shift projects

lead devops engineer for a publishing company

DevOps.CI/CD

Ansible, Bash, Groovy

40 hrs/week

12+ months

Colombia

Learn more

Currently, we are looking for a Lead DevOps Engineer to become a part of the global team.

The customer is a leading provider of consumer, financial, and property data, analytics, and services to businesses and governments.

responsibilities

Implement infrastructure-as-code principles on at least one of the major IaaS providers
Provide support for a development team from Ops perspective
Configure Secure Continuous Integration and Delivery pipelines
Configure new and already existing environments
Configure management and automation of systems maintenance
Participate in discussions, influences outcomes, and makes recommendations on feasibility and processes and architecture
Devise/modify procedures to solve problems considering computer equipment capacity and limitations, operating time, and desired results
Consult with users and develop business relationships and integrate activities with other IT departments to ensure successful implementation
Foster and maintain good relationships with customers and IT colleagues to meet expected customer service levels

requirements

7+ years of experience as a DevOps Engineer
1+ years of relevant leadership experience
Solid experience with Google Cloud Platform or Amazon Web Services
Experience with Jenkins(pipeline, groovy)
Experience with Terraform
Experience with Scripting (bash or python)
Knowledge of Ansible
Knowledge of Docker
B2+ English level

lead gcp cloud engineer for a publishing company

Google Cloud Platform

Google Anthos, Google Kubernetes Engine, Kubernetes

40 hrs/week

12+ months

Colombia

Learn more

We are currently looking for a remote Lead GCP Cloud Engineer to become a part of the global team.

The customer is a leading provider of consumer, financial, and property data, analytics, and services to businesses and governments.

responsibilities

Articulate and grasp ideas with onsite team
Manage configurations using Ansible, Puppet, Chef or Salt Stack
Manage pipelines, branches, CI/CD Workflow usage

requirements

7+ years of experience with Google Cloud Platform
Experience with Kubernetes
Solid experience with GKE and GKE Anthos
Hands-on Terraform and Ansible experience
Good spoken and written English (B2 or higher level)
Experience with Infrastructure as code automation with Terraform (preferred) or CloudFormation, Deployment Manager (GCP), Plum
Experience with CI/CD using Jenkins (preferred) or GitLab, TFS, Github Actions
1+ years of relevant leadership experience

nice to have

Experience with Lift & Shift projects

integration architect

APIs and Integration

IBM App Connect, Apache Kafka, AppDynamics

40 hrs/week

12+ months

Canada, India,

and others

Argentina, Brazil, Canada, Chile, Colombia, Estonia, Greece, India, Italy, Lithuania, Mexico, Poland, Portugal, Ukraine

Learn more

We are seeking a skilled remote Integration Architect to manage the coordination, planning, and design of integrations between internal and external platforms, products, applications, and IT components.

The Integration Architect will be responsible for ensuring secure, scalable, and best practice-based intra-system exchanges are appropriately deployed and evolving as integration technology advances.

responsibilities

Support enterprise and solution architects and project/product managers in matching technology services to specific business outcomes, provisioning estimates, developing overall implementation plans, and articulating the tradeoffs, benefits, and risks of integration architecture solutions
Provide cohesive integration architecture expertise throughout the organization, educating and guiding engineers in the vision and use cases of specific solutions
Resolve technical and business queries and derive functional and non-functional integration requirements
Conduct gap analyses, define priority use cases based on gaps, and identify the right integration patterns
Design current and target state architectures in collaboration with practice SMEs and solution stakeholders
Develop, demonstrate, and publish generic representation of deployable integration patterns, implementation procedures, and integration best practices
Maintain the inventory of communications and data flows and provide overviews of the connections between systems
Mentor integration engineering and architecture teams in requirements analysis, agile design practices, modern development processes & tools, and effective testing strategies

requirements

7+ years of hands-on tool/design experience with API based integration architectures, microservices design, and good knowledge of integration patterns and Agile Integration techniques
Experience in Modeling & Transformations techniques (UML, Data Modeling, Schema Mapping)
Exposure to healthcare standard (HL7, FHIR, EDI) interoperability designs and message models
Experience in designing orchestration and choreography-based integrations
Experience and knowledge of SSO, OAuth, Open ID, and SAML 2.0
Awareness of OOAD and SAFe Methodology
Deep understanding of Cloud Pak for Integration (CP4i), Open Shift Platform, Container Management, and their design aspects
Good knowledge of IBM Integration products, IBM API Connect, IBM App Connect Enterprise, SOAP and REST based Web services, and database concepts (RDBMS and No-SQL Database)
Extensive experience in SOAP and RESTful API designs following Open API specifications
Extensive design/working experience with confluent Kafka-based solutions
Deep understanding of Kafka Cluster brokers, broker sizing, topic sizing, h/w sizing, performance monitoring, broker security, topic security, consumer/producer access management (ACL)
Experience in designing high availability clusters and utilize Kafka APIs in integration solutions
Exposure to Confluent Kafka, zookeepers, Kafka connect, Kafka SQL, schema registry/Avro schemas
Experience with Kafka Connect distributed setup, configuration, and design of Kafka source/sink connectors & simple message transforms
Exposure to Kafka Producer/Consumer Microservices concepts in Java Spring Boot and Kafka distributed Architecture
Expert in Kafka topic design, data pipeline setup with Kafka connect (e.g., CDC)
Experience with Kafka Structured query language (KSQL), prepare queries, Left/Right/Inner joins
Awareness of performance tuning techniques for high throughput and high availability Confluent Kafka in container environment
Good understanding of modern Ops techniques and their inclusion in Integration Design
Exposure to SCM, GitOps, Azure DevOps, Jenkins, UCD, UCR, etc.
Good knowledge of application monitoring tools like, AppDynamics, Grafana, Prometheus, etc.
Experience with languages such as Java/C#, SQL, eSQL, kSQL, XML, Python
Excellent communication skills, be able to work independently as well as part of a team, and have a deep understanding of integration technologies and patterns
B2+ English level

Empleos de Data Ingeniero en Colombia

Enlaces Relacionados