Empleos de Big Data Ingeniero en Colombia

EPAM Anywhere busca Ingenieros de Big Data en Colombia

Remuneración competitiva

Respaldamos todos los pagos y operamos de conformidad con las normas laborales específicas de cada país.

Numerosos beneficios

Aprovecha más de 1500 beneficios, en línea y específicos de la ubicación, situados en más de 30 países, que incluyen programas de salud y deportes para ti y tu familia.

Oportunidades ilimitadas de crecimiento profesional

Recibe acceso a un ecosistema de gran escala que consiste en servicios de desarrollo educativo y profesional creados para tu crecimiento. Un asesor personal de habilidades te apoyará en cada paso de este viaje.

senior data engineer

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

Colombia, Mexico

Learn more

We are looking for a passionate remote Senior Data Engineer to join the Customer Success and Support (CSS) Data Engineering team.

In this role, you will be responsible for building world-class data solutions and applications that power crucial decisions throughout the organization. You should be someone who is excited about building services that scale.

responsibilities

Build tables and datamarts with separate data models for analytics purposes, working in sprints. Data Scientists will give requirements by the end of the quarter, with ad-hoc requests as needed (on-call support is expected)
Support Data Science teams by building scalable data solutions and applications that enable them to derive insights from large datasets
Build ingestion pipelines, and be responsible for supporting and improving existing pipelines
Ensure the quality and integrity of data through testing and monitoring of data solutions
Publish good documentation to help users understand the information provided
Work in collaboration with cross-functional teams to deliver quality solutions on time
Provide mentoring to junior team members as needed

requirements

3+ years of relevant experience in Data Software Engineering
High proficiency in SQL (must-have), with most tasks in Databrick SQL. Experience with DataBricks is a plus and can be trained
Extensive knowledge of Spark and experience with PySpark
Experience with Python and writing on top of Airflow
Experience with data integration and modeling
General knowledge of big data, AWS suite, and Airflow
Some ETL experience, including building ETL pipelines
Experience with data modeling and using REST APIs
Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)
Must be a team player with a positive attitude and willingness to learn new technologies on the fly
Experience with on-call support is preferred
If you are a self-motivated and skilled data engineer who is passionate about building world-class data solutions, we encourage you to apply
Strong communication and documentation skills
B2+ English level

lead data engineer

Data Software Engineering

Amazon Web Services, Apache Airflow, Apache Spark

40 hrs/week

12+ months

Colombia, Mexico

Learn more

We are looking for a passionate remote Lead Data Engineer to join the Customer Success and Support (CSS) Data Engineering team.

responsibilities

Build tables and datamarts with separate data models for analytics purposes, working in sprints. Data Scientists will give requirements by the end of the quarter, with ad-hoc requests as needed (on-call support is expected)
Support Data Science teams by building scalable data solutions and applications that enable them to derive insights from large datasets
Build ingestion pipelines, and be responsible for supporting and improving existing pipelines
Ensure the quality and integrity of data through testing and monitoring of data solutions
Publish good documentation to help users understand the information provided
Work in collaboration with cross-functional teams to deliver quality solutions on time
Provide mentoring to junior team members as needed

requirements

5+ years of relevant experience in Data Software Engineering
1+ years of relevant leadership experience
High proficiency in SQL (must-have), with most tasks in Databrick SQL. Experience with DataBricks is a plus and can be trained
Extensive knowledge of Spark and experience with PySpark
Experience with Python and writing on top of Airflow
Experience with data integration and modeling
General knowledge of big data, AWS suite, and Airflow
Some ETL experience, including building ETL pipelines
Experience with data modeling and using REST APIs
Experience working with varied forms of data infrastructure, including relational databases (e.g. SQL), Spark, and column stores (e.g. Redshift)
Must be a team player with a positive attitude and willingness to learn new technologies on the fly
Experience with on-call support is preferred
If you are a self-motivated and skilled data engineer who is passionate about building world-class data solutions, we encourage you to apply
Strong communication and documentation skills
B2+ English level

lead data quality engineer for a business services company

Python.Core

SQL, Management

40 hrs/week

12+ months

Colombia

Learn more

We are currently looking for a remote Lead Data Quality Engineer with 5+ years of experience in Data Quality Engineering and advanced Data Analysis skills using T-SQL, Python to join our team.

The customer is a provider of high-quality business services in such areas as IT, Procurement, HR, Product Lifecycle Services, Financial Reporting and Analytics, and Real Estate and Facility Services.

responsibilities

Design, lead, and manage a data implementation strategy
Manage and maintain data assets in alignment with data management processes
Ensure data governance and compliance through appropriate processes
Participate in mapping business data sources to appropriate repositories of data
Identify new critical data elements and metadata
Coordinate and ensure the implementation of data asset management standards and policies in close collaboration with the providers of the data
Accountable for data discrepancies and mitigation, data availability and consistency
Drive compliance risk mitigations for regional data privacy and security
Participate in mapping business data needs to appropriate sources of data; provide guidance and coordinate/resolve data issues
Collaborate with internal data governance teams and ensure the implementation of data governance and data asset management standards and policies

requirements

5+ years of experience in Data Quality Engineering
Advanced Data Analysis using T-SQL, Python (familiarity with Pandas); should be able to write complex scripts
Expert at doing Data Profiling and documenting the results
Expert at identifying common data issues related to data types, formats, missing values, duplicate data, etc.
Concrete experience working with various file formats more specifically CSV, Parquet, Any other Delimited, XML, JSON
Expert at working with relational tables in SQL Server Management Studio
Good understanding of time series and historical data. Good understanding
Good understanding of OLTP (Normalized tables in 3NF) and OLAP (Star Schema and Snowflake schema dimension and fact tables) systems
Familiarity with various encodings like ASCII and UNICODE and their implications on data quality
Good understanding of QA and Testing best practices
Be able to create test plans and test cases to do end-to-end testing of data pipelines, and appropriately identify data quality issues, and document them for bug fixes; once the bugs are fixed should be able to go back and do regression testing
Good with designing test harness for automated testing
Ideally good exposure to Azure DevOps
Good understanding of various ETL Tools especially ADF and Databricks
Proficient English (written and spoken) B2

Empleos de Big Data Ingeniero en Colombia

Enlaces Relacionados