Back icon

Senior Big Data Engineer for a Canadian Retail Company

Senior Big Data Engineer for a Canadian Retail Company 40 hrs/week, 12+ months

Currently, we are looking for a remote Senior Big Data Engineer to join our team.

The customer is a Canadian vehicle retailer operating online.

Responsibilities

  • Create and maintain scalable, maintainable and reliable pipelines that process large quantities of structured and unstructured data
    • Unify streaming and batch processing modes into one cohesive framework of processing including monitoring and alerting that fits into a unified and reliable data platform infrastructure
      • Participate in the design and implementation of data models as part of modern data lake, data warehouse and ETL/ELT approaches
        • Build streaming data pipelines that enable the business to engage consumers in real-time
          • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
            • Regularly review work with/from peers with a goal of improving personal knowledge of the systems, ensuring that code changes meet business goals and technology best practices
              • Regularly interact and collaborate with personnel across functions (product, technology, analytics, operations) within the assigned team and technology chapter
                • Work with stakeholders including the Executive, Product, and Data teams to assist with data-related technical issues and support their data infrastructure needs

                  Requirements

                  • 3+ years of experience in Big Data Engineering
                    • Excellent problem solving, troubleshooting, and communication skills
                      • Good understanding of ETL / ELT process: collecting data from multiple sources and loading it into a centralized data warehouse
                        • Experience with ETL / ELT tools: knowledge and experience of tools to complete ETL / ELT process (e.g. Fivetran, Talend, Airflow, dbt, FlyData, or similar tools)
                          • Knowledge of data pipeline management: ensure consistent and reliable data, monitoring for failures
                            • Deep understanding of data modeling: creating a visual representation of an information system, defining and analyzing data requirements
                              • Experience with DataOps: improve quality and reduce cycle time of data analytics
                                • Familiarity with Query optimization: analyzing queries and choosing the most efficient means to execute SQL
                                  • Knowledge of API design: handling dependencies, 3rd party integration, versioning
                                    • Experience working with data that is constantly generated by different data source
                                      • Programming experience: Python, Java, Scala, etc.
                                        • Knowledge of cloud data warehouse: snowflake, AWS
                                          • B2+ level of English

                                            Nice to have

                                            • Demonstrated ability to design and write maintainable software
                                              • Understanding of software engineering best practices, object oriented analysis & design, and design patterns & algorithms
                                                Data Software Engineering
                                                APIAmazon Web Services
                                                Data Modeling
                                                ETL/ELT Solutions
                                                JavaPython

                                                Benefits in eligible locations

                                                location.svg
                                                ImageImage

                                                For you

                                                • Prepaid Medicine with Colsanitas for you and your legal dependents 
                                                • MetLife Life Insurance for you 
                                                • Thousands of projects for top brands
                                                • Stable income
                                                ImageImage

                                                For your comfortable work

                                                • 100% remote work forever
                                                • Free licensed software
                                                • Possibility to work on your own device (BYOD)
                                                • Stable workload
                                                • Relocation opportunities
                                                • Flexible engagement models
                                                ImageImage

                                                For your growth

                                                • Free trainings for technical and soft skills
                                                • Free access to LinkedIn Learning platform
                                                • Support from a personal Skill Advisor
                                                • Language courses
                                                • Free access to internal and external e-Libraries
                                                • Access to internal communities and competency centers
                                                • Certification opportunities

                                                40 hrs/week

                                                Hours per week

                                                12+ months

                                                Project length

                                                Colombia

                                                Locations eligible for the position