go to searchlead aws data engineer
Lead AWS Data Engineer
We are looking for a remote Lead AWS Data Engineer to join our team, working on a cutting-edge data project for one of our delivery teams. As a key contributor to the project, you will be responsible for the design, architecture, and end-to-end execution of big data projects.
Your expertise in Amazon Web Services and Python will be essential to the successful development. Your strong communication skills, coupled with your ability to write complex queries to address business requirements, will be crucial in presenting data insights to stakeholders.
responsibilities
- Design and architecture of data products, ensuring alignment with business objectives and target market needs
- Collaborate with cross-functional team members to achieve project goals, including developers, business analysts, and stakeholders
- Lead and manage the team of developers
- Execute end-to-end big data projects with a strong focus on delivering high-quality results
- Develop ETL for AWS Glue jobs and AWS Lambda functions
- Investigate and implement data streaming solutions such as AWS Kinesis, Apache Flink, and Snowflake
- Write complex queries to address business requirements and present data insights to stakeholders
- Implement solutions in accordance with IaC principles using tools such as Atlassian Bitbucket, AWS CodeBuild, and Terraform
requirements
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience
- 5+ years of experience in data engineering, preferably in an AWS environment
- 1+ year of relevant leadership experience
- In-depth understanding of the data domain, including Apache Spark, Python (PySpark), and SQL
- Strong experience with AWS CLI, S3, Glue, Lambda, Athena, Step Functions, RDS
- Proficiency in microservices, OpenAPI, API Gateway, RDS, and unit tests
- Ability to work within an agile team environment, with a strong focus on delivering high-quality results
- Excellent communication skills to effectively present data insights
- B2+ English level proficiency
nice to have
- Experience with IoT
- CI/CD experience: Atlassian Bitbucket, AWS CodeBuild, Terraform
- Data streaming knowledge: AWS Kinesis / Apache Flink / Snowflake
- Experience in Spark jobs performance optimization
benefits for locations
Colombia
For you
- Prepaid Medicine with Colsanitas for you and your legal dependents
- MetLife Life Insurance for you
- Thousands of projects for top brands
- Stable income
For your comfortable work
- 100% remote work forever
- Free licensed software
- Possibility to work on your own device (BYOD)
- Stable workload
- Flexible engagement models
For your growth
- Free trainings for technical and soft skills
- Free access to LinkedIn Learning platform
- Support from a personal Skill Advisor
- Language courses
- Free access to internal and external e-Libraries
- Access to internal communities and competency centers
- Certification opportunities
don't have time? Apply later!We send you a link to the job in your e-mail
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
