backgo to search

senior java data pipeline engineer

bullets
Java, Google Cloud Dataflow, Spring, Google Cloud Platform
warning.png
Sorry the job is no longer available.

We are currently seeking an experienced Senior Java Data Pipeline Engineer to join our team remotely. In this role, you will focus on designing and implementing robust data pipelines in Google's DataFlow environment using Java and Apache Beam to efficiently process large amounts of data. Your work will incorporate the Spring Framework, a microservices system supporting our pipelines. You will also employ Google Cloud Platform services to deploy and manage data pipelines, ensuring high availability and reliability.

responsibilities
  • Design and create robust data pipelines using Java and Apache Beam in Google's DataFlow environment
  • Employ the Spring framework to support our pipelines
  • Use Google Cloud Platform services to deploy and manage data pipelines
  • Collaborate with data scientists and analysts to implement solutions for data modeling, mining, and extraction processes
  • Optimize data pipelines for performance and scalability, identify bottlenecks and implement improvements
  • Develop and maintain documentation for data pipeline architectures and operational procedures
  • Ensure data integrity and compliance with all governance and security policies throughout the data processing lifecycle
  • Monitor pipeline performance, implementing logging and alerting mechanisms to preemptively detect and address issues
requirements
  • A Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field
  • At least 3 years of experience in data pipeline development, backed by a strong Java and cloud-based data processing technology background
  • A proven track record of designing, implementing, and optimizing data pipelines capable of processing large data sets in a cloud environment
  • A thorough understanding of the Spring Framework, including Spring Boot, for building high-performance applications
  • Hands-on experience with Google DataFlow and Apache Beam for building and managing data pipelines
  • Experience with GCP services, particularly those related to data storage, processing, and analytics
  • Proficiency in using version control systems, such as Git for code management and collaboration
  • B2+ English level proficiency

These jobs are for you

benefits for locations

colombia.svg
For you
  • Prepaid Medicine with Colsanitas for you and your legal dependents 
  • MetLife Life Insurance for you 
  • Thousands of projects for top brands
  • Stable income
For your comfortable work
  • 100% remote work forever
  • Free licensed software
  • Possibility to work on your own device (BYOD)
  • Stable workload
  • Relocation opportunities
  • Flexible engagement models
For your growth
  • Free trainings for technical and soft skills
  • Free access to LinkedIn Learning platform
  • Support from a personal Skill Advisor
  • Language courses
  • Free access to internal and external e-Libraries
  • Access to internal communities and competency centers
  • Certification opportunities
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
a smiling man wearing sunglasses