backgo to search

senior data engineer

bullets
Data Software Engineering, Python, Amazon Web Services, Databricks, Apache Spark, SQL
warning.png
Sorry the job is no longer available.

We are searching for a skilled Senior Data Engineer to join our team. If you are proficient in Python and AWS, and you have experience with migrating GCP BigQuery and DataFlow pipelines into Databricks hosted on AWS, we invite you to apply for this exciting opportunity.

responsibilities
  • Collaborate with the team on the migration of GCP BigQuery and DataFlow pipelines to Databricks hosted on AWS, ensuring a seamless transition
  • Design, develop, and optimize data pipelines using Python, Spark, and Databricks to meet business requirements and enhance data processing efficiency
  • Work closely with cross-functional teams to understand data requirements and contribute to the architecture and implementation of data solutions
  • Perform data modeling and transformation tasks to prepare data for analysis and reporting
  • Collaborate on code reviews, ensuring the quality and reliability of data pipelines
  • Troubleshoot and resolve issues related to data pipelines, ensuring smooth and consistent data flow
requirements
  • A minimum of 3 years of relevant experience as a Data Software Engineer, demonstrating your proficiency in developing and optimizing data solutions
  • Strong familiarity with AWS, leveraging its resources for hosting and managing data solutions
  • Proficiency in Python, utilizing its capabilities to build robust and efficient data pipelines
  • Experience with Apache Spark, enabling you to work with large-scale data processing and analysis
  • Expertise in Databricks, particularly in the context of migrating pipelines and working on AWS-hosted platforms
  • Solid command of SQL, allowing you to perform data transformations and analysis effectively
  • Fluent English communication skills at a B2+ level, facilitating effective collaboration with a diverse team
nice to have
  • Familiarity with GCP, particularly experience with BigQuery and DataFlow
  • Knowledge of GCP BigQuery and DataFlow, aiding in the migration process and facilitating collaboration across platforms

These jobs are for you

benefits for locations

poland.svg
ImageImage
For you
  • Discounts on health insurance, sport clubs, shopping centers, cinema tickets, etc.
  • Stable income
  • Flexible roles
ImageImage
For your comfortable work
  • 100% remote work forever
  • EPAM hardware
  • EPAM software licenses
  • Access to offices and co-workings
  • Stable workload
  • Relocation opportunities
  • Flexible engagement models
ImageImage
For your growth
  • Free trainings for technical and soft skills
  • Free access to LinkedIn Learning platform
  • Language courses
  • Free access to internal and external e-Libraries
  • Certification opportunities
  • Skill advisory service
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
a smiling man wearing sunglasses