Skip To Main Content
backgo to search

senior data engineer (databricks and aws)

bullets
Data Software Engineering, Amazon Web Services, Databricks, Python, Apache Airflow, Apache Spark, Scala

We are looking for a remote Senior Data Engineer to join our project. The candidate should have expert-level skills in AWS and Databricks, as well as extensive knowledge of Big Data technologies such as Spark, Python, Airflow, and Scala/Java. The candidate should have excellent communication skills and be able to work independently as well as in a team of professionals.

responsibilities
  • Work closely with Business Analysts and data analysts to understand requirements
  • Automate data ingestion processes and pre-processing
  • Enhance data sets by creating automated match rules
  • Develop ETL transformations for data from various data sources
  • Report activities through agreed project tools and timely report about risks/issues/dependencies
requirements
  • Minimum of 3 years of experience in Data Software Engineering
  • Extensive knowledge of AWS and Databricks
  • Expert-level skills in Python, Airflow and Spark
  • Experience working with unstructured files and creating automated match rules
  • Strong problem-solving skills and the ability to work independently or in a team
  • Good written and verbal communication skills in English (B2+)
nice to have
  • Knowledge of Scala

benefits for locations

poland.svg
ImageImage
For you
  • Discounts on health insurance, sport clubs, shopping centers, cinema tickets, etc.
  • Stable income
  • Flexible roles
ImageImage
For your comfortable work
  • 100% remote work forever
  • EPAM hardware
  • EPAM software licenses
  • Access to offices and co-workings
  • Stable workload
  • Relocation opportunities
  • Flexible engagement models
ImageImage
For your growth
  • Free trainings for technical and soft skills
  • Free access to LinkedIn Learning platform
  • Language courses
  • Free access to internal and external e-Libraries
  • Certification opportunities
  • Skill advisory service
don't have time? Apply later!We send you a link to the job in your e-mail
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
a smiling man wearing sunglasses