go to searchsenior data engineer (databricks and aws)
Data Software Engineering, Amazon Web Services, Databricks, Python, Apache Airflow, Apache Spark, Scala
Senior Data Engineer (Databricks and AWS)
We are looking for a remote Senior Data Engineer to join our project. The candidate should have expert-level skills in AWS and Databricks, as well as extensive knowledge of Big Data technologies such as Spark, Python, Airflow, and Scala/Java. The candidate should have excellent communication skills and be able to work independently as well as in a team of professionals.
responsibilities
- Work closely with Business Analysts and data analysts to understand requirements
- Automate data ingestion processes and pre-processing
- Enhance data sets by creating automated match rules
- Develop ETL transformations for data from various data sources
- Report activities through agreed project tools and timely report about risks/issues/dependencies
requirements
- Minimum of 3 years of experience in Data Software Engineering
- Extensive knowledge of AWS and Databricks
- Expert-level skills in Python, Airflow and Spark
- Experience working with unstructured files and creating automated match rules
- Strong problem-solving skills and the ability to work independently or in a team
- Good written and verbal communication skills in English (B2+)
nice to have
- Knowledge of Scala
benefits for locations
Poland
For you
- Discounts on health insurance, sport clubs, shopping centers, cinema tickets, etc.
- Stable income
- Flexible roles
For your comfortable work
- 100% remote work forever
- EPAM hardware
- EPAM software licenses
- Access to offices and co-workings
- Stable workload
- Relocation opportunities
- Flexible engagement models
For your growth
- Free trainings for technical and soft skills
- Free access to LinkedIn Learning platform
- Language courses
- Free access to internal and external e-Libraries
- Certification opportunities
- Skill advisory service
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
looking for something else?
Find a vacancy that works for you. Send us your CV to receive a personalized offer.