go to searchsenior big data engineer with databricks
Data Software Engineering, Amazon Web Services, Apache Airflow, Apache Spark, Data Warehousing, Databricks, SQL
Senior Big Data Engineer with Databricks
We are looking for an experienced remote Senior Big Data Engineer with expertise in Databricks to lead our team of data engineers and take responsibility for designing and implementing data management solutions.
The successful candidate will be familiar with cloud-based data pipeline development and have experience building optimal data infrastructure solutions.
responsibilities
- Lead a team of data engineers, organize teamwork, and solve technical and non-technical challenges
- Design key software components of the data platform, and build collaborative partnerships with architects and technical leads
- Create and maintain optimal on-prem and cloud-based data pipeline architectures capable of ingesting structured and unstructured data using batch & streaming methods
- Assemble large, complex data sets that meet functional and technical requirements, and develop data flows that can leverage both on-premise and cloud architectures
- Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs
requirements
- Bachelor's degree in Computer Science, Information Systems, or another applicable field is preferred
- At least 3 years of experience in a Data Engineer role
- Advanced working knowledge of cloud-based data pipeline development, particularly on AWS
- Experience building and optimizing data pipelines for data acquisition and management
- Expertise in Databricks, Python, SQL, and AWS
- B2+ English level
nice to have
- Understanding of message queuing, stream processing, and Change Data Capture mechanisms
benefits for locations
Poland
For you
- Discounts on health insurance, sport clubs, shopping centers, cinema tickets, etc.
- Stable income
- Flexible roles
For your comfortable work
- 100% remote work forever
- EPAM hardware
- EPAM software licenses
- Access to offices and co-workings
- Stable workload
- Relocation opportunities
- Flexible engagement models
For your growth
- Free trainings for technical and soft skills
- Free access to LinkedIn Learning platform
- Language courses
- Free access to internal and external e-Libraries
- Certification opportunities
- Skill advisory service
don't have time? Apply later!We send you a link to the job in your e-mail
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
