go to searchsenior big data engineer
Data Software Engineering, Amazon Web Services, Python, Apache Spark, Databricks, Data Architecture, SQL, Redis
Sorry the job is no longer available.
Senior Big Data Engineer
We are looking for a Senior Big Data Engineer to join our team and help us create and adjust analytics data pipelines. The ideal candidate should have hands-on experience in Cloud computing on AWS, developing scripts using Python and developing ETL processes whilst displaying a strong understanding of query execution plans and query optimization.
responsibilities
- Develop analytics data pipelines
- Develop ETL processes and scripts in Python for data integration, from multiple sources
- Optimize and tune both SQL and NoSQL queries to ensure efficient and seamless data processing and delivery across our data pipelines
- Develop and maintain data architecture standards, principles, and models for efficient data integration and management
- Effectively communicate with stakeholders to understand business needs and translate them into technical requirements
requirements
- 2+ years of experience in Cloud computing on AWS
- Experience with Spark
- Knowledge of Databricks
- 2+ years of experience in developing scripts using Python
- Strong knowledge and expertise with SQL and NoSQL Databases
- Experience with Data architecture
These jobs are for you
benefits for locations
Poland
For you
- Discounts on health insurance, sport clubs, shopping centers, cinema tickets, etc.
- Stable income
- Flexible roles
For your comfortable work
- 100% remote work forever
- EPAM hardware
- EPAM software licenses
- Access to offices and co-workings
- Stable workload
- Relocation opportunities
- Flexible engagement models
For your growth
- Free trainings for technical and soft skills
- Free access to LinkedIn Learning platform
- Language courses
- Free access to internal and external e-Libraries
- Certification opportunities
- Skill advisory service
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
