senior data software engineer
Join our remote team as a Senior Data Software Engineer to work with our global leader in providing innovative software solutions. We are looking for someone who can develop and maintain data processing pipelines, design and implement data storage solutions, and integrate advanced analytics algorithms. The ideal candidate should have experience in Python, PySpark, and Databricks, as well as a deep understanding of Microsoft Azure and SQL Azure. You will work alongside a team of highly skilled professionals and impact the overall design and functionality of our data infrastructure.
- Build proof of concept (POC) for replacing the external vendor inside the infrastructure
- Set up required Azure services for the POC
- Extract data from data lake (EDL) for processing
- Process data based on application requirements and architecture
- Build a service layer that mimics the current existing application
- Design and implement data storage solutions
- Integrate advanced analytics algorithms into data processing pipelines
- Develop and maintain automated data quality checks
- Work with cross-functional teams to identify and prioritize business requirements
- Ensure the overall design and functionality of data infrastructure
- Collaborate with other developers to implement and maintain data processing pipelines
- 3+ years of experience in Data Software Engineering
- Experience in Python, PySpark, and Databricks for data processing
- Deep understanding of Microsoft Azure and SQL Azure for building and maintaining data storage solutions
- Experience with Python web services such as Django and Flask
- Experience building and maintaining data processing pipelines
- Experience with data integration and analytics algorithms
- Ability to develop and maintain automated data quality checks
- Experience with performance tuning and optimization of large-scale data processing systems
- Ability to work with cross-functional teams to identify and prioritize business requirements
- Excellent communication skills in spoken and written English, at an upper-intermediate level or higher
- Experience with scalable search technologies such as Elasticsearch is a plus
- Experience with machine learning and artificial intelligence is a plus
These jobs are for you
beneficios por ubicaciones
Cobertura de seguro
Licencias pagadas, incluyendo licencia por maternidad, luto, paternidad y licencia especial por COVID-19.
Asistencia financiera para crisis médicas
Beneficios de jubilación: VPF y NPS
Programas personalizados de atención plena y bienestar
Clubes de pasatiempos de EPAM
Modelo de trabajo híbrido
Préstamos suaves para establecer un espacio de trabajo en casa
Carga de trabajo estable
Oportunidades de reubicación con el programa 'EPAM without Borders'
Capacitaciones de certificación en habilidades técnicas y blandas
Acceso ilimitado a la plataforma de aprendizaje de LinkedIn
Acceso a programas internos de aprendizaje establecidos por entrenadores de clase mundial
Plataformas de networking comunitario y creación de ideas
Programas de mentoría
Herramienta de progresión profesional impulsada por uno mismo
![hombre sonriente](https://eu-images.contentstack.com/v3/assets/blt892f41c9788ae399/bltfbe680d159b16d41/62ce8dce877f50700eeff770/job_subscription_image.png)
Envíanos tu CV para recibir una oferta personalizada