Saltar al contenido principal
backir a búsqueda

senior data software engineer

bullets
Data Software Engineering, Databricks, Python, PySpark, Microsoft Azure, SQL Azure
bullets
India

Join our remote team as a Senior Data Software Engineer to work with our global leader in providing innovative software solutions. We are looking for someone who can develop and maintain data processing pipelines, design and implement data storage solutions, and integrate advanced analytics algorithms. The ideal candidate should have experience in Python, PySpark, and Databricks, as well as a deep understanding of Microsoft Azure and SQL Azure. You will work alongside a team of highly skilled professionals and impact the overall design and functionality of our data infrastructure.

responsibilities
  • Build proof of concept (POC) for replacing the external vendor inside the infrastructure
    • Set up required Azure services for the POC
      • Extract data from data lake (EDL) for processing
        • Process data based on application requirements and architecture
          • Build a service layer that mimics the current existing application
            • Design and implement data storage solutions
              • Integrate advanced analytics algorithms into data processing pipelines
                • Develop and maintain automated data quality checks
                  • Work with cross-functional teams to identify and prioritize business requirements
                    • Ensure the overall design and functionality of data infrastructure
                      • Collaborate with other developers to implement and maintain data processing pipelines
                        requirements
                        • 3+ years of experience in Data Software Engineering
                          • Experience in Python, PySpark, and Databricks for data processing
                            • Deep understanding of Microsoft Azure and SQL Azure for building and maintaining data storage solutions
                              • Experience with Python web services such as Django and Flask
                                • Experience building and maintaining data processing pipelines
                                  • Experience with data integration and analytics algorithms
                                    • Ability to develop and maintain automated data quality checks
                                      • Experience with performance tuning and optimization of large-scale data processing systems
                                        • Ability to work with cross-functional teams to identify and prioritize business requirements
                                          • Excellent communication skills in spoken and written English, at an upper-intermediate level or higher
                                            nice to have
                                            • Experience with scalable search technologies such as Elasticsearch is a plus
                                              • Experience with machine learning and artificial intelligence is a plus

                                                These jobs are for you

                                                beneficios por ubicaciones

                                                location.svg
                                                Para ti

                                                Cobertura de seguro

                                                Licencias pagadas, incluyendo licencia por maternidad, luto, paternidad y licencia especial por COVID-19.

                                                Asistencia financiera para crisis médicas

                                                Beneficios de jubilación: VPF y NPS

                                                Programas personalizados de atención plena y bienestar

                                                Clubes de pasatiempos de EPAM

                                                Para tu trabajo cómodo

                                                Modelo de trabajo híbrido

                                                Préstamos suaves para establecer un espacio de trabajo en casa

                                                Carga de trabajo estable

                                                Oportunidades de reubicación con el programa 'EPAM without Borders'

                                                Para tu crecimiento

                                                Capacitaciones de certificación en habilidades técnicas y blandas

                                                Acceso ilimitado a la plataforma de aprendizaje de LinkedIn

                                                Acceso a programas internos de aprendizaje establecidos por entrenadores de clase mundial

                                                Plataformas de networking comunitario y creación de ideas

                                                Programas de mentoría

                                                Herramienta de progresión profesional impulsada por uno mismo

                                                suscríbete a nuestros vacantesMantente al día con nuestras posiciones abierta para ingenieros en Control de Calidad, DevOps, Analista de Negocios y mucho más
                                                hombre sonriente
                                                ¿buscas algo más?

                                                Envíanos tu CV para recibir una oferta personalizada