senior data software engineer
Join our remote team as a Senior Data Software Engineer to work on exciting projects involving Databricks workflows, APIs, and analytical development. You will be an integral part of our team and must possess expertise in building and deploying production solutions using Azure, Python, Spark, PySpark, and SQL. We require a thoughtful and knowledgeable candidate who can create robust data pipelines and tie together loose ends for solutions across systems.
responsibilities
- Collaborate with stakeholders to design, develop, and deploy data pipelines for various use cases
- Develop and maintain robust ETL processes to extract, transform, and load data from various sources
- Design and develop data models to support reporting and analytics use cases
- Ensure data quality and reliability by implementing data validation and error handling mechanisms
- Optimize data pipelines for performance and scalability
- Troubleshoot and resolve data pipeline issues in a timely manner
- Develop and maintain technical documentation for data pipelines and data processes
- Contribute to the development of data engineering best practices and standards
requirements
- At least 3 years of relevant experience in data software engineering and development
- Proven track record of building end-to-end production solutions
- Expertise in one of the languages (Python, Spark, PySpark, SQL) with knowledge on how to build both within dev and enabling deployment to production
- Experience using Databricks for data engineering
- Ability to analyze, troubleshoot, and optimize data pipelines for performance and reliability
- Experience working on one or more cloud platforms (Azure, GCP, AWS), with a strong preference for Azure
- Ability to design and develop robust, scalable, and efficient data pipelines
- Experience using Azure DevOps, GitHub, (or others) and version control
- Ability to write and maintain technical documentation for data pipelines and data processes
- Excellent communication skills in spoken and written English, at an upper-intermediate level or higher
nice to have
- Experience with RESTful APIs and other data transfer protocols
- Experience with data visualization tools like Power BI
- Experience with Agile software development methodologies
These jobs are for you
beneficios por ubicaciones
Descuentos en seguros de salud, clubes deportivos, centros comerciales, entradas de cine, etc.
Ingreso estable
Roles flexibles
Trabajo remoto al 100% para siempre
Hardware de EPAM
Licencias de software de EPAM
Acceso a oficinas y espacios de coworking
Carga de trabajo estable
Oportunidades de reubicación
Modelos de participación flexibles
Formaciones gratuitas en habilidades técnicas y blandas
Acceso gratuito a la plataforma de aprendizaje de LinkedIn
Cursos de idiomas
Acceso gratuito a bibliotecas internas y externas
Oportunidades de certificación
Servicio de asesoramiento de habilidades
Envíanos tu CV para recibir una oferta personalizada