go to searchsenior data software engineer
Sorry the job is no longer available.
Senior Data Software Engineer
Join our remote team as a Senior Data Software Engineer to work on exciting projects involving Databricks workflows, APIs, and analytical development. You will be an integral part of our team and must possess expertise in building and deploying production solutions using Azure, Python, Spark, PySpark, and SQL. We require a thoughtful and knowledgeable candidate who can create robust data pipelines and tie together loose ends for solutions across systems.
responsibilities
- Collaborate with stakeholders to design, develop, and deploy data pipelines for various use cases
- Develop and maintain robust ETL processes to extract, transform, and load data from various sources
- Design and develop data models to support reporting and analytics use cases
- Ensure data quality and reliability by implementing data validation and error handling mechanisms
- Optimize data pipelines for performance and scalability
- Troubleshoot and resolve data pipeline issues in a timely manner
- Develop and maintain technical documentation for data pipelines and data processes
- Contribute to the development of data engineering best practices and standards
requirements
- At least 3 years of relevant experience in data software engineering and development
- Proven track record of building end-to-end production solutions
- Expertise in one of the languages (Python, Spark, PySpark, SQL) with knowledge on how to build both within dev and enabling deployment to production
- Experience using Databricks for data engineering
- Ability to analyze, troubleshoot, and optimize data pipelines for performance and reliability
- Experience working on one or more cloud platforms (Azure, GCP, AWS), with a strong preference for Azure
- Ability to design and develop robust, scalable, and efficient data pipelines
- Experience using Azure DevOps, GitHub, (or others) and version control
- Ability to write and maintain technical documentation for data pipelines and data processes
- Excellent communication skills in spoken and written English, at an upper-intermediate level or higher
nice to have
- Experience with RESTful APIs and other data transfer protocols
- Experience with data visualization tools like Power BI
- Experience with Agile software development methodologies
These jobs are for you
benefits for locations
India
For you
- Insurance Coverage
- Paid Leaves – including maternity, bereavement, paternity, and special COVID-19 leaves.
- Financial assistance for medical crisis
- Retiral Benefits – VPF and NPS
- Customized Mindfulness and Wellness programs
- EPAM Hobby Clubs
For your comfortable work
- Hybrid Work Model
- Soft loans to set up workspace at home
- Stable workload
- Relocation opportunities with ‘EPAM without Borders’ program
For your growth
- Certification trainings for technical and soft skills
- Access to unlimited LinkedIn Learning platform
- Access to internal learning programs set up by world class trainers
- Community networking and idea creation platforms
- Mentorship programs
- Self-driven career progression tool
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
