go to searchsenior data software engineer
Sorry the job is no longer available.
Senior Data Software Engineer
Join our remote team as a Senior Data Software Engineer to work with our global leader in providing innovative software solutions. We are looking for someone who can develop and maintain data processing pipelines, design and implement data storage solutions, and integrate advanced analytics algorithms. The ideal candidate should have experience in Python, PySpark, and Databricks, as well as a deep understanding of Microsoft Azure and SQL Azure. You will work alongside a team of highly skilled professionals and impact the overall design and functionality of our data infrastructure.
responsibilities
- Build proof of concept (POC) for replacing the external vendor inside the infrastructure
- Set up required Azure services for the POC
- Extract data from data lake (EDL) for processing
- Process data based on application requirements and architecture
- Build a service layer that mimics the current existing application
- Design and implement data storage solutions
- Integrate advanced analytics algorithms into data processing pipelines
- Develop and maintain automated data quality checks
- Work with cross-functional teams to identify and prioritize business requirements
- Ensure the overall design and functionality of data infrastructure
- Collaborate with other developers to implement and maintain data processing pipelines
requirements
- 3+ years of experience in Data Software Engineering
- Experience in Python, PySpark, and Databricks for data processing
- Deep understanding of Microsoft Azure and SQL Azure for building and maintaining data storage solutions
- Experience with Python web services such as Django and Flask
- Experience building and maintaining data processing pipelines
- Experience with data integration and analytics algorithms
- Ability to develop and maintain automated data quality checks
- Experience with performance tuning and optimization of large-scale data processing systems
- Ability to work with cross-functional teams to identify and prioritize business requirements
- Excellent communication skills in spoken and written English, at an upper-intermediate level or higher
nice to have
- Experience with scalable search technologies such as Elasticsearch is a plus
- Experience with machine learning and artificial intelligence is a plus
These jobs are for you
benefits for locations
India
For you
- Insurance Coverage
- Paid Leaves – including maternity, bereavement, paternity, and special COVID-19 leaves.
- Financial assistance for medical crisis
- Retiral Benefits – VPF and NPS
- Customized Mindfulness and Wellness programs
- EPAM Hobby Clubs
For your comfortable work
- Hybrid Work Model
- Soft loans to set up workspace at home
- Stable workload
- Relocation opportunities with ‘EPAM without Borders’ program
For your growth
- Certification trainings for technical and soft skills
- Access to unlimited LinkedIn Learning platform
- Access to internal learning programs set up by world class trainers
- Community networking and idea creation platforms
- Mentorship programs
- Self-driven career progression tool
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
