go to searchmiddle big data software engineer for a software company
Sorry, the job is expired
Middle Big Data Software Engineer for a Software Company
Expired job
We are currently looking for a remote Middle Big Data Software Engineer with 5+ years of relevant experience in one of the following areas: Big Data Engineering, Data Warehouse, Business Intelligence or Business Analytics to join our team.
The customer is a provider of software as a service and cloud-based remote connectivity services for collaboration, IT management and customer engagement. The company's products give users and administrators access to remote computers.
responsibilities
- Apply your broad knowledge of technology options, technology platforms, design techniques and approaches across the data warehouse lifecycle phases to design an integrated quality solution that address requirements
- Ensure completeness and compatibility of the technical infrastructure required to support system performance, availability and architecture requirements
- Design and plan for the integration for all data warehouse technical components
- Provide input and recommendations on technical issues to the team
- Responsible for data design, data extracts and transforms
- Develop implementation and operation support plans
- Lead architecture design and implementation of next generation BI solution
- Build robust and scalable data integration (ETL) pipelines using AWS Services, EMR, Python, PiG and Spark
- Mentor and help develop other junior data engineers
- Build and deliver high quality data architecture to support business analysts, data scientists and customer reporting needs
- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources
requirements
- 5+ years of relevant experience in one of the following areas: Big Data Engineering, Data Warehouse, Business Intelligence or Business Analytics
- 5+ years of hands-on experience in writing complex, highly optimized SQL queries across large data sets
- Bachelor's degree in Computer Science, though Master’s degree is preferred
- Demonstrated strength in data modelling, ETL development and Data Warehousing
- Experience with AWS services including S3, EMR, Kinesis and RDS
- Experience with big data stack of technologies, such as Hadoop, HDFS, Hive, Spark, Pig, Presto
- Experience delivering end-to-end projects independently
- Experience using AirFlow, creating and maintaining DAGs, Operators and Hooks
- Knowledge of distributed systems as it pertains to data storage and computing
- Exceptional problem solving and analytical skills
- Knowledge of software engineering best practices across the development lifecycle, including Agile methodologies, coding standards, code reviews, source management, build processes, testing and operations
- English level - B1
benefits for locations
India
For you
- Insurance Coverage
- Paid Leaves – including maternity, bereavement, paternity, and special COVID-19 leaves.
- Financial assistance for medical crisis
- Retiral Benefits – VPF and NPS
- Customized Mindfulness and Wellness programs
- EPAM Hobby Clubs
For your comfortable work
- Hybrid Work Model
- Soft loans to set up workspace at home
- Stable workload
- Relocation opportunities with ‘EPAM without Borders’ program
For your growth
- Certification trainings for technical and soft skills
- Access to unlimited LinkedIn Learning platform
- Access to internal learning programs set up by world class trainers
- Community networking and idea creation platforms
- Mentorship programs
- Self-driven career progression tool
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
looking for something else?
Find a vacancy that works for you. Send us your CV to receive a personalized offer.