senior big data engineer for a healthcare company
Senior Big Data Engineer for a Healthcare Company
We are currently looking for a remote Senior Big Data Engineer with 3+ years of experience in Data Engineering to join our team.
The customer is an American multinational company working in the combined industries of health information technology and clinical research.
responsibilities
- Data transformation and warehousing
- Analyze and correlate dataset to user profile
- Create the required technical tasks in backlog and update status regularly
- Provide Production Support for any issues raised by the Business and experience on Production/Integration release management
- Recommend changes to client software based on information such as client feedback, language changes and new technology
- developing Shell scripts to orchestrate execution of all other scripts and move the data files within and outside of HDFS
- Participate in all Agile ceremony meetings and update task status and adhere to timelines and quality standards for the task
- Working with business and peers to define, estimate, and deliver functionality
requirements
- 3+ years of Big Data Engineering experience
- In-depth understanding/knowledge of Hadoop & Spark Architecture and its components such as HDFS, Job Tracker, Task Tracker, executor cores and memory parameters
- Experience in Hadoop development, working experience on SPARK, SCALA is mandatory and Database exposure is must
- Hands-on experience in Spark and Spark Streaming creating RDD's, applying operations -Transformation and Actions
- Experience in code optimize to fine tune the applications
- Expertise in writing Hadoop/spark Jobs for analyzing data using Spark, Scala, Hive, Kafka and Python
- Experience with streaming workflow operations
- Experience with developing large-scale distributed applications and developing solutions to analyze large data sets efficiently
- Experience in Data Warehousing and ETL processes
- Strong database, SQL, ETL and data analysis skills
- Experienced in developing scripts for doing transformations using Scala
- Experience in Using Kafka on publish-subscribe messaging as a distributed commit log, have experienced in its fast, scalable and durability
- Able to understand existing business logic & implement the business changes
- Should have gone through entire development life cycle including system integration testing
- Right communication skills to be able to work with Business
- Good logical reasoning, analytical abilities
- Experience working with remote teams
- Experienced in Agile development methodology
- Proficient English (written and spoken) B2
benefits for locations
Armenia
For you
- Medical insurance package for you and your family
- Stable income
- Paid sick leave days
For your comfortable work
- 100% remote work forever
- Free licensed software
- Possibility to work on your own device (BYOD)
- Stable workload
- Relocation opportunities
- Flexible engagement models
For your growth
- Free trainings for technical, soft, and leadership skills
- Access to LinkedIn Learning platform
- Language courses
- Access to internal and external e-Libraries
- Certification opportunities
- Skill advisory service
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
looking for something else?
Find a vacancy that works for you. Send us your CV to receive a personalized offer.