senior big data engineer for an insurance company
Senior Big Data Engineer for an Insurance Company
Currently, we are looking for a remote Senior Big Data Engineer with 3+ years of Big Data engineering experience, and Hands-on experience with Cloudera Hadoop stack to join our team.
Our customer offers automobile, property, liability, agriculture, and surety insurance.
responsibilities
- Contribute to designing, developing, and monitoring systems and solutions for collecting, storing, processing, and analyzing large data sets
- Work in a team made up of other Data Engineers
- Understand and implement certain platform capabilities
- Understand coding standards and implement them within code being developed
requirements
- 3+ years of Big Data engineering experience
- Hands-on experience with Cloudera Hadoop stack including Hive and Impala performance optimization
- Data Quality management knowledge is highly desirable
- Experience with real-time data processing technologies: Flume, Message Queues (preferably IBM WebSphere MQ)
- 2+ years' experience with Hadoop stack: HDFS, Hive, Impala
- 2+ years' experience with Spark Scala
- 1+ year of ETL tools experience, preferably Pentaho
- Experience with Cloudera 6+
- Knowledge of SQL/HQL
- Experience with scripting (bash preferably or Perl)
- Knowledge of RDBMS technologies (Oracle preferably and experience with SQL Server, SSRS - reporting, SSIS - ETL)
- Experience with AWS or Cloud technologies
- Experience in messaging tech – MQ or Kafka or both and general cloud awareness would be extremely helpful
- Knowledge of Insurance field and Guidewire system
- Data Modelling CA Erwin/Sparx
- Experience in OOZIE workflow
- Proficient English (written and spoken) B2
benefits for locations
Georgia
For you
- Paid time off
- Paid sick leave days
- Medical insurance
- Stable income
For your comfortable work
- 100% remote work forever
- Free licensed software
- Possibility to work on your own device (BYOD)
- Stable workload
- Relocation opportunities
- Flexible engagement models
For your growth
- Free trainings for technical and soft skills
- Free access to LinkedIn Learning platform
- Language courses
- Free access to internal and external e-Libraries
- Certification opportunities
- Skill advisory service
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
looking for something else?
Find a vacancy that works for you. Send us your CV to receive a personalized offer.