go to searchsenior big data engineer for an insurance company
Big DataData Integration DB and ETL, SQL, Scala, Perl, Oracle
Colombia, Georgia, Greece, Poland, Portugal
Senior Big Data Engineer for an Insurance Company
Currently, we are looking for a remote Senior Big Data Engineer with 3+ years of Big Data engineering experience, and Hands-on experience with Cloudera Hadoop stack to join our team.
Our customer offers automobile, property, liability, agriculture, and surety insurance.
responsibilities
- Contribute to designing, developing, and monitoring systems and solutions for collecting, storing, processing, and analyzing large data sets
- Work in a team made up of other Data Engineers
- Understand and implement certain platform capabilities
- Understand coding standards and implement them within code being developed
requirements
- 3+ years of Big Data engineering experience
- Hands-on experience with Cloudera Hadoop stack including Hive and Impala performance optimization
- Data Quality management knowledge is highly desirable
- Experience with real-time data processing technologies: Flume, Message Queues (preferably IBM WebSphere MQ)
- 2+ years' experience with Hadoop stack: HDFS, Hive, Impala
- 2+ years' experience with Spark Scala
- 1+ year of ETL tools experience, preferably Pentaho
- Experience with Cloudera 6+
- Knowledge of SQL/HQL
- Experience with scripting (bash preferably or Perl)
- Knowledge of RDBMS technologies (Oracle preferably and experience with SQL Server, SSRS - reporting, SSIS - ETL)
- Experience with AWS or Cloud technologies
- Experience in messaging tech – MQ or Kafka or both and general cloud awareness would be extremely helpful
- Knowledge of Insurance field and Guidewire system
- Data Modelling CA Erwin/Sparx
- Experience in OOZIE workflow
- Proficient English (written and spoken) B2
benefits for locations
Colombia
For you
- Prepaid Medicine with Colsanitas for you and your legal dependents
- MetLife Life Insurance for you
- Thousands of projects for top brands
- Stable income
For your comfortable work
- 100% remote work forever
- Free licensed software
- Possibility to work on your own device (BYOD)
- Stable workload
- Relocation opportunities
- Flexible engagement models
For your growth
- Free trainings for technical and soft skills
- Free access to LinkedIn Learning platform
- Support from a personal Skill Advisor
- Language courses
- Free access to internal and external e-Libraries
- Access to internal communities and competency centers
- Certification opportunities
subscribe to EPAM Anywhere vacancies!Hundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
looking for something else?
Find a vacancy that works for you. Send us your CV to receive a personalized offer.
