backgo to search

senior big data engineer for an insurance company

Currently, we are looking for a remote Senior Big Data Engineer with 3+ years of Big Data engineering experience, and Hands-on experience with Cloudera Hadoop stack to join our team.

Our customer offers automobile, property, liability, agriculture, and surety insurance.

responsibilities
  • Contribute to designing, developing, and monitoring systems and solutions for collecting, storing, processing, and analyzing large data sets
    • Work in a team made up of other Data Engineers
      • Understand and implement certain platform capabilities
        • Understand coding standards and implement them within code being developed
          requirements
          • 3+ years of Big Data engineering experience
            • Hands-on experience with Cloudera Hadoop stack including Hive and Impala performance optimization
              • Data Quality management knowledge is highly desirable
                • Experience with real-time data processing technologies: Flume, Message Queues (preferably IBM WebSphere MQ)
                  • 2+ years' experience with Hadoop stack: HDFS, Hive, Impala
                    • 2+ years' experience with Spark Scala
                      • 1+ year of ETL tools experience, preferably Pentaho
                        • Experience with Cloudera 6+
                          • Knowledge of SQL/HQL
                            • Experience with scripting (bash preferably or Perl)
                              • Knowledge of RDBMS technologies (Oracle preferably and experience with SQL Server, SSRS - reporting, SSIS - ETL)
                                • Experience with AWS or Cloud technologies
                                  • Experience in messaging tech – MQ or Kafka or both and general cloud awareness would be extremely helpful
                                    • Knowledge of Insurance field and Guidewire system
                                      • Data Modelling CA Erwin/Sparx
                                        • Experience in OOZIE workflow
                                          • Proficient English (written and spoken) B2

                                            benefits for locations

                                            location.svg
                                            For you
                                            • Paid time off
                                            • Paid sick leave days
                                            • Medical insurance
                                            • Stable income
                                            For your comfortable work
                                            • 100% remote work forever
                                            • Free licensed software
                                            • Possibility to work on your own device (BYOD)
                                            • Stable workload
                                            • Relocation opportunities
                                            • Flexible engagement models
                                            For your growth
                                            • Free trainings for technical and soft skills
                                            • Free access to LinkedIn Learning platform
                                            • Language courses
                                            • Free access to internal and external e-Libraries
                                            • Certification opportunities
                                            • Skill advisory service
                                            get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
                                            Girl in front of laptop
                                            looking for something else?

                                            Find a vacancy that works for you. Send us your CV to receive a personalized offer.