Remote Lead Big Data Engineer vacancy | EPAM Anywhere

This website uses cookies for analytics, personalization and advertising. Click here to learn more or change your cookie settings. By continuing to browse, you agree to our use of cookies.

Back icon

Lead Big Data Engineer for an Insurance Company

Lead Big Data Engineer for an Insurance Company 40 hrs/week, 12+ months

Currently, we are looking for a remote Lead Big Data Engineer with 5+ years of Big Data engineering experience, and Hands-on experience with Cloudera Hadoop stack to join our team.

Our customer offers automobile, property, liability, agriculture, and surety insurance.

Please note that even though you are applying for this position, you may be offered other projects to join within EPAM Anywhere.

We accept CVs only in English.

Responsibilities

  • Contribute to designing, developing, and monitoring systems and solutions for collecting, storing, processing, and analyzing large data sets
    • Work in a team made up of other Data Engineers
      • Understand and implement certain platform capabilities
        • Understand coding standards and implement them within code being developed

          Requirements

          • 5+ years of Big Data engineering experience
            • Hands-on experience with Cloudera Hadoop stack including Hive and Impala performance optimization
              • Data Quality management knowledge is highly desirable
                • Experience with real-time data processing technologies: Flume, Message Queues (preferably IBM WebSphere MQ)
                  • 3+ years' experience with Hadoop stack: HDFS, Hive, Impala
                    • 3+ years' experience with Spark Scala
                      • 2+ year of ETL tools experience, preferably Pentaho
                        • Experience with Cloudera 6+
                          • Knowledge of SQL/HQL
                            • Experience with scripting (bash preferably or Perl)
                              • Knowledge of RDBMS technologies (Oracle preferably and experience with SQL Server, SSRS - reporting, SSIS - ETL)
                                • Experience with AWS or Cloud technologies
                                  • Experience in messaging tech – MQ or Kafka or both and general cloud awareness would be extremely helpful
                                    • Knowledge of Insurance field and Guidewire system
                                      • Data Modelling CA Erwin/Sparx
                                        • Experience in OOZIE workflow

                                          We offer

                                          • Competitive compensation depending on experience and skills
                                            • Work on enterprise-level projects on a long-term basis
                                              • Full-time remote work
                                                • Unlimited access to learning resources (EPAM training courses, English classes, Internal Library)
                                                  • Community of 38,000+ industry's top professionals
                                                    Big Data
                                                    Data Integration DB and ETL
                                                    SQL
                                                    Scala
                                                    Perl
                                                    Oracle

                                                    40 hrs/week

                                                    Hours per week

                                                    12+ months

                                                    Project length

                                                    Italy

                                                    Locations eligible for the position