backgo to search

senior big data software engineer for a biotechnology company

We are currently looking for a remote Senior Big Data Software Engineer with 3+ years of production experience with Spark (PySpark) to join our team.

The customer is a biotechnology company, which engages in the discovery, invention, development, manufacture, and commercialization of medicines.

The main goal is to work out a solution that consumes and stores data from multiple customer’s domains.

responsibilities
  • Implement pipeline processing application using PySpark and Airflow
    • Integrate required database structure
      • Apply data marts in Hive and PostgreSQL
        • Create analytical SQL-scripts in PostgreSQL or any other DB
          • Communicate with English speaking colleagues and customer representatives
            requirements
            • 3+ years of production experience with Spark (PySpark)
              • Strong skills in Apache Airflow
                • Familiarity with Apache Hive
                  • English level B2+
                    nice to have
                    • Working experience within AWS services: S3, Athena, EC2

                      benefits for locations

                      location.svg

                      For you

                      • Medical insurance package for you and your family
                      • Stable income
                      • Paid sick leave days

                      For your comfortable work

                      • 100% remote work forever
                      • Free licensed software
                      • Possibility to work on your own device (BYOD)
                      • Stable workload
                      • Relocation opportunities
                      • Flexible engagement models

                      For your growth

                      • Free trainings for technical, soft, and leadership skills
                      • Access to LinkedIn Learning platform
                      • Language courses
                      • Access to internal and external e-Libraries
                      • Certification opportunities
                      • Skill advisory service
                      subscribe to EPAM Anywhere vacancies!Hundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
                      Girl in front of laptop

                      looking for something else?

                      Find a vacancy that works for you. Send us your CV to receive a personalized offer.