backgo to search

lead big data software engineer for a biotechnology company

Data Software Engineering, Big Data
Sorry the job is no longer available.

We are currently looking for a remote Lead Big Data Software Engineer with 5+ years of production experience with Spark (PySpark) to join our team.

The customer is a biotechnology company, which engages in the discovery, invention, development, manufacture, and commercialization of medicines.

The main goal is to work out a solution that consumes and stores data from multiple customer’s domains.

  • Implement pipeline processing application using PySpark and Airflow
    • Integrate required database structure
      • Apply data marts in Hive and PostgreSQL
        • Create analytical SQL-scripts in PostgreSQL or any other DB
          • Communicate with English speaking colleagues and customer representatives
            • 5+ years of production experience with Spark (PySpark)
              • Extensive knowledge and experience with Apache Airflow
                • Familiarity with Apache Hive
                  • 1+ year of relevant leadership experience
                    • English level B2+
                      nice to have
                      • Working experience within AWS services: S3, Athena, EC2

                        These jobs are for you

                        benefits for locations

                        For you
                        • Paid time off
                        • Paid sick leave days
                        • Stable income
                        • Meal and home office compensation
                        For your comfortable work
                        • 100% remote work 
                        • Hybrid work opportunities
                        • Free licensed software
                        • Possibility to work on your own device (BYOD)
                        • Stable workload
                        • Relocation opportunities
                        • Flexible engagement models
                        For your growth
                        • Free trainings for technical and soft skills
                        • Free access to LinkedIn Learning platform
                        • Free access to internal and external e-Libraries
                        • Certification opportunities
                        • Skill advisory service
                        • Language courses
                        get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
                        a smiling man wearing sunglasses