senior data software engineer

Data Software Engineering, Apache Spark, Microsoft Azure, Python, Forecasting Models, Data Science, MLOps, Databricks

Poland

Sorry the job is no longer available.

Senior Data Software Engineer

We are seeking a Senior Data Software Engineer to join our team in building a data integration solution. The Senior Data Software Engineer will take responsibility for the development and execution of the data engineering strategy, working closely with data scientists and other stakeholders to ensure that data is transformed into valuable insights. The ideal candidate will have a strong background in data engineering, machine learning, and software development.

responsibilities

Collaborate with data scientists to build and deploy machine learning models in production
Design and develop data pipelines, data processing systems, and APIs for data integration and analysis
Optimize data pipelines for performance and scalability
Ensure data quality, accuracy, and consistency through data validation and testing
Develop and implement MLOps processes to monitor and maintain machine learning models
Work with stakeholders to understand data requirements and provide solutions to meet their needs
Design and implement data security and privacy measures to protect sensitive data
Stay up-to-date with emerging trends and technologies in data engineering and machine learning
Provide technical guidance and mentorship to junior team members

requirements

Minimum 3+ years of experience in data engineering or software development roles
Proficiency in Apache Spark, Microsoft Azure, and Databricks for data processing and management
Expertise in Python programming language and associated data science libraries such as Pandas and NumPy
Experience in building forecasting models, statistical models, and machine learning models
Strong knowledge of MLOps and deploying machine learning models in production
Experience with Git for version control and team collaboration
Good understanding of Azure concepts such as clouds, regions, and compute
Ability to work in a fast-paced environment and deliver results under tight deadlines
Excellent English communication skills, both written and verbal, for effective global collaboration (B2+)

nice to have

Experience with SQL and relational databases for data management
Familiarity with cloud-based data warehousing solutions such as Azure Data Lake Storage (ADLS)
Knowledge of other machine learning tools and platforms such as TensorFlow and PyTorch
Experience with data visualization tools such as Tableau and Power BI