senior data software engineer

Data Software Engineering, Apache Spark, Microsoft Azure, Python, Forecasting Models, Data Science, MLOps, Databricks

Poland

Sorry the job is no longer available.

Senior Data Software Engineer

Join our remote team as a Senior Data Software Engineer within a globally recognized company that specializes in delivering innovative technology solutions. We are currently seeking a hands-on technical expert to collaborate closely with development peers, product leadership, and other technical staff to create innovative data integration solutions. The successful candidate will have the opportunity to contribute significantly to the design, development, and optimization of features in a dynamic Agile development environment.

responsibilities

Designing and implementing data integration solutions that meet business requirements and are scalable, efficient, and reliable
Collaborating with data scientists to transform their models into production-ready solutions
Developing and implementing data integration processes and workflows using Apache Spark and Databricks
Working closely with cross-functional teams to identify and resolve data-related issues and ensure data quality
Implementing MLOps processes to ensure that machine learning models are deployed and maintained in production environments
Designing and implementing data architecture and storage solutions in Microsoft Azure
Designing and implementing data migration solutions to migrate data from on-premise systems to Microsoft Azure
Performing code reviews, ensuring code quality and adherence to standards
Mentoring junior team members, helping them enhance their skills and grow their careers
Actively participating in architectural and technical discussions

requirements

At least 3 years of experience in software engineering with a focus on data integration solutions
Experience with Apache Spark for processing large datasets, and Databricks for data integration and machine learning workflows
Expertise in Microsoft Azure for cloud-based infrastructure and application management
Deep understanding of Python programming language and knowledge of forecasting models and statistical models
Experience with MLOps for taking data science models and making them production ready
Familiarity with Git for version control
Excellent knowledge of SQL and relational tables
Ability to design and develop scalable and efficient data integration pipelines using Python, Spark, and other relevant technologies
Experience with developing machine learning models and utilizing ML tools and libraries
Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

nice to have

Experience with Panda library for data manipulation and analysis is a plus
Knowledge of cloud computing concepts such as regions and ADLS
Experience with other Microsoft Azure services such as Azure Data Factory and Azure Stream Analytics