senior data software engineer

Data Software Engineering, Databricks, Python, PySpark, Microsoft Azure, SQL Azure

Poland

Sorry the job is no longer available.

Senior Data Software Engineer

Join our remote team as a Senior Data Software Engineer. We are seeking a deeply technical individual with a solid background in data engineering to collaborate closely with development peers, product leadership, and other technical staff to create innovative and impactful solutions. This role offers an opportunity to contribute significantly to the design, development, and optimization of features in a dynamic Agile development environment.

responsibilities

Provide technical input for new feature requirements, partnering with business owners and architects
Ensure continuous improvement by staying abreast of industry trends and emerging technologies
Setup required Azure services
Extract data from data lake (EDL)
Mimic current existing application
Process data based on application requirements & architecture
Collaborate with Developers, Product and Program Management, and senior technical staff to deliver customer-centric solutions.
Build service layer
Actively contribute to architectural and technical discussions

requirements

At least 3+ years of production experience in Data Software Engineering
Be hands-on with deep expertise in Databricks, PySpark, Microsoft Azure, and SQL Azure
Experience with Python web services such as Django and Flask for building scalable and high-performance applications
Support applications and systems in a production environment, ensuring timely resolution of issues
Exposure to containerization technologies such as Docker for application packaging and deployment
Expertise in Microservices architecture for designing and building scalable applications
Reviewing requirements and translating them into a documented technical design for implementation
Deep understanding of data structures, algorithms, and their practical applications
Familiarity with Git, Jenkins, and CI/CD for version control, integration, and deployment
Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

nice to have

Experience with other web frameworks and languages such as Ruby on Rails and Node.js
Familiarity with Hadoop, Hive, and NoSQL databases such as MongoDB and Cassandra
Experience with ML pipelines and frameworks such as TensorFlow and Keras