senior data software developer

Data Software Engineering, Databricks, Python, PySpark, Microsoft Azure, SQL Azure

Poland

Facebook LinkedIn Twitter Send via email

Senior Data Software Developer

Facebook LinkedIn Twitter Send via email

We are seeking a remote Senior Data Software Developer to join our team.

The ideal candidate should also have experience working with Python and Azure Databricks. The successful candidate will develop reusable DataBricks components for data ingestion and data analytics, ingest data into data lake for reporting and predictive modelling, ensure security controls, integrate data governance and establish clear auditable data lineage. They will collaborate with architects, technical leads and key individuals within other functional groups. The Senior Data Software Developer will also actively participate in code review, test solutions and write project documentation.

responsibilities

Build reusable DataBricks components for data ingestion and data analytics
Ingest data via batch, streaming, replication into data lake for reporting and predictive modelling
Ensure security controls, integrate with data governance and establish clear auditable data lineage
Collaborate with architects, technical leads and key individuals within other functional groups
Participate in code review, testing solutions and writing project documentation

requirements

At least 3 years of experience in Data Software Engineering
Proficiency in Python and Azure Databricks is a must
Experience building data ingestion pipelines, Data Warehouse or Database architecture
Data modeling skills with hands-on development experience with modern Big Data components
Cloud experience in designing, deploying and administering scalable, available and fault-tolerant systems
An extensive understanding of regulatory compliance such as PI, GDPR, HIPAA
B2+ English level

nice to have