senior data software engineer

Data Software Engineering, Python, Apache Spark, Amazon Web Services, Scala, Apache Hadoop, Databricks

Poland

Facebook LinkedIn Twitter Send via email

Senior Data Software Engineer

Facebook LinkedIn Twitter Send via email

We are seeking a highly motivated Senior Data Software Engineer to join our remote team, working with the world's leading source of news and information for professional markets. As a Senior Data Software Engineer, you will be responsible for developing and building Spark applications, working with large datasets and Cloud technologies. If you have a solid understanding of the core AWS building blocks, including workloads, stacks, instances, containers, and basic security knowledge - we invite you to apply!

responsibilities

Develop and build Spark applications, working with large datasets
Perform data parsing and manipulation using Scala and Python
Collaborate with cross-functional teams to understand product requirements and user needs
Participate in design reviews, offering input on requirements, product design, and potential challenges
Contribute to the preparation of automated test cases using tools like CodeBuild/CodeDeploy or other preferred automation frameworks
Prepare detailed reports covering all aspects of software development, including identified issues and development outcomes

requirements

A minimum of 3 years of experience in Data Software Engineering, demonstrating your proficiency in developing and building Spark applications
Solid understanding of the core AWS building blocks, including workloads, stacks, instances, containers, VPCs, networking, internetworking, routing, core services like DNS
Proficiency in Scala and Python, enabling you to work with the Scala ecosystem and perform ETL/ELT jobs
Experience working with Apache Hadoop and Databricks
Strong focus on teamwork and exceptional interpersonal skills, allowing you to collaborate effectively with cross-functional teams
Fluent spoken and written English at an Upper-Intermediate level or higher

nice to have

Work experience with the following technologies: S3, Oracle, Elastic Search, Step Functions, Dynamo, CloudTrail/CloudWatch, DataDog, SNS/SQS, or Athena