senior spark engineer for financial company
Currently, we are looking for a remote Senior Spark Engineer to join our team.
The goal of this project is to develop a cutting-edge investment analytics platform to allow macroeconomists and investment analysts to conduct their research and modeling.
- Solving challenging tasks related to the language design
- The automatization of queries
- The optimization of distributed calculations
- The correct utilization of the cloud infrastructure
- Low-level code optimization
- The optimal storage of bitemporal data, protocols for online collaboration with the DSL
- 6+ years of experience with Java
- Experience with engineering in a relevant role with strong computer science fundamentals
- Experience with Spark and open systems
- Experience with SQL and understanding of database internals
- Knowledge of Resilient Distributed Datasets (RDD) and multithreading computer architecture knowledge - deadlocks, concurrency control, schedulers, etc.
- Knowledge of Distributed systems – RPC, naming servers, distributed transaction processing, etc.
- English level B2+