go to searchlead big data engineer
Data Software Engineering, Data Analytics and Visualization, Databricks, AWS Glue, Amazon Web Services, MicroStrategy Analytics, PySpark, Python
Lead Big Data Engineer
We are currently hiring for the position of Lead Big Data Engineer for a remote work setup.
The ideal candidate will work closely with technical teams and business stakeholders in developing, designing, and delivering high-quality data products that meet business requirements. The role is responsible for end-to-end data integration, modeling, and reporting on MicroStrategy and Databricks platforms.
responsibilities
- Translate business requirements into technical solutions
- Design, develop, monitor, and visualize Customer Data Access Overhaul data product
- Integrate high-quality datasets for analytical use-cases
- Design incident management process
- Help other data teams follow the customer standards
- Conduct testing (preparation and execution)
- Operate data pipelines and address alerts, bugs, etc.
requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or related field
- Minimum of 5 years of experience in Databricks or similar
- Minimum of 5 years of experience in MicroStrategy
- 1+ years of relevant leadership experience
- Strong skills in data visualization and data modeling
- Good understanding of ETL concepts
- Proficient in Apache Spark, PySpark, Python, and SQL
- Familiarity with AWS Glue, Amazon S3, GitHub, and CI/CD
- Ability to work independently and as a team player
- Strong communication and organizational skills
- Strong problem-solving skills and attention to detail
- Ability to multitask in a fast-paced environment
- Willingness to learn and keep updated with emerging technologies
nice to have
- Advanced Databricks skills like delta, cluster configuration, or Databricks APIs
- Experience in new technologies like BigQuery, Airflow, Redshift, or Apache NiFi
benefits for locations
Georgia
For you
- Paid time off
- Paid sick leave days
- Medical insurance
- Stable income
For your comfortable work
- 100% remote work forever
- Free licensed software
- Possibility to work on your own device (BYOD)
- Stable workload
- Relocation opportunities
- Flexible engagement models
For your growth
- Free trainings for technical and soft skills
- Free access to LinkedIn Learning platform
- Language courses
- Free access to internal and external e-Libraries
- Certification opportunities
- Skill advisory service
get job alerts in your inboxHundreds of open jobs for Software Engineers, QA, DevOps, Business Analysts and other tech professionals
looking for something else?
Find a vacancy that works for you. Send us your CV to receive a personalized offer.