Lead Big Data Developer for a Semiconductor Manufacturer

Currently, we are looking for a remote Lead Big Data Developer.

Our client is one of the biggest semiconductor manufacturers. The main idea is to implement a “smart manufacturing” approach and this project is one of the first steps in this direction. As part of the solution, we should apply complex processing using cutting-edge Big Data technologies to process the original data to produce comprehensive block information.

Please note that even though you are applying for this position, you still can be offered  other projects to join within EPAM Anywhere.

Join EPAM Anywhere to quickly and easily find projects that match your knowledge and experience, while working with Forbes Global 2000 clients, building a successful IT career, and earning competitive rewards. The platform provides additional perks, including a flexible schedule, professional development opportunities and access to a community of experts.

Responsibilities

• Increase production line throughput
• Improve manufacturing equipment utilization
• Relate the events during the processing to the resulting product quality
• Identify the reasons for delays in the processing pipeline and quantifying their impact
• Manufacture control systems capture process data in various formats including relational storage, files, and system snapshots
• Build a technology platform to bring all the data together in one place, process it, and map to a unified data model, handling the proprietary unstructured data formats
• Analyze the data to get the big picture on manufacturing delays across the fab to potentially optimize the manufacturing process and increase manufacturing capacity and cost effectiveness

Requirements

• 5+ years of experience with Big Data stack
• Hands on Java experience
• Knowledge of Scala
• Experience with Python
• Hands on Apache Spark
• Knowledge of Apache Parquet
• Apache EMR
• Hands on Jupyter
• Knowledge of NoSQL
• Experience with AWS
• Good spoken and written English (B2)

We offer

• Competitive compensation depending on experience and skills
• Work on enterprise-level projects on a long-term basis
• Full-time remote work
• Unlimited access to learning resources (EPAM training courses, English classes, Internal Library)
• Community of 38,000+ industry's top professionals