Software Engineer, Managed Service for Apache Spark

Job description

Design and implement features that make Dataproc easier to use and and the most efficient way to run Spark workloads. Architect, implement, and operate the core Dataproc Control Plane, focusing on high-availability, fault-tolerance, and state management for global-scale resource provisioning and cluster orchestration. Build high-impact customer-facing features which make Dataproc the best place to run Hadoop, Spark, Flink, AI/ML and newer technologies in the cloud. Minimum Qualifications: Bachelor’s degree or equivalent practical experience. 2 years of experience with software development, or 1 year of experience with an advanced degree in an industry setting. Preferred Qualifications: Master's degree or PhD in Computer Science, or related technical fields. 2 years of experience with data structures and algorithms. Experience with Apache Spark, Apache YARN, Hadoop Distributed File System, and Compute Engine.