Staff Software Engineer - Database Engine Internals

What this role involves

This role involves designing and implementing next-generation database engine internals for the Databricks Lakehouse platform. The work spans query compilation, distributed execution, vectorized execution, storage structures, and resource management. Candidates should have deep experience in database systems, distributed systems, or performance optimization.

Skills this posting asks for

• query compilation
• query optimization
• distributed query execution
• vectorized execution
• data security
• resource management
• transaction coordination
• storage structures
• encodings
• indexes
• automatic physical data optimization
• database systems
• storage systems
• distributed systems
• language design
• performance optimization
• apache spark
• data warehousing
• etl
• data science

Requirements

• Level: staff

From the employer’s posting

P-188 Our mission at Databricks is to radically simplify the whole data lifecycle from ingestion to ETL, BI, and all the way up to ML/AI with a unified platform. To achieve this goal, we believe the data warehouse architecture as we know it today will be replaced by a new architectural pa…