Your career compass awaits
Create a free account to unlock
- ✓ See how you match this role
- ✓ AI resume tailored to this specific job
- ✓ Inside Track Companion — find your insider contact
- ✓ Skills gap analysis and upskill plan
- ✓ Interview prep kit for this role
- ✓ Relocation concierge — salary, tax, cost of living
Free — no credit card required
Staff Software Engineer, Lakeflow Pipelines DR
✓ This company has sponsored visas before. The posting doesn't say so, but it's still worth applying.
ICT
💰 Salary Not shared
📊 Market ₹18,000–₹30,000/mo (₹216,000–₹360,000/yr)
About the Company
Our mission at Databricks is to radically simplify the data lifecycle with a unified Lakehouse platform for data engineering, analytics, and AI. The Lakehouse addresses major challenges in enterprise data platforms, including reliability, data staleness, operational complexity, total cost of ownership, and data lock-in. Lakeflow is a critical part of this vision, helping customers build and operate streaming and batch ETL pipelines that power business-critical data products.
About the Role
As a Staff Engineer on the Lakeflow Disaster Recovery team, you will design and implement distributed systems that replicate and recover pipelines across regions. A pipeline includes streaming checkpoints, source offsets, stateful operator state, table versions, transaction metadata, schedules, and dependencies across a dataflow graph. You will solve challenging problems involving consistency, idempotency, causal ordering, failover, failback, and safe recovery without silent data loss or duplication. This role offers the opportunity to build the foundations of resilient Lakehouse computing and help customers keep their data pipelines running when failure matters most.
Responsibilities
- ● Design and implement distributed systems that replicate and recover pipelines across regions
- ● Solve challenging problems involving consistency, idempotency, causal ordering, failover, failback, and safe recovery without silent data loss or duplication
- ● Work on cross-region replication and recovery for Lakeflow pipelines, streaming tables, and materialized views
- ● Work on distributed consistency across pipeline dependencies, table versions, and transaction logs
- ● Work on failover and failback workflows with conservative correctness guardrails
- ● Work on deep clone, metadata reconciliation, observability, and failure-injection testing
- ● Work on high-fidelity recovery simulations, game-day testing, and formal reasoning about failure modes
Requirements
- ● A passion for distributed systems, databases, storage systems, streaming systems, or reliability engineering
- ● Strong software engineering skills in Java, Scala, C++, Go, Python, or a similar production language
- ● Understanding of consistency, transactions, idempotency, replication, checkpointing, and data lineage
- ● Ability to define and work toward a multi-year technical vision with incremental, production-quality deliverables
- ● 8+ years of experience working on related systems preferred
- ● Optional: PhD or advanced research experience in databases, distributed systems, or storage
Confirm Application
Are you applying to ?
We'll track this in your dashboard as Applied.
Saving to your tracker…
Stand out: message someone at Databricks.
A short, personal note to a recruiter can get your application looked at sooner.
⚡ Full Resume Sandbox Canvas