Senior Software Engineer - SRE

<p>When the Tarr Steps, a footbridge assembled of heavy stones in Exmoor National Park in England, washed away in a flood in 1942, the Royal Engineers rebuilt it. Then it washed away again in 1952. So the Royal Engineers heaved in more stones: on and on, like a Sisyphean lesson in absurdity.</p> <p>Of course, they do this because the Tarr Steps are a historical monument, believed to be built during the Bronze Age. Modern bridge building looks a lot different and generally requires less upkeep. While we appreciate the charm of ancient things, Mercury is engineering the future of banking*. "Quaint" and "archaic" are not values we seek in our systems. Rebooting a tumbling server and hoping a flood of requests doesn't wash it away can be an emergency tactic, but we actively seek out durable solutions over monotonous ops work. You'll bring this ethos and teach others how to live it too.</p> <p>Up to this point, the Stability team at Mercury has primarily built platform-level constructs that product teams adopt. However, those teams are asking for us to work more closely with them to mature their implementations and practices. We are creating an SRE team that will rotate through product teams. You will understand the team's domain, identify opportunities for improvements in reliability/observability/performance/preparedness and create self-reinforcing, virtuous cycles.</p> <h3>As part of this role, you will:</h3> <ul> <li>Embed with product teams, helping them improve their operational maturity by setting up and refining practices around on-call, monitoring, alerting, and run books</li> <li>Run regular game day exercises with product teams, helping them feel more prepared to investigate and quickly remediate incidents</li> <li>Jump into application code written in Haskell &amp; TypeScript and implement reliability techniques such as retries, better error handling, better logging, circuit breaking, etc</li> <li>Steer SLOs towards meaningful customer outcomes that product teams are accountable for. Those SLOs become a strong signal for whether the product is working as intended</li> <li>Champion reliability practices through design document and code reviews</li> <li>Identify observability gaps that hinder debugging, incident response, and business intelligence and help close those</li> <li>Advocate for longer-term improvements that non-product engineering teams can drive</li> <li>Participate in the product team's on-call rotation while embedding or as part of a more general engineering rotation, helping us improve processes and how we learn from incidents</li> </ul> <h3>The ideal candidate for the role:</h3> <ul> <li>Has past Site Reliability Engineering or DevOps experience</li> <li>Has measurable examples of influencing an o