Top 3 Spot instances Interview Questions

Browse 3 real-world technical and behavioral interview questions about Spot instances. Review scenarios, edge cases, and architectural best practices.

How would you cut the cost of a GPU training fleet without slowing the team down?

Measure utilisation first, because most fleets pay for idle accelerators rather than for too few. Then right-size to whatever each job is bound by, move interruptible work onto spot capacity behind tested checkpointing, and pool the fleet behind one queue instead of reserving per team.

harddesign

How would you architect an ephemeral, auto-scaling GitHub Actions runner infrastructure using spot instances to drastically reduce costs without compromising pipeline reliability or introducing unacceptable queuing delays?

An analysis of the challenges in designing a cost-effective, scalable GitHub Actions runner environment using spot instances, focusing on state management, instance termination handling, and performance tuning.

hardscenario

A training job dies eight hours in with nothing to show for it. What should have been in place?

Periodic checkpoints of model weights, optimiser state and data-loader position written atomically to durable storage; a resume path that is exercised rather than assumed; and interruption handling that checkpoints on the preemption signal. Each is justified by the expected cost of lost compute, not by principle.

mediumscenario