How do you decide whether a machine learning solution is the right choice for a problem, instead of using a simpler rule-based or statistical approach?

This is based on the general industry context and the balanced interview mix, which should test whether the candidate can choose an appropriate approach for a real problem.