Two Player Non Zero-sum Stopping Games in Discrete Time

We prove that every two-player nonzero sum stopping game in discrete time admits an ?-equilibrium in randomized strategies for every ?>0. We use a stochastic variation of Ramsey's theorem, which enables us to reduce the problem to that of studying properties of ?-equilibria in a simple class of stochastic games with finite state space.