Text this: Simulation-Based Algorithms for Markov Decision Processes