Augmented and virtual reality for use with neuromodulation therapy

A virtual or augmented reality system is disclosed which is capable of both (i) evaluating prospective implantable neurostimulator patient candidates, and (ii) determining optimal stimulation settings for already-implanted neurostimulation patients. Physiological sensors are included with the system to provide objective measurements relevant to a patient's symptoms, such as pain in a Spinal Cord Stimulation (SCS) system. Such objective measurements are determined during the presentation of various virtual or augmented environments, and can be useful to determining which patients are suitable candidates to consider for implantation. Stimulation settings for already-implanted patients may be adjusted while presenting a virtual or augmented environment to the patient, with objective measurements being determined for each stimulation setting. Such objective measurements can then be used to determine optimal stimulation settings for the patient.