Increased demand to learn English for business and education has led to growing interest in automatic spoken language assessment and teaching systems. With this shift to automated approaches, it is important that systems reliably assess all aspects of a candidate’s responses, one of which is whether the response from the candidate is relevant to the prompt provided. This paper will give audience an understanding of how off-topic detection can be done fairly accurately with seen and unseen prompts.