You can turn off the VoiceOver feature on your Apple TV generation 3 or later using Siri or Settings.
You can turn off Siri to prevent the virtual assistant from listening to your commands by disabling it in the Settings app.