This was a problem that ended up being much more annoying than it should have been.
We have an RCA Universal Remote (RCR311B). For some reason, it will not properly configure itself for use with our kids' small Orion TV. To add fuel to the fire, we brilliantly lost the manuals. So, if you're in our situation and having trouble with the manuals link above, here are the Orion TV codes: