If the location of the chest in unknown, I think you'd actually have to stumble upon it to loot it. It could be in an inn room, mine or castle. Odds are, there is much more effort into breaking into these things to find it than the payoff would be, at least in my opinion.
