The silver key opens the chest in secret room #22. In #22 there is a chest, and one of the items is the golden key, which opens this chest.
for room #22
Explore thoroughly the small chamber on the right hand side of the floor where you enter the fortress. It's called Chamber 1