Can I visit the Treasury Museum in casual attire?

Yes, informal clothing is permitted, provided it is appropriate for a place of worship. Shoulders and knees must always be covered.