I'd scuff up the brake shoe with some sandpaper, the contact area is probably glazed up .
Another problem in that area, is the shaft that moves the brake shoes, it's quite common to have the o-rings on that shaft to leak .
If you see any wetness in that area, replace the o-rings now, it's a 30 minute job .
May save you a set of brake linings later .