How do I get rubber carpet backing off my wood floor?

Part of the non-skid backing from an older area rug has adhered to my wood floor. It is quite a large area ( about 3X3 inches) and is rock hard and won't budge with a nylon scr. Any suggestions will be appreciated.