Hmmm...took the "clean" razor blade way huh??? Shoulda used a die grinder with a scotch brite, then everything would be nice and smooth.
This is a big NO NO! The case is aluminum and if you use a die grinder and scotch brite you take the chance of removing some aluminum and making the sealing surface uneven. I've personally seen this on a block that a dealer used the die grinder/scotchbrite method and ended up have to have the case welded and resurfaced. Razor blade is the only way to go. The reason your having such a hard time removing the material is someone must have used a "gasket sealant". I only use a trace amount of petroleum jelly (vasaline), just enough to darken the color of the gasket. An old mechanic taught me this trick and has work perfectly on every rebuild I've done ( 15 or 16 over the years). The gasket is designed to make the seal and if parts are flat and true that is all you should need. Good luck, Just my 2 cents worth.