— To sand away pocks, you'll likely need 40- to 60-grit sandpaper. You may need a few different types of sandpaper to achieve the result you want—some to take off layers of concrete and others to give a fine finish. ... also called floor concrete grinders or walk-behind sanders, are large and powerful machines that use diamond abrasive discs ...