As said, depends. I only have a rubber case for my iPhone 6. But I carry it in my pants pocked with nothing else, so no scratches.
That leaves damage to iPhone glass if I drop it, glass-side down, on something hard and sharp enough to break it. Then there's having the phone out on the floor or...