Just a regular school eraser works too. Don’t rub too hard. If you can get one of those artists soft erasers, they are the most gentle and best. They are called putty rubber or kneaded eraser.
I know this may sound a bit odd but if you don’t have any lemon oil around, try peanut butter. It’s working on the same principle, namely that oil will dissolve the scuff without damaging the finish,
It works wonders on getting gum out of a kids hair. Same principle.
I combined a few ideas and got the winning solution. A paste made with baking soda and water to remove the scuffs and then lemon oil to restore the shine. Thanks all!