A little vegetable oil or olive oil on a cloth or kitchen paper will remove most petroleum based residues from oiled wood surfaces, works well on crayon and biro too. WD40 or white spirit will work also but they smell and would probably strip a little of the oiled finish.