It's quite normal. Babies do like this because they are exploring everything through mouth, try to avoid gently don't force. After few weeks they will stop. It's not like they are hungry that's why they keep hand in mouth. Please don't apply anything to hand. Wipe hand with clean cloth

Apply coconut oil in thumb.