The Minecraft crafting guide shows how to craft an Arrow from 4 × Glowstone Dust and 1 × Arrow. It refers to Combat.