Right-click the lantern to place it if it is not already placed
Break the lantern with any tool or your hand to remove it
If the lantern is hanging, break the block it is attached to
If the lantern is sitting on a block, break the block beneath it
Use a Silk Touch tool to pick it up without destroying it
Place a redstone-powered light source instead if you want an on/off option