Center punch the rivet head
Drill into the center of the rivet head with a bit slightly smaller than the rivet shank
Stop drilling when the head separates
Pry off the rivet head with a flat tool if needed
Push the remaining shank through with a punch or nail set
Use a rivet removal tool if available
For blind rivets, drill out the mandrel and head
For stubborn rivets, grind the head off before punching it out
Wear safety glasses and secure the workpiece
Match the drill bit size to the rivet size as closely as possible