Turn off the power and remove the fuse from the circuit
Set the multimeter to continuity mode or the lowest resistance setting
Touch one probe to each end of the fuse
Read the multimeter display
A beep or near-zero resistance means the fuse is good
No beep or infinite resistance means the fuse is blown
Replace the fuse if it is blown
Reinstall the fuse only after confirming the circuit is safe