Press the Caps Lock key once
Press Shift + Caps Lock
Check if the keyboard has a Caps Lock indicator light
Restart the device if Caps Lock stays on
Check keyboard settings if the key is stuck
Clean or replace the keyboard if the key is physically stuck