If you have an micro SD card installed and your photos are stored in there, you can turn off your phone and remove the battery and SD card and place it into a card reader or adaptor and plug it into the USB port of the computer. The SD card will function like any typical USB thumb drive and you don't have to worry about plugging and unplugging your phone.
Note that you can always eject the SD card correctly with the phone on. Just go to Settings --> Storage and eject the SD card. If that did not make sense to you, then turn the phone off before you pull out the SD card. Do not pull the micro SD card without properly ejecting it or else it can damage your phone.
