Yes, when you export, the dialog will have a check box giving you the option to export the photos as well.
If you check this dialog, you will see a list of folders included with your data:
These folder's names are based off of the unique id of the data that you exported. In each folder you will find that record's attached photos.
Going to that folder will show you the attached photos.