The short answer is no. You can't point a Media Web Part to a picture library or a directory/folder with images and have it produce a slide show.
You can change the image that people see when the video isn't playing. This is done from the "Change Image" drop down on the Media | Options ribbon menu, which is visible when you click on a media control.
