Yeah its possible... using windows media connect software, or the zune software. You can stream music pictures, and windows media videos... if your videos arent in that format, you can download a free program to convert them.
edit:
a program called tversity
http://www.tversity.com/ will encode the files into windows media on the fly, so no need to manually convert all those files!
