Wordpress feeds in external site

Hi there.
In a nutshell I want to provide the latest info from a wordpress blog in a side bar on a separate site.

Iv been trawling the net and have had no love.
is there a quick way to activate a feed. and access it. or do you need a feed burner or some extra thing like that.

could some one point me to the correct files and functions in my wordpress.

thanks in advance.:cowboy: