Yahoo! Pipes for information filtering

If you’re not intimidated by this screenshot, please read on.

example pipe

Yahoo! Pipes allows you to visually design a transformation on web resources. You define input sources for pretty much anything that is available on the web. And transform that data into any form you want. You can filter data you don’t need, merge different sources and many more.

What I wanted, was a number of album review sites as input (Resident Advisor for starters) and add some sources of samples for those albums. This is what I came up with right now. Yahoo doesn’t show you the links in the preview, so you might want to take a look at the RSS version.

Take a look at the source to see how visual and easy this process is. The RSS is loaded and truncated at 5 items. For each entry, the entire article is downloaded and the cover image is extracted. The album is then searched on the Amazon site and a link is added to the image.

Currently, not every album is found on Amazon, although it is usually available, so I have some work there. I would also like to add a better sample source, as Amazon doesn’t have samples for most of this new stuff. I’m thinking Beatport, but there were some ready-made components available for Amazon.

So, keep your eye on the feed, it will get better in the near future.