MasterNewMedia by Robin Good
Be Smart, Be Independent, Be Good
Print this article Print this article   |   Read this article in: | ES | IT |

March 9, 2006



How To Create A RSS Feed From Any Web Page


Sooner or later, and maybe without even knowing the technical terms required to communicate this to someone else, you will want to subscribe and monitor web sites, information pages, or online catalog sections on an ongoing basis.

RSS_icon.gif

You have heard about RSS, webfeeds, Atom and other apparently not too clear tech terms describing something that did sound like what you are really in need of now, but even with all of your best will you wouldn't how or where to start given that those pages you have identified do not sport any orange colored button or icon hinting to a proper RSS feed.

Can do you generate an RSS feed for a web page that doesn't have one?

Can anyone do this on her own?

The answer to both is a resounding YES!

Today, thanks to new "html scraping" services available to everyone, RSS feeds can be automatically generated for just about any web site, no matter what kind of layout, coding or language it is written in. In some situations, to create a standard RSS feed from any web page that does not have one may take less than a minute, while in other cases, where your needs for customization are higher, you may need to spend a little more time.

Morale of the story: any web page today can be made to generate a RSS feed automatically. By the owner or, as it will increasingly happen, by someone else who wants to be informed in near-real-time of any news and content updates made on it.

Here the details:



RSS_yahoo_my_rssaddress_350.gif

HTML scraping or the ability to automatically generate a standard RSS feed from a HTML document (a web page) that does not have one has been a new type service under increasing demand for over 2 years now.

Early services (e.g.: MyRSS) that offered HTML scraping later disappeared or were replaced by other more profitable ones. Creating an automatic RSS feed from a non-RSS enabled web page enables a number of truly useful potential applications and I am sure that such services will enjoy soon greater marketplace rewards.



FeedYes
feed_yes.gif
FeedYes is the latest entry in this small group of online services which allow anyone to create/ generate automatically a RSS feed for any web page. FeedYes, has really found a simple and truly effective route to simplify this task while providing good enough a solution to satisfy most needs.

While it is not perfect, it is damn good and fast at doing what it does. It is alos rather simple to use, and once you have gone through it once, creating a second feed for another site, may take literally only a few seconds.

FeedYes is a three-step process that involves a) providing the URL of the page out of which an automatic RSS feed needs to be created, b) indicating among the dynamic links found by FeedYes on the specifiied URL, which one is the first that refers to the content section that you are interested in (all web pages have different content sections in the same page, and you probably do not want to create a feed for the comments section or for the most recent articles appearing on the same site), c) indicating in the updated list of links FeedYes will spit out the last relevant link pertaining to your selected content section.

In this way, FeedYes isolates with good precision (you are the one effectively guiding) the specific content section you are interested in (say the Latest News) and creates an RSS feed for it.



Feed43
feed43_logo.gif
Feed43 is an online service that converts standard web pages or XML documents to RSS feeds. Feed43 does so by extracting snippets of text or HTML by applying specific search patterns to the document from which the feed needs to be extracted. The search patterns help Feed43 understand exactly which content to grab from a page and which not.

This allows for a much more precise control of what will be contained in a feed at the expense of the ease of use and accessibility of the overall product itself. For technically savvy users this is in fact an excellent and very reliable approach to RSS feed generation but for non-technical users Feed43 may scare off lots of users in a matter of minutes.

In Feed43 the set of steps required to create a custom RSS feed for a web page that has none are as follows:
a) Identify the web page from which to generate a RSS feed.
b) Create a RSS feed on Feed43 pointing to that web page.
c) Define search patterns required.
d) Specify output templates required.
e) Generate the new RSS feed.

All feeds created with Feed43 are "public", but optionally Feed43 also allows you to protect any newly created RSS feed with a password. The service is free.



FeedFire
feedfire_logo_170.gif
FeedFire is the oldest of these HTML-to-RSS services allowing anyone to automatically create a RSS news feed for any Web site that does not have one.

You simply register at FeedFire, input the URL of the page and FeedFire dos the rest for you in the fraction of a second. All that's needed is a FULL URL to the page you would like to have made into RSS. All bandwidth costs to host the new RSS feeds are absorbed by FeedFire.

FeedFire also allows to sponsor newly created RSS feeds. this can be done by anyone like me and you, who are not major corporations but people who are looking for a clever, considered and comprehensively featured service that allows them to add extra reach, exposure, visibility and unique content to others and/or to THEIR own web site.

RSS feeds created and sponsored with FeedFire can also be made private, and used for creating intelligence reports or RSS learning objects or RSS newsmastering channels containing information otherwise inaccessible to others.

Sponsored feeds can be further filtered by allowing the sponsor to select only news items that "include" or do not have specific keywords. It is also possible to customize the number of news items displayed in the sponsored feed, the number of words per news item and even the title and the description of the newly created RSS feed. The varying levels of sponsorship have increasingly higher levels of features and customisation.

Find out more.

Conversation Tags: , , ,
Readers' Comments    
Click here to post a comment!
2007-10-17 01:21:15

rss feeds

Great article - appreciate you spreading the knowledge!

Another service worth checking out is Runstream.

It's not an scraping service like some of the others listed, this offers an easy editor and a full analytics package for tracking feed usage.



2007-10-01 18:28:07

RRSSSSSgen

You can always try to rely on an external service, but i've found the best thing to be a server side PHP script that creates the RSS feed on your OWN server! check out http://www.xmlhub.com/rssgenr8.php they have good instructs etc.. been using this for over 4 yrs. and still working like a charm



2007-06-20 12:58:37

tenfourzero

www.IrisFeed.com creates an RSS AND Atom feeds for any website!

It's so much easier to use than the other services AND it's free AND you don't need to register AND there's no banners ... did I mention its awsome?!



2007-06-11 04:51:26

hoodooville

Robin, thanks again for all of the goodies you publish!.
Be Smart! Be Independent! Be Good! Thanks for walking your talk.
P.S. Anyone know if one feed is better for photos than the other?



2007-02-10 04:31:42

Drew2020

Feedity (www.feedity.com) works like a charm for me in just two clicks!



2006-05-08 18:15:05

Ryan North

You might also want to check out RSSPECT.com, which generates RSS feeds for any document (HTML, but also PDF or MP3 or anything else) online. It simply checks to see if the document has been updated, and if so, updates the feed. The feeds themselves are less detailed (you have to visit the site you've targeted to see what's changed) but the setup process is easy and it doesn't rely on text parsing, which can be brittle.

(Disclaimer: I wrote the site!)



2006-03-13 17:03:21

webcam

Hi Robin,

i have trouble to mix xml with php.
where i can find info about this?



2006-03-13 13:38:23

Peter Bates

Hi Robin,

Just getting to grips with creating RSS feeds. But there is still one thing I don't fully understand. When using something like "Yesfeed", I create the feed and add the RSS script to my page with the RSS button. Is that all I have to do? Will the RSS feed get automatically updated every time I add new content that that page?

Peter



2006-03-11 18:39:55

Carmen Holotescu

Hi,

A very good presentation.

You can use also MySyndicaat - http://www.mysyndicaat.com to create RSS feeds.

My best,
Carmen



2006-03-10 08:25:12

John Tropea

Wow Robin, I just did a watered down version of this exact post:
http://libraryclips.blogsome.com/2006/03/10/feedyes-to-scraping/





Print this article Print this article   |   Read this article in: | ES | IT |
Related Articles



March 2, 2006
Web Traffic Generation And Monetization Opportunities For Small Online Independent Publishers


Robin Good: Best Practices And Tactics For Increasing Web Traffic, Online Exposure and Visibility while being ethical, effective, and useful to the network at large. I am an online micro-publisher managing over 10 small and independent news sites and online resources for a total of more than... read more



February 24, 2006
User Experience Monetization Replaces Content Business Toll Gates
Good content is like water, or a great view: you build business around it, not on it. More and more, online content and media publishers are understanding that giving extra reach, a rich end user experience, mindshare and freedom of access to good, quality content creates much... read more



October 23, 2004
Automatic Site-To-RSS Feed Creation: FeedFire
FeedFire is a breakthrough new service that allows anyone to create automatically a RSS news feed for any Web site that does not have one. You simply register at FeedFire, input the URL of the page and FeedFire dos the rest for you in the fraction of... read more



September 15, 2004
RSS Wave: Good Ideas For Business And Marketing Applications


Rok Hrastnik has recently engaged me in a short tour de force around some major questions on the future of email, RSS, and RSS possible uses for business and marketing goals. He is the man behind MarketingStudies, an online resource dedicated to explore many of the... read more



February 19, 2004
The Birth Of The NewsMaster: The Network Starts To Organize Itself


NewsMasters: RSS And The Opportunity For Sustainable Filtering And Aggregation Of Online Content Into Niche Websites And Dedicated Information Channels An independent publisher opportunity and a socially valuable way of filtering and organizing news information and the Web at large. Photo credit: Emsago from Stock Exchange Introduction Yesterday, at the... read more



December 31, 2002
How To Syndicate Web Site News Through RSS Feeds Technology
*Introduction to RSS newsfeeds* One new technology that has been rapidly catching up in the alleys of Internet independent researches, publishers and reporters of all kinds, is the highly interesting and potentially revolutionary RSS newsfeed. Nowadays, to "RSSify" a Web site, means to create an RSS feed so... read more



posted by Robin Good on Thursday, March 9 2006, updated on Friday, March 24 2006


Search this site for more with Google

 

 

 

 

Understanding comes from exploration

Home | Subscribe | RSS Feeds | Site map | Syndicate
Consulting | Publications
About | Privacy | Contact

 

Creative Commons License
This work is licensed under a Creative Commons License.





View blog authority

 

5221