{"id":24,"date":"2011-02-10T21:19:18","date_gmt":"2011-02-10T21:19:18","guid":{"rendered":"http:\/\/ulrichard.is-a-geek.net\/?p=24"},"modified":"2011-02-10T21:19:18","modified_gmt":"2011-02-10T21:19:18","slug":"convert-news-web-page-into-rss-feed","status":"publish","type":"post","link":"https:\/\/ulrichard.ch\/blog\/?p=24","title":{"rendered":"Convert news web page into rss feed"},"content":{"rendered":"

At the company I work (BORM<\/a>), we have an internal web page with the company news. We’re required to log in and check every once in a while.<\/p>\n

Now to get notified automatically, wehen some news are to be discovered, I hacked together a PHP script that logs in, downloads and parses the news. It then serves an rss xml file to my feed reader.<\/p>\n

In the past I didn’t do a lot of PHP scripting. Only editing some bits and pieces. So this is my biggest endeavor to PHP.<\/p>\n

Tested with liferea<\/a> and BeyondPod<\/a>.<\/p>\n

I won’t tell you where the script can be accessed, as the company news requires login. But the script itself is here:<\/p>\n

<\/p>\n

<?php
\nheader(‘Content-type: application\/xml’);<\/p>\n

echo “<rss version=”2.0″>n”;
\necho “t<channel>n”;
\necho “tt<title>BormIntern<\/title>n”;
\necho “tt<description>News aus dem BORM Point<\/description>n”;
\necho “tt<language>de<\/language>n”;
\necho “tt<link>http:\/\/secret.news.borm.ch<\/link>n”;
\necho “tt<lastBuildDate>Thu, 10. Feb 2011 00:00:00 GMT<\/lastBuildDate>n”;<\/p>\n

$ckfile = tempnam (“\/tmp”, “CURLCOOKIE”);<\/p>\n

$ch = curl_init();
\ncurl_setopt($ch, CURLOPT_URL, “http:\/\/secret.news.borm.ch\/login.php”);
\ncurl_setopt($ch, CURLOPT_COOKIEJAR, $ckfile);
\ncurl_setopt($ch, CURLOPT_USERAGENT, “php script to generate an rss feed for the BORM news”);
\ncurl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
\ncurl_setopt($ch, CURLOPT_FOLLOWLOCATION, false);
\n$output = curl_exec($ch);<\/p>\n

curl_setopt($ch, CURLOPT_POST, true);
\ncurl_setopt($ch, CURLOPT_POSTFIELDS, “Schritt=2&Seite=index.asp&sel_Adr=150&Passwort=mysecretpassword&submit=Login”);
\ncurl_setopt($ch, CURLOPT_COOKIEFILE, $ckfile);
\ncurl_setopt($ch, CURLOPT_REFERER, “http:\/\/secret.news.borm.ch\/Login.php?Seite=index.php”);
\ncurl_setopt($ch, CURLOPT_FOLLOWLOCATION, 1);
\n$output = curl_exec($ch);<\/p>\n

curl_close($ch);<\/p>\n

$dom = new domDocument;
\nif(!$dom->loadHTML($output))
\necho “failed to parse the html”;
\n$dom->preserveWhiteSpace=false;
\n$tables = $dom->getElementsByTagName(‘table’);
\n$tableid = $tables->length – 2;
\n$rows = $tables->item($tableid)->getElementsByTagName(‘tr’);<\/p>\n

$firstitem = true;
\nforeach($rows as $row)
\n{
\n$cols = $row->getElementsByTagName(‘td’);<\/p>\n

if($cols->length > 0 && strlen($cols->item(0)->nodeValue) > 0)
\n{
\n$msgtext = $cols->item(0)->nodeValue;<\/p>\n

if($cols->item(0)->getElementsByTagName(‘strong’)->length > 0)
\n{
\nif(!$firstitem)
\n{
\necho “ttt<\/description>n”;
\necho “tt<\/item>n”;
\n}
\n$firstitem = false;<\/p>\n

echo “tt<item>n”;
\necho “ttt<title>”;
\necho $msgtext;
\necho “<\/title>n”;
\necho “ttt<link>http:\/\/secret.news.borm.ch<\/link>n”;
\necho “ttt<pubDate>Wed, 9. Feb 2011 00:00:00 GMT<\/pubDate>n”;
\necho “ttt<guid>”;
\necho md5($msgtext);
\necho “<\/guid>n”;
\necho “ttt<description>”;
\n}
\nelse if($cols->length > 1 && $cols->item(1)->getElementsByTagName(‘a’)->length)
\n{
\n$link = $cols->item(1)->getElementsByTagName(‘a’)->item(0);
\necho “<a href=”http:\/\/secret.news.borm.ch\/” . $link->getAttribute(“href”) . “”>” . $link->childNodes->item(0)->nodeValue . “<\/a><br \/>n”;
\n}
\nelse
\n{
\necho $msgtext;
\necho “<br \/>n”;
\n}
\n}
\n}
\nif(!$firstitem)
\n{
\necho “ttt<\/description>n”;
\necho “tt<\/item>n”;
\n}<\/p>\n

echo “t<\/channel>n”;
\necho “<\/rss>n”;<\/p>\n

?><\/p>\n","protected":false},"excerpt":{"rendered":"

At the company I work (BORM), we have an internal web page with the company news. We’re required to log in and check every once in a while. Now to get notified automatically, wehen some news are to be discovered, I hacked together a PHP script that logs in, downloads and parses the news. It […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7,1],"tags":[172],"class_list":["post-24","post","type-post","status-publish","format-standard","hentry","category-software","category-uncategorized","tag-php"],"_links":{"self":[{"href":"https:\/\/ulrichard.ch\/blog\/index.php?rest_route=\/wp\/v2\/posts\/24","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ulrichard.ch\/blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ulrichard.ch\/blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ulrichard.ch\/blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ulrichard.ch\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=24"}],"version-history":[{"count":0,"href":"https:\/\/ulrichard.ch\/blog\/index.php?rest_route=\/wp\/v2\/posts\/24\/revisions"}],"wp:attachment":[{"href":"https:\/\/ulrichard.ch\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=24"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ulrichard.ch\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=24"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ulrichard.ch\/blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=24"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}