MythTV.nl
4 December 2020, 06:06:11 *
Welcome, Guest. Please login or register.

Login with username, password and session length
News: Klik hier voor een overzicht van de meest recente fourm postings.
Help mee te uit te groeien tot een noemenswaardige Nederlandse MythTV community en anderen ver te helpen met MythTV!

:
 
   Home   Help Search Login Register  
Pages: [1] 2
  Print  
Author Topic: Java grabber for tvgids.nl  (Read 14999 times)
FedorComander
Newbie
*
Posts: 11


« on: 26 October 2008, 13:11:25 »

Hello allemaal!

Ik heb een java grabber gemaakt die werkt op all besturingsystemen. De sources en eerste versie is op google code  http://code.google.com/p/jxmltvnl/

Suc6.

Logged
FedorComander
Newbie
*
Posts: 11


« Reply #1 on: 27 October 2008, 09:01:09 »

Version 1.0.1 released. It can be downloaded from http://www.anuta.org/grabber/
Logged
moosylog
Full Member
***
Posts: 60


Instant Messaging: moosylog@gmail.com


WWW
« Reply #2 on: 30 October 2008, 09:35:50 »

Heel goed - kun je het grabber overzicht bijwerken en http://wiki.mythtv.nl/index.php/Grabbers
Logged
FedorComander
Newbie
*
Posts: 11


« Reply #3 on: 1 November 2008, 09:07:23 »

Added.
Logged
FedorComander
Newbie
*
Posts: 11


« Reply #4 on: 21 November 2008, 11:19:21 »

New version 1.1 is available now. It is VERY fast now Wink))

http://www.anuta.org/grabber/

README
---------
Hi there!

This is another www.tvgids.nl grabber written in java. Due to java nature it is completely
platform independant, so it can run on any platform wich has java on it. JDK 1.5 or higher
is required. You can download java for your operating system from http://java.sun.com/javase/downloads/index.jsp

This grabber is NOT compatible with xmltv grabbers, but able to produce xmltv compatible
xml file with epg. It can be used later in any xmltv compatible software.

The features of this grabber:
- Platform independant
- Fully customisable. Based on spring framework/xmlbeans/hibernate/apache-commons
  Allows you fine tune your installation, categories, basically all!
- Multithreaded
- HTML parsing based on xml tags, not on regular expressions. Minor layout changes will not affect it.
- HTTP proxy support
- Export to file or console
- Kijkwijzer support
- IMDB star rating support
- Automatic IMDB file download (if it is changed)
- Database (MYSQL) support for IMDB star rating
- Extended customisable logging using commons-logging/log4j
- Full html entities support
- Full unicode support
- Automatic timezone support
- etc etc etc

Release notes:

1.1
- Added multithread support
- Added IMDB database support
- Added IMDB star rating lookup

1.0.1 Initial release.

For comments/feature requests please mail to fedor@anuta.org or port your messages to the
forum http://www.mythtv.nl/forum/index.php?topic=126.0

Have a good grabbing!
Fedor


INSTALL
---------
Installation instructions:

- Unzip downloaded archive in some directory
- Rename conf/configuration.properties.example to /conf/configuration.properties
- Customize conf/configuration.properties to your needs
- Fine tune (if needed) conf/tvgids.xml and conf/imdb.xml
- Fine tune start.sh script
- Create database on mysql server using imdb/imdb.sql script if needed
- Run it!
- Enjoy it!
 
Logged
FedorComander
Newbie
*
Posts: 11


« Reply #5 on: 21 November 2008, 11:29:50 »

Example xml:

<programme channel="34" start="20081119183500 +0100" stop="20081119190000 +0100">
  <title lang="nl">According to Jim</title>
    <desc lang="nl">
      Jim werkt als voorman in de bouw samen met zijn beste vriend en zwager Andy. Jim is een typisch Amerikaanse machoman die een groot hart heeft voor zijn vrouw Cheryl en zijn drie kinderen
    </desc>
    <credits>
      <actor>James Belushi</actor>
      <actor>Courtney Thorne-Smith</actor>
      <actor>Kimberly Williams</actor>
    </credits>
    <category lang="nl">Comedy</category>
    <rating system="KW">
      <value>6+</value>
      <icon src="6.png"/>
    </rating>
    <rating system="KW">
      <value>Geweld</value>
      <icon src="geweld.png"/>
    </rating>
    <star-rating>
      <value>7/10</value>
    </star-rating>
</programme>
Logged
FedorComander
Newbie
*
Posts: 11


« Reply #6 on: 24 November 2008, 15:11:02 »

I see many of downloads of version 1.1, can you please post some feedback about the grabber?
Logged
FedorComander
Newbie
*
Posts: 11


« Reply #7 on: 23 April 2009, 12:18:21 »

New version 1.2.1 available.
Logged
gerard
Newbie
*
Posts: 9


« Reply #8 on: 21 July 2009, 19:37:16 »

Hallo FedorComander
vlgns mij zit er een kleine typo in de start.sh

$JAVA_HOME/bin/java -Xmx256M -jar lib/JavaXmlTvCore-1.2.2.jar  ipv 1.2.1
en bij mij staat java ergens anders
#export JAVA_HOME=/usr/java/jdk1.6.0_10/
export JAVA_HOME=/usr


Ik heb de grabber geprobeerd maar loop tegen problemen aan, mogelijk veroorzaakt door mijn installatie/onkunde met het begrip grabber


Ik krijg:
Exception in thread "main" org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'imdbAccess' defined in class path resource [imdb.xml]: Invocation of init method failed; nested exception is org.springframework.jdbc.UncategorizedSQLException: Hibernate operation: Cannot open connection; uncategorized SQLException for SQL [???]; SQL state [null]; error code [0]; Cannot create PoolableConnectionFactory (Access denied for user 'imdb'@'localhost' (using password: YES)); nested exception is org.apache.commons.dbcp.SQLNestedException: Cannot create PoolableConnectionFactory (Access denied for user 'imdb'@'localhost' (using password: YES))
   at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1336)
   
Wat zou hier aan de hand kunnen zijn?
Moet ik een user imdb in mysql hebben?

alvast bedankt
Logged
FedorComander
Newbie
*
Posts: 11


« Reply #9 on: 3 January 2010, 20:40:39 »

It seems grabber cannot connect to the imdb mysql database due to permission problem. Please set correct permission on the database.
Logged
FedorComander
Newbie
*
Posts: 11


« Reply #10 on: 6 January 2010, 11:50:32 »

Version 1.2.5 (bugfix/cache cleanup) has been released.
Logged
Sjakko
Guest
« Reply #11 on: 6 January 2010, 12:14:16 »

Have had good experiences with this grabber. Reliable, configurable and good and fast feedback from the author when it comes to bugfixes, adjustments when tvgids.nl decides to change their underlying code and help from the author in general. I use it on Windows myself.

Sjakko
Logged
wasperen
Newbie
*
Posts: 2


« Reply #12 on: 17 January 2010, 21:17:13 »

This one was easy to get going.

It does, however, have Null Pointer exceptions when I run it...

Exception in thread "pool-1-thread-4" java.lang.NullPointerException
        at org.anuta.xmltv.XMLTVGrabberTask.run(XMLTVGrabberTask.java:214)
        at edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1061)
        at edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:575)
        at java.lang.Thread.run(Thread.java:619)
Exception in thread "pool-1-thread-1" java.lang.NullPointerException
        at org.anuta.xmltv.XMLTVGrabberTask.run(XMLTVGrabberTask.java:214)
        at edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1061)
        at edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:575)
        at java.lang.Thread.run(Thread.java:619)
Exception in thread "pool-1-thread-6" java.lang.NullPointerException
        at org.anuta.xmltv.XMLTVGrabberTask.run(XMLTVGrabberTask.java:214)
        at edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1061)
        at edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:575)
        at java.lang.Thread.run(Thread.java:619)
Exception in thread "pool-1-thread-8" java.lang.NullPointerException
Exception in thread "pool-1-thread-5" java.lang.NullPointerException
Exception in thread "pool-1-thread-3" java.lang.NullPointerException
Exception in thread "pool-1-thread-10" java.lang.NullPointerException
Exception in thread "main" java.lang.NullPointerException
        at org.anuta.xmltv.beans.Channel.getXmltvChannelId(Channel.java:74)
        at org.anuta.xmltv.XMLTVGrabberThreadPool.grab(XMLTVGrabberThreadPool.java:143)
        at org.anuta.xmltv.XMLTVGrabber.grab(XMLTVGrabber.java:50)
        at org.anuta.xmltv.Starter.main(Starter.java:43)


Plus: anyone got a clue how to get the logo's into myth? I have added the appropriate properties to the beans:


<bean class="org.anuta.xmltv.beans.Channel">                                                         
     <property name="channelId" value="10" />                                                     
     <property name="channelName" value="ZDF" />                                                 
     <property name="grabber" ref="tvgids" />                                                     
     <property name="language" value="de" />                                                     
     <property name="channelLogo" value="http://xmltv.fambus.nl/logos/zdf.png" />                 
</bean>


but: no icons in the myth...

Regards,
Willem
Logged
ReinierL
Newbie
*
Posts: 2


« Reply #13 on: 30 May 2010, 15:21:42 »

Hallo FedorComander,

Mooie bijdrage, ziet er goed uit! Is de broncode van de laatste versie ergens beschikbaar? Ik zie dat de google code / SVN niet de laatste versie bevat.

Dank je!
Logged
FedorComander
Newbie
*
Posts: 11


« Reply #14 on: 29 December 2010, 20:09:31 »

The sources has been updated on google code. Please follow http://code.google.com/p/jxmltvnl/downloads/list for new versions from now on. The code will be mostly maintained by Jasper in nearest future.

Cheers and happy grabbing in the new year!
Logged
Pages: [1] 2
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.8 | SMF © 2006-2008, Simple Machines LLC Valid XHTML 1.0! Valid CSS!