Jump to content

EPG Collector- open source EIT, MHEG and OpenTV (Sky) grabber

dvbrewer

By dvbrewer
in General DVBViewer Pro/GE

Recommended Posts

dvbrewer Newbie

dvbrewer

Posted
Posted (edited)

Haven't seen this mentioned anywhere on DVBViewer yet, a tool has been created by nzsjb & ukkiwi73 on sourceforge that allows grabbing of EPG in EIT, MHEG and OpenTV (Sky) formats to an xml file. I have been attempting to import the XML to DVBViewer using XEPG so far without success, but people have been successfully using it with DVBlogic's TVsource for Windows Media Center. Does the fact it is open source indicate a possibility that EIT and Open TV EPG grabbing could be integrated into DVBViewer :bye: ?

Edited by dvbrewer
  • Like 3
Link to comment
dvbrewer Newbie

dvbrewer

Posted
  • Author
Posted

What problems are you having?

 

I've been using EPG collector/XEPG successfully with a Recording Service task to get UK Freesat/FTA channels EPG

It won't import into DVBViewer for some reason, can you give me any tips on setting it up with recording service & I will try that :bye:.

 

BTW :rolleyes: , DVBViewer programmers, is there any chance OpenEPG grabbing could be integrated like the Freesat EPG grabbing?

Link to comment
essen Newbie

essen

Posted
Posted

Can you test import the data into DVBViewer? I had a problem importing the data because I didn't set EPGCollector working path in the XMLTV Job editor

 

epgcollectorsetup.th.png

 

To get EPG Collector/XEPG working with the Recording service (I guess you have Epg collector/Xpeg all setup and configured)

 

Open recording service configuration

 

Go to tasks

 

create a new task

 

Fill in Task Name, Description, Xepg.exe path details

 

add "-xGrabThenImport" to Parameters

 

tasks.th.png

 

Open Recording service webinterface

 

Click on Timer

processtimer.th.png

 

create a new process task timer

 

Set up the timer for when you want to collect the EPG

 

processtimeredit.th.png

 

Mine is setup to update at 12.55 and shutdown the PC at 1.05, My XMLTV is small "8MB" you might need to add more time for the Epg to update

 

It should now have update EPG freesat/FTA channels when the task is run(mine update in about 2mins)

 

Set DVBViewer in get EPG from recording service

 

timeline.th.png

 

dvbviewerepg1.th.png

Link to comment
dvbrewer Newbie

dvbrewer

Posted
  • Author
Posted (edited)

Can you test import the data into DVBViewer? I had a problem importing the data because I didn't set EPGCollector working path in the XMLTV Job editor

Hi, thanks very much for all your help with this! I filled in the EPGCollector path as suggested but still XEPG says it can't connect to DVBViewer if I do a test import- are you using the latest XEPG version (0.3.3.4 Beta) or an older version? I set a timer to start at 20:30 and end at 21:00 as you suggested, a TVGuide.xml of approx 42MB was created but it looks like XEPG does not import to Recording Service either as no non Freesat channels have been imported, or Freesat channel data :( .

 

 

Set DVBViewer in get EPG from recording service

Do you mean tick "Enable Suport for the DVBViewer Recording Service" in DVBViewer Options- I have this ticked and all other boxes except "Download channellist on startup"- is that right?

Edited by dvbrewer
Link to comment
essen Newbie

essen

Posted
Posted

Hi

 

I am using 0.3.3.4 beta

 

Do you mean tick "Enable Suport for the DVBViewer Recording Service" in DVBViewer Options- I have this ticked and all other boxes except "Download channellist on startup"- is that right?

Yes, all boxes are enabled in my recordingservice options as well

 

Are your recording service details set is the Xepg Options?

 

i.e.

'Use recording service if available' box (enabled)

Recording service Username/Pass IP No/Port

 

xepgoptions.th.png

 

the XMLTV data should going directly to the recording service not DVBViewer. I believe DVBViewer get the data from the rec. service as I have "Do Not Receive Epg Data" enable in DVBViewer Options. The only time Xepg asked for DVBViewer was when I was pairing up the channels.

Link to comment
dvbrewer Newbie

dvbrewer

Posted
  • Author
Posted (edited)

 

Are your recording service details set is the Xepg Options?

 

i.e.

'Use recording service if available' box (enabled)

Recording service Username/Pass IP No/Port

Should I be using the same ip and port as you have there- do I need to input that in recording service options as well?

 

the XMLTV data should going directly to the recording service not DVBViewer. I believe DVBViewer get the data from the rec. service as I have "Do Not Receive Epg Data" enable in DVBViewer Options. The only time Xepg asked for DVBViewer was when I was pairing up the channels.

I just did another test starting 17:50 scheduled to end at 18:15, the TVGuide.xml was again created successfully, XEPG ran for a while as a child process of the recording service, but in the recording service status it records as follows

 

EPG Records:4, Served Requests:95, Data sent:808kb, Uptime:33, Next EPG Update:18:19 - it does it every minute with a new request recorded and kbs of information transferred?

Edited by dvbrewer
Link to comment
essen Newbie

essen

Posted
Posted

Should I be using the same ip and port as you have there- do I need to input that in recording service options as well?

You should put the details your computer uses to access the Rec. service, it is displayed in DVBViewer' Recording Service Options

 

The Xepg process task seem to be working, Sorry I am not sure why it's not update the EPG in DVBViewer/Recording service :(

Link to comment
dvbrewer Newbie

dvbrewer

Posted
  • Author
Posted (edited)

You should put the details your computer uses to access the Rec. service, it is displayed in DVBViewer' Recording Service Options

 

The Xepg process task seem to be working, Sorry I am not sure why it's not update the EPG in DVBViewer/Recording service :(

Can I ask how large your TVGuide.xml that EPGCollector creates is? Do you get it to grab data for all channels or selected? My TVGuide.xml is 42MB, I am wondering whether XEPG is just crashing because of the size, as the older XMLTV importer tool works fine.

Edited by dvbrewer
Link to comment
essen Newbie

essen

Posted
Posted

7-8 Mb

 

I excluded all the stations which are not on my DVBViewer Channel list by using 'Station'

Parameter in EPG Collector.ini. From what I can remember my XMLTV was 50+ MB, I only cut it down 8MB to speed it up.

 

OK, I cleared my rec. service EPG and did a test import with a new .ini/ 53MB XMLTV, it took 11 minutes but imported OK

Link to comment
essen Newbie

essen

Posted
Posted

I think my EPG collector.ini was setup get all stations I.e. BBC/ITV regions stations, SKY etc

 

I got the info in the ini from that avforum link and I am not sure how it works

 

I had more problems getting 'EPG collector' to work than 'Xepg/DVBViewer' as I only had a Communal dish install/ DVB-S Card for 3 weeks!

Link to comment
dvbrewer Newbie

dvbrewer

Posted
  • Author
Posted (edited)

I think my EPG collector.ini was setup get all stations I.e. BBC/ITV regions stations, SKY etc

 

I got the info in the ini from that avforum link and I am not sure how it works

 

I had more problems getting 'EPG collector' to work than 'Xepg/DVBViewer' as I only had a Communal dish install/ DVB-S Card for 3 weeks!

Could you possibly upload a TVGuide.xml to mediafire that you have successfully imported so I can try and rule out out what may or may not be the issue (the 8MB one will be fine)?

Edited by dvbrewer
Link to comment
dvbrewer Newbie

dvbrewer

Posted
  • Author
Posted (edited)

Strange, Have you asked for help at the EPG collector' support page?

 

http://www.geekzone.co.nz/forums.asp?topicid=58935&forumid=126&page_no=1

 

I hope you narrow down the problem, Good luck :)

Thanks for your help, it's now resolved with a new XEPG Beta :) - it looks like it was either a memory issue using IE engine under Windows 7 or a small incompatibility with EasyXML, which is fixed in the Beta.

Edited by dvbrewer
Link to comment
Tjod Newbie

Tjod

Posted
Posted

What is the difference between the "EPG Collector" an the EPG collecting system in DVBViewer/Recording Service?

Only the MHEG5 support or are there other differences as well. MediaHighway and FreeSat EPG should work in DVBViewer/Recording Service as well.

Link to comment
dvbrewer Newbie

dvbrewer

Posted
  • Author
Posted (edited)

What is the difference between the "EPG Collector" an the EPG collecting system in DVBViewer/Recording Service?

Only the MHEG5 support or are there other differences as well. MediaHighway and FreeSat EPG should work in DVBViewer/Recording Service as well.

EPG Collector supports EIT and Open TV EPG systems as well, i.e. Sky in various parts of the world uses OpenTV.

Edited by dvbrewer
Link to comment
  • 1 month later...
mborkP Newbie

mborkP

Posted
Posted

If DVBViewere could add OpenTV native support that would be fantastic.

 

yeah, I asked this question long time ago, but there is not enough people to "nag" the developers here so there in no priority on this one I guess.

But yes it would be nice. Especially now when EPG Collector is open source it should be not that difficoult.

Cheers

Link to comment
  • 1 month later...
dvbrewer Newbie

dvbrewer

Posted
  • Author
Posted

hi,

 

can anyone tell me how i can get more than 1 region in the xml file? i cant seem to input more than 1 channels line in the epgcollector.ini file.

 

thanks.

Do you not just leave it blank, so get all regional variants?

Link to comment
daveyboyc Newbie

daveyboyc

Posted
Posted

what, like channels: (then nothing) or remove channels line completely. I will try again in a moment, but i think when i leave it blank it gives me an error in command prompt regrading the channles line..

  • Like 1
Link to comment
daveyboyc Newbie

daveyboyc

Posted
Posted

theres no error when i remove the channels line, but i can only seem to be able to get a few regionals in the channel pairing list of xepg.

i can see them when i read the xml with my web browser though..

ive attached the xml, should i be able to import all the regionals with this? (itv regionals)

Link to comment
dvbrewer Newbie

dvbrewer

Posted
  • Author
Posted

theres no error when i remove the channels line, but i can only seem to be able to get a few regionals in the channel pairing list of xepg.

i can see them when i read the xml with my web browser though..

ive attached the xml, should i be able to import all the regionals with this? (itv regionals)

Any reason why you don't just use DVBViewer's inbuilt Freesat grabbing facility for those? On another point, a new version of EPGCollector has been released v.3, looks like it might require some fiddling to get it to work though as quite a few changes have been made- discussions on Sourceforge, download.

Link to comment
toblerone Newbie

toblerone

Posted
Posted (edited)

sorry but no1 notified that the epg collector doesn't work if the recording service is enabled? and so the xepg automation in the dvb recording service is useless

 

actually to have a working epg i need to add a win scheduled task with:

in the order

stop the recording service

epg collector

start the service

then xepg

 

or i wrong something?

 

thx

Edited by toblerone
Link to comment
  • 2 months later...
glyn1972 Newbie

glyn1972

Posted
Posted

Horses for courses I guess! I use this to collect all my EPG information now here in the UK (Freeview, Freesat and Sky FTA), it gathers it all and imports into the Recording Service EPG no problem.

 

Initially I did have issues with v3, but found that uninstalling and then re-installing and applying the latest fix pack made everything work as expected :biggrin:

Link to comment
  • 2 months later...
nzsjb Newbie

nzsjb

Posted
Posted

mobiwan:

 

I'm sorry that you have had problems with EPG Collector.

 

Would you like to elaborate on what they were and I will fix them so that other users don't have the same unsatisfactory experience.

Link to comment
  • 1 month later...
damy Newbie

damy

Posted
Posted (edited)

Hi,

 

would EPG collector get to work with Sky Italia.

 

Found enthusiastic comments

 

yea yea yea

0.3.3.6 works PERFECT (sk it)!

thanks for this soft!!!!

 

but no howtos.

 

Installed epg Collector 3.1

 

Then I clicked

 

"Create New Collection parameters" and choose "Italy Sky TV"

 

After that I Clicked "Run" -> "Collect EPG Data"

 

Here is the log:

 

15:38:48:406 Run collection menu option selected
15:38:48:406 Checking if save needed for Collection Parameters
15:38:48:406 Data has not changed - ok to proceed
15:38:48:406 Checking if save needed for Plugin Parameters
15:38:48:406 No update control - ok to proceed
15:38:48:406 Checking if save needed for EIT Program Categories
15:38:48:406 No update control - ok to proceed
15:38:48:406 Checking if save needed for OpenTV Program Categories
15:38:48:406 No update control - ok to proceed
15:38:48:406 Checking if save needed for MediaHighway Program Categories
15:38:48:406 No update control - ok to proceed
15:38:48:406 Checking if save needed for PSIP Program Categories
15:38:48:406 No update control - ok to proceed
15:38:48:406 Checking if save needed for Custom Program Categories
15:38:48:406 No update control - ok to proceed
15:38:48:406 Asking if current parameters are to be used
15:38:49:812 Using current parameters
15:38:49:812 Running collection with C:\Dokumente und Einstellungen\All Users\Anwendungsdaten\Geekzone\EPG Collector\EPG Collector.ini
15:38:49:812 Changing menu availability to False
15:38:49:812 Save availability changed to False:False
15:38:49:859 Started on 08.07.2011
15:38:49:859 
15:38:49:875 ============================ EPG Collector (Version 3.1) ==============================
15:38:49:875 
15:38:49:875 OS version: 5.1.2600.196608
15:38:49:875 
15:38:49:875 Executable build: 3.1.4186.27075
15:38:49:875 DirectShow build: 3.1.4180.24792
15:38:49:875 DomainObjects build: 3.1.4180.24791
15:38:49:875 DVBServices build: 3.1.4186.27074
15:38:49:875 
15:38:49:875 Privilege level: Administrator
15:38:49:875 
15:38:49:875 Base directory: C:\Programme\Geekzone\EPG Collector
15:38:49:875 Data directory: C:\Dokumente und Einstellungen\All Users\Anwendungsdaten\Geekzone\EPG Collector
15:38:49:875 
15:38:49:875 Processing command line parameter: /ini=C:\Dokumente und Einstellungen\All Users\Anwendungsdaten\Geekzone\EPG Collector\EPG Collector.ini
15:38:49:875 Processing command line parameter: /background=189153849
15:38:49:890 Processing ini parameter: [GENERAL]
15:38:49:890 Processing ini parameter: Output=C:\Dokumente und Einstellungen\All Users\Anwendungsdaten\Geekzone\EPG Collector\TVGuide.xml
15:38:49:890 Processing ini parameter: Timeouts=10,300,5
15:38:49:890 Processing ini parameter: Location=ITA,0
15:38:49:890 Processing ini parameter: InputLanguage=ita
15:38:49:906 Processing ini parameter: Charset=windows-1250
15:38:49:921 Processing ini parameter: Option=ACCEPTBREAKS
15:38:49:921 Processing ini parameter: [DVBS]
15:38:49:921 Processing ini parameter: Satellite=130
15:38:49:937 Processing ini parameter: Dish=9750000,10600000,11700000
15:38:49:937 Processing ini parameter: TuningFile=13.0°E Hot Bird 6,8,9.xml
15:38:49:937 Processing ini parameter: ScanningFrequency=11881000,27500,3/4,V,OpenTV
15:38:50:031 Tuner info: Node type 0
15:38:50:031 Tuner info: Node type 1
15:38:50:031 Tuner info: Descriptor 00000000-0000-0000-0000-000000000000 71985f4c-1ca1-11d3-9cc8-00c04f7971e0 0
15:38:50:031 Tuner info: Descriptor 00000000-0000-0000-0000-000000000000 6390c905-27c1-4d67-bdb7-77c50d079300 1
15:38:50:140  
15:38:50:140 Found tuner 1: USB 2.0 BDA DVB-S Tuner (Satellite)
15:38:50:140  
15:38:50:156 Tuning to frequency 11881000 on Satellite
15:38:53:937 Using tuner 1: USB 2.0 BDA DVB-S Tuner
15:38:54:031 Signal acquired: lock is True quality is 100 strength is 53
15:38:55:046 EPG delivery system is OpenTV on frequency 11881000
15:38:55:046 Loading OpenTV Program Categories from C:\Programme\Geekzone\EPG Collector\Configuration\Program Categories\OpenTV Categories ITA.cfg
15:38:55:046 Loaded 109 program categories
15:38:55:062 Loading Huffman Dictionary from C:\Programme\Geekzone\EPG Collector\Configuration\Huffman Dictionary ITA.cfg
15:38:55:062 Dictionary loaded
15:38:55:078 Collecting station data......
15:39:07:093 Stopping station reader for frequency 11881000 - V
15:39:07:093 Stations: 18 buffer space used: 75200
15:39:07:109 Included station: CINE+ CLUB       (1,1074,8351 Type: 1 Encrypted EPG: NN&S)
15:39:07:109 Included station: MCM              (1,1074,8352 Type: 1 Encrypted EPG: NN&S)
15:39:07:109 Included station: TV BREIZH        (1,1074,8353 Type: 1 Encrypted EPG: NN&S)
15:39:07:109 Included station: MCM POP          (1,1074,8354 Type: 1 Encrypted EPG: NN&S)
15:39:07:109 Included station: A VOIR CE SOIR   (1,1074,8355 Type: 1 Encrypted EPG: None)
15:39:07:109 Included station: W9               (1,1074,8356 Type: 1 Encrypted EPG: NN&S)
15:39:07:109 Included station: FRANCE 2         (1,1074,8357 Type: 1 Encrypted EPG: NN&S)
15:39:07:109 Included station: TEST CDN 8       (1,1074,8360 Type: 1 Clear EPG: None)
15:39:07:109 Included station: No Service Name  (1,1074,8361 Type: 1 Encrypted EPG: None)
15:39:07:109 Included station: No Service Name  (1,1074,8363 Type: 1 Encrypted EPG: None)
15:39:07:109 Included station: MCM TOP          (1,1074,8365 Type: 1 Encrypted EPG: NN&S)
15:39:07:109 Included station: TF1              (1,1074,8366 Type: 1 Encrypted EPG: NN&S)
15:39:07:109 Included station: M6               (1,1074,8367 Type: 1 Encrypted EPG: NN&S)
15:39:07:109 Included station: TF1              (1,1074,8371 Type: 1 Encrypted EPG: NN&S)
15:39:07:109 Included station: M6               (1,1074,8372 Type: 1 Encrypted EPG: NN&S)
15:39:07:109 Included station: W9               (1,1074,8373 Type: 1 Encrypted EPG: NN&S)
15:39:07:109 Included station: FRANCE 2         (1,1074,8374 Type: 1 Encrypted EPG: NN)
15:39:07:109 Included station: DATA SYSTEM[74]  (1,1074,8399 Type: 193 Clear EPG: None)
15:39:07:109 Station count now: 18
15:39:07:109 Collecting channel data.....
15:39:17:187 Stopping bouquet reader
15:39:17:187 Channel count: 0 buffer space used: 62980
15:39:17:187 Collecting title data.....
15:39:22:203 Stopping title reader
15:39:22:218 Title count: 0 buffer space used: 94564
15:39:22:218 Collecting summary data.....
15:39:27:281 Stopping summary reader
15:39:27:281 Summary count: 0 buffer space used: 0
15:39:27:281 Stopping section readers
15:39:27:281 Stopped section readers
15:39:27:296 Background worker thread finished
15:39:27:296 Stop request received
15:39:27:296 Stopping background worker thread
15:39:27:296 Stop request processed
15:39:27:500 
15:39:27:500 ============================ Stations With No Data ==============================
15:39:27:500 
15:39:27:515 Station: CINE+ CLUB       (1,1074,8351) No data
15:39:27:515 Station: MCM              (1,1074,8352) No data
15:39:27:515 Station: TV BREIZH        (1,1074,8353) No data
15:39:27:515 Station: MCM POP          (1,1074,8354) No data
15:39:27:515 Station: A VOIR CE SOIR   (1,1074,8355) No data
15:39:27:515 Station: W9               (1,1074,8356) No data
15:39:27:515 Station: FRANCE 2         (1,1074,8357) No data
15:39:27:515 Station: TEST CDN 8       (1,1074,8360) No data
15:39:27:515 Station: No Service Name  (1,1074,8361) No data
15:39:27:515 Station: No Service Name  (1,1074,8363) No data
15:39:27:515 Station: MCM TOP          (1,1074,8365) No data
15:39:27:515 Station: TF1              (1,1074,8366) No data
15:39:27:515 Station: M6               (1,1074,8367) No data
15:39:27:515 Station: TF1              (1,1074,8371) No data
15:39:27:515 Station: M6               (1,1074,8372) No data
15:39:27:515 Station: W9               (1,1074,8373) No data
15:39:27:515 Station: FRANCE 2         (1,1074,8374) No data
15:39:27:515 Station: DATA SYSTEM[74]  (1,1074,8399) No data
15:39:27:515 
15:39:27:515 ============================ Output Data ==============================
15:39:27:515 
15:39:27:515 <S> Summary: Total Stations = 0 Total Gaps = 0 Total Overlaps = 0 Total Time = 00:00:37.6406250
15:39:27:515 Deleting any existing version of output file
15:39:27:515 Creating output file: C:\Dokumente und Einstellungen\All Users\Anwendungsdaten\Geekzone\EPG Collector\TVGuide.xml
15:39:27:515 <C> Finished - created 0 EPG entries
15:39:27:515 <e> No data collected
15:39:27:515 <e> Exiting with code = 13
15:39:27:546 Changing menu availability to True
15:39:27:546 Save availability changed to False:False

 

"Spain Satellite Mediahighway2 data" works perfect.

 

 

What I am doing wrong?

 

Thanks

Edited by damy
Link to comment
nzsjb Newbie

nzsjb

Posted
Posted

Are your dish parameters correct?

 

Having the dish parameters wrong can cause it to tune to the wrong frequency. That looks likely from the log as the stations listed are not for Sky Italia.

Link to comment
damy Newbie

damy

Posted
Posted (edited)

Thanks for the hint. I think I have to read more to find out about the difference (and the relevance) between the scanning frequenzy and the Dish.

 

Indeed 11881000 is not a Sky Italia Transponder.

 

Will post the result.

 

Thanks again

Edited by damy
Link to comment
nzsjb Newbie

nzsjb

Posted
Posted

I'm pretty certain that 11881V is the correct frequency for collecting Sky Italia.

 

If your dish parameters are wrong then even though this is the frequency listed in the log it is not necessarily the frequency that the tuner tunes to.

 

You need to know what sort of LNB you have.

Link to comment
damy Newbie

damy

Posted
Posted

Thanks nzsjb.

 

With this configuration, it works. Think I have to play with the location parameter (Location=ita?)

 

Indeed i have a normal Diseq configuration, 13,0 and 19,2.

 

[GENERAL]

Output=C:\Dokumente und Einstellungen\All Users\Anwendungsdaten\Geekzone\EPG Collector\TVGuide.xml

Timeouts=10,300,5

Location=ITA,0

Option=ACCEPTBREAKS,USESAFEDISEQC

 

[DVBS]

Satellite=192

Dish=9750000,10600000,11700000,AA

TuningFile=19.2°E Astra 1H,1KR,1L,1M.xml

ScanningFrequency=10847000,22000,5/6,V,MediaHighway2

 

[DVBS]

Satellite=130

Dish=9750000,10600000,11700000,AB

TuningFile=13.0°E Hot Bird 6,8,9.xml

ScanningFrequency=11881000,27500,3/4,V,OpenTV

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Unfortunately, your content contains terms that we do not allow. Please edit your content to remove the highlighted words below.
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
Go to topic listing
×
×
  • Create New...