Basic Pricing Plan Query

[palaz]

Just downloaded some MATCH_ODDS Market Type sample data in an attempt to understand the structure of the files before spending some money on the advanced/pro. Every event appears to have two bz2 files, one significantly larger than the other and with two different ids...example (after unzipping tar file):

path = "...data\xds\historic\BASIC\28054213"
files/marketIds:
1.128814195.bz2
1.128814239.bz2

so both are (Watford vs. Tottenham, Match Odds, 01/01/17 13:30:00) but the smaller file only has 63 entries whereas the 'main' file has 991 entries. According to the timestamps both have events before and after the market startTime...am a bit lost why there would be two records of the same event.

Questions:
(1) Is this the same format in the advanced/pro files?
(2) Why are there seemingly two versions of the same event, albeit with different id and different datasets?
(3) Do you need to combine them to get the 'true' second by second /whatever by whatever view of the market (doesn't seem likely as some times are duplicated across the two files for the Basic output but potentially if you go into more detail on the Av/Pro files this might change)

Many thanks in advance if anyone can help

[palaz]

Always great when you're the only one replying to your own thread...I also downloaded the sample Advanced file and see the same behaviour for a few marketTypes:

marketType             id1	      id2
CORRECT_SCORE2         1.131162740    1.131162729
MATCH_ODDS             1.131162806    1.131162837
OVER_UNDER_05          1.131162819    1.131162847
OVER_UNDER_45          1.131162720    1.131162841
TO_SCORE_BOTH_HALVES   1.131162739    1.131162742

so...again, completely lost as to why we have multiple 'uniqueIds' for the one market and it appears to be a feature of the ad/pro files if this Advanced sample is representative.