Streaming - Raise max market subscription

[Julien]

Hello,

Currently, I am limited to 200 markets when subscribing through the Streaming API.
I am trading on greyhound markets, that have more than 200 races a day

Do you know, what I should do to get this limit raised?
Or who I should contact?

[geoffw123]

Hi

It is a fair point you raise, for example just subscribing to the days UK greyhound racing Win markets can give you 120 or more subscriptions. Adding the days horse racing win markets and you are pretty close to that limit. I agree they could do with increasing that number if possible.

Hopefully someone from Betfair Tech Support will comment on it here, but if they dont go to https://support.developer.betfair.com and then hit the contact us, you can send them an email. If they do comment via email, please post their reply here. Thanks

[bfexplorer]

You have got 10 connections available, and I think it is good step from betfair to minimize resource impact on their services/servers, mainly when similar users like you two use streaming api without thinking what they do.

In some use case scenarios this could lead to problems, for instance betfair traders running 1.01 laying strategies, where detection of new markets is critical, but again any of such solutions can be optimized to generate upto 200 subscribed markets.

[geoffw123]

BFExplorer, do you have to reply to every post with a sarcastic comment ? It is getting very tiresome.

My previous post you were very sarcastic and condescending and told me i shouldnt even be writing an App, as there were already lots out there. (I.e yours)
I let that one go over my head without replying.

Now you say "users like you two use streaming api without thinking what they do."

We simply pointed out that just subscribing to a days UK Greyhound racing takes you very close to that subscription limit. I said "Hopefully someone from Betfair Tech Support will comment on the issue here". That means BF explain why that figure of 200 was chosen, is there some potential for it to be increasd without causing server problems ? If that is a hard limit, what are their recommendations for workarounds to the issue, I.E would multiple connections be a lesser load from their perspective ?

Please try and desist from replying to my posts in the future please, that would be most appreciated.

Thanks

[LiamP]

Hello,

Currently, I am limited to 200 markets when subscribing through the Streaming API.
I am trading on greyhound markets, that have more than 200 races a day

Do you know, what I should do to get this limit raised?
Or who I should contact?

Send an email direct to bdp asking for it to be raised.

[bfexplorer]

BFExplorer, do you have to reply to every post with a sarcastic comment ? It is getting very tiresome.

My previous post you were very sarcastic and condescending and told me i shouldnt even be writing an App, as there were already lots out there. (I.e yours)
I let that one go over my head without replying.

Now you say "users like you two use streaming api without thinking what they do."

We simply pointed out that just subscribing to a days UK Greyhound racing takes you very close to that subscription limit. I said "Hopefully someone from Betfair Tech Support will comment on the issue here". That means BF explain why that figure of 200 was chosen, is there some potential for it to be increasd without causing server problems ? If that is a hard limit, what are their recommendations for workarounds to the issue, I.E would multiple connections be a lesser load from their perspective ?

Please try and desist from replying to my posts in the future please, that would be most appreciated.

Thanks

Sir, greyhound races have betable volume from 5 to 3 minutes to the official races start time, so there is no need to open/subscribe to all greyhounds markets by one subscription.

All my concerns are to users who either do not read documentation or do not understand what they are doing. Now we have betfair downtimes on services/servers like we have got last weeks, simply because people use api to such extent that server resources collapse.Then we all involved losing money, when open trades cannot be closed!

If you do not understand that then your app should really not be certified for using.

Another bad example of misusing api is bet angel app. People bet/trade on football, and run some strategies on football matches depending on match score and/or time, statistics and so on.

What is bet angel recommendation for such traders running automated strategies, to open correct score and all over/under markets just to judge score in match.

I would really advice betfair to have a look at on such practices, because api showdowns is too much last weeks.

[Julien]

I like a bit of drama, but I agree with geoffw123, there is no need to be condescending. If we are posting on the forum is that we are not expert and looking for best practices... (And hopefully increasing the liquidity for all)
Regarding my issue with Greyhound, I agree it is tradeable only minutes before the race, I'd be happy if Betfair could implement some market filter based on time to race, but to my knowledge there is not.
Bfexplorer, my understanding is that streaming was the best way to go not to get the Betfair service under too much pressure, as it only push info when there is a change. If you have a way which is less intensive I am open to any suggestions?

[geoffw123]

Hi Julien

If you have a way which is less intensive I am open to any suggestions?

You are correct using the streaming API is the optimum way to minimise load on the BF Server. It is the classic Publisher/Subscriber model from the textbooks.

If you subscribe to a 9 p.m greyhound market at 9 a.m in the morning, it is probably several hours before BF even has to send you a changed data packet. For that period, it is zero load on the BF server as it doesnt even need to bother looking through its list of subscribers until something changes.

[bfexplorer]

Hi Julien



You are correct using the streaming API is the optimum way to minimise load on the BF Server. It is the classic Publisher/Subscriber model from the textbooks.

If you subscribe to a 9 p.m greyhound market at 9 a.m in the morning, it is probably several hours before BF even has to send you a changed data packet. For that period, it is zero load on the BF server as it doesnt even need to bother looking through its list of subscribers until something changes.

This is not right, because any streaming subscription on betfair servers creates user's context of data betfair must manage. Yes, from clients perspective it looks like minimum load, because you have got only changes, but on betfair side, this user's context takes resources.

The original question was: "Streaming - Raise max market subscription"

If you want to use streaming api, you must manage to get maximal 200 markets per one streaming connection.

[geoffw123]

Yes obviously, the initial subscription request will take a small amount of Server CPU processing time and and require the Server to allocate some memory to remember the subscriber. When I was said it is no load for the hours when the market is static, I was referring to CPU time and comms time.

It would be nice to get Betfairs thoughts on this to confirm that 200 is an absolute maximum and that if you want more markets then just open more connections. It doesnt discuss this in the docs as far as I recall.

I doubt if they will respond though as they are busy fire fighting their recent API change and counting their rounded pennies !

[bfexplorer]

Yes obviously, the initial subscription request will take a small amount of Server CPU processing time and and require the Server to allocate some memory to remember the subscriber. When I was said it is no load for the hours when the market is static, I was referring to CPU time and comms time.

It would be nice to get Betfairs thoughts on this to confirm that 200 is an absolute maximum and that if you want more markets then just open more connections. It doesnt discuss this in the docs as far as I recall.

I doubt if they will respond though as they are busy fire fighting their recent API change and counting their rounded pennies !

Sir, do you understand at least something?

Betfiar announced this changes:Exchange Stream API Release - Connection Throttling - 26th February

When creating streaming subscription, it is not just about initial subscription request. Any subscription created is transformed to markets which has to be monitored to be streamed for any changes to the user.

Monitoring part an subsequent market data changes are done for all open markets, so are centralized, and then through all subscriptions just user's markets are streamed.

It is clear that we can open all kinds of subscriptions, not just by market ids, it means that on betfair server in some intervals it must be executed discovery procedure, so new added markets when fulfill your subscription criteria must be added to your subscription.

When betfair introduced streaming api, as alternative to rest api, the main goal was to as well lower amount of server resources, but as adoptions of streaming api maybe reached its peak, and most api users use streaming api, it shows big impact on betfair server resources, therefore betfair must introduced Exchange Stream API Release - Connection Throttling to 200 markets per subscription connection.

In minimal bet size issue, I again understand betfair motivations, its business model is about fees per winning bet, so all that is ok.

As always problems is in not so good implementation, some software vendors made, it is not my case for instance and I showed that in my testing video.

https://www.youtube.com/watch?v=Xf5ysUiBzPU

Yes, betfair could be blamed not to noticing the prefered way how traders (of very bad trading softwares) and they show that in tutorial video for trading, hedge bet position, so by net stake first, and then hedging for pennies in most cases.

So if betfair fix was meant against traders opening bet position under minimal stake amount, in this case impact was bigger.

My software by default offers hedging, and when under minimal bet stakes are placed, what can be done to 0.5 back stake amount or 0.8 lay stake after betfair fix, but when such minimal bet stake transaction cannot be executed, my app cancels original bet, bet not for instance cymatic or bet angel, so this way user actually losing its trade when such bet is matched.

[geoffw123]

OK I give in, you win

The first half page is basically what I said, just I said it in a shortened form.

I agree, you are the most knowledgable programmer on the forum, you App is the best, your posts are the most interesting to read, your App coped the best with the recent ill judged betfair lay bet change, every other App apart from yours is "very bad trading softwares", you are the least irritating person on the forum.

Anything else you want me to add ?

Please dont bother replying to this post as I have now added you to my blocked posters list.

I will continue reading posts on here and trying to help other posters where i can (free of charge)

Goodbye

[bfexplorer]

OK I give in, you win

The first half page is basically what I said, just I said it in a shortened form.

I agree, you are the most knowledgable programmer on the forum, you App is the best, your posts are the most interesting to read, your App coped the best with the recent ill judged betfair lay bet change, every other App apart from yours is "very bad trading softwares", you are the least irritating person on the forum.

Anything else you want me to add ?

Please dont bother replying to this post as I have now added you to my blocked posters list.

I will continue reading posts on here and trying to help other posters where i can (free of charge)

Goodbye

Just for record, it was you who started to take it personally, not me. I just replied with my opinion and you started lynching me.