Mike
Member of DD Central
Posts: 651
Likes: 446
|
Post by Mike on Jan 11, 2016 17:33:28 GMT
What is this thread meant to prove? That you can copy the transaction data here? Yoh haven't managed to filter out who is a bot and who isn't, so I'm not clear what the purpose of these posts is
|
|
sam i am
Member of DD Central
Posts: 697 
Likes: 555
|
Post by sam i am on Jan 11, 2016 17:35:31 GMT
If I list any manual buys amongst the rest, then I apologise. When larger chunks are being sold, it's more likely to happen. I don't think SS have switched off bots, because I rather doubt they have the ability. But they may possibly have started to contact offenders. Alternatively, this thread might have made some a little nervous. No need to apologise, no offense was taken. I posted mainly out of delight that I'd managed to buy something 
|
|
mikes1531
Member of DD Central
Posts: 6,453
Likes: 2,320
|
Post by mikes1531 on Jan 11, 2016 17:42:38 GMT
... I wonder if the bots have been switched off ... Perhaps they've downed tools for their afternoon tea break.  Whatever the reason, I'm glad to have had a chance to make a manual purchase -- no bot here. And I never did a manual refresh -- I was made aware of the parts' availability because the SS page I have open in a separate window updated itself automatically. I probably have missed other opportunities as a result, but I can't be refreshing the website all the time just in case something shows up -- I have other things I'm supposed to be doing, like working on my tax return.
|
|
|
|
Post by sunspot on Jan 11, 2016 17:52:22 GMT
xell
Without writing something very similar to a bot, it's impossible to identify with absolute certainty which transactions are automated and which are manual.
As for the point of this thread, if you're using a bot, then you understand well enough. Otherwise, you'll perhaps reap the rewards if and when bots are expelled.
Incidentally, chunks of PBL020 appeared to sell manually a few of minutes ago. And possibly PBL019 too. These are both overdue though, so that may not prove anything.
|
|
|
|
Post by supernumerary on Jan 11, 2016 18:01:11 GMT
If I list any manual buys amongst the rest, then I apologise. When larger chunks are being sold, it's more likely to happen. I don't think SS have switched off bots, because I rather doubt they have the ability. But they may possibly have started to contact offenders. Alternatively, this thread might have made some a little nervous. I agree with you. This 'bot watch' thread will be useful. I see the usual suspects are operating...
|
|
adrianc
Member of DD Central
Posts: 10,001
Likes: 5,139
Member is Online
|
Post by adrianc on Jan 11, 2016 18:10:18 GMT
A p2p site that doesn't allow API access would get my vote everytime How about one that promises API access, but Fails Completely to actually extract digit?
|
|
|
|
Post by GSV3MIaC on Jan 11, 2016 18:11:57 GMT
Perhaps they've downed tools for their afternoon tea break. And I never did a manual refresh -- I was made aware of the parts' availability because the SS page I have open in a separate window updated itself automatically. I probably have missed other opportunities as a result, but I can't be refreshing the website all the time just in case something shows up -- I have other things I'm supposed to be doing, like working on my tax return. Nope mine is still running, but it is somewhat selective about what to buy (and sell too .. I assume someone noticed the parts that were recently listed for sale .. blame Dove for that too). Leaving the page to autorefresh you will lose nothing .. you get notified just as fast as a bot would** .. and you avoid the risk of being locked out as a DOS attacker. Whether you can click 'buy' as fast ... no, of course you can't. ** Unless the bot is hitting the 'need to redraw' .JSON page faster than the 'every 3 seconds' the auto refresh uses, which would be asking for trouble (and no, I don't).
|
|
ablender
Member of DD Central
Posts: 2,204
Likes: 555
|
Post by ablender on Jan 11, 2016 19:04:38 GMT
... I wonder if the bots have been switched off ... - I have other things I'm supposed to be doing, like working on my tax return. Just emailed mine to the accountant. Finally . . .
|
|
ablender
Member of DD Central
Posts: 2,204
Likes: 555
|
Post by ablender on Jan 11, 2016 19:11:45 GMT
'need to redraw' .JSON page faster than the 'every 3 seconds' the auto refresh uses, What is this JSON that you referred to a number of times?
|
|
|
|
Post by GSV3MIaC on Jan 11, 2016 19:53:36 GMT
The web address which the available loan page looks at to decide whether there are any loans available (so a full redraw is required), which lives at
"https://savingstream.co.uk/_data-feed/renderLoansIfAny:available"
and which return a .json (java script object notation) object of the form {"renderLoansIfAny":[false]} as you can see by going there yourself. When 'false' is 'true' it means there is something for sale, and the main available loans page gets redrawn (assuming you are logged in of course, elsewise you just get the live loans page instead). The available loans page dings the .json object every 3 seconds or so, and redraws only if it needs to, thus taking a huge (1000x) load off the servers, which would otherwise have to redraw the whole 'nothing for sale' page every 3 seconds instead.
Now you're sorry you asked, aren't you! 8>.
p.s. while it is undoubtedly cute, it'd be a lot cuter (certainly for bots) if it returned a more complex json object which actually included the loan numbers and amounts available .. although if you really want the pictures and loan sizes and the whole 9 yards I guess maybe not.
|
|
wysiati
Member of DD Central
Posts: 397
Likes: 86
|
Post by wysiati on Jan 11, 2016 19:58:52 GMT
Perhaps they've downed tools for their afternoon tea break. And I never did a manual refresh -- I was made aware of the parts' availability because the SS page I have open in a separate window updated itself automatically. I probably have missed other opportunities as a result, but I can't be refreshing the website all the time just in case something shows up -- I have other things I'm supposed to be doing, like working on my tax return. Nope mine is still running, but it is somewhat selective about what to buy (and sell too .. I assume someone noticed the parts that were recently listed for sale .. blame Dove for that too). I had assumed you named your bot Dave, so why Dove?
|
|
|
|
Post by GSV3MIaC on Jan 11, 2016 20:01:30 GMT
Seemed more friendly than the hawks which were hovering (or hoovering) before. Actually she's really called Buddy, but don't let on. Hopefully she can retire soon.
|
|
|
|
Post by sunspot on Jan 11, 2016 21:30:41 GMT
PBL071
11/01/2016 d**e £10.00
11/01/2016 d**e £93.00
This had literally gone before it appeared on my computer - i.e. when the page refreshed, it was already zero.
This happens quite often!
|
|
ablender
Member of DD Central
Posts: 2,204
Likes: 555
|
Post by ablender on Jan 11, 2016 22:59:42 GMT
The web address which the available loan page looks at to decide whether there are any loans available (so a full redraw is required), which lives at "https://savingstream.co.uk/_data-feed/renderLoansIfAny:available" and which return a .json (java script object notation) object of the form {"renderLoansIfAny":[false]} as you can see by going there yourself. When 'false' is 'true' it means there is something for sale, and the main available loans page gets redrawn (assuming you are logged in of course, elsewise you just get the live loans page instead). The available loans page dings the .json object every 3 seconds or so, and redraws only if it needs to, thus taking a huge (1000x) load off the servers, which would otherwise have to redraw the whole 'nothing for sale' page every 3 seconds instead. Now you're sorry you asked, aren't you! 8>. p.s. while it is undoubtedly cute, it'd be a lot cuter (certainly for bots) if it returned a more complex json object which actually included the loan numbers and amounts available .. although if you really want the pictures and loan sizes and the whole 9 yards I guess maybe not. Wow, it is quite technical.
|
|
|
|
Post by sunspot on Jan 12, 2016 0:53:50 GMT
I'm not familiar with that part of javascript, but from the description, all you have is a repeat loop that periodically checks a flag on the server which identifies whether or not loans are available.
Code always looks complicated at first, but that much at least seems straightforward.
Personally, I would have thought something could have been done using the HTTP request header If-Modified-Since:, an IFrame and a meta refresh, but javascript is often required to do basic things that have somehow been overlooked by the designers of HTML and HTTP.
|
|
