|
Post by cinereus on Oct 5, 2019 0:18:08 GMT
Yeah I'm manually generating the first cookie from a normal POST request through a regular browser then extracting this and feeding it to wget which uses "load-cookies" for all subsequent requests. From your explanation should wget be getting a new cookie I can replace the original with?
I will test more soon - I had to leave the computer moments after getting working XPATHs.
Luckily with this much working it's simple to set up email/SMS alerts for when rates are favourable.
|
|
Stonk
Stonking
Posts: 735
Likes: 658
|
Post by Stonk on Oct 5, 2019 0:34:57 GMT
Yeah I'm manually generating the first cookie from a normal POST request through a regular browser then extracting this and feeding it to wget which uses "load-cookies" for all subsequent requests. From your explanation should wget be getting a new cookie I can replace the original with? I will test more soon - I had to leave the computer moments after getting working XPATHs. Luckily with this much working it's simple to set up email/SMS alerts for when rates are favourable.
I think you might also need a --save-cookies (to the same file) on every request, otherwise it's just using the original cookies from the very first request every time.
|
|
aju
Member of DD Central
Posts: 3,484
Likes: 917
|
Post by aju on Oct 5, 2019 9:03:30 GMT
The issue i found with my simple extension was that of finding the timer criteria of the relevant site. I used a simple extension that just fired off a reload() funtion and found 2 possible scenarios as follows.
Some sites seem to track and check for certain types of repeated requests to same page. I found also for RS and Zopa that the ideal for RS was 1 min cycles. On Zopa there are network issues that throw this out some times I seem to recall that wget used to code that coped with this scenario but its a long time since i was introduced to it and i wanted a very simple approach i never bothered with it.
So on RS my observations are that RS seems to be somewhat bursty in that with 1 min or even 2 min reloads very little might change then all of a sudden changes will occur. I usually step in and run some manual reloads and this shows more changes.
Not sure what patterns you are expecting in the new system and my observational method may not work. If your logout issues are causing your logout is an issue one thing that seems to occur is that in chrome the system allows multiple sessions all working from the same cookie set used for the initial screen.
If this is all irrelevant to the wget methods appologies for butting in. RS does seem to have quite a long timeout certainly compared to Zopa but its session control is streets ahead of Zopa in that it always resets correctly whereas Zope will drop a relogin into any screen last used which is not very useful for more than one user on a pc.
|
|
|
Post by cinereus on Oct 5, 2019 16:01:46 GMT
The issue i found with my simple extension was that of finding the timer criteria of the relevant site. I used a simple extension that just fired off a reload() funtion and found 2 possible scenarios as follows. Some sites seem to track and check for certain types of repeated requests to same page. I found also for RS and Zopa that the ideal for RS was 1 min cycles. On Zopa there are network issues that throw this out some times I seem to recall that wget used to code that coped with this scenario but its a long time since i was introduced to it and i wanted a very simple approach i never bothered with it. So on RS my observations are that RS seems to be somewhat bursty in that with 1 min or even 2 min reloads very little might change then all of a sudden changes will occur. I usually step in and run some manual reloads and this shows more changes. Not sure what patterns you are expecting in the new system and my observational method may not work. If your logout issues are causing your logout is an issue one thing that seems to occur is that in chrome the system allows multiple sessions all working from the same cookie set used for the initial screen. If this is all irrelevant to the wget methods appologies for butting in. RS does seem to have quite a long timeout certainly compared to Zopa but its session control is streets ahead of Zopa in that it always resets correctly whereas Zope will drop a relogin into any screen last used which is not very useful for more than one user on a pc. Haven't experienced RS doing any server-side caching of results so far. Think cookie issue is sorted, as Stonk said I was just forgetting to update my cookie file as far as I can tell.
|
|
aju
Member of DD Central
Posts: 3,484
Likes: 917
|
Post by aju on Oct 5, 2019 23:38:40 GMT
The issue i found with my simple extension was that of finding the timer criteria of the relevant site. I used a simple extension that just fired off a reload() funtion and found 2 possible scenarios as follows. Some sites seem to track and check for certain types of repeated requests to same page. I found also for RS and Zopa that the ideal for RS was 1 min cycles. On Zopa there are network issues that throw this out some times I seem to recall that wget used to code that coped with this scenario but its a long time since i was introduced to it and i wanted a very simple approach i never bothered with it. So on RS my observations are that RS seems to be somewhat bursty in that with 1 min or even 2 min reloads very little might change then all of a sudden changes will occur. I usually step in and run some manual reloads and this shows more changes. Not sure what patterns you are expecting in the new system and my observational method may not work. If your logout issues are causing your logout is an issue one thing that seems to occur is that in chrome the system allows multiple sessions all working from the same cookie set used for the initial screen. If this is all irrelevant to the wget methods appologies for butting in. RS does seem to have quite a long timeout certainly compared to Zopa but its session control is streets ahead of Zopa in that it always resets correctly whereas Zope will drop a relogin into any screen last used which is not very useful for more than one user on a pc. Haven't experienced RS doing any server-side caching of results so far. Think cookie issue is sorted, as Stonk said I was just forgetting to update my cookie file as far as I can tell. That's good to hear, its always very satisfying when one fixes an issue that has been dogging some results, well done - I for one look forward to you sharing your results if and when you determine what your analysis of the new lending patterns are .
|
|
|
Post by cinereus on Oct 7, 2019 12:53:52 GMT
Haven't experienced RS doing any server-side caching of results so far. Think cookie issue is sorted, as Stonk said I was just forgetting to update my cookie file as far as I can tell. That's good to hear, its always very satisfying when one fixes an issue that has been dogging some results, well done - I for one look forward to you sharing your results if and when you determine what your analysis of the new lending patterns are . Already seems like things might be very different in the age of the new markets. I don't get why lend rate and borrow rate are both 2.9% so often now either.
|
|
aju
Member of DD Central
Posts: 3,484
Likes: 917
|
Post by aju on Oct 7, 2019 15:22:44 GMT
That's good to hear, its always very satisfying when one fixes an issue that has been dogging some results, well done - I for one look forward to you sharing your results if and when you determine what your analysis of the new lending patterns are . Already seems like things might be very different in the age of the new markets. I don't get why lend rate and borrow rate are both 2.9% so often now either. Thing is though is with the lend rate @ 2.9% then how is RS making any money if at all. On Zopa one can see both the borrower rate and the Lend rate and hence the zone of profit rates that Zopa is using. RS must be doing a similar thing in that they have to have some borrowers that are quite a bit higher than the lend rates especially now they are more fixed. I tried borrowing for a bit of sport recently after all it said it won't affect my credit line which is fine as thankfully I don't use credit for loans anyway but I was intrigued with the result I got APR (fees and interest included): 6.9% Monthly payment: £446.48 Total repayable amount: £10,715.52 that was on £10000 over 24 months. There were higher rates on longer terms too. I'm not sure that I have ever managed better than 6.3% in the 5Y back in January this year and Mrs Aju managed some 6.6% loans in the 5Y back in March too. I think those days maybe over now, or at least until things settle down and we get a handle on the workings and anomalies of the new lending queues etc. They are all still live so thats good for us.
|
|
robski
Member of DD Central
Posts: 772
Likes: 462
|
Post by robski on Oct 7, 2019 16:00:40 GMT
Already seems like things might be very different in the age of the new markets. I don't get why lend rate and borrow rate are both 2.9% so often now either. Thing is though is with the lend rate @ 2.9% then how is RS making any money if at all. On Zopa one can see both the borrower rate and the Lend rate and hence the zone of profit rates that Zopa is using. RS must be doing a similar thing in that they have to have some borrowers that are quite a bit higher than the lend rates especially now they are more fixed. I tried borrowing for a bit of sport recently after all it said it won't affect my credit line which is fine as thankfully I don't use credit for loans anyway but I was intrigued with the result I got APR (fees and interest included): 6.9% Monthly payment: £446.48 Total repayable amount: £10,715.52 that was on £10000 over 24 months. There were higher rates on longer terms too. I'm not sure that I have ever managed better than 6.3% in the 5Y back in January this year and Mrs Aju managed some 6.6% loans in the 5Y back in March too. I think those days maybe over now, or at least until things settle down and we get a handle on the workings and anomalies of the new lending queues etc. They are all still live so thats good for us. I tried some similar playing around myself a couple of years ago when getting a new car. Needed to take PCP to get 000s from the manufacturer, so decided to see if I should keep the loan or pay it off. (decided to keep as rate to pay well under what I was getting back in returns) RS loan was silly APR for me, I could get 3.x% in plenty of places, yet RS was similar to you, 6.9 or 7.9% something like that. I was very surprised. In the end I went with ZOPA at 3.1%, still have it now actually, but planning to take some RS capital & interest and pay it down early. Was supposed to be using my ZOPA to repay as they came in but never got round to it. Down to 1 ZOPA (lending) loan left now, I just need that to repay and I have no lendings left. Oddly I was kinda getting itchy for a new motor a month ago after I logged into ZOPA (wrong account) so a banner popped up to say want to borrow more? I thought well lets have a look, new rate was terribad. Very odd indeed. Yet I still have places like Nationwide, Santander offering low rates 3% or so. So seems ZOPA now think I am a bad risk. Luckily the rate was so bad I laughed and logged out so I could log into the right account, and forgot all about the new car idea.
|
|
|
Post by cinereus on Oct 8, 2019 12:00:12 GMT
Already seems like things might be very different in the age of the new markets. I don't get why lend rate and borrow rate are both 2.9% so often now either. Thing is though is with the lend rate @ 2.9% then how is RS making any money if at all. On Zopa one can see both the borrower rate and the Lend rate and hence the zone of profit rates that Zopa is using. RS must be doing a similar thing in that they have to have some borrowers that are quite a bit higher than the lend rates especially now they are more fixed. I tried borrowing for a bit of sport recently after all it said it won't affect my credit line which is fine as thankfully I don't use credit for loans anyway but I was intrigued with the result I got APR (fees and interest included): 6.9% Monthly payment: £446.48 Total repayable amount: £10,715.52 that was on £10000 over 24 months. There were higher rates on longer terms too. I'm not sure that I have ever managed better than 6.3% in the 5Y back in January this year and Mrs Aju managed some 6.6% loans in the 5Y back in March too. I think those days maybe over now, or at least until things settle down and we get a handle on the workings and anomalies of the new lending queues etc. They are all still live so thats good for us. I always assumed the quoted rates aren't the actual rates they are taking - they are artificial (calculated in some way). Clearly their has always been much more than 0.1% in each market and you can see this if you apply for loans yourself.
|
|
aju
Member of DD Central
Posts: 3,484
Likes: 917
|
Post by aju on Oct 8, 2019 13:32:43 GMT
Thing is though is with the lend rate @ 2.9% then how is RS making any money if at all. On Zopa one can see both the borrower rate and the Lend rate and hence the zone of profit rates that Zopa is using. RS must be doing a similar thing in that they have to have some borrowers that are quite a bit higher than the lend rates especially now they are more fixed. I tried borrowing for a bit of sport recently after all it said it won't affect my credit line which is fine as thankfully I don't use credit for loans anyway but I was intrigued with the result I got APR (fees and interest included): 6.9% Monthly payment: £446.48 Total repayable amount: £10,715.52 that was on £10000 over 24 months. There were higher rates on longer terms too. I'm not sure that I have ever managed better than 6.3% in the 5Y back in January this year and Mrs Aju managed some 6.6% loans in the 5Y back in March too. I think those days maybe over now, or at least until things settle down and we get a handle on the workings and anomalies of the new lending queues etc. They are all still live so thats good for us. I always assumed the quoted rates aren't the actual rates they are taking - they are artificial (calculated in some way). Clearly their has always been much more than 0.1% in each market and you can see this if you apply for loans yourself. Yes otherwise how does RS monetise their platform that they provide for us to make money and borrowers to borrow. As i say on Zopa you can see the spread and it can be as high as 9% and as low as 0.5% based on my current zopa invest data. (assuming that the lend rate and the borrower rate are accurate of course) not sure if there are other fees involved and not sure if the above figures have accounted for my early adopter bonus of 0.5% as well. I suspect that where the 0.5% comes from but without checking for the same loans on Mrs Aju's account I can't be sure. at one time most of the loans detailed a 1.0% minimum spread whcih would have be the original 1% fee. One cannot see this much detail in RS but it has to be a similar approach as you elude to..
|
|