|
|
Post by steveit on Aug 9, 2020 11:37:55 GMT
Hi,
My first post but been reading for a few months, since the current problems started.
I check manually daily, sometimes multiple times, to see if there is money to be withdrawn. Partly to stop it being re-invested (even with my Access at 8%), partly to keep track of withdrawal stats, partly because I can!
Has anyone built an automated/screen-scraping way of checking? Or know of an API RS have to make this easier? I screen-scrape using node-red or other technologies on other websites but it looks like RS use ASP.net forms with Viewstate to login, meaning it's trickier.
(BTW, if I do get something working without locking out my account, I'll post it).
Thanks to everyone who posts on this board, it's useful.
FWIW, my stats are 33% returned from Access, with request made 15/3 and 1,145 ahead of me.
Regards,
Steve
|
|
tjtl
Posts: 232
Likes: 351
|
Post by tjtl on Aug 9, 2020 11:53:38 GMT
Steve
Welcome to the Board. Cannot help you with the technology, but good to see you posting rather than just reading- as you will have seen a number of us post with (at times) little to say of great insight, but there is a stack of knowledge shared by users- and as P2P goes through a transformation/ re-set/ death-throes (take your pick) this site will only continue to have any use if new posts are created. So don't be shy!
|
|
aju
Member of DD Central
Posts: 3,500 
Likes: 924
|
Post by aju on Aug 9, 2020 11:54:54 GMT
Hi, My first post but been reading for a few months, since the current problems started. I check manually daily, sometimes multiple times, to see if there is money to be withdrawn. Partly to stop it being re-invested (even with my Access at 8%), partly to keep track of withdrawal stats, partly because I can! Has anyone built an automated/screen-scraping way of checking? Or know of an API RS have to make this easier? I screen-scrape using node-red or other technologies on other websites but it looks like RS use ASP.net forms with Viewstate to login, meaning it's trickier. (BTW, if I do get something working without locking out my account, I'll post it). Thanks to everyone who posts on this board, it's useful. FWIW, my stats are 33% returned from Access, with request made 15/3 and 1,145 ahead of me. Regards, Steve Good luck, Perhpas with RS not being quite so interested in screen changes it might work. to be honest. I have funds dropping through on all our accounts and I certainly have funds being pushed out - I have the 5Y/1Y set to relend at 10% not sure new ones can do that anymore.(I have some £10 punts in there to maintain the accounts access to these products as there are more tools available than only those with A/P/M (new products) have available. Anyway I usually make it part of my routine once in the morning and once in the evening to just log into our accounts, I manage Mrs Aju as well for her (She's not very interested unless we are losing money!). I can do this within a couple of minutes for RS slightly longer if I have to remove new items from the lending queues (I also do Zopa as well similarly but that's a bit slower but I just use direct links for that one. Again despite how slow Zopa is I can usually do this very quickly.) My question would be the amount of effort you might have to expend and also cope with RS changes to their screens might make it quite restrictive time wise and benefit wise but hey if you are into that sort of thing I guess one has to also consider the fun and pleasure one can get circumventing websites. (I am very fond of using chrome inspect to convert most publishing websites grey text to raw black as its easier for people like me to read (I'm getting on in years sighte wise). I also didn't like the layouts in a lot of sites and in particular RS colours and tablet mode layouts so I use "stylus" and other extensions to counter site settings - That's how I know they are changing things so regularly as its usually shows up on my adjustments.
|
|
|
|
Post by steveit on Aug 9, 2020 16:56:02 GMT
Yes, it's become my morning routine with a coffee (and that of many I suspect), that "log in, check money to be withdrawn, check position of RYI in the queue, log it to Excel", that last step maybe not everyone does. Hardly essential to automate I agree, but it is the kind of thing I'm into I suppose (and as it's now 5 months since I've been stuck outside the UK waiting to return due to the virus, I am tending to try to find things to do...).
Same for me with Zopa too, if I can log in without the "Techies at work" which seems to pop-up most morning for me nowadays.
I'll post again if I get anywhere...
|
|
|
|
Post by nebula on Sept 4, 2020 9:20:18 GMT
Hi, My first post but been reading for a few months, since the current problems started. I check manually daily, sometimes multiple times, to see if there is money to be withdrawn. Partly to stop it being re-invested (even with my Access at 8%), partly to keep track of withdrawal stats, partly because I can! Has anyone built an automated/screen-scraping way of checking? Or know of an API RS have to make this easier? I screen-scrape using node-red or other technologies on other websites but it looks like RS use ASP.net forms with Viewstate to login, meaning it's trickier. (BTW, if I do get something working without locking out my account, I'll post it). Thanks to everyone who posts on this board, it's useful. FWIW, my stats are 33% returned from Access, with request made 15/3 and 1,145 ahead of me. Regards, Steve You can do this if you're familiar with curl and grep. Get the full curl url (with session and everything) from your browser's dev tool then grep it for the part you need.
|
|
aju
Member of DD Central
Posts: 3,500
Likes: 924
|
Post by aju on Sept 4, 2020 10:34:04 GMT
Hi, My first post but been reading for a few months, since the current problems started. I check manually daily, sometimes multiple times, to see if there is money to be withdrawn. Partly to stop it being re-invested (even with my Access at 8%), partly to keep track of withdrawal stats, partly because I can! Has anyone built an automated/screen-scraping way of checking? Or know of an API RS have to make this easier? I screen-scrape using node-red or other technologies on other websites but it looks like RS use ASP.net forms with Viewstate to login, meaning it's trickier. (BTW, if I do get something working without locking out my account, I'll post it). Thanks to everyone who posts on this board, it's useful. FWIW, my stats are 33% returned from Access, with request made 15/3 and 1,145 ahead of me. Regards, Steve You can do this if you're familiar with curl and grep. Get the full curl url (with session and everything) from your browser's dev tool then grep it for the part you need. Mrs aju said I've already got a full curl now my hair is growing back during lockdown ... 
|
|
|
|
Post by steveit on Sept 4, 2020 10:41:29 GMT
Hi, My first post but been reading for a few months, since the current problems started. I check manually daily, sometimes multiple times, to see if there is money to be withdrawn. Partly to stop it being re-invested (even with my Access at 8%), partly to keep track of withdrawal stats, partly because I can! Has anyone built an automated/screen-scraping way of checking? Or know of an API RS have to make this easier? I screen-scrape using node-red or other technologies on other websites but it looks like RS use ASP.net forms with Viewstate to login, meaning it's trickier. (BTW, if I do get something working without locking out my account, I'll post it). Thanks to everyone who posts on this board, it's useful. FWIW, my stats are 33% returned from Access, with request made 15/3 and 1,145 ahead of me. Regards, Steve You can do this if you're familiar with curl and grep. Get the full curl url (with session and everything) from your browser's dev tool then grep it for the part you need. Thanks. Sure, curl and grep would be fine, it's just getting past the login screen with the ASP.net viewstate data (it has to be posted back between requests that makes it a bit more complicated - and I'd rather not get my account locked out in trying.). Think I'll drop them a quick email to see if there's an API.
|
|
|
|
Post by nebula on Sept 4, 2020 12:58:46 GMT
You can do this if you're familiar with curl and grep. Get the full curl url (with session and everything) from your browser's dev tool then grep it for the part you need. Thanks. Sure, curl and grep would be fine, it's just getting past the login screen with the ASP.net viewstate data (it has to be posted back between requests that makes it a bit more complicated - and I'd rather not get my account locked out in trying.). Think I'll drop them a quick email to see if there's an API.
Once you login and take the curl request from your browser, the call will keep working as long as you don't login with your browser again. Doing so invalidates the previous session. I was going to think about it a bit more but now that I'm mostly RYI'd, I have less interest in it. For the record, here's what I tried before (this one returns money in your holding account):
curl summary-page | grep -A 6 'Holding Account' | tail -1 | xargs | cut -d'<' -f 1`
Worth asking for API. I wouldn't be surprised if they made the curl approach more difficult. If they really wanted us to cancel requests frequently they would have given us a built-in functionality to do so.
|
|
|
|
Post by james91 on Sept 4, 2020 17:09:44 GMT
Would be very surprised if they have an API they'd be willing to share.
Do funds actually get deposited in the holding account during the day? I check daily about 7.30am, and it has always come through by that point. I don't bother checking again, as I assumed it gets done in a batch during the night/early morning?
|
|
star dust
Member of DD Central
Posts: 2,998
Likes: 3,531
|
Post by star dust on Sept 4, 2020 20:00:21 GMT
Would be very surprised if they have an API they'd be willing to share. Do funds actually get deposited in the holding account during the day? I check daily about 7.30am, and it has always come through by that point. I don't bother checking again, as I assumed it gets done in a batch during the night/early morning? Most of the ordinary repayment run returns are done by early morning, sometimes the 5 year (being the last one) will take until late evening or even early hours of the following day on days like 1 September just after the bank holiday, but that's increasingly rare these days, and it all seems to have speeded up overall in my experience. However, early repayments can arrive almost at any time during the day I had one early afternoon today - luckily I knew it was about to arrive as I noticed a loan had a zero set on the months remaining and a repayment date re-set to today, but hadn't paid into my account by the end of today's A/P/M payment run. I've made the withdrawal request for the lot now.
|
|
