RBS fcuk up....
27 June 2012, 12:02 AM
#31
Too right there will be a lot of pissed off customers, I would be if I were in their shoes. It must be a nightmare for those affected by this.
I wonder, as I haven't read a lot about this, but will people end up having their credit rating damaged as a result?
27 June 2012, 07:37 AM
#33
Scooby Regular
Don't mean to start an argument but having worked for various banks and building societies in I.T support roles on mainframes, midrange and distributed system, i.e. most of them, I'd like to point out that the above is complete nonsense, apparently paraphrasing The Register's explanation.
It's an unfortunate situation I agree but it's not like other large companies dont have outages. Power cuts, hose pipe bans, oil spills, gas plant explosions, tube strikes, train crashes, postal strikes, etc etc.
Frankly it's remarkable that there hasn't been a major I.T. Outage at a bank before now. I don't remember one in my 23 year financial I.T. Career so far.
I work for lloyds by the way, as a permie.
It's an unfortunate situation I agree but it's not like other large companies dont have outages. Power cuts, hose pipe bans, oil spills, gas plant explosions, tube strikes, train crashes, postal strikes, etc etc.
Frankly it's remarkable that there hasn't been a major I.T. Outage at a bank before now. I don't remember one in my 23 year financial I.T. Career so far.
I work for lloyds by the way, as a permie.
Yep, just my view based on a few decades in corporate IT, I don't get my opinions from the register, I never read it tbh
27 June 2012, 08:21 AM
#34
Scooby Regular
Join Date: May 2002
Location: Liverpool
Posts: 3,229
Likes: 0
Received 0 Likes
on
0 Posts
I've also worked in IT for Banks for the past 15 years, I now work for Santander and the change process for any IT related changes is the most rigorous I've ever seen, the processes we have to go through for the smallest of changes is very time consuming.
It was a similar process in Alliance & Leicester and the Co-operative Bank, obviously not the same in RBS.
Although I'm working on a massive project with RBS at the moment and I always had the impression they were process driven to the extreme!!
Feel sorry for the people who survive from week to week and are affected by this.
It was a similar process in Alliance & Leicester and the Co-operative Bank, obviously not the same in RBS.
Although I'm working on a massive project with RBS at the moment and I always had the impression they were process driven to the extreme!!
Feel sorry for the people who survive from week to week and are affected by this.
27 June 2012, 09:21 AM
#35
Scooby Senior
Join Date: Dec 2000
Location: North Wales
Posts: 5,826
Likes: 0
Received 0 Likes
on
0 Posts
I've also worked in IT for Banks for the past 15 years, I now work for Santander and the change process for any IT related changes is the most rigorous I've ever seen, the processes we have to go through for the smallest of changes is very time consuming.
It was a similar process in Alliance & Leicester and the Co-operative Bank, obviously not the same in RBS.
Although I'm working on a massive project with RBS at the moment and I always had the impression they were process driven to the extreme!!
Feel sorry for the people who survive from week to week and are affected by this.
It was a similar process in Alliance & Leicester and the Co-operative Bank, obviously not the same in RBS.
Although I'm working on a massive project with RBS at the moment and I always had the impression they were process driven to the extreme!!
Feel sorry for the people who survive from week to week and are affected by this.
When you are backing out a change like that, you will have sufficient access to do stuff like that, you have to, it was simply human error. No amount of process will stop that, ever.
I haven't worked on CA7 for about 10 years, but IIRC it wouldn't be that hard to nobble it in a situation like this.
Geezer
27 June 2012, 09:27 AM
#36
Scooby Regular
Join Date: May 2002
Location: Liverpool
Posts: 3,229
Likes: 0
Received 0 Likes
on
0 Posts
Well they obviously didn't dry run the backout process enough to verify
a) it worked
b) caused no unforeseen issues
Something like that should be documented to the letter.
a) it worked
b) caused no unforeseen issues
Something like that should be documented to the letter.
27 June 2012, 10:04 AM
#37
Scooby Senior
Join Date: Dec 2000
Location: North Wales
Posts: 5,826
Likes: 0
Received 0 Likes
on
0 Posts
I respectfully disagree 
The backout process may well have been through a dry run, or even done on their test systems. I believe what they did was just delete the wrong file or restore the wrong file. It could have been a simple typo, we've all done it.
The question then is, once the mistake is made, how they handled it, and that, I believe, is where it all fell down. And that's where the question of experience comes in, and RBS has got rid of most (if not all) that experience in favour of offshore resource.
Geezer
The backout process may well have been through a dry run, or even done on their test systems. I believe what they did was just delete the wrong file or restore the wrong file. It could have been a simple typo, we've all done it.
The question then is, once the mistake is made, how they handled it, and that, I believe, is where it all fell down. And that's where the question of experience comes in, and RBS has got rid of most (if not all) that experience in favour of offshore resource.
Geezer
27 June 2012, 10:29 AM
#38
Scooby Regular
Join Date: Mar 2010
Posts: 10,329
Likes: 0
Received 0 Likes
on
0 Posts
It's being blamed on some junior Indian who wiped some data by accident.
http://www.telegraph.co.uk/finance/p...-in-India.html
http://www.telegraph.co.uk/finance/p...-in-India.html
27 June 2012, 10:32 AM
#39
Scooby Senior
Join Date: Jun 2006
Location: RIP - Tam the bam & Andy the Jock
Posts: 14,333
Likes: 0
Received 0 Likes
on
0 Posts
27 June 2012, 11:36 AM
#40
Scooby Regular
Join Date: May 2002
Location: Liverpool
Posts: 3,229
Likes: 0
Received 0 Likes
on
0 Posts
I respectfully disagree
The backout process may well have been through a dry run, or even done on their test systems. I believe what they did was just delete the wrong file or restore the wrong file. It could have been a simple typo, we've all done it.
The question then is, once the mistake is made, how they handled it, and that, I believe, is where it all fell down. And that's where the question of experience comes in, and RBS has got rid of most (if not all) that experience in favour of offshore resource.
Geezer
The backout process may well have been through a dry run, or even done on their test systems. I believe what they did was just delete the wrong file or restore the wrong file. It could have been a simple typo, we've all done it.
The question then is, once the mistake is made, how they handled it, and that, I believe, is where it all fell down. And that's where the question of experience comes in, and RBS has got rid of most (if not all) that experience in favour of offshore resource.
Geezer
That's when you need people who can think on their feet, and fast!!
27 June 2012, 12:47 PM
#41
Scooby Regular
Join Date: May 2002
Location: Pot Belly HQ
Posts: 16,694
Likes: 0
Received 0 Likes
on
0 Posts
I'm not happy. That bunch of jokers charge me a fortune to accept credit and debit card payments. Nearly a week on since putting my last transactions through, and I'm still waiting to receive the funds.
27 June 2012, 04:03 PM
#42
It's being blamed on some junior Indian who wiped some data by accident.
http://www.telegraph.co.uk/finance/p...-in-India.html
http://www.telegraph.co.uk/finance/p...-in-India.html
All part of cost cutting initiatives that started a few years ago, get rid of "expensive" permie staff and bring in cheaper outsourced partners who promise more than they can ever hope to deliver. Only now it's not so cheap but actually more expensive and with a lot poorer service.
27 June 2012, 04:31 PM
#44
27 June 2012, 06:42 PM
#47
Scooby Regular
Join Date: Feb 1999
Location: Cardiff. Wales
Posts: 11,758
Likes: 0
Received 0 Likes
on
0 Posts
27 June 2012, 09:00 PM
#50
Scooby Regular
Join Date: May 2002
Location: Pot Belly HQ
Posts: 16,694
Likes: 0
Received 0 Likes
on
0 Posts
Currently over a grand that Sagepay processed that has yet to make it to my account via Natwest. Times are hard enough for start-ups, this really doesn't make things any easier.
28 June 2012, 09:43 AM
#58
Scooby Senior
Join Date: Dec 2000
Location: North Wales
Posts: 5,826
Likes: 0
Received 0 Likes
on
0 Posts
Well, we run about 70k jobs a day on our main system, so imagine trying to run that manually, with all the correct inputs and inter-dependencies. It's not hard to imagine just how much **** they were in.
I bet some overtime has been earned there this last week!
Geezer
