Posted by William Charles on February 7, 2019
Uncategorized

Published on February 7th, 2019 | by William Charles

32

Wells Fargo Suffering Online, Mobile Banking & ATM Outage Due To Smoke At Server Farm

Update: Systems and services have now been restored, but expect intermittent issues.

If you’ve tried to use Wells Fargo online or mobile banking or a Wells Fargo ATM today then chances are it won’t have worked. This is as a result of a smoke at a server farm in Shoreview, Minnesota. Due to this farm servers have been shut down leading to this large outage.

Some media outlets are reporting that the shut down is due to a fire rather than just smoke, but the official Wells Fargo twitter account only mentions smoke (although there is the old saying where there is smoke there is fire).

What’s worrying is that because this is an isolated incident it appears that Wells Fargo doesn’t have any in built redundancy if one server farm goes down. It seems ridiculous that all of the Wells Fargo server assets for online, mobile and ATM banking is located in a single server farm.  Normally for essential services such as this you’d have the load spread out over multiple different physical locations with additional resources available if one or more of those experiences downtime. Interestingly enough there are a number of people on reddit claiming to have first hand knowledge of what is currently occurring.



32
Leave a Reply

avatar
 

  Subscribe  
newest oldest most voted
Notify of
Andrew
Andrew

First the propel outage issue now this? Maybe they need to spend some money on servers

Stan
Stan

personally i am shocked that such a problem could befall a fine prestigious well-run respected institution as Wells Fargo

Hari
Hari

Well respected institution that lost hundreds of people their home because of their mistake?
Bankers opened accounts by themselves without asking?
Just couldn’t find a well respected news from them lately.

TomT
TomT

I am sure the comment above was satirical.

J. Sarayda Shapiro
J. Sarayda Shapiro

Wells Fargo sold my account to Flagstar, and now neither Wells Fargo or Flagstar can find my account. I had already zeroed out the account, but what do you bet Glagstar starts charging me fees for going negative? In this sort of situation, all I can do is …. sing

[Sung to the tune of “Wells Fargo Wagon” from _The Music Man_]
Oh, oh, the Wells Fargo Bank is a cheatin’ someone!
I wonder who in the world it could be?
Oh, they might cheat someone who is no relation,
But they might cheat, someone special
(Very, very special)
Namely me!!!

Ann
Ann

The transition did have a lot of problems a couple months ago, have they still not resolved it for you? https://www.bankrate.com/banking/flagstar-wells-fargo-account-failure/
If you’re still waiting after 2 months, time to file a CFPB complaint.

bax
bax

Worse than the lack of hardware / capacity redundancy is the human know-how redundancy. Many giants in the tech / financial industries really rely on an astoundingly small number of individuals with tribal knowledge NOT “getting hit by a bus”.

alvinroast
alvinroast

This is all too true. I recently had some serious issues with a travel company that couldn’t find my reservation with their own confirmation code. Then I remembered that this company was bought out by one of the largest travel companies in the world.

My college roommate (not a CS major) is kept on staff there because he’s the only one that understands how their older databases work. Perhaps I should check on him. I hope he didn’t get hit by a bus.

Josh
Josh

They really don’t have a failover data center? That’s ridiculous in 2019.

NinjaX
NinjaX

not if ur wells fargo. they still send letters via horseymen and carriages.

Liam
Liam

Hahahah

Joe
Joe

Yeah, it’s on their debit cards

Looney Tunes
Looney Tunes

Was able to login online without a problem though running sluggish. Did see that my $150 promotion bonus posted, that’s all I wanted to do online anyways.

Josh
Josh

Actually received a text about 15 minutes ago saying my debit card was locked. Looks illegitimate. Possibly much more than “smoke”?

Yoni
Yoni

C-Suite executives had to look for new area’s to earn bonuses after losing bonuses based on new accounts(fake) an new product elections.

So a bonuses based on infrastructure & IT spending and savings materialized in Quarterly and Annual bonuse checks of C-Suite employees
hahahah

FWIW I Can access biz DDA accounts via mobile but not CC and a little banner on the acct summary page indicates as much, go thing that this is not my main business acct that I depend on for running my business.

Luke
Luke

Checking account applications are affected too. This morning I couldn’t get past entering a zipcode without it timing out. This afternoon/evening I’ve been able to fill out the app, but it times out when submitting.

Ann
Ann

Crazy long reddit thread. Here’s the actual ‘first-hand knowledge’ bit: https://www.reddit.com/r/sysadmin/comments/ao4g2y/wells_fargo_is_down_declining_transactions_and_no/efy6wch/

” Throwaway since I have first hand knowledge. Fire suppression went off in one of their main Data Centres from some utility work this morning. No power to any of the network or compute equipment and some failovers did not work as expected.

​Edit: I’ve gotten a number of DMs asking for updates over the last few hours – so for those interested the last I heard (15-20 min ago) was that everything minus core network gear was manually being unplugged from any PDUs to help the control the initial power-on. No ETA on when that will be finished, let alone when things will be back up. “

Flea
Flea

That’s ridiculous lol. Manual unplugging…??

Anna
Anna

I logged in around 2:45pm pacific time and the app was working for me, it was sluggish and took a bit to load but I was able to check my balance and activity.

jessica
jessica

My direct deposit didn’t go through last night, which it does every other Friday. I’m totally screwed as I was waiting on that to pay off my credit cards. It’s my only checking account. I think I just learned a lesson.

Steve

They’re saying that deposits actually posted, they’re just not displaying on their website yet. (And that problem might be fixed now.)

Rob
Rob

Still can’t activate a new debit card. Almost 24 hours since I began having problems. I feel bad for those who use as their main account.

Austin
Austin

When I logged onto my Wells Fargo account this morning it asked me to verify a 2nd email address linked to my checking and savings accounts. It was almost exactly the same as my only email account but a few letters were different. I of course said the email was not correct and deleted it. Makes me wonder if some accounts were hacked/compromised during their technical issues. These are not my main checking and savings accounts but it’s still very concerning.

Dylan
Dylan

Whats the worst out of the two:

1. Citi’s IT?

2. wells fargos scandals?

People think im a bad person for churning, but I would argue im just punching back for everything the bank has raped me with.

Cameron
Cameron

Last week my wells fargo business card number was used in a fraudulent airbnb transaction. hmmm. Good news is my state tax refund is appeared in my checking account.

Mike
Mike

interesting. I had the same thing happen about 3 weeks ago (wells fargo business CC used in a fraudulent airbnb transaction). I had only used the card a few times at giftcardmall last summer in order to earn the sign-up bonus. Card was in my possession at all times and no one else had access to it. So it seems either Wells Fargo or giftcardmall has been hacked.

Cameron
Cameron

wells fargos been hacked. I have never used giftcardmall. I used mine april and may of 2018 for the bonus and its been in my possession ever since.

Back to Top ↑