Regarding Recent Downtime (03/02/17 - 03/03/17)

Status

Mick

BuiltByBit Owner
Management
Feedback score
28
Posts
6,413
Reactions
7,704
Resources
0
Hello there everyone,
Recently MC-Market has been experiencing significant issues along with many other websites and these have been due to issues with our hosting provider for the site; Amazon Web Services.

This has resulted in us having several hours of downtime and extremely slow loading speeds for the site over the past 48 hours or so. We apologise for the time that we have been down and are hopeful that problems like these won’t occur in the future, but the downtime has been completely out of our hands. It has now been fixed.

Once again I’d like to apologise to everyone this has affected.
Mick
 
PebbleHost
High performance, consistent uptime and fast support. Minecraft hosting that just works.

Toler

Feedback score
0
Posts
230
Reactions
69
Resources
0
It's still REALLY slow for me. I'm still getting those "CloudFront" errors now and then.
 
Last edited:

Mick

BuiltByBit Owner
Management
Feedback score
28
Posts
6,413
Reactions
7,704
Resources
0
It's still REALLY slow for me. I'm still getting those "CloudFront" errors now and then.
Oh? From what I've seen it is back to normal for everyone else. Would you mind sending me a PM?
 

Themindshaper

Mystic PvP Owner ★Plugin Configurator★
Supreme
Feedback score
5
Posts
65
Reactions
24
Resources
0
It's still really slow loading for me too

Edit: Back to normal now, was having issues 10 mins ago but they appear to be fixed.
 

Wvisoecj

Supreme
Feedback score
9
Posts
471
Reactions
677
Resources
0
I saw some tweets yesterday about AWS being down.
Yea AWS had a major outage yesterday but it was only for a couple hours. After that no reported AWS instances were down. Which is why I'm asking why d3l3t3d is saying AWS has been down when it hasnt.
 
Last edited:

Ivain

Master Terraformer
Supreme
Feedback score
45
Posts
9,610
Reactions
4,888
Resources
0
I can comfirm there was something with AWS, as far as I know PMC also uses it and they've been having trouble as well
 

Spotters

Minecraft Server Owner
Supreme
Feedback score
4
Posts
175
Reactions
37
Resources
0
"only"[DOUBLEPOST=1488539195][/DOUBLEPOST]"only"
 

Phineas

phineas.io
Premium
Feedback score
8
Posts
281
Reactions
124
Resources
0
Would you like me to take a look? I've used AWS CloudFront & GCE before & I also used to have leakage errors within the CDN service.
 

d3l3t3d

d3l3t3d
Feedback score
0
Posts
13
Reactions
43
Resources
0
Hi,

So. Yes there was the main public component to the AWS outage. A typo, as it now turns out. However there is no doubt in my mind that there has been some continual flow on effect that hasn't been listed. I know that the status page states that it is operating normally, but it hasn't been.

This is a graph of 5xx connection errors on our cloudfront distribution. http://prntscr.com/efiobm. In UTC.

Case in point, i just tried to login into the console again to get some data and I can't. So there is still stuff going on that I can't substantiate as their notices say that everything is good.

I have and am doing what I can to make sure everything is as it should be. I really don't do this stuff on purpose. It truly isn't fun reading the stuff that gets pushed through the SB.
 
Last edited:

EpicFooF

Digital Artist
Premium
Feedback score
13
Posts
1,438
Reactions
520
Resources
2
Its still slow for me. Nothing has been fixed.
I keep receiving messages like "we are doing maintenance" or "mcm is down" or "server could not respond in time".
This hasnt been fixed at all.
 

HM04

Computer Science and Finance Student
Premium
Feedback score
3
Posts
544
Reactions
269
Resources
0
Okay, the thing that bothers me is you continuously saying the issues are out of your hands. We have not been experiencing extremely slow speeds for 48 hours or so, it's definitely been months. It's in your hands to make the wise management decision and move services.
 

Fire

Always DM me here before dealing via Discord.
Supreme
Feedback score
74
Posts
3,045
Reactions
1,745
Resources
0
+1 Mick For making a post about the downtime, if this is the start of keeping us informed, then im sure alot more of us will begin to understand. I hate downtime as much as anyone (Probably more so) however if its out of your hands then there is nothing that can be done.

d3l3t3d as system admin you will get blamed for everything (Just seems to be how it is), though if you and Mick keep making posts like this, people will begin to realise that its not you that keeps "breaking for forum" and there are external factors (AWS issues, attacks, etc) at play causing downtime and other problems. Perhaps some day people will be see you as the person that fixes everything, rather then the one that causes it.

Though the one thing im unable to understand is why these problems keep happening, slowless, errors and downtimes are all something that happens multiple times a week, sometimes even daily. Im trying to keep as open mided as possible, but im not sure how problems like this happen so often. It cant be AWS all the time or you would have switched providers. If you could shed some light on that, that would be great.

At the time of posting this, the forum is been quite slow and very buggy with constant error messages.
 

d3l3t3d

d3l3t3d
Feedback score
0
Posts
13
Reactions
43
Resources
0
Hi Fire,

Thanks for the post, well structured and balanced. I appreciate that.

Your question around understanding, is valid and very accurate. They are not all AWS issues. I will try and list in brief what has happened. If you would like to know anything in more detail, please contact me directly.

Once we had gotten past the first month and has some stability, we had some additions to the site. The onyx plugin being the main one, and few other minor things. Due to the DDoS stuff that was also going on at the time, I was still in the process of fine tuning some of the protection mechanisms. One of the functions I was building was a rate blocker, so when onyx came along, it tipped my first rate blocker over the edge. Onyx was implemented around the 1st of Jan. 4 weeks after I had been given the job of moving and running the site. So that is what caused that issues around the first on Jan.

We have had other numerous changes between now and then that have also had their own contributing issues.

.......to be continued. Sorry I have leave, but I did want to answer your post, and will finish it off a bit later. So I will post this bit at least.
 
Last edited:
Status
Top