What is the Sites connection speed?
08-29-2004, 12:05 PM
#2
Registered User
Join Date: Oct 2000
Location: Seattle, WA
Posts: 2,108
Likes: 0
Received 0 Likes
on
0 Posts
We're probably using 10% of available bandwidth 
. The bottleneck is the database. Cthree worked wonders last night and got replication setup, now all we have to do is tune the damn thing.
. The bottleneck is the database. Cthree worked wonders last night and got replication setup, now all we have to do is tune the damn thing.
08-29-2004, 12:27 PM
#3
Administrator
Originally Posted by Jonesy,Aug 29 2004, 01:01 PM
Hey, what is the connection to the site right now? And is that the bottleneck when lots of people get on?
08-29-2004, 01:11 PM
#4
Administrator
100Mbps
Edit: There is no one specific bottleneck, the problems of dealing with a site to big yet so small are more complex than that. A forum based site with 1000 members, 100-200 thousand posts and 50-80 users online would be considered average. This accounts for probably 90% of all the forums out there. The problems occur when you scale that up 10x. Tons of little things on a normal site that you wouldn't even notice become magnified many times over. There are probably a list of 100 complications we've had to deal with that a normal site would never have to deal with.
The software that runs the site is designed for the median which is to say we fall on the bleeding leading edge. s2ki is the largest site using the software we use and that means we get to find and deal with all of the issues related to scale. There are other sites of a larger size, say hondatech, which don't have as many issues of scale chiefly because their software tends to be much more simple. We started with a feature rich system and continue as best we can manage it remain feature rich. Everything comes at a cost. Compare the amount of detail sites running zeroforums to ours and then consider that all those rich features come at the price of database accesses and CPU power.
Managing the growth of the system is a big job and a big pain in the arse but it keeps us busy and you guys complaining. It will never end until s2ki.com stops growing and I don't expect that to happen anytime soon.
Edit: There is no one specific bottleneck, the problems of dealing with a site to big yet so small are more complex than that. A forum based site with 1000 members, 100-200 thousand posts and 50-80 users online would be considered average. This accounts for probably 90% of all the forums out there. The problems occur when you scale that up 10x. Tons of little things on a normal site that you wouldn't even notice become magnified many times over. There are probably a list of 100 complications we've had to deal with that a normal site would never have to deal with.
The software that runs the site is designed for the median which is to say we fall on the bleeding leading edge. s2ki is the largest site using the software we use and that means we get to find and deal with all of the issues related to scale. There are other sites of a larger size, say hondatech, which don't have as many issues of scale chiefly because their software tends to be much more simple. We started with a feature rich system and continue as best we can manage it remain feature rich. Everything comes at a cost. Compare the amount of detail sites running zeroforums to ours and then consider that all those rich features come at the price of database accesses and CPU power.
Managing the growth of the system is a big job and a big pain in the arse but it keeps us busy and you guys complaining. It will never end until s2ki.com stops growing and I don't expect that to happen anytime soon.
08-29-2004, 02:36 PM
#5
Well, I for one am not complaining about that explanation, Erik. Thanks...
08-30-2004, 07:35 AM
#7
Originally Posted by cthree,Aug 29 2004, 01:11 PM
100Mbps
Edit: There is no one specific bottleneck, the problems of dealing with a site to big yet so small are more complex than that. A forum based site with 1000 members, 100-200 thousand posts and 50-80 users online would be considered average. This accounts for probably 90% of all the forums out there. The problems occur when you scale that up 10x. Tons of little things on a normal site that you wouldn't even notice become magnified many times over. There are probably a list of 100 complications we've had to deal with that a normal site would never have to deal with.
The software that runs the site is designed for the median which is to say we fall on the bleeding leading edge. s2ki is the largest site using the software we use and that means we get to find and deal with all of the issues related to scale. There are other sites of a larger size, say hondatech, which don't have as many issues of scale chiefly because their software tends to be much more simple. We started with a feature rich system and continue as best we can manage it remain feature rich. Everything comes at a cost. Compare the amount of detail sites running zeroforums to ours and then consider that all those rich features come at the price of database accesses and CPU power.
Managing the growth of the system is a big job and a big pain in the arse but it keeps us busy and you guys complaining. It will never end until s2ki.com stops growing and I don't expect that to happen anytime soon.
Edit: There is no one specific bottleneck, the problems of dealing with a site to big yet so small are more complex than that. A forum based site with 1000 members, 100-200 thousand posts and 50-80 users online would be considered average. This accounts for probably 90% of all the forums out there. The problems occur when you scale that up 10x. Tons of little things on a normal site that you wouldn't even notice become magnified many times over. There are probably a list of 100 complications we've had to deal with that a normal site would never have to deal with.
The software that runs the site is designed for the median which is to say we fall on the bleeding leading edge. s2ki is the largest site using the software we use and that means we get to find and deal with all of the issues related to scale. There are other sites of a larger size, say hondatech, which don't have as many issues of scale chiefly because their software tends to be much more simple. We started with a feature rich system and continue as best we can manage it remain feature rich. Everything comes at a cost. Compare the amount of detail sites running zeroforums to ours and then consider that all those rich features come at the price of database accesses and CPU power.
Managing the growth of the system is a big job and a big pain in the arse but it keeps us busy and you guys complaining. It will never end until s2ki.com stops growing and I don't expect that to happen anytime soon.
Thread
Thread Starter
Forum
Replies
Last Post