Skip to main content.
November 10th, 2009

netfirms hosting and cgi concurrency limits

I find hosting a confusing area, so I’m sure other less less technical people will really struggle to understand some of the problems that you can encounter.

I started off hosting this site on a small shared hosting server… but as traffic grew, I found problems with shared hosting.

The biggest problem was that shared hosting is that you share all the computers resources with other websites.

This shouldn’t be an issue, except for the way most hosting servers split their resources.

Eg lets say the server is a 3000 Mhz, quad core processor (ie a totaly of 3000 X 4 = 12000 Mhz (12Ghz)

Now, if the server has 60 websites on it, then each website is effectively running on server that runs at 200Mhz.

So, as traffic builds, you start hitting all sorts of limits.

So, after guessing that my site will gradually increase traffic, but probably won’t have an exponential increase in traffic, I started looking at dedicated hosting (ie 1 computer per website), but that was too expensive considering the type of site that I had.

I then heard about clustered servers. These sounded like the the best of both worlds (and the way I initially thought servers worked): resources get allocated to your website as needed.

Ie during quiet times, your website uses minimal resources, which are then allocated to other websites. If your website suddenly needs more resources, they are allocated.

Obviously there needs to be limits, so that websites don’t abuse resources.

Despite some negative comments, I eventually settled on netfirms.com as my new website host, and I went with the “advantage” plan (ie, middle of the road… not the cheapest, but not the most expensive.

After a few months, I realised that there are some limits that are not mentioned on the website, that can affect a reasonable busy website like mine (average of 1800 page requests per day… which varies between 1100 and 3000 pages per day).

The first I noticed was that the control panel was not a standard CPanel found with most linux hosts. It took some getting used-to, and applications like wordpress were not at the most current version (usually many version “behind”).

Secondly, while making filesystem and domain-related changes, nothing seemed to happen. So I fired off a support request. A few hours later, I noticed my changes took effect… ah, so some changes take a long time to make their way through the system… that ok, now that I know what to expect…

But what happened to the support request?

A few days later, I got a terse reply, saying something like: oh, you seem to have fixed it yourself…

I also had trouble moving my forum to netfirms. Although they tried to help (in their slow way), I eventually had to give up, and remove the Computer Aid forum (no big loss, as it didn’t get much traffic anyway), but it shouldn’t have happened.

Thirdly, during the first 12 months after changing to netfirms, I would occasionally get computer-aid (and even netfirms) disappearing off the internet, and usually everything would go back to normal after 5 – 20 minutes…

Recently, it seems Netfirms have moved to a bigger datacentre… I wonder if they shouldn’t have done this sooner?

Nevertheless, I have noticed that my website occasionally displays the following error message: “CGI concurrency limit of 10 exceeded”.

Now I start to wonder: the “advantage” plan includes amazing limits like: 2,000 Gb of monthly bandwidth, 25-Gb of disk space, 30 mysql databases… but most of that is actually meaningless if a website can only have 10 CGI database connections at a time.

Of course if I want to increase the limit, I need to move up to the next plan.

If I knew that the limit existed, then at least I could have planned a move to a bigger plan… but I don’t like finding out about hidden limits… particularly when I find out because of errors on the website.

Since I have another 12 months to go with netfirms, I’ll use the time to research hosting companies, with the new knowledge that I also need to keep an eye on CGI concurrency.

I like the idea of VPS (Virtual Private Server) hosting, so I’ll look at that closely.

If I can’t find something suitable, then I might bite the bullet, and go with a dedicated server… but I still think its overkill for a site like computer-aid.

  • Share/Bookmark

Related posts:

  1. Tips on starting a new website (hosting and domains) I’m finding more and more people wanting to start websites, yet getting confused about some of the details. The first...
  2. blocked websites (ISP or hosting?) I maintain 2 websites hosted with unlimited-space. One day, these 2 sites suddenly stopped appearing (the usual IE7 web page about a...
  3. Computer Aid blog outage As many of you will have noticed, the Computer Aid blog (and even the main website) stopped working for a...
  4. Secretive hosting / website design companies Recently, I’ve had a few business customers ask about improving their websites, but not willing to go back to their original hosting...
  5. Free website hosting (with a twist) I had a customer call, saying he (and his daughter) was having difficulty uploading his new website to his hosting...


If you found this post helpful, please consider donating (I'm not wealthy, so every little bit helps my family):

Posted by Computer Help in Technical

6 Comments »

6 Responses to “netfirms hosting and cgi concurrency limits”

  1. Chinaren says:

    Sounds a bit wobbly. I moved hosts from iWeb to JustHost early this year.

    iWeb, which had a decent package, p155ed me totally off when my sites (on a shared server) were hacked, and their response when I asked for advice on how to stop it happening (I fixed it, it was hacked again about twice) was – to go and find stuff out myself.

    Fair enough, goodbye, was my answer.

    SO FAR (and it’s been just over six months) I’ve been really happy with JustHost. They (apparently) don’t have any limits (though I’m sure they do really of course), and their support has been excellent and friendly.

    Worth a look.

    (No, this isn’t a sponsored post or anything!! lol)

  2. Ken Michael says:

    I am one of those “… less less technical people” who finds this hosting thing quite confusing. I am glad you shared with us your “hosting” experience. As I am currently looking around for a web host for my blog, your discussion has given me some some points to consider in my choice.

    Thanks

  3. Dan Kershaw says:

    Hi! I am Dan Kershaw the new General Manager at Netfirms. I wanted to first say thank you for posting your concerns to the web – I am always looking to meet our firm’s customers and want unfiltered feedback. Your posted raised a number of concerns and I have taken the weekend to get some real answers from the development team and sys admins that keep the Netfirms Data Center humming along year round.

    First off, you raise a number of questions about share hosting in general – we have taken a unique approach to share hosting versus our peers in the industry so the limitations are not as dire as they appear in your post. I had another website ask similar questions of Netfirms and I got back to them as well (http://hosting-website.biz/2009/07/qa-with-dan-kershaw-of-netfirms/).

    Secondly, thank you for selecting Netfirms – I reviewed your questions and have some specific answers for you.
    - We were unaware (until your post) that concurrency limits were causing problems – I have had them doubled effective November 14th.
    - I have organized a brigade of staff members that are regularly upgrading all of our One Click apps, and adding new ones regularly. Since late August were are running the most current versions.
    - We have always felt tying ourselves to Cpanel or other Control Panel would limit our clients. We are regularly adding, updating and fine tuning the Control based on direct requests from our clients.
    - We saw the delays as well and since this summer all DNS updates take only about 5 minutes.
    - Your support response is not the standard I am grooming inside the company – we are investing heavily in training, hiring, and turnaround time to concerns like yours.
    - Email me your specific information on the Forum – to generalmanager at netfirms.com – I will see if one of my Tier 3 Support wizards can help you move it if you are still interested.
    - There were a number of serious Denial of Service (DOS) Attacks during the summer that did affect you. We have added over $100,000 in new routing equipment to address this issue.
    - In a word – Yes – we should have moved quicker on the new data center. The scope of work to move 1.2 million websites and the associated data to an brand new million dollar infrastructure is not a small task – I’d prefer to take the time to do it right than rush and hope.
    - Your CGI concerns should be addressed now with the Concurrency limit changes on your existing hosting plan.
    - We are weeks away from launching our own VPS Beta system using Plesk – to address clients requests for more flexibility and control – if you’d like to be a Beta Client – drop me a email!

    Thanks again Luigi, Frank and Mike (not sure which of you made this post)
    Regards

    Dan Kershaw
    General Manager
    Netfirms, Inc.

  4. Computer Help says:

    Hi Dan (this is Luigi),

    Thanks for replying (and more importantly, doubling the CGI concurrency limit).

    Its unfortunate that it took a post in a moderately popular blog (like this one), before any meaningful changes were made.

    The past CGI limits were the equivalent of putting a motorcycle engine into a large truck: it can be done, but its not worth it.

    At least now, I feel like my site has room to grow some more, before I need to look at a VPS solution. Thanks.

    I can’t begin to imagine the difficulty in seamlessly moving over 1 million websites to a different datacenter, so congratulations on that front.

    I understand that DOS and DDOS attacks can be a big problem for hosting companies, so its good to see you are working to minimise the problem.

    Thanks for the VPS Beta offer, but at this stage, I’d like to avoid any potential problems.

    I must say that the correctly working clustered hosting solution is probably worth more than what you are charging… If you can address the many major issues facing netfirms, then I’d be happy to pay more (50% to 100% more) for quality clustered hosting, with good service, and room for expansion. I’m sure there are others in a similar situation as mine, who need a middle ground (price-wise and performance-wise) between shared hosting and VPS.

  5. Dan Kershaw says:

    Hi Luigi
    The sad part of working on the Internet is I never get to meet most of my customers – so I look for blogs like this to try and better understand the challenges we may be able to better address.

    If you’d like to email me directly, I’d love some further insight on what specific issues you refer too that we haven’t touched on?

    I am driving the company to focused on providing solid reliable web hosting for people like you and direct feedback is always welcome.

    Regards
    Dan Kershaw
    General Manager
    Netfirms, Inc.

  6. Red Paredes says:

    Got a surprise today – I havent even widely publicized by website yet and I have very few visitors but now, its showing:

    “Maximum CGI processes concurrency limit of 20 exceeded.Currently serving the following requests:
    /cgi/formmail
    /cgi/formmail
    If you are the owner of this website, you may need to upgrade to a more advanced plan.”

    I dont even use formmail. From what I read above, this is caused by other websites that happen to be hosted on the server where my domain is hosted?

    What is this?!? Theres nothing about “concurrent CGI” in the Packages. Just disk space and bandwidth. And I have a whole lot of that unused under my Advantage Plan.

To Reply:

XHTML: You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>