Sponsor:

Server and Web Integrator
Link:
Kloxo-MR logo
6.5.0 or 7.0.0
Click for "How to install"
Donation/Sponsorship:
Kloxo-MR is open-source.
Donate and or Sponsorship always welcome.
Click to:
Click Here
Please login or register. 2024-04-19, 08:31:45

Author Topic: Serious Problem MRatWork  (Read 13139 times)

0 Members and 1 Guest are viewing this topic.

Offline josifbg

  • Junior Member
  • *
  • Posts: 46
  • Karma: +0/-0
    • View Profile
Serious Problem MRatWork
« on: 2014-01-08, 11:14:39 »
The problem is that no matter what i do and no matter how many times i reinstall the server there is one specific problem which drives me crazy...

After 16 hours up time all the sites hosted on kloxo suddenly vanish... and by vanish i mean that they are not opening in browser.... no matter if there is some application installed on the domain or not the website is not opening.

Only Kloxo Panel is working and i can login.

I have to manually execute sh /scripts/restart-all in order to resolve the issue.

There are no error messages recorded in the logs which is like a ghost living in my server...

Despite the above mentioned problem Kloxo and all related services are working like a charm.

But I can`t restart the server every time the websites are gone and can`t open from browser....

2 weeks already every couple of days i reinstall the server with some hope that this time the problem will disapear..., but nooooo.

Here are some details you`ll probably ask for:

OS: Centos 6.5
Webserver Config:
PHP Branch: php53u
PHP Type: mod_php_ruid2

Web: Apache
DNS: Bind


cat /etc/sysctl.conf
Quote
# Kernel sysctl configuration file for Red Hat Linux
#
# For binary values, 0 is disabled, 1 is enabled.  See sysctl(8) and
# sysctl.conf(5) for more details.

# Controls IP packet forwarding
net.ipv4.ip_forward = 0

# Controls source route verification
net.ipv4.conf.default.rp_filter = 1

# Do not accept source routing
net.ipv4.conf.default.accept_source_route = 0

# Controls the System Request debugging functionality of the kernel
kernel.sysrq = 0

# Controls whether core dumps will append the PID to the core filename.
# Useful for debugging multi-threaded applications.
kernel.core_uses_pid = 1

# Controls the use of TCP syncookies
net.ipv4.tcp_syncookies = 1

# Disable netfilter on bridges.
net.bridge.bridge-nf-call-ip6tables = 0
net.bridge.bridge-nf-call-iptables = 0
net.bridge.bridge-nf-call-arptables = 0

# Controls the default maxmimum size of a mesage queue
kernel.msgmnb = 65536

# Controls the maximum size of a message, in bytes
kernel.msgmax = 65536

# Controls the maximum shared segment size, in bytes
kernel.shmmax = 68719476736

# Controls the maximum number of shared memory segments, in pages
kernel.shmall = 4294967296

### begin -- add by Kloxo-MR
fs.aio-max-nr = 1048576
fs.file-max = 1048576
vm.swappiness = 10
vm.vfs_cache_pressure = 50
vm.dirty_background_ratio = 15
vm.dirty_ratio = 5
### end -- add by Kloxo-MR


« Last Edit: 2014-01-08, 11:23:45 by josifbg »

Offline MRatWork

  • Administrator
  • The Elite
  • *****
  • Posts: 15,807
  • Karma: +119/-11
  • Gender: Male
    • View Profile
    • MRatWork Forum
Re: Serious Problem MRatWork
« Reply #1 on: 2014-01-08, 11:26:37 »
Try increase 'Memory Limit' in 'Advanced Php Config' from '64M' to '128M'.

Together with it, disable plugin in your website application (like plugin in wordpress) first and then enable one-by-one.
..:: MRatWork (Mustafa Ramadhan Projects) ::..
-- Server/Web-integrator - Web Hosting (Kloxo-MR READY!) --

Offline josifbg

  • Junior Member
  • *
  • Posts: 46
  • Karma: +0/-0
    • View Profile
Re: Serious Problem MRatWork
« Reply #2 on: 2014-01-08, 11:36:16 »
Try increase 'Memory Limit' in 'Advanced Php Config' from '64M' to '128M'.

Together with it, disable plugin in your website application (like plugin in wordpress) first and then enable one-by-one.

I can increase 'Memory Limit' to 256 or even 512 if it is not a problem i don`t mind...

I will try your suggestion and will report back!

Offline MRatWork

  • Administrator
  • The Elite
  • *****
  • Posts: 15,807
  • Karma: +119/-11
  • Gender: Male
    • View Profile
    • MRatWork Forum
Re: Serious Problem MRatWork
« Reply #3 on: 2014-01-08, 11:40:46 »
It's crazy set 'memory limit' until '512M'. Remember, if want '512' you must set '512M' (that mean '512 MB').
..:: MRatWork (Mustafa Ramadhan Projects) ::..
-- Server/Web-integrator - Web Hosting (Kloxo-MR READY!) --

Offline josifbg

  • Junior Member
  • *
  • Posts: 46
  • Karma: +0/-0
    • View Profile
Re: Serious Problem MRatWork
« Reply #4 on: 2014-01-08, 11:42:47 »
It's crazy set 'memory limit' until '512M'. Remember, if want '512' you must set '512M' (that mean '512 MB').

I`ve change it to 128M and now all site are opening extremely slow... maybe i have to restart the services?

Offline josifbg

  • Junior Member
  • *
  • Posts: 46
  • Karma: +0/-0
    • View Profile
Re: Serious Problem MRatWork
« Reply #5 on: 2014-01-08, 12:05:30 »
OK

After the slow opening of the sites i`ve tried:

./fix-all - no effect
./restart-all - no effect

Total restart ot the system has back to normal everything...

I`ll report back.


Offline insanity

  • Senior Member
  • *
  • Posts: 215
  • Karma: +0/-0
    • View Profile
Re: Serious Problem MRatWork
« Reply #6 on: 2014-01-08, 13:39:46 »
Please check /var/log/httpd/error_log
If all sites can't load 100% you will see some errors inside error_log.

Offline josifbg

  • Junior Member
  • *
  • Posts: 46
  • Karma: +0/-0
    • View Profile
Re: Serious Problem MRatWork
« Reply #7 on: 2014-01-09, 13:46:46 »
Please check /var/log/httpd/error_log
If all sites can't load 100% you will see some errors inside error_log.

No errors at all!

Offline josifbg

  • Junior Member
  • *
  • Posts: 46
  • Karma: +0/-0
    • View Profile
Re: Serious Problem MRatWork
« Reply #8 on: 2014-01-09, 13:53:57 »
OK...

24 hours latter update:

After couple of tests i`ve increased the Memory Limit from 128 to 256
So far so good... All sites are stable and non of them disappear up to now.

But this leads me another problem... with the above configuration the performance of the websites/apache are super slow.

The response time and the actual load of the website...

 

Offline josifbg

  • Junior Member
  • *
  • Posts: 46
  • Karma: +0/-0
    • View Profile
Re: Serious Problem MRatWork
« Reply #9 on: 2014-01-09, 14:22:41 »
Here are the results of a simple test:

Using: php54 with mod_php_ruid2

The below test is executed from separated machine!

The requested Website test.domain.com is Joomla with no plugins... only few pictures and text... nothing heavy!

Quote
ab -n 500 -c 10 http://test.domain.com:80/
This is ApacheBench, Version 2.3 <$Revision: 1430300 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/

Benchmarking test.domain.com (be patient)
Completed 100 requests
Completed 200 requests
Completed 300 requests
Completed 400 requests
Completed 500 requests
Finished 500 requests


Server Software:        Apache/2.2.26
Server Hostname:        test.domain.com
Server Port:            80

Document Path:          /
Document Length:        9289 bytes

Concurrency Level:      10
Time taken for tests:   44.938 seconds
Complete requests:      500
Failed requests:        476
   (Connect: 0, Receive: 0, Length: 476, Exceptions: 0)

Write errors:           0
Total transferred:      4932817 bytes
HTML transferred:       4678317 bytes
Requests per second:    11.13 [#/sec] (mean)
Time per request:       898.768 [ms] (mean)
Time per request:       89.877 [ms] (mean, across all concurrent requests)
Transfer rate:          107.20 [Kbytes/sec] received

Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        2    3   2.3      3      40
Processing:   352  848 267.6    843    5822
Waiting:      337  834 267.3    831    5811
Total:        355  851 267.7    847    5824

Percentage of the requests served within a certain time (ms)
  50%    847
  66%    877
  75%    901
  80%    916
  90%   1012
  95%   1159
  98%   1264
  99%   1431
 100%   5824 (longest request)
« Last Edit: 2014-01-09, 14:26:57 by josifbg »

Offline MRatWork

  • Administrator
  • The Elite
  • *****
  • Posts: 15,807
  • Karma: +119/-11
  • Gender: Male
    • View Profile
    • MRatWork Forum
Re: Serious Problem MRatWork
« Reply #10 on: 2014-01-10, 02:51:31 »
If using php-fpm as 'php type', reduce client/customer amount. It's because php thread depend on how much client/customer amount. Better using 'admin' for all your domain and no other clients/customers.
..:: MRatWork (Mustafa Ramadhan Projects) ::..
-- Server/Web-integrator - Web Hosting (Kloxo-MR READY!) --

Offline josifbg

  • Junior Member
  • *
  • Posts: 46
  • Karma: +0/-0
    • View Profile
Re: Serious Problem MRatWork
« Reply #11 on: 2014-01-10, 06:36:08 »
If using php-fpm as 'php type', reduce client/customer amount. It's because php thread depend on how much client/customer amount. Better using 'admin' for all your domain and no other clients/customers.

If I switch to php-fpm I can`t change upload_limit_size and post_max_size per domain.

Maybe a bug? i don`t know. the changes a written in the .htaccess but simply they don`t work.

Only if php-type: mod_php_ruid2 is selected I can change the upload_limit_size and post_max_size...


Offline josifbg

  • Junior Member
  • *
  • Posts: 46
  • Karma: +0/-0
    • View Profile
Re: Serious Problem MRatWork
« Reply #12 on: 2014-01-15, 18:15:37 »
Here we go again :(

I receive error message in /var/log/messages:

Quote
Jan 15 19:09:06 ns1 kernel: php-fpm[18921]: segfault at 1256b90 ip 0000000001256b90 sp 00007fffa26d3fc8 error 15

And in the same moment all sites stop working...

There is a ping of course, but non of the sites are opening in the browser...

Please MRatWork tell me what to do.

Offline josifbg

  • Junior Member
  • *
  • Posts: 46
  • Karma: +0/-0
    • View Profile
Re: Serious Problem MRatWork
« Reply #13 on: 2014-01-15, 18:25:06 »
Update:

./fixweb
./restart-web

Fixes the problem.

But when i set password for stats in the same moment i received again:

Quote
Jan 15 19:19:52 ns1 kernel: php-fpm[20048] general protection ip:6d6eb6 sp:7fff05bad3a8 error:0 in php-fpm[400000+3a5000]

And everything stop working again ... :(

Maybe there is something related to this BUG here -> http://forum.mratwork.com/kloxo-mr-technical-helps/'statistics-page-password'-have-no-effect/

Offline josifbg

  • Junior Member
  • *
  • Posts: 46
  • Karma: +0/-0
    • View Profile
Re: Serious Problem MRatWork
« Reply #14 on: 2014-01-15, 18:27:56 »
End again and again.....

And now this:

I can`t take it anymore....

Quote
./restart-web
Stopping httpd:                                            [FAILED]
Starting httpd: (98)Address already in use: make_sock: could not bind to address [::]:80
(98)Address already in use: make_sock: could not bind to address 0.0.0.0:80
no listening sockets available, shutting down
Unable to open logs
                                                           [FAILED]
Stopping php-fpm:                                          [  OK  ]
Starting php-fpm:                                          [  OK  ]

 


Top 4 Global Search Engines:    Google    Bing    Baidu    Yahoo
Click Here

Page created in 0.03 seconds with 21 queries.

web stats analysis