MRatWork Forum by Mustafa Ramadhan

Sawo Project - Kloxo-MR Discussions => Kloxo-MR Technical Helps => Topic started by: Spacedust on 2013-06-25, 22:13:36

Title: 'pure-pw' 'usermod' 'domain.com' VERY SLOW !!!
Post by: Spacedust on 2013-06-25, 22:13:36
Mustafa - the pure-pw user mod is very slow on my server. Why is this hapenning ?

Code: [Select]
18:10 Jun/25/2013: 0:  [(__system__:/usr/local/lxlabs/kloxo/httpdocs) 'pure-pw'  'useradd' 'mojanowadomena5.pl' '-u' 'admin2' '-d' '/home/admin2/mojanowadomena5.pl' '-m']
18:10 Jun/25/2013: pure-pw usermod mojanowadomena5.pl -N '' -m
18:10 Jun/25/2013: 0:  [(__system__:/usr/local/lxlabs/kloxo/httpdocs) 'pure-pw'  'usermod' 'mojanowadomena5.pl' '-z' '0000-2359' '-m']

This is causing a delay about 20-25 seconds when adding new domain !
Title: Re: 'pure-pw' 'usermod' 'domain.com' VERY SLOW !!!
Post by: Spacedust on 2013-06-25, 22:19:01
It seems it's not pure-pw.
Code: [Select]
[(__system__:/var/qmail/control/domainkeys/test2.pl) 'openssl'  'rsa' '-in' 'private' '-out' '/tmp/lxtmp_rsagen4RmDUd' '-pubout' '-outform' 'PEM']
18:18 Jun/25/2013: 0:  [(__system__:/usr/local/lxlabs/kloxo/httpdocs) 'pure-pw'  'useradd' 'test2.pl' '-u' 'admin' '-d' '/home/admin/test2.pl' '-m']
18:18 Jun/25/2013: pure-pw usermod test2.pl -N '' -m
18:18 Jun/25/2013: 0:  [(__system__:/usr/local/lxlabs/kloxo/httpdocs) 'pure-pw'  'usermod' 'test2.pl' '-z' '0000-2359' '-m']

SOMETHING TAKING ABOUT 20-25 SECONDS HERE BUT PURE-PW NOT RUNNING IN PS AUX -- WHAT IS THIS ???

Code: [Select]
18:18 Jun/25/2013: 0:  [(__system__:/usr/local/lxlabs/kloxo/httpdocs) 'chmod'  '0755' '/home/httpd/test2.pl']
18:18 Jun/25/2013: 0:  [(__system__:/usr/local/lxlabs/kloxo/httpdocs) 'chmod'  '0755' '/home/admin/test2.pl']
Title: Re: 'pure-pw' 'usermod' 'domain.com' VERY SLOW !!!
Post by: Spacedust on 2013-06-25, 22:27:05
Strace just shows this:

Code: [Select]
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "OiJsb2NhbCI7fWk6NTQ0O2E6NTp7czo1"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "bm5hbWUiO3M6MjI6ImJhZHppZXdpYXJ6"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "IjtzOjExOiJ3ZWJtYWlscHJvZyI7czow"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "IiI7czoxMToid2VibWFpbF91cmwiO3M6"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "IiI7czoxMToid2VibWFpbF91cmwiO3M6"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "YW1lIjtzOjIwOiJwbG90a2kud2lhZG9t"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "aWwuY29tLnBsIjtzOjEzOiJwYXJlbnRf"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "OiIiO3M6MTU6InJlbW90ZWxvY2FsZmxh"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "IjtzOjA6IiI7czoxNToicmVtb3RlbG9j"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "cnQucGwiO3M6MTM6InBhcmVudF9jbG5h"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "bnRfY2xuYW1lIjtzOjI4OiJkb21haW4t"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "dXJsIjtzOjA6IiI7czoxNToicmVtb3Rl"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "bWFpbF91cmwiO3M6MDoiIjtzOjE1OiJy"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "aXQucG9ydGFsby5wbCI7czoxMzoicGFy"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "b2NhbGZsYWciO3M6NToibG9jYWwiO31p"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "YWciO3M6NToibG9jYWwiO31pOjEwMjQ7"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "bm5hbWUiO3M6MTc6ImVmaW5hbnNlMjQu"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "OiJwYXJlbnRfY2xuYW1lIjtzOjMyOiJk"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
poll([{fd=7, events=POLLIN|POLLERR|POLLHUP}], 1, -64771072) = 1 ([{fd=7, revents=POLLIN}])
recvfrom(7, "IjtzOjE1OiJkb21haW4tcGphdGkucGwi"..., 8192, MSG_DONTWAIT, NULL, NULL) = 8192
Title: Re: 'pure-pw' 'usermod' 'domain.com' VERY SLOW !!!
Post by: Spacedust on 2013-06-25, 22:34:28
It's not related to kernel version or hardware. It's only something inside Kloxo :/
Title: Re: 'pure-pw' 'usermod' 'domain.com' VERY SLOW !!!
Post by: MRatWork on 2013-06-25, 23:58:10
Pure-pw is part of pure-ftpd. Maybe you need investigate pure-ftpd config
Title: Re: 'pure-pw' 'usermod' 'domain.com' VERY SLOW !!!
Post by: Spacedust on 2013-06-26, 00:01:32
Tested and pure-pw takes less then a second.

Code: [Select]
18:18 Jun/25/2013: 0:  [(__system__:/usr/local/lxlabs/kloxo/httpdocs) 'pure-pw'  'usermod' 'test2.pl' '-z' '0000-2359' '-m']
SOMETHING IS TAKING ABOUT 20-25 SECONDS HERE WHAT IS THIS ???
18:18 Jun/25/2013: 0:  [(__system__:/usr/local/lxlabs/kloxo/httpdocs) 'chmod'  '0755' '/home/httpd/test2.pl']
Title: Re: 'pure-pw' 'usermod' 'domain.com' VERY SLOW !!!
Post by: Spacedust on 2013-06-29, 04:43:00
Got it:

Looks like one CPU is busy receiving some enormous JSON:

Code: [Select]
? ~/ base64 -D
OiJsb2NhbCI7fWk6NTQ0O2E6NTp7czo1
bm5hbWUiO3M6MjI6ImJhZHppZXdpYXJ6
IjtzOjExOiJ3ZWJtYWlscHJvZyI7czow
^D
:"local";}i:544;a:5:{s:5
nname";s:22:"badziewiarz
";s:11:"webmailprog";s:0%

Mustafa please fix it !
Title: Re: 'pure-pw' 'usermod' 'domain.com' VERY SLOW !!!
Post by: Spacedust on 2013-07-04, 01:52:39
Finally got it !!!

It was mmail table inside database. It's full of old customers accounts which is causing very high slowdowns in my Kloxo-MR. Probably it's some data from Kloxo official that Kloxo-MR is unable to read properly.

As soon I replace this file with blank from another Kloxo install my Kloxo is flying ! Domains are adding within just 10-11 seconds not 40-50 seconds :)

How can I properly rebuild it ?