nginx proxy keeps restarting

[Spacedust]

My nginx is freezing and then it restarts itself.

It started after adding the latest configs. Any ideas ?

[Spacedust]

nginx[10968]: segfault at 418 ip 00000000004484c6 sp 00007fff0846b8f0 error 4 in nginx[400000+b8000]
nginx[10979]: segfault at 418 ip 00000000004484c6 sp 00007fff0846b960 error 4 in nginx[400000+b8000]
nginx[10982]: segfault at 1 ip 0000000000446fe9 sp 00007fff0846b938 error 4 in nginx[400000+b8000]
nginx[10966]: segfault at 418 ip 00000000004484c6 sp 00007fff0846b960 error 4 in nginx[400000+b8000]
nginx[10985]: segfault at 418 ip 00000000004484c6 sp 00007fff0846b960 error 4 in nginx[400000+b8000]
show_signal_msg: 80 callbacks suppressed
nginx[11215]: segfault at 22 ip 00000000004484c6 sp 00007fff0846b940 error 4 in nginx[400000+b8000]
nginx[11212]: segfault at 307106d4b ip 0000000000447008 sp 00007fff0846b938 error 4 in nginx[400000+b8000]
nginx[11106]: segfault at 2018 ip 00000000004484c6 sp 00007fff0846b940 error 4 in nginx[400000+b8000]
traps: nginx[11147] general protection ip:4484c6 sp:7fff0846b8d0 error:0 in nginx[400000+b8000]
nginx[11170]: segfault at 2018 ip 00000000004484c6 sp 00007fff0846b940 error 4 in nginx[400000+b8000]
nginx[11214]: segfault at 2018 ip 00000000004484c6 sp 00007fff0846b8d0 error 4 in nginx[400000+b8000]
nginx[11196]: segfault at ea78 ip 00000000004484c6 sp 00007fff0846b960 error 4 in nginx[400000+b8000]
nginx[11231]: segfault at 1000 ip 0000000000001000 sp 00007fff0846b938 error 14 in nginx[400000+b8000]
nginx[11230]: segfault at 1 ip 0000000000446fe9 sp 00007fff0846b938 error 4 in nginx[400000+b8000]
nginx[11241]: segfault at 1000 ip 0000000000001000 sp 00007fff0846b938 error 14 in nginx[400000+b8000]
show_signal_msg: 59 callbacks suppressed
nginx[11447]: segfault at 418 ip 00000000004484c6 sp 00007fff0846b960 error 4 in nginx[400000+b8000]
nginx[11457]: segfault at 313059b9b ip 0000000000447008 sp 00007fff0846b978 error 4 in nginx[400000+b8000]
nginx[11458]: segfault at 2018 ip 00000000004484c6 sp 00007fff0846b940 error 4 in nginx[400000+b8000]
nginx[11481]: segfault at 28 ip 0000000000446fe9 sp 00007fff0846b938 error 4 in nginx[400000+b8000]
nginx[11439]: segfault at 418 ip 00000000004484c6 sp 00007fff0846b960 error 4 in nginx[400000+b8000]
nginx[11456]: segfault at 418 ip 00000000004484c6 sp 00007fff0846b960 error 4 in nginx[400000+b8000]
nginx[11434]: segfault at 28 ip 0000000000446fe9 sp 00007fff0846b938 error 4 in nginx[400000+b8000]
nginx[11483]: segfault at 418 ip 00000000004484c6 sp 00007fff0846b960 error 4 in nginx[400000+b8000]
nginx[11495]: segfault at 418 ip 00000000004484c6 sp 00007fff0846b960 error 4 in nginx[400000+b8000]
nginx[11454]: segfault at 418 ip 00000000004484c6 sp 00007fff0846b960 error 4 in nginx[400000+b8000]
show_signal_msg: 78 callbacks suppressed
nginx[11708]: segfault at 22 ip 00000000004484c6 sp 00007fff0846b940 error 4 in nginx[400000+b8000]
nginx[11718]: segfault at 28 ip 0000000000446fe9 sp 00007fff0846b938 error 4 in nginx[400000+b8000]
nginx[11730]: segfault at 1 ip 0000000000446fe9 sp 00007fff0846b938 error 4 in nginx[400000+b8000]
nginx[11731]: segfault at 28 ip 0000000000446fe9 sp 00007fff0846b938 error 4 in nginx[400000+b8000]
nginx[11732]: segfault at 22 ip 00000000004484c6 sp 00007fff0846b940 error 4 in nginx[400000+b8000]
nginx[11733]: segfault at 1 ip 0000000000446fe9 sp 00007fff0846b938 error 4 in nginx[400000+b8000]
nginx[11743]: segfault at 1c ip 00000000004484c6 sp 00007fff0846b940 error 4 in nginx[400000+b8000]
nginx[11753]: segfault at 1000 ip 0000000000001000 sp 00007fff0846b938 error 14 in nginx[400000+b8000]
nginx[11754]: segfault at 19 ip 00000000004484c6 sp 00007fff0846b960 error 4 in nginx[400000+b8000]
traps: nginx[11765] general protection ip:4484c6 sp:7fff0846b940 error:0 in nginx[400000+b8000]
show_signal_msg: 100 callbacks suppressed
nginx[12007]: segfault at 3344fcc5b ip 0000000000447008 sp 00007fff0846b938 error 4 in nginx[400000+b8000]
nginx[12010]: segfault at 418 ip 00000000004484c6 sp 00007fff0846b960 error 4 in nginx[400000+b8000]
traps: nginx[12012] general protection ip:446fe9 sp:7fff0846b8c8 error:0 in nginx[400000+b8000]
traps: nginx[12022] general protection ip:4484c6 sp:7fff0846b940 error:0 in nginx[400000+b8000]
nginx[12023]: segfault at ea78 ip 00000000004484c6 sp 00007fff0846b960 error 4 in nginx[400000+b8000]
nginx[12011]: segfault at 19 ip 00000000004484c6 sp 00007fff0846b940 error 4 in nginx[400000+b8000]
traps: nginx[12008] general protection ip:4484c6 sp:7fff0846b910 error:0 in nginx[400000+b8000]
traps: nginx[12009] general protection ip:446fe9 sp:7fff0846b938 error:0 in nginx[400000+b8000]
nginx[12024]: segfault at 1 ip 0000000000446fe9 sp 00007fff0846b938 error 4 in nginx[400000+b8000]
nginx[12043]: segfault at 19 ip 00000000004484c6 sp 00007fff0846b8d0 error 4 in nginx[400000+b8000]

[Spacedust]

What is this ?

2014/06/03 15:45:43 [crit] 4451#0: unlink() "/var/cache/nginx-proxy/8/5b/63f134a7e52a41cb0b8cfd62c412c5b8" failed (2: No such file or directory)
2014/06/03 15:45:43 [crit] 4451#0: unlink() "/var/cache/nginx-proxy/8/5b/06a26e831b6067d9275aaddcc6a445b8" failed (2: No such file or directory)
2014/06/03 15:45:43 [crit] 4451#0: unlink() "/var/cache/nginx-proxy/8/5b/20a8a93eae31289d04bbbe696c5575b8" failed (2: No such file or directory)
2014/06/03 15:45:43 [crit] 4451#0: unlink() "/var/cache/nginx-proxy/8/5b/ad14c1c709228956ff393e82029435b8" failed (2: No such file or directory)
2014/06/03 15:45:43 [crit] 4451#0: unlink() "/var/cache/nginx-proxy/8/09/277a0cc5b7e71b7076341b0c98be7098" failed (2: No such file or directory)
2014/06/03 15:45:43 [crit] 4451#0: unlink() "/var/cache/nginx-proxy/8/09/2713889198e3329977658a00e6dee098" failed (2: No such file or directory)
2014/06/03 15:45:43 [crit] 4451#0: unlink() "/var/cache/nginx-proxy/8/09/488531ccf97a262806d4063e5de75098" failed (2: No such file or directory)
2014/06/03 15:45:43 [crit] 4451#0: unlink() "/var/cache/nginx-proxy/8/09/110b2aad5a4037799529cff0626a6098" failed (2: No such file or directory)
2014/06/03 15:45:43 [crit] 4451#0: unlink() "/var/cache/nginx-proxy/8/a1/12dd9ac4a6bd7014afd7466459d75a18" failed (2: No such file or directory)
2014/06/03 15:45:43 [crit] 4451#0: unlink() "/var/cache/nginx-proxy/8/a1/84fd4f6d22af81dfc165caf28399ea18" failed (2: No such file or directory)

[MRatWork]

Check directory for exist or not and permissions.

[Spacedust]

Check directory for exist or not and permissions.

Permissions are properly set.

It's crashing all the time:

tail -f /var/log/nginx/error.log
2014/06/04 11:36:23 [alert] 12928#0: worker process 3958 exited on signal 11
2014/06/04 11:36:23 [alert] 12928#0: worker process 3959 exited on signal 11
2014/06/04 11:36:23 [alert] 12928#0: worker process 3992 exited on signal 11
2014/06/04 11:36:23 [alert] 12928#0: worker process 3982 exited on signal 11
2014/06/04 11:36:24 [alert] 12928#0: worker process 3993 exited on signal 11
2014/06/04 11:36:24 [alert] 12928#0: worker process 3995 exited on signal 11
2014/06/04 11:36:25 [alert] 12928#0: worker process 4001 exited on signal 11
2014/06/04 11:36:25 [alert] 12928#0: worker process 3994 exited on signal 11
2014/06/04 11:36:25 [alert] 12928#0: worker process 4002 exited on signal 11
2014/06/04 11:36:26 [alert] 12928#0: worker process 4021 exited on signal 11

[MRatWork]

Inform here your 'yum list nginx --showduplicates'.

Look like related to module in nginx. Possible different repo have different issue related to nginx.

[Spacedust]

Inform here your 'yum list nginx --showduplicates'.

Look like related to module in nginx. Possible different repo have different issue related to nginx.

Installed Packages
nginx.x86_64                         1.7.1-1.el6.ngx                           @mratwork-nginx
Available Packages
nginx.x86_64                         1.0.5-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.0.6-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.0.7-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.0.8-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.0.8-2.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.0.9-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.0.10-1.el6.ngx                          mratwork-nginx-stable
nginx.x86_64                         1.0.11-1.el6.ngx                          mratwork-nginx-stable
nginx.x86_64                         1.0.12-1.el6.ngx                          mratwork-nginx-stable
nginx.x86_64                         1.0.13-1.el6.ngx                          mratwork-nginx-stable
nginx.x86_64                         1.0.14-1.el6.ngx                          mratwork-nginx-stable
nginx.x86_64                         1.0.15-1.el6.ngx                          mratwork-nginx-stable
nginx.x86_64                         1.0.15-5.el6                              epel
nginx.x86_64                         1.0.15-5.el6                              mratwork-epel
nginx.x86_64                         1.2.0-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.2.1-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.2.2-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.2.3-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.2.4-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.2.5-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.2.6-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.2.6-6.el6.art                           atomic
nginx.x86_64                         1.2.6-7.el6.art                           atomic
nginx.x86_64                         1.2.7-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.2.7-8.el6.art                           atomic
nginx.x86_64                         1.2.8-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.2.8-9.el6.art                           atomic
nginx.x86_64                         1.3.15-1.el6.ngx                          mratwork-nginx
nginx.x86_64                         1.3.16-1.el6.ngx                          mratwork-nginx
nginx.x86_64                         1.4.0-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.4.1-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.4.1-11.el6.art                          atomic
nginx.x86_64                         1.4.2-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.4.2-13.el6.art                          atomic
nginx.x86_64                         1.4.3-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.4.3-14.el6.art                          atomic
nginx.x86_64                         1.4.4-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.4.4-15.el6.art                          atomic
nginx.x86_64                         1.4.4-16.el6.art                          atomic
nginx.x86_64                         1.4.5-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.4.5-17.el6.art                          atomic
nginx.x86_64                         1.4.6-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.4.6-18.el6.art                          atomic
nginx.x86_64                         1.4.7-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.4.7-19.el6.art                          atomic
nginx.x86_64                         1.4.7-20.el6.art                          atomic
nginx.x86_64                         1.5.0-1.el6.ngx                           mratwork-nginx
nginx.x86_64                         1.5.1-1.el6.ngx                           mratwork-nginx
nginx.x86_64                         1.5.2-1.el6.ngx                           mratwork-nginx
nginx.x86_64                         1.5.3-1.el6.ngx                           mratwork-nginx
nginx.x86_64                         1.5.4-1.el6.ngx                           mratwork-nginx
nginx.x86_64                         1.5.5-1.el6.ngx                           mratwork-nginx
nginx.x86_64                         1.5.6-1.el6.ngx                           mratwork-nginx
nginx.x86_64                         1.5.7-1.el6.ngx                           mratwork-nginx
nginx.x86_64                         1.5.8-1.el6.ngx                           mratwork-nginx
nginx.x86_64                         1.5.9-1.el6.ngx                           mratwork-nginx
nginx.x86_64                         1.5.10-1.el6.ngx                          mratwork-nginx
nginx.x86_64                         1.5.11-1.el6.ngx                          mratwork-nginx
nginx.x86_64                         1.5.12-1.el6.ngx                          mratwork-nginx
nginx.x86_64                         1.5.13-1.el6.ngx                          mratwork-nginx
nginx.x86_64                         1.6.0-1.el6.ngx                           mratwork-nginx-stable
nginx.x86_64                         1.6.0-21.el6.art                          atomic
nginx.x86_64                         1.7.0-1.el6                               mratwork-centalt
nginx.x86_64                         1.7.0-1.el6.ngx                           mratwork-nginx
nginx.x86_64                         1.7.1-1.el6.ngx                           mratwork-nginx

[MRatWork]

This issue appear in 1 month ago?. After centalt repo down, mratwork.repo use nginx repo instead centalt repo in latest update.

[MRatWork]

Maybe the same issue with https://code.google.com/p/naxsi/issues/detail?id=47

[Spacedust]

It happens always after adding new domain, then reloading nginx.

[MRatWork]

Try change:

Code: [Select]

        #proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_set_header X-Forwarded-For $remote_addr;
to:

Code: [Select]

        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        #proxy_set_header X-Forwarded-For $remote_addr;

in /home/nginx/conf/globals/custom.proxy.conf

[Spacedust]

Try change:

Code: [Select]

        #proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_set_header X-Forwarded-For $remote_addr;
to:

Code: [Select]

        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        #proxy_set_header X-Forwarded-For $remote_addr;

in /home/nginx/conf/globals/custom.proxy.conf

It seems it something different: http://forum.nginx.org/read.php?2,250647,250651#msg-250651

[Spacedust]

So far good

[Spacedust]

All fine again - that was this bug

[Spacedust]

Still no fix from nginx guys