Sponsor:

Server and Web Integrator
Link:
Kloxo-MR logo
6.5.0 or 7.0.0
Click for "How to install"
Donation/Sponsorship:
Kloxo-MR is open-source.
Donate and or Sponsorship always welcome.
Click to:
Click Here
Please login or register. 2024-04-29, 13:12:00

Author Topic: Problem with importing the database (MySql)  (Read 14674 times)

0 Members and 1 Guest are viewing this topic.

Offline I<3Kloxo

  • Senior Member
  • *
  • Posts: 205
  • Karma: +0/-0
    • View Profile
Problem with importing the database (MySql)
« on: 2014-04-29, 03:02:19 »
Hello,

I own Kloxo latest version "Kloxo-MR 6.5.0.f-2014042802". I have a problem with uploading the database MySql which have the gzip format. The MySql datebase is heavy 121 MB in format "gzip". The problem is that when I uploading MySql (gzip) datebase via phpmyadmin after approximately 30-40 seconds throw me out and datebase is not uploaded. The worst thing is that I can no longer access the Kloxo panel about 15 - 30 min. After 15-30 minutes I again can acces Kloxo-MR.
My friend who is in another state he can enter into Kloxo Panel then at that time when I can not enter. Does anyone know what the problem is ?

Offline MRatWork

  • Administrator
  • The Elite
  • *****
  • Posts: 15,807
  • Karma: +119/-11
  • Gender: Male
    • View Profile
    • MRatWork Forum
Re: Problem with importing the database (MySql)
« Reply #1 on: 2014-04-29, 04:08:08 »
Open '/usr/local/lxlabs/kloxo/init/hiawatha.conf' and change 'MaxUploadSize = 100' to 'MaxUploadSize = 2000'.

After that, run 'sh /script/restart'
..:: MRatWork (Mustafa Ramadhan Projects) ::..
-- Server/Web-integrator - Web Hosting (Kloxo-MR READY!) --

Offline I<3Kloxo

  • Senior Member
  • *
  • Posts: 205
  • Karma: +0/-0
    • View Profile
Re: Problem with importing the database (MySql)
« Reply #2 on: 2014-04-29, 04:35:28 »
Open '/usr/local/lxlabs/kloxo/init/hiawatha.conf' and change 'MaxUploadSize = 100' to 'MaxUploadSize = 2000'.

After that, run 'sh /script/restart'

Little wonder becouse Hiawatha Web Server was switch off in my Kloxo panel. Please see my pic. :





or I am making a mistake with something ? ?

Offline MRatWork

  • Administrator
  • The Elite
  • *****
  • Posts: 15,807
  • Karma: +119/-11
  • Gender: Male
    • View Profile
    • MRatWork Forum
Re: Problem with importing the database (MySql)
« Reply #3 on: 2014-04-29, 04:40:38 »
Hiawatha using by Kloxo-MR for their panel. In 6.5.1, hiawatha also as webserver (nginx/lighttpd/apache).

So, your panel is normal.
..:: MRatWork (Mustafa Ramadhan Projects) ::..
-- Server/Web-integrator - Web Hosting (Kloxo-MR READY!) --

Offline I<3Kloxo

  • Senior Member
  • *
  • Posts: 205
  • Karma: +0/-0
    • View Profile
Re: Problem with importing the database (MySql)
« Reply #4 on: 2014-04-29, 04:47:04 »
Quote
Hiawatha using by Kloxo-MR for their panel. In 6.5.1, hiawatha also as webserver (nginx/lighttpd/apache).

So, your panel is normal.

I did not know this information. Now I just understands.
That means I must increase the number here:
'/usr/local/lxlabs/kloxo/init/hiawatha.conf'

MaxUploadSize = 100' to 'MaxUploadSize = 2000

Offline MRatWork

  • Administrator
  • The Elite
  • *****
  • Posts: 15,807
  • Karma: +119/-11
  • Gender: Male
    • View Profile
    • MRatWork Forum
Re: Problem with importing the database (MySql)
« Reply #5 on: 2014-04-29, 05:03:55 »
Yes.

Kloxo official using 'special' lighttpd (call as lxlighttpd) and 'special' php (call as lxphp).

Kloxo-MR using 'standard' hiawatha and php but different process to install for it (especially in 6.5.1).
..:: MRatWork (Mustafa Ramadhan Projects) ::..
-- Server/Web-integrator - Web Hosting (Kloxo-MR READY!) --

Offline I<3Kloxo

  • Senior Member
  • *
  • Posts: 205
  • Karma: +0/-0
    • View Profile
Re: Problem with importing the database (MySql)
« Reply #6 on: 2014-04-29, 06:38:34 »
I changed the numbers and reset the vps and then the problem is same. Simply drop me off when I begin to upload  datebase. The base has about 600 MB when is not in gzip. In gzip has about 120 MB. Does someone can help me ?

I have one more base which has only 40MB (other websites) and everything works perfectly through phpmyadmin.

Offline MRatWork

  • Administrator
  • The Elite
  • *****
  • Posts: 15,807
  • Karma: +119/-11
  • Gender: Male
    • View Profile
    • MRatWork Forum
Re: Problem with importing the database (MySql)
« Reply #7 on: 2014-04-29, 06:52:59 »
2 portions related to upload size:

1. webserver (hiawatha) side --> 'MaxUploadSize' in '/usr/local/lxlabs/kloxo/init/hiawatha.conf'
2. php (php52s in 6.5.0.f and php53s in 6.5.1.b) --> 'upload_max_filesize' in '/opt/php52s/etc/php.ini' (for 6.5.0.f)
..:: MRatWork (Mustafa Ramadhan Projects) ::..
-- Server/Web-integrator - Web Hosting (Kloxo-MR READY!) --

Offline Kloxo-DR

  • Senior Member
  • *
  • Posts: 239
  • Karma: +3/-9
    • View Profile
Re: Problem with importing the database (MySql)
« Reply #8 on: 2014-04-30, 08:55:00 »
Hi jure12,

FOR BIG DATABASES
AVOID EXPORT MYSQL ---> DOWNLOAD ---> UPLOAD ---> IMPORT
USE PACK ---> HIGH SPEED TRANSFER BETWEEN DATACENTERS ---> UNPACK

Anything to do with export from mysql has given many problems. I do a transfer by archiving it and unpacking the archive, a method that is reliable.

FOR THIS YOU DO NOT NEED TO DOWNLOAD THE BACKUP FILE TO YOUR COMPUTER!

#####################################
Do the following:

1) OLD SERVER: PREPARE FOR TRANSFER AND PACK
Make a tar of the corresponding database from # shell and make it accessable on the internet.

Code: [Select]
mkdir /home/clientname/domain.com/download_dir_name
cd /home/clientname/domain.com/download_dir_name
tar -zpcf backup.tgz /var/lib/mysql/db_name

2) NEW SERVER: CONNECT AND DOWNLOAD BY WGET METHOD AND UNPACK

You can use the following to download the backup by following:

Code: [Select]
mkdir /root/download
cd /root/download
wget https://domain.com/download_dir_name/backup.tgz --no-check-certificate
tar -zxvf backup.tgz

Then you are done.
#####################################

In the above step, the database is made available for download via internet. You can add password protection to download_dir_name or backup.tgz, or do without it.

If you add password protection to download_dir_name, then you must make the wget  connection with username and Password.
If you add Password protection to backup.tgz, then you must give it during unpacking by tar -zxvf.

When you download the file to your computer, then you use the download speed of your internet connection of downloadstream. When you upload this file, you use 8 times slower internet connection speed of upstream.

When you make a secure wget connection, you use 10-30 times faster connection from new server to old server for download and transfer the file in compressed format depending the network card attached to both servers and load on the servers.

The advantage of this method is that you DOWNLOAD THE FILE USE HIGH SPEED TRANSFER BETWEEN DATACENTERS.

---------------------------------------------------------

You should have created a db_name under the client in new server. Simply copy contents of the archive uncompressed under /root/download to the respective /var/lib/mysql/db_name. Then you are done.
« Last Edit: 2014-04-30, 09:01:19 by Kloxo-DR »

Offline fossxplorer

  • Master
  • **
  • Posts: 640
  • Karma: +1/-0
    • View Profile
Re: Problem with importing the database (MySql)
« Reply #9 on: 2014-04-30, 11:49:09 »
121MB of gzipped DB isn't considered big :) Could sound like it's PHP that's timing out as the default script execution time is 30s. I'm not familar with Kloxo-MR 6.5.0, but find the php.ini for the PHP version the panel is using and change both  max_execution_time and max_input_time to a higher value.
Restart Kloxo and see if it solves your problem.
 

Hello,

I own Kloxo latest version "Kloxo-MR 6.5.0.f-2014042802". I have a problem with uploading the database MySql which have the gzip format. The MySql datebase is heavy 121 MB in format "gzip". The problem is that when I uploading MySql (gzip) datebase via phpmyadmin after approximately 30-40 seconds throw me out and datebase is not uploaded. The worst thing is that I can no longer access the Kloxo panel about 15 - 30 min. After 15-30 minutes I again can acces Kloxo-MR.
My friend who is in another state he can enter into Kloxo Panel then at that time when I can not enter. Does anyone know what the problem is ?
Kloxo-MR!

Offline zenkul

  • Global Moderator
  • Master
  • *****
  • Posts: 383
  • Karma: +3/-0
    • View Profile
    • home & decor
Re: Problem with importing the database (MySql)
« Reply #10 on: 2014-04-30, 12:47:50 »
another way
create backup folder for import - export in phpmyadmin

open file : /usr/local/lxlabs/kloxo/httpdocs/thirdparty/phpMyAdmin/config.inc.php

see line 66 & 67
Code: [Select]
$cfg['UploadDir'] = '';
$cfg['SaveDir'] = '';

create folder, for example "/home/myfolderbackup/"

edit
Code: [Select]
$cfg['UploadDir'] = '/home/myfolderbackup/';
$cfg['SaveDir'] = '/home/myfolderbackup/';

input file at this folder backup and see phpmyadmin import menu
easy, secure and speed up web panel ===> Kloxo-MR

Offline MRatWork

  • Administrator
  • The Elite
  • *****
  • Posts: 15,807
  • Karma: +119/-11
  • Gender: Male
    • View Profile
    • MRatWork Forum
Re: Problem with importing the database (MySql)
« Reply #11 on: 2014-04-30, 13:56:25 »
another way
create backup folder for import - export in phpmyadmin

open file : /usr/local/lxlabs/kloxo/httpdocs/thirdparty/phpMyAdmin/config.inc.php

see line 66 & 67
Code: [Select]
$cfg['UploadDir'] = '';
$cfg['SaveDir'] = '';

create folder, for example "/home/myfolderbackup/"

edit
Code: [Select]
$cfg['UploadDir'] = '/home/myfolderbackup/';
$cfg['SaveDir'] = '/home/myfolderbackup/';

input file at this folder backup and see phpmyadmin import menu
Great idea.
..:: MRatWork (Mustafa Ramadhan Projects) ::..
-- Server/Web-integrator - Web Hosting (Kloxo-MR READY!) --

Offline cmdman

  • Senior Member
  • *
  • Posts: 298
  • Karma: +1/-0
    • View Profile
Re: Problem with importing the database (MySql)
« Reply #12 on: 2014-04-30, 14:24:52 »
i face same problem i have 700mb database when i try to import via phpadmin it i get blank page  and kloxo stops working i need to restart services..

i tried mr tips by above adding upload size more.. i tested with interworks it works good but bad in kloxo

Offline Kloxo-DR

  • Senior Member
  • *
  • Posts: 239
  • Karma: +3/-9
    • View Profile
Re: Problem with importing the database (MySql)
« Reply #13 on: 2014-04-30, 16:00:15 »
Hi Mella,
121MB of gzipped DB isn't considered big :) Could sound like it's PHP that's timing out as the default script execution time is 30s.
 

Living is a developed world both of us may experience different kind of speeds of internet connections.

For someone in  developing country, 121 MB is huge data to upload.

While it is ofcourse better to increase execution time out any way, in any other solution there is a download and upload.

Many times I use wget. Sometimes I use Midnight commander to make an ftp connection depending on if I require secure or not. Because wget uses https, it is easier and faster.

The solution I suggested, which I use it daily, is a data transfer between servers directly, regardless of midnight commander or wget. It is 10 times faster compared to upstream of a private upstream capacity.

Offline cmdman

  • Senior Member
  • *
  • Posts: 298
  • Karma: +1/-0
    • View Profile
Re: Problem with importing the database (MySql)
« Reply #14 on: 2014-04-30, 16:39:47 »
i have 10gbps network

 


MRatWork Affiliates:    BIGRAF(R) Inc.    House of LMAR    EFARgrafix
Click Here

Page created in 0.069 seconds with 19 queries.

web stats analysis