[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Bacula-devel] Alternative DB proposal


2008/10/14 John Huttley <John@xxxxxxxxxxxxxxxxxx>:
> So the modified version is actually a bit faster?
>

Well, yes.

> Thats odd.

So that MySQL slow with fields of type BLOB, imho.

In an alternative scheme appear new fields : size, ctime, mtime.
I therefore reduced length the value that is inserted into the field LStat.

char *lstat = "MI s9MB IG0 B H2 H0 A 9t BAA I";
instead of
char *lstat = "MI s9MB IG0 B H2 H0 A 9t BAA I BIVsDs BIR93m BIVqaC A A E";

>
> are you running  64Bit?

Yes.

> Whats your Ram?

8Gb, but MySQL does not use the entire memory.
The server is used only for this test.

> Version of Mysql?

mysql  Ver 14.12 Distrib 5.0.45, for redhat-linux-gnu (x86_64) using
readline 5.0

/etc/my.cnf taken from /usr/share/doc/mysql-server-5.0.45/my-huge.cnf

>
>
> I'll run it on my system also.
>
> Regards,
>
> john
>
>
> Yuri Timofeev wrote:
>
> Hi
>
> 2008/10/7 John Huttley <John@xxxxxxxxxxxxxxxxxx>:
>
>
> Hi
> My first test are complete.
> To aid in getting all the questions/answers and results in one place, I've
> made a wiki entry.
>
> http://wiki.bacula.org/doku.php?id=wiki:playground
>
>
>
> My first test are complete. ;)
>
> Summary:
>
> MySQL, ProLiant DL180G5, CentOS 5.2
>
> 1. Batch inserts 10M unique! records in table 'File' (DB schema not
> changed) : 39 hours (23+16), DB file size 15,4 Gb
> 2. Batch inserts 10M unique! records in table 'File' (NEW DB schema
> see also create_mysql_test2.sh) : 35 hours (19+16), DB file size 15,2
> Gb
>
> Source code attached.
>
> Please note that the length of time (16 hours) insert records from the
> table 'batch' to the table 'File' the same.
> This indicates the stability of results.
>
>
>
>
>
> Full report:
>
> # ./test
> Date: Oct 10 2008 11:27:37
> Host: Localhost via UNIX socket
> Use database: 'bacula_test'.
> Temporary table 'batch' created.
> Start filling tables 'batch'(temporary), 'Path', 'Filename' ...
> End.
> 10000000 records inserts.
> *** CPUs time used : 375.880000
> *** Elapsed time (wall clock) : 85334.000000
>
> Start inserts from temporary table 'batch' to 'File' ...
> End inserts to 'File' ...
> *** CPUs time used : 0.000000
> *** Elapsed time (wall clock) : 58838.000000
>
>
>
>
> # ./test2
> Date: Oct 10 2008 11:27:37
> Host: Localhost via UNIX socket
> Use database: 'bacula_test2'.
> Temporary table 'batch' created.
> Start filling tables 'batch'(temporary), 'Path', 'Filename' ...
> End.
> 10000000 records inserts.
> *** CPUs time used : 384.650000
> *** Elapsed time (wall clock) : 71670.000000
>
> Start inserts from temporary table 'batch' to 'File' ...
> End inserts to 'File' ...
> *** CPUs time used : 0.000000
> *** Elapsed time (wall clock) : 58564.000000
>
>
>
>
>
>
>
> ________________________________
> -------------------------------------------------------------------------
> This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
> Build the coolest Linux based applications with Moblin SDK & win great
> prizes
> Grand prize is a trip for two to an Open Source event anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
>
> ________________________________
> _______________________________________________
> Bacula-devel mailing list
> Bacula-devel@xxxxxxxxxxxxxxxxxxxxx
> https://lists.sourceforge.net/lists/listinfo/bacula-devel
>



-- 
with best regards

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-devel mailing list
Bacula-devel@xxxxxxxxxxxxxxxxxxxxx
https://lists.sourceforge.net/lists/listinfo/bacula-devel


This mailing list archive is a service of Copilotco.