[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Bacula-devel] accurate restore problem


Hello,

today i did another test restore of /usr, 
results are almost accurate, rsync doesnt report any files.


ulrich@leodolter:~$ rsync -avO --dry-run /usr/ /bacula-restores/usr/
sending incremental file list

sent 3961858 bytes  received 61559 bytes  2682278.00 bytes/sec
total size is 3106601920  speedup is 772.13 (DRY RUN)


the rsync -O option tells rsync to ignore directory modification times.
without -O rsync lists a number directories.

i think accurate restore of directory modification times is not an
easy task.   during restore directory modification times must be
set after all files an sub-directories are restored.  


as i mentioned earlier i am running a daily CopyDiskToTape job.
during the restore file selection bacula uses the Tape Copy of
the last Full Job from sunday, an not the Job from Disk (Disk
Volume are recycled after 15 days, so at least 2 Full are on Disk)

so i think it is not predictable which Job ist used for restore
when two or more Copy Jobs on different Media exist.

maybe this can be solved by using
Media or Pool Priority or by sorting based
on Job.PriorJobId or Pool.NextPoolId

Regards,
Ulrich

On Fri, 2008-06-20 at 12:19 +0200, Ulrich Leodolter wrote:
> On Fri, 2008-06-20 at 11:00 +0200, Kern Sibbald wrote:
> > On Friday 20 June 2008 10:46:32 Ulrich Leodolter wrote:
> > > Hello,
> > >
> > > i am running the bacula svn version since 4 weeks,
> > > i also did a couple of "svn up" + "make install".
> > > (thats why i post here)
> > >
> > > today i did a restore of /usr on my pc for testing.
> > > restore job runs fine, then i compared the result
> > >
> > > $ find /bacula-restores/usr/ |wc -l
> > > 151118
> > >
> > > $ find /usr/ |wc -l
> > > 150841
> > >
> > > i did not run "apt-get update" or something like
> > > that, so i am pretty sure /usr is modified sice
> > > last backup tonight.
> > >
> > > i thought "accurate backup/restore" is implemented
> > > in the current svn version,  but i looks bacula
> > > restores deleted files.
> > >
> > > is there anything to configure for "accurate backup/restore" ?
> > 
> > Yes, you must add a directive to each Job resource where you want an Accurate 
> > backup done:
> > 
> >    Accurate = yea
> > 
> > The default is not to do an accurate backup, because it is new code and there 
> > is a significant overhead in the File daemon to do it.  You also *must* 
> > install 2.5.x clients for each job that does accurate backup -- they have a 
> > lot of new code not in version 2.4.x and lower.
> > 
> > There is nothing special to do for the restore -- it automatically detects 
> > whether the backup was a "normal" or an "accurate" one.
> > 
> > Please re-run your tests and let us know what you find.  Note before doing a 
> > restore, please delete the /bacula-restores/usr directory (or wherever you 
> > are going to do the restore) because that directory has old files already in 
> > it. An accurate restore will not restore deleted files, but if they already 
> > exist in the target directory, the restore will not delete them (restore 
> > restores -- it never deletes).
> > 
> > Thanks for testing this -- we certainly need help testing ...
> > 
> > Regards,
> > 
> > Kern
> > 
> 
> thanks, my first accurate backup/restore looks good (for my linux pc :-)
> 
> i have done the following steps:
> 
> 1. uninstall/purge bacula client 2.2.8 (debian lenny)
> 2. configure, build and install client 2.5.1 from svn
> 3. modify Job leodolter-backup "Accurate = yes" and restart bacula-dir
> 4. run incremental leodolter-backup (job log contains a lot of 
>    st_mtime differs messages)
> 5. rm -fr /bacula-restores/usr and run restore /usr using bconsole
>    from client.
> 6. check results using "rsync -av --dry-run /bacula-restores/usr/ /usr/"
>    rsync reports some directorys, but no files.
> 
> looks very good! i was not sure if it works, because older jobs
> run without "Accurate = yes".
> i will try this again next week after a couple of "apt-get update".
> 
> 
> > >
> > > thanks
> > > ulrich
> > >
> > >
> > >
> > > here is my bconsole output for the file selection:
> > >
> > > ulrich@leodolter:~$ bconsole
> > > Connecting to Director troll.obvsg.at:9101
> > > 1000 OK: troll-dir Version: 2.5.1 (18 June 2008)
> > > Enter a period to cancel a command.
> > > *restore
> > > Automatically selected Catalog: MyCatalog
> > > Using Catalog "MyCatalog"
> > >
> > > First you select one or more JobIds that contain files
> > > to be restored. You will be presented several methods
> > > of specifying the JobIds. Then you will be allowed to
> > > select which files from those JobIds are to be restored.
> > >
> > > To select the JobIds, you have the following choices:
> > >      1: List last 20 Jobs run
> > >      2: List Jobs where a given File is saved
> > >      3: Enter list of comma separated JobIds to select
> > >      4: Enter SQL list command
> > >      5: Select the most recent backup for a client
> > >      6: Select backup for a client before a specified time
> > >      7: Enter a list of files to restore
> > >      8: Enter a list of files to restore before a specified time
> > >      9: Find the JobIds of the most recent backup for a client
> > >     10: Find the JobIds for a backup for a client before a specified
> > > time
> > >     11: Enter a list of directories to restore for found JobIds
> > >     12: Cancel
> > > Select item:  (1-12): 5
> > > Automatically selected Client: leodolter-fd
> > > The defined FileSet resources are:
> > >      1: FullLinuxSet
> > >      2: leodolter-home
> > > Select FileSet resource (1-2): 1
> > > +-------+-------+----------+---------------+---------------------+---------
> > >----+
> > >
> > > | JobId | Level | JobFiles | JobBytes      | StartTime           |
> > >
> > > VolumeName  |
> > > +-------+-------+----------+---------------+---------------------+---------
> > >----+
> > >
> > > |   675 | F     |  167,664 | 1,977,600,040 | 2008-06-15 02:05:01 |
> > >
> > > Backup-0035 |
> > >
> > > |   675 | F     |  167,664 | 1,977,600,040 | 2008-06-15 02:05:01 |
> > >
> > > Backup-0036 |
> > >
> > > |   675 | F     |  167,664 | 1,977,600,040 | 2008-06-15 02:05:01 |
> > >
> > > Backup-0037 |
> > >
> > > |   675 | F     |  167,664 | 1,977,600,040 | 2008-06-15 02:05:01 |
> > >
> > > Backup-0038 |
> > >
> > > |   675 | F     |  167,664 | 1,977,600,040 | 2008-06-15 02:05:01 |
> > >
> > > Backup-0039 |
> > >
> > > |   675 | F     |  167,664 | 1,977,600,040 | 2008-06-15 02:05:01 |
> > >
> > > Backup-0040 |
> > >
> > > |   675 | F     |  167,664 | 1,977,600,040 | 2008-06-15 02:05:01 |
> > >
> > > Backup-0041 |
> > >
> > > |   675 | F     |  167,664 | 1,977,600,040 | 2008-06-15 02:05:01 |
> > >
> > > Backup-0042 |
> > >
> > > |   675 | F     |  167,664 | 1,977,600,040 | 2008-06-15 02:05:01 |
> > >
> > > Backup-0043 |
> > >
> > > |   675 | F     |  167,664 | 1,977,600,040 | 2008-06-15 02:05:01 |
> > >
> > > Backup-0044 |
> > >
> > > |   703 | I     |      229 |    22,913,060 | 2008-06-16 02:05:00 |
> > >
> > > Backup-0110 |
> > >
> > > |   725 | I     |      229 |    22,938,756 | 2008-06-16 02:05:00 |
> > >
> > > BAC.001     |
> > >
> > > |   731 | I     |    6,684 |   148,319,016 | 2008-06-17 02:05:01 |
> > >
> > > Backup-0110 |
> > >
> > > |   745 | I     |    6,684 |   149,218,636 | 2008-06-17 02:05:01 |
> > >
> > > BAC.001     |
> > >
> > > |   759 | I     |    1,207 |    45,679,054 | 2008-06-18 02:05:00 |
> > >
> > > Backup-0067 |
> > >
> > > |   759 | I     |    1,207 |    45,679,054 | 2008-06-18 02:05:00 |
> > >
> > > Backup-0110 |
> > >
> > > |   773 | I     |    1,207 |    45,832,438 | 2008-06-18 02:05:00 |
> > >
> > > BAC.001     |
> > >
> > > |   787 | I     |    2,208 |    70,229,178 | 2008-06-19 02:05:00 |
> > >
> > > Backup-0067 |
> > >
> > > |   787 | I     |    2,208 |    70,229,178 | 2008-06-19 02:05:00 |
> > >
> > > Backup-0068 |
> > >
> > > |   801 | I     |    2,208 |    70,513,318 | 2008-06-19 02:05:00 |
> > >
> > > BAC.001     |
> > >
> > > |   815 | I     |      234 |    19,118,657 | 2008-06-20 02:05:00 |
> > >
> > > Backup-0068 |
> > >
> > > |   829 | I     |      234 |    19,144,410 | 2008-06-20 02:05:00 |
> > >
> > > BAC.001     |
> > > +-------+-------+----------+---------------+---------------------+---------
> > >----+ You have selected the following JobIds:
> > > 675,703,725,731,745,759,773,787,801,815,829
> > >
> > > Building directory tree for JobId(s)
> > > 675,703,725,731,745,759,773,787,801,815,829 ...
> > > +++++++++++++++++++++++++++++++++++++++++++++++++
> > > 166,813 files inserted into the tree.
> > >
> > > You are now entering file selection mode where you add (mark) and
> > > remove (unmark) files to be restored. No files are initially added,
> > > unless
> > > you used the "all" keyword on the command line.
> > > Enter "done" to leave this mode.
> > >
> > > cwd is: /
> > > $ mark usr
> > > 151,118 files marked.
> > 
> > 
> > 
-- 
Ulrich Leodolter <ulrich.leodolter@xxxxxxxx>
Oesterreichische Bibliothekenverbund und Service GmbH
Bruennlbadgasse 17/2A, A-1090 Wien
Fax +43 1 4035158-30
Tel +43 1 4035158-21
Web http://www.obvsg.at


-------------------------------------------------------------------------
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services for
just about anything Open Source.
http://sourceforge.net/services/buy/index.php
_______________________________________________
Bacula-devel mailing list
Bacula-devel@xxxxxxxxxxxxxxxxxxxxx
https://lists.sourceforge.net/lists/listinfo/bacula-devel


This mailing list archive is a service of Copilotco.