[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Bacula-devel] Multiple fd plugins in one fileset: Restore problems


Hi,

On Monday 29 September 2008, Kern Sibbald wrote:
> - the code is still under important (heavy) development, and you didn't
> specify what version of Bacula you are using.

SVN snapshot from last friday; I am just now upgrading to a current snapshot 
(rev. 7662).

> - Although the plugin interface has been changing, I have not incremented
> the version numbers, which means that if you do not build Bacula and the
> plugin at the same time, there is bound to be some problems.

bpipe plugin, director and file daemon (and all other code) are built from the 
same sources and were installed at the same point of time.

> - The plugin is not at all going to understand __RESTORE_LOCATION=xxx
> /path... So I am not sure how that is going to work.

Whoops. That was some leftover debugging code.

"__RESTORE_LOCATION__==%r /path..." gives the restore location as an 
environment variable to the receiving executable. This part works fine. The 
problems persist when removing that stuff.

> - Though it is possible, I don't see any connection between this and the
> ACL problem. The code is very different.

Both problems seem to be located in filed/restore.c; I do have the impression 
that both problems have something to do with inconsistent/insufficient state 
transitions when the stream type changes. I may well be wrong.

> - Error conditions concerning the plugin are still being worked on to
> ensure that it is robust.

Good :)

> - There may well be a bug.  I'll add multiple Plugin calls to my test case.

Even better!

> - If you can ensure you are on the latest SVN update, it would help, but
> realize the plugin code is still changing on a daily basis as we are just
> now developing a "serious" plugin, so we are correcting problems "real
> time".

ACK.

> - If you are on a recent SVN update and you get a crash, I would like to
> see all the job output (perhaps a debug -d 50 listing) and most important a
> traceback.

I suppose you are requesting a -d 50 from the fd; it is attached for cases (4) 
and (5), referring the cases (4) and (4), the second, of my first mail 
(mis-numbered them there).

Traceback of case 5 attached as well.

> The above remarks are not at all designed to discourage you -- we *need*
> testers.

I did not feel offended. :)

Thx & best regards
   Bastian

-- 
Collax GmbH . Burkheimer Straße 3 . 79111 Freiburg . Germany
p: +49 (0) 761-45684-24
f: +49 (0) 761-45684-10        www.collax.com

Geschäftsführer: William K. Hite / Boris Nalbach
AG München HRB 158898 . Ust.-IdNr: DE 814464942
\ I've taken a vow of poverty. To annoy me, send money.
bilbobox4-fd: plugins.c:113-0 Loaded plugin: name=bpipe-fd.so len=11
bilbobox4-fd: fd_plugins.c:418-0 Loaded plugin: bpipe-fd.so
bilbobox4-fd: filed.c:234-0 filed: listening on port 9102
bilbobox4-fd: cram-md5.c:73-0 send: auth cram-md5 <1019284660.1222699569@bilbobox4-fd> ssl=0
bilbobox4-fd: fd_plugins.c:448-2521 Instantiate plugin_ctx=954bea0 JobId=2521
bilbobox4-fd: fd_plugins.c:104-2521 plugin_ctx=954bea0 JobId=2521
bilbobox4-fd: fd_plugins.c:104-2521 plugin_ctx=954bea0 JobId=2521
bilbobox4-fd: cram-md5.c:80-2521 send: auth cram-md5 <1313644180.1222699569@bilbobox4-fd> ssl=0
bilbobox4-fd: cram-md5.c:99-2521 Authenticate OK Gi+k87+lmi+I86pppU/UgB
bilbobox4-fd: fd_plugins.c:104-2521 plugin_ctx=954bea0 JobId=2521
bilbobox4-fd: crypto.c:600-2521 crypto_digest_new jcr=954b1c0
bilbobox4-fd: fd_plugins.c:152-2521 plugin cmd=bpipe:myname1:/home/b/bastian/tmp05/out1:/home/b/bastian/tmp05/in1
bilbobox4-fd: fd_plugins.c:163-2521 plugin=bpipe-fd.so cmd=bpipe:myname1:/home/b/bastian/tmp05/out1:/home/b/bastian/tmp05/in1 len=5
bilbobox4-fd: fd_plugins.c:168-2521 Command plugin = bpipe:myname1:/home/b/bastian/tmp05/out1:/home/b/bastian/tmp05/in1
bpipe-fd: pluginEvent cmd=bpipe:myname1:/home/b/bastian/tmp05/out1:/home/b/bastian/tmp05/in1
bpipe-fd: plugin=bpipe fname=myname1 reader=/home/b/bastian/tmp05/out1 writer=/home/b/bastian/tmp05/in1
bilbobox4-fd: fd_plugins.c:181-2521 startBackup st_size=7b66210 st_blocks=7b6621c sp=7b661d8
bilbobox4-fd: fd_plugins.c:198-2521 Save_file: file=myname1
bilbobox4-fd: crypto.c:600-2521 crypto_digest_new jcr=954b1c0
bilbobox4-fd: fd_plugins.c:222-2521 send_plugin_name=bpipe:myname1:/home/b/bastian/tmp05/out1:/home/b/bastian/tmp05/in1
bilbobox4-fd: fd_plugins.c:229-2521 send: 2 26 0
bilbobox4-fd: fd_plugins.c:243-2521 send: 2 1 1 bpipe:myname1:/home/b/bastian/tmp05/out1:/home/b/bastian/tmp05/in1
bilbobox4-fd: bfile.c:839-2521 call plugin_bopen fname=myname1
bilbobox4-fd: fd_plugins.c:485-2521 plugin_bopen
bilbobox4-fd: fd_plugins.c:538-2521 plugin_bread
bilbobox4-fd: fd_plugins.c:538-2521 plugin_bread
bilbobox4-fd: fd_plugins.c:513-2521 plugin_bclose
bilbobox4-fd: fd_plugins.c:222-2521 send_plugin_name=bpipe:myname1:/home/b/bastian/tmp05/out1:/home/b/bastian/tmp05/in1
bilbobox4-fd: fd_plugins.c:229-2521 send: 3 26 0
bilbobox4-fd: fd_plugins.c:243-2521 send: 0 0
bilbobox4-fd: fd_plugins.c:152-2521 plugin cmd=bpipe:myname2:/home/b/bastian/tmp05/out2:/home/b/bastian/tmp05/in2
bilbobox4-fd: fd_plugins.c:163-2521 plugin=bpipe-fd.so cmd=bpipe:myname2:/home/b/bastian/tmp05/out2:/home/b/bastian/tmp05/in2 len=5
bilbobox4-fd: fd_plugins.c:168-2521 Command plugin = bpipe:myname2:/home/b/bastian/tmp05/out2:/home/b/bastian/tmp05/in2
bpipe-fd: pluginEvent cmd=bpipe:myname2:/home/b/bastian/tmp05/out2:/home/b/bastian/tmp05/in2
bpipe-fd: plugin=bpipe fname=myname2 reader=/home/b/bastian/tmp05/out2 writer=/home/b/bastian/tmp05/in2
bilbobox4-fd: fd_plugins.c:181-2521 startBackup st_size=7b66210 st_blocks=7b6621c sp=7b661d8
bilbobox4-fd: fd_plugins.c:198-2521 Save_file: file=myname2
bilbobox4-fd: crypto.c:600-2521 crypto_digest_new jcr=954b1c0
bilbobox4-fd: fd_plugins.c:222-2521 send_plugin_name=bpipe:myname2:/home/b/bastian/tmp05/out2:/home/b/bastian/tmp05/in2
bilbobox4-fd: fd_plugins.c:229-2521 send: 3 26 0
bilbobox4-fd: fd_plugins.c:243-2521 send: 3 1 1 bpipe:myname2:/home/b/bastian/tmp05/out2:/home/b/bastian/tmp05/in2
bilbobox4-fd: bfile.c:839-2521 call plugin_bopen fname=myname2
bilbobox4-fd: fd_plugins.c:485-2521 plugin_bopen
bilbobox4-fd: fd_plugins.c:538-2521 plugin_bread
bilbobox4-fd: fd_plugins.c:538-2521 plugin_bread
bilbobox4-fd: fd_plugins.c:513-2521 plugin_bclose
bilbobox4-fd: fd_plugins.c:222-2521 send_plugin_name=bpipe:myname2:/home/b/bastian/tmp05/out2:/home/b/bastian/tmp05/in2
bilbobox4-fd: fd_plugins.c:229-2521 send: 4 26 0
bilbobox4-fd: fd_plugins.c:243-2521 send: 0 0
bilbobox4-fd: fd_plugins.c:152-2521 plugin cmd=bpipe:myname3:/home/b/bastian/tmp05/out3:/home/b/bastian/tmp05/in3
bilbobox4-fd: fd_plugins.c:163-2521 plugin=bpipe-fd.so cmd=bpipe:myname3:/home/b/bastian/tmp05/out3:/home/b/bastian/tmp05/in3 len=5
bilbobox4-fd: fd_plugins.c:168-2521 Command plugin = bpipe:myname3:/home/b/bastian/tmp05/out3:/home/b/bastian/tmp05/in3
bpipe-fd: pluginEvent cmd=bpipe:myname3:/home/b/bastian/tmp05/out3:/home/b/bastian/tmp05/in3
bpipe-fd: plugin=bpipe fname=myname3 reader=/home/b/bastian/tmp05/out3 writer=/home/b/bastian/tmp05/in3
bilbobox4-fd: fd_plugins.c:181-2521 startBackup st_size=7b66210 st_blocks=7b6621c sp=7b661d8
bilbobox4-fd: fd_plugins.c:198-2521 Save_file: file=myname3
bilbobox4-fd: crypto.c:600-2521 crypto_digest_new jcr=954b1c0
bilbobox4-fd: fd_plugins.c:222-2521 send_plugin_name=bpipe:myname3:/home/b/bastian/tmp05/out3:/home/b/bastian/tmp05/in3
bilbobox4-fd: fd_plugins.c:229-2521 send: 4 26 0
bilbobox4-fd: fd_plugins.c:243-2521 send: 4 1 1 bpipe:myname3:/home/b/bastian/tmp05/out3:/home/b/bastian/tmp05/in3
bilbobox4-fd: bfile.c:839-2521 call plugin_bopen fname=myname3
bilbobox4-fd: fd_plugins.c:485-2521 plugin_bopen
bilbobox4-fd: fd_plugins.c:538-2521 plugin_bread
bilbobox4-fd: fd_plugins.c:538-2521 plugin_bread
bilbobox4-fd: fd_plugins.c:513-2521 plugin_bclose
bilbobox4-fd: fd_plugins.c:222-2521 send_plugin_name=bpipe:myname3:/home/b/bastian/tmp05/out3:/home/b/bastian/tmp05/in3
bilbobox4-fd: fd_plugins.c:229-2521 send: 5 26 0
bilbobox4-fd: fd_plugins.c:243-2521 send: 0 0
bilbobox4-fd: fd_plugins.c:104-2521 plugin_ctx=954bea0 JobId=2521
bilbobox4-fd: job.c:253-2521 Quit command loop. Canceled=0
bilbobox4-fd: fd_plugins.c:104-2521 plugin_ctx=954bea0 JobId=2521
bilbobox4-fd: fd_plugins.c:470-2521 Free instance plugin_ctx=954bea0 JobId=2521
bilbobox4-fd: plugins.c:113-0 Loaded plugin: name=bpipe-fd.so len=11
bilbobox4-fd: fd_plugins.c:418-0 Loaded plugin: bpipe-fd.so
bilbobox4-fd: filed.c:234-0 filed: listening on port 9102
bilbobox4-fd: cram-md5.c:73-0 send: auth cram-md5 <1419219498.1222699863@bilbobox4-fd> ssl=0
bilbobox4-fd: fd_plugins.c:448-2524 Instantiate plugin_ctx=9cfeea0 JobId=2524
bilbobox4-fd: fd_plugins.c:104-2524 plugin_ctx=9cfeea0 JobId=2524
bilbobox4-fd: cram-md5.c:80-2524 send: auth cram-md5 <225248905.1222699863@bilbobox4-fd> ssl=0
bilbobox4-fd: cram-md5.c:99-2524 Authenticate OK vxF+VhNt655x9j+OGlRaeA
bilbobox4-fd: fd_plugins.c:104-2524 plugin_ctx=9cfeea0 JobId=2524
bilbobox4-fd: restore.c:655-2524 restore stream_plugin_name=0 0
bilbobox4-fd: fd_plugins.c:265-2524 Read plugin stream string=0 0
Variable "argc" is not available.
Variable "argc" is not available.
/usr/lib/bacula/btraceback.gdb:15: Error in sourced command file:
Variable "maxfd" is not available.
bilbobox4-fd: plugins.c:113-0 Loaded plugin: name=bpipe-fd.so len=11
bilbobox4-fd: fd_plugins.c:418-0 Loaded plugin: bpipe-fd.so
bilbobox4-fd: filed.c:234-0 filed: listening on port 9102
bilbobox4-fd: cram-md5.c:73-0 send: auth cram-md5 <1985493541.1222699706@bilbobox4-fd> ssl=0
bilbobox4-fd: fd_plugins.c:448-2522 Instantiate plugin_ctx=8a7dea0 JobId=2522
bilbobox4-fd: fd_plugins.c:104-2522 plugin_ctx=8a7dea0 JobId=2522
bilbobox4-fd: cram-md5.c:80-2522 send: auth cram-md5 <110559162.1222699706@bilbobox4-fd> ssl=0
bilbobox4-fd: cram-md5.c:99-2522 Authenticate OK M0k//9hWR6/n9UYlq+/RMA
bilbobox4-fd: fd_plugins.c:104-2522 plugin_ctx=8a7dea0 JobId=2522
bilbobox4-fd: restore.c:655-2522 restore stream_plugin_name=2 1 1 bpipe:myname1:/home/b/bastian/tmp05/out1:/home/b/bastian/tmp05/in1
bilbobox4-fd: fd_plugins.c:265-2522 Read plugin stream string=2 1 1 bpipe:myname1:/home/b/bastian/tmp05/out1:/home/b/bastian/tmp05/in1
bilbobox4-fd: fd_plugins.c:292-2522 plugin restore cmd=bpipe:myname1:/home/b/bastian/tmp05/out1:/home/b/bastian/tmp05/in1
bilbobox4-fd: fd_plugins.c:307-2522 plugin=bpipe-fd.so cmd=bpipe:myname1:/home/b/bastian/tmp05/out1:/home/b/bastian/tmp05/in1 len=5
bilbobox4-fd: fd_plugins.c:312-2522 Restore Command plugin = bpipe:myname1:/home/b/bastian/tmp05/out1:/home/b/bastian/tmp05/in1
bpipe-fd: EventRestoreCommand cmd=bpipe:myname1:/home/b/bastian/tmp05/out1:/home/b/bastian/tmp05/in1
bpipe-fd: pluginEvent cmd=bpipe:myname1:/home/b/bastian/tmp05/out1:/home/b/bastian/tmp05/in1
bpipe-fd: plugin=bpipe fname=myname1 reader=/home/b/bastian/tmp05/out1 writer=/home/b/bastian/tmp05/in1
bpipe-fd: IO_OPEN writer=/home/b/bastian/tmp05/in1
bilbobox4-fd: attr.c:281-2522 -rwx------   0 root     root            -1 2008-09-29 16:46:10  myname1
bilbobox4-fd: fd_plugins.c:563-2522 plugin_bwrite
bilbobox4-fd: restore.c:655-2522 restore stream_plugin_name=0 0
bilbobox4-fd: fd_plugins.c:265-2522 Read plugin stream string=0 0
bilbobox4-fd: restore.c:655-2522 restore stream_plugin_name=3 1 1 bpipe:myname2:/home/b/bastian/tmp05/out2:/home/b/bastian/tmp05/in2
bilbobox4-fd: fd_plugins.c:265-2522 Read plugin stream string=3 1 1 bpipe:myname2:/home/b/bastian/tmp05/out2:/home/b/bastian/tmp05/in2
bilbobox4-fd: fd_plugins.c:292-2522 plugin restore cmd=bpipe:myname2:/home/b/bastian/tmp05/out2:/home/b/bastian/tmp05/in2
bilbobox4-fd: fd_plugins.c:307-2522 plugin=bpipe-fd.so cmd=bpipe:myname2:/home/b/bastian/tmp05/out2:/home/b/bastian/tmp05/in2 len=5
bilbobox4-fd: fd_plugins.c:312-2522 Restore Command plugin = bpipe:myname2:/home/b/bastian/tmp05/out2:/home/b/bastian/tmp05/in2
bpipe-fd: EventRestoreCommand cmd=bpipe:myname2:/home/b/bastian/tmp05/out2:/home/b/bastian/tmp05/in2
bpipe-fd: pluginEvent cmd=bpipe:myname2:/home/b/bastian/tmp05/out2:/home/b/bastian/tmp05/in2
bpipe-fd: plugin=bpipe fname=myname2 reader=/home/b/bastian/tmp05/out2 writer=/home/b/bastian/tmp05/in2
bpipe-fd: IO_OPEN writer=/home/b/bastian/tmp05/in2
bilbobox4-fd: attr.c:281-2522 -rwx------   0 root     root            -1 2008-09-29 16:46:10  myname2
bilbobox4-fd: fd_plugins.c:563-2522 plugin_bwrite
bilbobox4-fd: fd_plugins.c:513-2522 plugin_bclose
bilbobox4-fd: restore.c:763-2522 End Do Restore. Files=2 Bytes=28
bilbobox4-fd: fd_plugins.c:104-2522 plugin_ctx=8a7dea0 JobId=2522
bilbobox4-fd: job.c:253-2522 Quit command loop. Canceled=1
bilbobox4-fd: fd_plugins.c:104-2522 plugin_ctx=8a7dea0 JobId=2522
bilbobox4-fd: fd_plugins.c:470-2522 Free instance plugin_ctx=8a7dea0 JobId=2522
Using host libthread_db library "/lib/libthread_db.so.1".
[Thread debugging using libthread_db enabled]
[New Thread -1208461088 (LWP 31309)]
[New Thread 63372208 (LWP 31326)]
[Thread debugging using libthread_db enabled]
[New Thread -1208461088 (LWP 31309)]
[New Thread 63372208 (LWP 31326)]
[New Thread 24443824 (LWP 31310)]
[Thread debugging using libthread_db enabled]
[New Thread -1208461088 (LWP 31309)]
[New Thread 63372208 (LWP 31326)]
0x005cb877 in ___newselect_nocancel () from /lib/libc.so.6
$1 = "bilbobox4-fd", '\0' <repeats 17 times>
$2 = 0x9cf1020 "bacula-fd"
$3 = 0x9cf1048 "/usr/sbin/bacula-fd"
$4 = 0x0
$5 = 0x813e953 "2.5.8 (29 September 2008)"
$6 = 0x8138437 "i686-pc-linux-gnu"
$7 = 0x813e9ba "unknown"
$8 = 0x813e9ba "unknown"
$9 = "bilbobox4", '\0' <repeats 40 times>
#0  0x005cb877 in ___newselect_nocancel () from /lib/libc.so.6
#1  0x08068694 in bnet_thread_server (addrs=0x9cf18c8, max_clients=20, client_wq=0x817ce60, handle_client_request=0x8059010 <handle_client_request(void*)>)
    at bnet_server.c:161
#2  0x08050d9a in main (argc=) at filed.c:236

Thread 3 (Thread 24443824 (LWP 31310)):
#0  0x00a89b22 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#1  0x0807fe72 in watchdog_thread (arg=0x0) at watchdog.c:307
#2  0x00a8706f in start_thread () from /lib/libpthread.so.0
#3  0x005d1ebe in clone () from /lib/libc.so.6
#4  0x0174fbb0 in ?? ()

Thread 2 (Thread 63372208 (LWP 31326)):
#0  0x00a8cb11 in __waitpid_nocancel () from /lib/libpthread.so.0
#1  0x0807cc7f in signal_handler (sig=11) at signal.c:167
#2  <signal handler called>
#3  0x08055026 in plugin_name_stream (jcr=0x9cfe1c0, name=0x9d00678 "0 0") at fd_plugins.c:282
#4  0x0805d2ef in do_restore (jcr=0x9cfe1c0) at restore.c:656
#5  0x0805b1c8 in restore_cmd (jcr=0x9cfe1c0) at job.c:1737
#6  0x0805995b in handle_client_request (dirp=0x9cfde60) at job.c:251
#7  0x08080aff in workq_server (arg=0x817ce60) at workq.c:357
#8  0x00a8706f in start_thread () from /lib/libpthread.so.0
#9  0x005d1ebe in clone () from /lib/libc.so.6
#10 0x03c6fbb0 in ?? ()

Thread 1 (Thread -1208461088 (LWP 31309)):
#0  0x005cb877 in ___newselect_nocancel () from /lib/libc.so.6
#1  0x08068694 in bnet_thread_server (addrs=0x9cf18c8, max_clients=20, client_wq=0x817ce60, handle_client_request=0x8059010 <handle_client_request(void*)>)
    at bnet_server.c:161
#2  0x08050d9a in main (argc=) at filed.c:236
#0  0x005cb877 in ___newselect_nocancel () from /lib/libc.so.6
#0  0x005cb877 in ___newselect_nocancel () from /lib/libc.so.6
No symbol table info available.
#1  0x08068694 in bnet_thread_server (addrs=0x9cf18c8, max_clients=20, client_wq=0x817ce60, handle_client_request=0x8059010 <handle_client_request(void*)>)
    at bnet_server.c:161
161	      if ((stat = select(maxfd + 1, &sockset, NULL, NULL, NULL)) < 0) {
Current language:  auto; currently c++
maxfd =

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Bacula-devel mailing list
Bacula-devel@xxxxxxxxxxxxxxxxxxxxx
https://lists.sourceforge.net/lists/listinfo/bacula-devel


This mailing list archive is a service of Copilot Consulting.