Trace number 238048

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
galac 1? (TO) 1800.07 1815.77

General information on the benchmark

Namehaystacks/
haystacks_11.xml
MD5SUM112511f328f26d7ff7e1fbd0be7de3f1
Bench Category2-ARY-INT (binary constraints in intension)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark0.349946
SatisfiableNO
(Un)Satisfiability was proved
Number of variables121
Number of constraints615
Maximum constraint arity2
Maximum domain size11
Number of constraints which are defined in extension0
Number of constraints which are defined in intension615
Global constraints used (with number of constraints)

Solver Data (download as text)

0.03	c --- Preproc Stats ---
1.10	c start processing
1.10	c start relation processing
1.10	c start cnf exporting
1.60	c parsing time : 0.931
1.60	c preprocessing time : 1.434
1.60	
1.60	c Nary constraints - conflicts : 0 supports : 0
1.60	c Binary constraints - conflicts : 605 supports :10
1.60	c max arity constraint : 2
1.60	c Max Tuples generated 121
1.60	c relations : 4
1.60	c relations BDD: 0
1.60	c vars : 1332 - clauses :  13851
1.60	
1.63	 
1.63	c --- Minisat Stats ---
1.63	 

Verifier Data (download as text)

ERROR: Unexpected answer ! (SAT/UNSAT expected)
Got answer: 

Watcher Data (download as text)

runsolver version 3.1.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node9/watcher-238048-1168352975 -o ROOT/results/node9/solver-238048-1168352975 -C 1800 -M 900 /tmp/evaluation/238048-1168352975/galac.sh /tmp/evaluation/238048-1168352975/unknown.xml 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 921600 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 972800 KiB
Current StackSize limit: 10240 KiB

/proc/loadavg: 2.04 2.03 2.00 5/93 20926
/proc/meminfo: memFree=1605472/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=8560 CPUtime=0
/proc/20925/stat : 20925 (galac.sh) R 20923 20925 18393 0 -1 4194304 308 0 0 0 0 0 0 0 20 0 1 0 183692650 8765440 253 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215419176847 0 0 4096 8192 0 0 0 17 1 0 0
/proc/20925/statm: 2140 253 197 79 0 133 0

[startup+0.10591 s]
/proc/loadavg: 2.04 2.03 2.00 5/93 20926
/proc/meminfo: memFree=1605472/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=0.01
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 761 1704 0 0 0 0 0 1 18 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47576

[startup+0.513946 s]
/proc/loadavg: 2.04 2.03 2.00 5/93 20926
/proc/meminfo: memFree=1605472/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=0.01
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 761 1704 0 0 0 0 0 1 18 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 47576

[startup+1.33704 s]
/proc/loadavg: 2.04 2.03 2.00 4/101 20946
/proc/meminfo: memFree=1558880/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=0.01
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 761 1704 0 0 0 0 0 1 18 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20939] ppid=20925 vsize=861064 CPUtime=1.27
/proc/20939/stat : 20939 (java) R 20925 20925 18393 0 -1 0 11939 0 1 0 119 8 0 0 17 0 8 0 183692654 881729536 11690 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4073696711 0 4 0 23759 18446744073709551615 0 0 17 1 0 0
/proc/20939/statm: 215266 11690 2011 14 0 201471 0
[pid=20939/tid=20940] ppid=20925 vsize=861064 CPUtime=0.11
/proc/20939/task/20940/stat : 20940 (java) S 20925 20925 18393 0 -1 64 3356 0 0 0 10 1 0 0 16 0 8 0 183692658 881729536 11690 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 0 0 23759 0 0 0 -1 1 0 0
[pid=20939/tid=20941] ppid=20925 vsize=861064 CPUtime=0
/proc/20939/task/20941/stat : 20941 (java) S 20925 20925 18393 0 -1 64 12 0 0 0 0 0 0 0 15 0 8 0 183692658 881729536 11690 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20939/tid=20942] ppid=20925 vsize=861064 CPUtime=0
/proc/20939/task/20942/stat : 20942 (java) S 20925 20925 18393 0 -1 64 7 0 0 0 0 0 0 0 15 0 8 0 183692658 881729536 11690 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20939/tid=20943] ppid=20925 vsize=861064 CPUtime=0
/proc/20939/task/20943/stat : 20943 (java) S 20925 20925 18393 0 -1 64 1 0 0 0 0 0 0 0 18 0 8 0 183692662 881729536 11690 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20939/tid=20944] ppid=20925 vsize=861064 CPUtime=0.29
/proc/20939/task/20944/stat : 20944 (java) R 20925 20925 18393 0 -1 64 1039 0 0 0 28 1 0 0 21 0 8 0 183692662 881729536 11690 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20939/tid=20945] ppid=20925 vsize=861064 CPUtime=0
/proc/20939/task/20945/stat : 20945 (java) S 20925 20925 18393 0 -1 64 1 0 0 0 0 0 0 0 19 0 8 0 183692662 881729536 11690 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
[pid=20939/tid=20946] ppid=20925 vsize=861064 CPUtime=0
/proc/20939/task/20946/stat : 20946 (java) S 20925 20925 18393 0 -1 64 1 0 0 0 0 0 0 0 15 0 8 0 183692662 881729536 11690 18446744073709551615 134512640 134570532 4294956112 18446744073709551615 4294960144 0 4 0 23759 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1.28
Current children cumulated vsize (KiB) 908640

[startup+2.97722 s]
/proc/loadavg: 2.11 2.04 2.01 3/94 20947
/proc/meminfo: memFree=1589784/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=6140 CPUtime=1.31
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 1212 0 0 0 131 0 0 0 25 0 1 0 183692814 6287360 1194 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529509 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 1535 1194 54 142 0 1391 0
Current children cumulated CPU time (s) 2.88
Current children cumulated vsize (KiB) 53716

[startup+6.2726 s]
/proc/loadavg: 2.11 2.04 2.01 3/94 20947
/proc/meminfo: memFree=1587608/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=7888 CPUtime=4.58
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 1655 0 0 0 458 0 0 0 25 0 1 0 183692814 8077312 1637 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529382 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 1972 1637 54 142 0 1828 0
Current children cumulated CPU time (s) 6.15
Current children cumulated vsize (KiB) 55464

[startup+12.7393 s]
/proc/loadavg: 2.10 2.04 2.00 3/94 20947
/proc/meminfo: memFree=1566168/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=9532 CPUtime=10.99
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 2070 0 0 0 1098 1 0 0 25 0 1 0 183692814 9760768 2052 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 2383 2052 54 142 0 2239 0
Current children cumulated CPU time (s) 12.56
Current children cumulated vsize (KiB) 57108

[startup+25.5768 s]
/proc/loadavg: 2.08 2.04 2.00 3/94 20947
/proc/meminfo: memFree=1531864/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=13056 CPUtime=23.71
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 2918 0 0 0 2370 1 0 0 25 0 1 0 183692814 13369344 2900 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134522227 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 3264 2900 54 142 0 3120 0
Current children cumulated CPU time (s) 25.28
Current children cumulated vsize (KiB) 60632

[startup+51.2657 s]
/proc/loadavg: 2.05 2.03 2.00 3/94 20947
/proc/meminfo: memFree=1465944/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=20556 CPUtime=49.16
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 4756 0 0 0 4913 3 0 0 25 0 1 0 183692814 21049344 4738 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529304 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 5139 4738 54 142 0 4995 0
Current children cumulated CPU time (s) 50.73
Current children cumulated vsize (KiB) 68132

[startup+102.507 s]
/proc/loadavg: 2.08 2.04 2.00 3/94 20947
/proc/meminfo: memFree=1350040/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=20556 CPUtime=99.94
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 4774 0 0 0 9990 4 0 0 25 0 1 0 183692814 21049344 4756 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529417 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 5139 4756 54 142 0 4995 0
Current children cumulated CPU time (s) 101.51
Current children cumulated vsize (KiB) 68132

[startup+162.6 s]
/proc/loadavg: 2.03 2.03 2.00 3/94 20947
/proc/meminfo: memFree=1263384/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=24884 CPUtime=159.49
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 5782 0 0 0 15944 5 0 0 25 0 1 0 183692814 25481216 5764 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529426 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 6221 5764 54 142 0 6077 0
Current children cumulated CPU time (s) 161.06
Current children cumulated vsize (KiB) 72460

[startup+222.694 s]
/proc/loadavg: 2.01 2.02 2.00 3/94 20947
/proc/meminfo: memFree=1180504/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=29920 CPUtime=219.03
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 6896 0 0 0 21897 6 0 0 25 0 1 0 183692814 30638080 6878 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529426 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 7480 6878 54 142 0 7336 0
Current children cumulated CPU time (s) 220.6
Current children cumulated vsize (KiB) 77496

[startup+282.771 s]
/proc/loadavg: 2.08 2.05 2.01 3/94 20947
/proc/meminfo: memFree=1176536/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=34292 CPUtime=278.55
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 7882 0 0 0 27848 7 0 0 25 0 1 0 183692814 35115008 7864 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134522156 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 8573 7864 54 142 0 8429 0
Current children cumulated CPU time (s) 280.12
Current children cumulated vsize (KiB) 81868

[startup+342.869 s]
/proc/loadavg: 2.03 2.03 2.00 3/94 20947
/proc/meminfo: memFree=1174040/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=37016 CPUtime=338.11
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 8487 0 0 0 33803 8 0 0 25 0 1 0 183692814 37904384 8469 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 9254 8469 54 142 0 9110 0
Current children cumulated CPU time (s) 339.68
Current children cumulated vsize (KiB) 84592

[startup+402.949 s]
/proc/loadavg: 2.09 2.04 2.01 3/94 20947
/proc/meminfo: memFree=1172632/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=38416 CPUtime=397.64
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 8820 0 0 0 39755 9 0 0 25 0 1 0 183692814 39337984 8802 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 9604 8802 54 142 0 9460 0
Current children cumulated CPU time (s) 399.21
Current children cumulated vsize (KiB) 85992

[startup+463.014 s]
/proc/loadavg: 2.08 2.05 2.00 3/94 20947
/proc/meminfo: memFree=1170904/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=40372 CPUtime=457.16
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 9228 0 0 0 45706 10 0 0 25 0 1 0 183692814 41340928 9210 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0

################
# More data... #
################

/proc/loadavg: 2.00 2.01 2.00 3/94 20947
/proc/meminfo: memFree=1143512/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=69636 CPUtime=1111.55
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 15881 0 0 0 111135 20 0 0 25 0 1 0 183692814 71307264 15863 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529435 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 17409 15863 54 142 0 17265 0
Current children cumulated CPU time (s) 1113.12
Current children cumulated vsize (KiB) 117212

[startup+1183.51 s]
/proc/loadavg: 2.17 2.05 2.01 3/94 20947
/proc/meminfo: memFree=1143384/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=69636 CPUtime=1171.08
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 15891 0 0 0 117088 20 0 0 25 0 1 0 183692814 71307264 15873 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529417 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 17409 15873 54 142 0 17265 0
Current children cumulated CPU time (s) 1172.65
Current children cumulated vsize (KiB) 117212

[startup+1243.61 s]
/proc/loadavg: 2.10 2.05 2.01 3/94 20947
/proc/meminfo: memFree=1142104/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=71084 CPUtime=1230.63
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 16199 0 0 0 123041 22 0 0 25 0 1 0 183692814 72790016 16181 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 17771 16181 54 142 0 17627 0
Current children cumulated CPU time (s) 1232.2
Current children cumulated vsize (KiB) 118660

[startup+1303.62 s]
/proc/loadavg: 2.08 2.06 2.01 3/94 20947
/proc/meminfo: memFree=1140760/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=72540 CPUtime=1290.09
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 16519 0 0 0 128987 22 0 0 25 0 1 0 183692814 74280960 16501 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529354 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 18135 16501 54 142 0 17991 0
Current children cumulated CPU time (s) 1291.66
Current children cumulated vsize (KiB) 120116

[startup+1363.65 s]
/proc/loadavg: 2.03 2.04 2.01 3/94 20947
/proc/meminfo: memFree=1140376/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=72720 CPUtime=1349.57
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 16587 0 0 0 134934 23 0 0 25 0 1 0 183692814 74465280 16569 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 18180 16569 54 142 0 18036 0
Current children cumulated CPU time (s) 1351.14
Current children cumulated vsize (KiB) 120296

[startup+1423.67 s]
/proc/loadavg: 2.01 2.03 2.00 4/94 20947
/proc/meminfo: memFree=1139288/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=73820 CPUtime=1409.03
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 16835 0 0 0 140880 23 0 0 25 0 1 0 183692814 75591680 16817 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 18455 16817 54 142 0 18311 0
Current children cumulated CPU time (s) 1410.6
Current children cumulated vsize (KiB) 121396

[startup+1483.69 s]
/proc/loadavg: 2.06 2.04 2.00 3/94 20947
/proc/meminfo: memFree=1138392/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=74868 CPUtime=1468.51
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 17036 0 0 0 146827 24 0 0 25 0 1 0 183692814 76664832 17018 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 18717 17018 54 142 0 18573 0
Current children cumulated CPU time (s) 1470.08
Current children cumulated vsize (KiB) 122444

[startup+1543.7 s]
/proc/loadavg: 2.06 2.04 2.00 4/94 20947
/proc/meminfo: memFree=1137624/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=75616 CPUtime=1527.98
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 17223 0 0 0 152773 25 0 0 25 0 1 0 183692814 77430784 17205 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529430 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 18904 17205 54 142 0 18760 0
Current children cumulated CPU time (s) 1529.55
Current children cumulated vsize (KiB) 123192

[startup+1603.78 s]
/proc/loadavg: 2.08 2.05 2.00 3/94 20947
/proc/meminfo: memFree=1137048/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=76256 CPUtime=1587.5
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 17346 0 0 0 158725 25 0 0 25 0 1 0 183692814 78086144 17328 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 19064 17328 54 142 0 18920 0
Current children cumulated CPU time (s) 1589.07
Current children cumulated vsize (KiB) 123832

[startup+1663.86 s]
/proc/loadavg: 2.10 2.05 2.00 5/94 20947
/proc/meminfo: memFree=1136088/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=77252 CPUtime=1647.03
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 17575 0 0 0 164677 26 0 0 25 0 1 0 183692814 79106048 17557 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529354 0 0 4096 3 0 0 0 17 1 0 0
/proc/20947/statm: 19313 17557 54 142 0 19169 0
Current children cumulated CPU time (s) 1648.6
Current children cumulated vsize (KiB) 124828

[startup+1723.89 s]
/proc/loadavg: 1.55 1.92 1.96 2/79 20963
/proc/meminfo: memFree=1749968/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=77876 CPUtime=1706.82
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 17710 0 0 0 170655 27 0 0 25 0 1 0 183692814 79745024 17692 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134525757 0 0 4096 3 0 0 0 17 0 0 0
/proc/20947/statm: 19469 17692 54 142 0 19325 0
Current children cumulated CPU time (s) 1708.39
Current children cumulated vsize (KiB) 125452

[startup+1783.94 s]
/proc/loadavg: 1.77 1.90 1.95 3/86 21264
/proc/meminfo: memFree=1587240/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=78516 CPUtime=1766.81
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 17883 0 0 0 176649 32 0 0 25 0 1 0 183692814 80400384 17865 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134529316 0 0 4096 3 0 0 0 17 0 0 0
/proc/20947/statm: 19629 17865 54 142 0 19485 0
Current children cumulated CPU time (s) 1768.38
Current children cumulated vsize (KiB) 126092



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1815.76 s]
/proc/loadavg: 1.86 1.91 1.95 3/94 21334
/proc/meminfo: memFree=1612064/2055920 swapFree=4191880/4192956
[pid=20925] ppid=20923 vsize=47576 CPUtime=1.57
/proc/20925/stat : 20925 (galac.sh) S 20923 20925 18393 0 -1 4194304 799 17492 0 1 0 0 143 14 17 0 1 0 183692650 48717824 363 18446744073709551615 4194304 4520092 548682069344 18446744073709551615 215418596186 0 2 4096 73728 18446744071563181037 0 0 17 1 0 0
/proc/20925/statm: 11894 363 245 79 0 218 0
[pid=20947] ppid=20925 vsize=78872 CPUtime=1798.5
/proc/20947/stat : 20947 (minisat) R 20925 20925 18393 0 -1 4194304 17957 0 0 0 179815 35 0 0 25 0 1 0 183692814 80764928 17939 18446744073709551615 134512640 135096742 4294956496 18446744073709551615 134525757 0 0 4096 3 0 0 0 17 0 0 0
/proc/20947/statm: 19718 17939 54 142 0 19574 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 126448

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 20925 and gives childrusage.ru_utime.tv_sec=1 childrusage.ru_utime.tv_usec=433782 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=150977
CPU time returned by wait4() is 1.58476
while last known CPU time is 1800.07

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1815.77
CPU time (s): 1800.07
CPU user time (s): 1799.58
CPU system time (s): 0.49
CPU usage (%): 99.1352
Max. virtual memory (cumulated for all children) (KiB): 908640

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.43378
system time used= 0.150977
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18291
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 935
involuntary context switches= 939

runsolver used 2.09868 s user time and 5.8951 s system time

The end

Launcher Data (download as text)

Begin job on node9 on Tue Jan  9 14:29:35 UTC 2007


IDJOB= 238048
IDBENCH= 6979
FILE ID= node9/238048-1168352975

PBS_JOBID= 3503638

Free space on /tmp= 66544 MiB

BENCH NAME= HOME/pub/bench/CPAI06/haystacks/haystacks_11.xml
COMMAND LINE= /tmp/evaluation/238048-1168352975/galac.sh /tmp/evaluation/238048-1168352975/unknown.xml
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node9/watcher-238048-1168352975 -o ROOT/results/node9/solver-238048-1168352975 -C 1800 -M 900  /tmp/evaluation/238048-1168352975/galac.sh /tmp/evaluation/238048-1168352975/unknown.xml

META MD5SUM SOLVER= d8bf20eb49fe33822f00bab08f33d7fc
MD5SUM BENCH=  112511f328f26d7ff7e1fbd0be7de3f1

RANDOM SEED= 942109788

TIME LIMIT= 1800 seconds

MEMORY LIMIT= 900 MiB


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.231
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.231
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1605888 kB
Buffers:         21544 kB
Cached:         126084 kB
SwapCached:        408 kB
Active:         332576 kB
Inactive:        72644 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1605888 kB
SwapTotal:     4192956 kB
SwapFree:      4191880 kB
Dirty:            2920 kB
Writeback:           0 kB
Mapped:         279196 kB
Slab:            29188 kB
Committed_AS:  6261200 kB
PageTables:       2744 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66542 MiB



End job on node9 on Tue Jan  9 14:59:51 UTC 2007