Trace number 3386002

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3942.1 1300.07

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-23_507.cnf
MD5SUM0c4fc551e2fe598a8074df6204d87f7d
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables254
Number of clauses34289
Sum of the clauses size152236
Maximum clause length23
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2337
Number of clauses of size 331448
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 52504

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386002-1305581927/watcher-3386002-1305581927 -o /tmp/evaluation-result-3386002-1305581927/solver-3386002-1305581927 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386002-1305581927.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 11.16 11.15 11.15 9/413 27794
/proc/meminfo: memFree=12774768/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=21448 CPUtime=0 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 1553 0 0 0 0 0 0 0 25 0 1 0 669792561 21962752 983 33554432000 4194304 4625164 140737142906688 18446744073709551615 4361099 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/27794/statm: 5362 985 296 106 0 865 0

[startup+0.176281 s]
/proc/loadavg: 11.16 11.15 11.15 9/413 27794
/proc/meminfo: memFree=12774768/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=258964 CPUtime=0.31 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 4788 0 0 0 31 0 0 0 25 0 4 0 669792561 265179136 3096 33554432000 4194304 4625164 140737142906688 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/27794/statm: 64741 3096 337 106 0 60244 0
Current children cumulated CPU time (s) 0.31
Current children cumulated vsize (KiB) 258964

[startup+0.200278 s]
/proc/loadavg: 11.16 11.15 11.15 9/413 27794
/proc/meminfo: memFree=12774768/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=258964 CPUtime=0.38 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 4941 0 0 0 38 0 0 0 25 0 4 0 669792561 265179136 3249 33554432000 4194304 4625164 140737142906688 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/27794/statm: 64741 3249 338 106 0 60244 0
Current children cumulated CPU time (s) 0.38
Current children cumulated vsize (KiB) 258964

[startup+0.300261 s]
/proc/loadavg: 11.16 11.15 11.15 9/413 27794
/proc/meminfo: memFree=12774768/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=258964 CPUtime=0.66 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 5793 0 0 0 66 0 0 0 25 0 4 0 669792561 265179136 3621 33554432000 4194304 4625164 140737142906688 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/27794/statm: 64741 3621 338 106 0 60244 0
Current children cumulated CPU time (s) 0.66
Current children cumulated vsize (KiB) 258964

[startup+0.70019 s]
/proc/loadavg: 11.16 11.15 11.15 9/413 27794
/proc/meminfo: memFree=12774768/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=260908 CPUtime=1.45 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 8021 0 0 0 145 0 0 0 25 0 4 0 669792561 267169792 4007 33554432000 4194304 4625164 140737142906688 18446744073709551615 4512057 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/27794/statm: 65227 4007 338 106 0 60730 0
Current children cumulated CPU time (s) 1.45
Current children cumulated vsize (KiB) 260908

[startup+1.50105 s]
/proc/loadavg: 11.15 11.14 11.15 12/417 27798
/proc/meminfo: memFree=12757632/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=261880 CPUtime=3.44 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 12333 0 0 0 343 1 0 0 25 0 4 0 669792561 268165120 4615 33554432000 4194304 4625164 140737142906688 18446744073709551615 4393101 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/27794/statm: 65470 4615 338 106 0 60973 0
[pid=27794/tid=27796] ppid=27792 vsize=261880 CPUtime=0.9 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 1230 0 0 0 90 0 0 0 25 0 4 0 669792564 268165120 4615 33554432000 4194304 4625164 140737142906688 18446744073709551615 4288640 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=261880 CPUtime=0.61 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 1381 0 0 0 61 0 0 0 25 0 4 0 669792564 268165120 4615 33554432000 4194304 4625164 140737142906688 18446744073709551615 4339569 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=261880 CPUtime=0.54 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 5739 0 0 0 54 0 0 0 25 0 4 0 669792564 268165120 4615 33554432000 4194304 4625164 140737142906688 18446744073709551615 248089395385 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.44
Current children cumulated vsize (KiB) 261880

[startup+3.10076 s]
/proc/loadavg: 11.15 11.14 11.15 12/417 27798
/proc/meminfo: memFree=12751672/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=264056 CPUtime=6.91 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 19385 0 0 0 688 3 0 0 25 0 4 0 669792561 270393344 6177 33554432000 4194304 4625164 140737142906688 18446744073709551615 4509196 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/27794/statm: 66014 6177 342 106 0 61517 0
[pid=27794/tid=27796] ppid=27792 vsize=264056 CPUtime=1.73 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 2488 0 0 0 173 0 0 0 25 0 4 0 669792564 270393344 6177 33554432000 4194304 4625164 140737142906688 18446744073709551615 4352017 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=264056 CPUtime=1.34 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 1815 0 0 0 134 0 0 0 25 0 4 0 669792564 270393344 6177 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=264056 CPUtime=1.1 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 10789 0 0 0 109 1 0 0 25 0 4 0 669792564 270393344 6177 33554432000 4194304 4625164 140737142906688 18446744073709551615 4352404 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 6.91
Current children cumulated vsize (KiB) 264056

[startup+6.3002 s]
/proc/loadavg: 11.13 11.14 11.15 12/417 27798
/proc/meminfo: memFree=12733504/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=266924 CPUtime=13.15 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 31509 0 0 0 1310 5 0 0 25 0 4 0 669792561 273330176 8631 33554432000 4194304 4625164 140737142906688 18446744073709551615 4512190 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/27794/statm: 66731 8631 342 106 0 62234 0
[pid=27794/tid=27796] ppid=27792 vsize=266924 CPUtime=3.15 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 4798 0 0 0 314 1 0 0 25 0 4 0 669792564 273330176 8631 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351795 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=266924 CPUtime=2.85 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 3464 0 0 0 285 0 0 0 25 0 4 0 669792564 273330176 8631 33554432000 4194304 4625164 140737142906688 18446744073709551615 4339865 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=266924 CPUtime=2.1 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 18402 0 0 0 207 3 0 0 25 0 4 0 669792564 273330176 8631 33554432000 4194304 4625164 140737142906688 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 13.15
Current children cumulated vsize (KiB) 266924

[startup+12.7011 s]
/proc/loadavg: 11.12 11.14 11.14 12/417 27798
/proc/meminfo: memFree=12707120/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=277668 CPUtime=27.55 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 62174 0 0 0 2745 10 0 0 25 0 4 0 669792561 284332032 14638 33554432000 4194304 4625164 140737142906688 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/27794/statm: 69417 14638 344 106 0 64920 0
[pid=27794/tid=27796] ppid=27792 vsize=277668 CPUtime=8.25 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 8975 0 0 0 824 1 0 0 25 0 4 0 669792564 284332032 14638 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=277668 CPUtime=6 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 5548 0 0 0 600 0 0 0 25 0 4 0 669792564 284332032 14638 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=277668 CPUtime=5.14 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 42166 0 0 0 508 6 0 0 25 0 4 0 669792564 284332032 14638 33554432000 4194304 4625164 140737142906688 18446744073709551615 4547847 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 27.55
Current children cumulated vsize (KiB) 277668

[startup+25.5008 s]
/proc/loadavg: 11.18 11.15 11.15 12/417 27799
/proc/meminfo: memFree=12674104/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=285372 CPUtime=52.96 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 102154 0 0 0 5279 17 0 0 25 0 4 0 669792561 292220928 22401 33554432000 4194304 4625164 140737142906688 18446744073709551615 4512066 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/27794/statm: 71343 22401 367 106 0 66846 0
[pid=27794/tid=27796] ppid=27792 vsize=285372 CPUtime=14.73 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 13707 0 0 0 1470 3 0 0 25 0 4 0 669792564 292220928 22401 33554432000 4194304 4625164 140737142906688 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=285372 CPUtime=12.3 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 9046 0 0 0 1229 1 0 0 25 0 4 0 669792564 292220928 22401 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=285372 CPUtime=11.2 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 73095 0 0 0 1109 11 0 0 25 0 4 0 669792564 292220928 22401 33554432000 4194304 4625164 140737142906688 18446744073709551615 4548757 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 52.96
Current children cumulated vsize (KiB) 285372

[startup+51.1013 s]
/proc/loadavg: 11.11 11.13 11.14 12/417 27799
/proc/meminfo: memFree=12598792/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=328072 CPUtime=114.03 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 188955 0 0 0 11372 31 0 0 25 0 4 0 669792561 335945728 37086 33554432000 4194304 4625164 140737142906688 18446744073709551615 4519314 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/27794/statm: 82018 37086 573 106 0 77521 0
[pid=27794/tid=27796] ppid=27792 vsize=328072 CPUtime=30.35 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 23026 0 0 0 3031 4 0 0 25 0 4 0 669792564 335945728 37086 33554432000 4194304 4625164 140737142906688 18446744073709551615 4352002 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=328072 CPUtime=25.11 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 12545 0 0 0 2509 2 0 0 25 0 4 0 669792564 335945728 37086 33554432000 4194304 4625164 140737142906688 18446744073709551615 4352827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=328072 CPUtime=23.91 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 145051 0 0 0 2369 22 0 0 25 0 4 0 669792564 335945728 37086 33554432000 4194304 4625164 140737142906688 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 114.03
Current children cumulated vsize (KiB) 328072

[startup+102.301 s]
/proc/loadavg: 11.14 11.14 11.14 12/417 27801
/proc/meminfo: memFree=12471888/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=340620 CPUtime=236.43 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 327847 0 0 0 23588 55 0 0 25 0 4 0 669792561 348794880 55153 33554432000 4194304 4625164 140737142906688 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/27794/statm: 85155 55153 473 106 0 80658 0
[pid=27794/tid=27796] ppid=27792 vsize=340620 CPUtime=62.32 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 35638 0 0 0 6224 8 0 0 25 0 4 0 669792564 348794880 55153 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=340620 CPUtime=50.6 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 20210 0 0 0 5055 5 0 0 25 0 4 0 669792564 348794880 55153 33554432000 4194304 4625164 140737142906688 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=340620 CPUtime=49.55 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 261477 0 0 0 4916 39 0 0 25 0 4 0 669792564 348794880 55153 33554432000 4194304 4625164 140737142906688 18446744073709551615 4352765 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 236.43
Current children cumulated vsize (KiB) 340620

[startup+162.301 s]
/proc/loadavg: 11.15 11.14 11.14 12/417 27802
/proc/meminfo: memFree=12364952/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=403308 CPUtime=385.43 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 355128 0 0 0 38481 62 0 0 25 0 4 0 669792561 412987392 74337 33554432000 4194304 4625164 140737142906688 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/27794/statm: 100827 74337 1061 106 0 96330 0
[pid=27794/tid=27796] ppid=27792 vsize=403308 CPUtime=92.16 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 48854 0 0 0 9204 12 0 0 25 0 4 0 669792564 412987392 74337 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=403308 CPUtime=80.6 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 28782 0 0 0 8053 7 0 0 25 0 4 0 669792564 412987392 74337 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=403308 CPUtime=79.54 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 261999 0 0 0 7914 40 0 0 25 0 4 0 669792564 412987392 74337 33554432000 4194304 4625164 140737142906688 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 385.43
Current children cumulated vsize (KiB) 403308

[startup+222.316 s]
/proc/loadavg: 11.10 11.13 11.14 12/417 27804
/proc/meminfo: memFree=12282824/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=540920 CPUtime=532.45 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 423523 0 0 0 53170 75 0 0 25 0 4 0 669792561 553902080 82516 33554432000 4194304 4625164 140737142906688 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/27794/statm: 135230 82516 620 106 0 130733 0
[pid=27794/tid=27796] ppid=27792 vsize=540920 CPUtime=122.26 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 54224 0 0 0 12212 14 0 0 25 0 4 0 669792564 553902080 82516 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=540920 CPUtime=111.49 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 32764 0 0 0 11141 8 0 0 25 0 4 0 669792564 553902080 82516 33554432000 4194304 4625164 140737142906688 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=540920 CPUtime=108.59 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 317612 0 0 0 10810 49 0 0 25 0 4 0 669792564 553902080 82516 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 532.45
Current children cumulated vsize (KiB) 540920

[startup+282.3 s]

################
# More data... #
################

[pid=27794] ppid=27792 vsize=1052372 CPUtime=1895.37 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 2177083 0 0 0 189195 342 0 0 25 0 4 0 669792561 1077628928 191419 33554432000 4194304 4625164 140737142906688 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/27794/statm: 263093 191419 843 106 0 258596 0
[pid=27794/tid=27796] ppid=27792 vsize=1052372 CPUtime=391.81 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 115649 0 0 0 39140 41 0 0 25 0 4 0 669792564 1077628928 191419 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=1052372 CPUtime=537.28 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 101488 0 0 0 53705 23 0 0 25 0 4 0 669792564 1077628928 191419 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351909 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=1052372 CPUtime=408.44 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 1879574 0 0 0 40580 264 0 0 25 0 4 0 669792564 1077628928 191419 33554432000 4194304 4625164 140737142906688 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1895.37
Current children cumulated vsize (KiB) 1052372

[startup+822.3 s]
/proc/loadavg: 7.07 8.56 10.00 8/408 27838
/proc/meminfo: memFree=13923224/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=1052372 CPUtime=2074.52 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 2193683 0 0 0 207099 353 0 0 25 0 4 0 669792561 1077628928 197653 33554432000 4194304 4625164 140737142906688 18446744073709551615 4392942 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/27794/statm: 263093 197653 843 106 0 258596 0
[pid=27794/tid=27796] ppid=27792 vsize=1052372 CPUtime=421.8 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 115872 0 0 0 42139 41 0 0 25 0 4 0 669792564 1077628928 197653 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=1052372 CPUtime=596.46 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 105504 0 0 0 59617 29 0 0 25 0 4 0 669792564 1077628928 197653 33554432000 4194304 4625164 140737142906688 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=1052372 CPUtime=438.43 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 1880114 0 0 0 43579 264 0 0 25 0 4 0 669792564 1077628928 197653 33554432000 4194304 4625164 140737142906688 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2074.52
Current children cumulated vsize (KiB) 1052372

[startup+882.316 s]
/proc/loadavg: 7.08 8.29 9.82 8/408 27839
/proc/meminfo: memFree=13892904/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=1096088 CPUtime=2276.83 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 2630611 0 0 0 227260 423 0 0 25 0 4 0 669792561 1122394112 205116 33554432000 4194304 4625164 140737142906688 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/27794/statm: 274022 205116 774 106 0 269525 0
[pid=27794/tid=27796] ppid=27792 vsize=1096088 CPUtime=481.54 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 118062 0 0 0 48112 42 0 0 25 0 4 0 669792564 1122394112 205116 33554432000 4194304 4625164 140737142906688 18446744073709551615 4339650 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=1096088 CPUtime=637.99 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 105967 0 0 0 63769 30 0 0 25 0 4 0 669792564 1122394112 205116 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=1096088 CPUtime=479.46 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 2279921 0 0 0 47623 323 0 0 25 0 4 0 669792564 1122394112 205116 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2276.83
Current children cumulated vsize (KiB) 1096088

[startup+942.301 s]
/proc/loadavg: 7.03 8.05 9.64 8/408 27841
/proc/meminfo: memFree=13851932/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=1154864 CPUtime=2515.99 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 2969928 0 0 0 251125 474 0 0 25 0 4 0 669792561 1182580736 215485 33554432000 4194304 4625164 140737142906688 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/27794/statm: 288716 215485 413 106 0 284219 0
[pid=27794/tid=27796] ppid=27792 vsize=1154864 CPUtime=541.53 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 152976 0 0 0 54105 48 0 0 25 0 4 0 669792564 1182580736 215485 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=1154864 CPUtime=697.97 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 106343 0 0 0 69767 30 0 0 25 0 4 0 669792564 1182580736 215485 33554432000 4194304 4625164 140737142906688 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=1154864 CPUtime=538.66 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 2544038 0 0 0 53506 360 0 0 25 0 4 0 669792564 1182580736 215485 33554432000 4194304 4625164 140737142906688 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2515.99
Current children cumulated vsize (KiB) 1154864

[startup+1002.3 s]
/proc/loadavg: 7.01 7.86 9.47 8/408 27843
/proc/meminfo: memFree=13821628/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=1156184 CPUtime=2755.16 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 3545413 0 0 0 274956 560 0 0 25 0 4 0 669792561 1183932416 223327 33554432000 4194304 4625164 140737142906688 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/27794/statm: 289046 223327 409 106 0 284549 0
[pid=27794/tid=27796] ppid=27792 vsize=1156184 CPUtime=601.52 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 156470 0 0 0 60104 48 0 0 25 0 4 0 669792564 1183932416 223327 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=1156184 CPUtime=757.97 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 106899 0 0 0 75767 30 0 0 25 0 4 0 669792564 1183932416 223327 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=1156184 CPUtime=597.84 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 3114103 0 0 0 59339 445 0 0 25 0 4 0 669792564 1183932416 223327 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2755.16
Current children cumulated vsize (KiB) 1156184

[startup+1062.3 s]
/proc/loadavg: 7.05 7.72 9.32 8/408 27844
/proc/meminfo: memFree=13769244/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=1216908 CPUtime=2994.36 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 4146388 0 0 0 298788 648 0 0 25 0 4 0 669792561 1246113792 236186 33554432000 4194304 4625164 140737142906688 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/27794/statm: 304227 236186 418 106 0 299730 0
[pid=27794/tid=27796] ppid=27792 vsize=1216908 CPUtime=661.53 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 159422 0 0 0 66103 50 0 0 25 0 4 0 669792564 1246113792 236186 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=1216908 CPUtime=817.97 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 110920 0 0 0 81765 32 0 0 25 0 4 0 669792564 1246113792 236186 33554432000 4194304 4625164 140737142906688 18446744073709551615 4340144 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=1216908 CPUtime=657.05 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 3678612 0 0 0 65179 526 0 0 25 0 4 0 669792564 1246113792 236186 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2994.36
Current children cumulated vsize (KiB) 1216908

[startup+1122.3 s]
/proc/loadavg: 7.06 7.60 9.18 8/408 27846
/proc/meminfo: memFree=13731004/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=1236616 CPUtime=3233.55 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 4694365 0 0 0 322623 732 0 0 25 0 4 0 669792561 1266294784 245228 33554432000 4194304 4625164 140737142906688 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/27794/statm: 309154 245228 373 106 0 304657 0
[pid=27794/tid=27796] ppid=27792 vsize=1236616 CPUtime=721.53 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 161573 0 0 0 72101 52 0 0 25 0 4 0 669792564 1266294784 245228 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=1236616 CPUtime=877.98 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 112932 0 0 0 87762 36 0 0 25 0 4 0 669792564 1266294784 245228 33554432000 4194304 4625164 140737142906688 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=1236616 CPUtime=716.24 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 4219109 0 0 0 71020 604 0 0 25 0 4 0 669792564 1266294784 245228 33554432000 4194304 4625164 140737142906688 18446744073709551615 248089356550 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3233.55
Current children cumulated vsize (KiB) 1236616

[startup+1182.3 s]
/proc/loadavg: 7.02 7.49 9.04 8/408 27847
/proc/meminfo: memFree=13694872/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=1240324 CPUtime=3472.75 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 4806727 0 0 0 346524 751 0 0 25 0 4 0 669792561 1270091776 254282 33554432000 4194304 4625164 140737142906688 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/27794/statm: 310081 254282 355 106 0 305584 0
[pid=27794/tid=27796] ppid=27792 vsize=1240324 CPUtime=781.54 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 165756 0 0 0 78100 54 0 0 25 0 4 0 669792564 1270091776 254282 33554432000 4194304 4625164 140737142906688 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=1240324 CPUtime=937.98 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 114795 0 0 0 93761 37 0 0 25 0 4 0 669792564 1270091776 254282 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=1240324 CPUtime=775.45 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 4321767 0 0 0 76926 619 0 0 25 0 4 0 669792564 1270091776 254282 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3472.75
Current children cumulated vsize (KiB) 1240324

[startup+1242.3 s]
/proc/loadavg: 7.04 7.41 8.91 8/408 27849
/proc/meminfo: memFree=13644592/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=1258252 CPUtime=3711.95 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 5264069 0 0 0 370378 817 0 0 25 0 4 0 669792561 1288450048 266574 33554432000 4194304 4625164 140737142906688 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/27794/statm: 314563 266574 342 106 0 310066 0
[pid=27794/tid=27796] ppid=27792 vsize=1258252 CPUtime=841.53 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 171968 0 0 0 84097 56 0 0 25 0 4 0 669792564 1288450048 266574 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=1258252 CPUtime=997.98 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 117108 0 0 0 99760 38 0 0 25 0 4 0 669792564 1288450048 266574 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351839 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=1258252 CPUtime=834.66 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 4767811 0 0 0 82785 681 0 0 25 0 4 0 669792564 1288450048 266574 33554432000 4194304 4625164 140737142906688 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3711.95
Current children cumulated vsize (KiB) 1258252



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 7.05 7.35 8.80 8/408 27851
/proc/meminfo: memFree=13616264/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=1323788 CPUtime=3942.01 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 5389268 0 0 0 393361 840 0 0 25 0 4 0 669792561 1355558912 273788 33554432000 4194304 4625164 140737142906688 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/27794/statm: 330947 273788 342 106 0 326450 0
[pid=27794/tid=27796] ppid=27792 vsize=1323788 CPUtime=899.26 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 174573 0 0 0 89867 59 0 0 25 0 4 0 669792564 1355558912 273788 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=1323788 CPUtime=1055.7 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 119271 0 0 0 105529 41 0 0 25 0 4 0 669792564 1355558912 273788 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=1323788 CPUtime=891.59 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 4886735 0 0 0 88460 699 0 0 25 0 4 0 669792564 1355558912 273788 33554432000 4194304 4625164 140737142906688 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3942.01
Current children cumulated vsize (KiB) 1323788

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 7.05 7.35 8.80 8/408 27851
/proc/meminfo: memFree=13616264/32950928 swapFree=62427640/67111528
[pid=27794] ppid=27792 vsize=1323788 CPUtime=3942.01 cores=0,2,4,6
/proc/27794/stat : 27794 (SArTagnan) R 27792 27794 27246 0 -1 4202496 5389268 0 0 0 393361 840 0 0 25 0 4 0 669792561 1355558912 273788 33554432000 4194304 4625164 140737142906688 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/27794/statm: 330947 273788 342 106 0 326450 0
[pid=27794/tid=27796] ppid=27792 vsize=1323788 CPUtime=899.26 cores=0,2,4,6
/proc/27794/task/27796/stat : 27796 (SArTagnan) R 27792 27794 27246 0 -1 4202560 174573 0 0 0 89867 59 0 0 25 0 4 0 669792564 1355558912 273788 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=27794/tid=27797] ppid=27792 vsize=1323788 CPUtime=1055.7 cores=0,2,4,6
/proc/27794/task/27797/stat : 27797 (SArTagnan) R 27792 27794 27246 0 -1 4202560 119271 0 0 0 105529 41 0 0 25 0 4 0 669792564 1355558912 273788 33554432000 4194304 4625164 140737142906688 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=27794/tid=27798] ppid=27792 vsize=1323788 CPUtime=891.59 cores=0,2,4,6
/proc/27794/task/27798/stat : 27798 (SArTagnan) R 27792 27794 27246 0 -1 4202560 4886735 0 0 0 88460 699 0 0 25 0 4 0 669792564 1355558912 273788 33554432000 4194304 4625164 140737142906688 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3942.01
Current children cumulated vsize (KiB) 1323788

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.07
CPU time (s): 3942.1
CPU user time (s): 3933.64
CPU system time (s): 8.45471
CPU usage (%): 303.222
Max. virtual memory (cumulated for all children) (KiB): 1323788

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3933.64
system time used= 8.45471
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5389268
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2427
involuntary context switches= 32325

runsolver used 5.15322 second user time and 12.3081 second system time

The end

Launcher Data 

Begin job on node123 at 2011-05-16 23:38:48
IDJOB=3386002
IDBENCH=83269
IDSOLVER=1871
FILE ID=node123/3386002-1305581927
RUNJOBID= node123-1305577116-27264
PBS_JOBID= 13350215
Free space on /tmp= 73252 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/VanDerWaerden_pd_2-3-23_507.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386002-1305581927/watcher-3386002-1305581927 -o /tmp/evaluation-result-3386002-1305581927/solver-3386002-1305581927 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386002-1305581927.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0c4fc551e2fe598a8074df6204d87f7d
RANDOM SEED=670731386

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12775172 kB
Buffers:          3536 kB
Cached:          37392 kB
SwapCached:      74908 kB
Active:        7749780 kB
Inactive:     12197328 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12775172 kB
SwapTotal:    67111528 kB
SwapFree:     62427640 kB
Dirty:            1184 kB
Writeback:           0 kB
AnonPages:    19839172 kB
Mapped:          25916 kB
Slab:            87648 kB
PageTables:      75180 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 109070428 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73252 MiB
End job on node123 at 2011-05-17 00:00:30