Trace number 3385973

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3974.63 1300.17

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_60_20_50_3-dir.shuffled-as.sat03-114.cnf
MD5SUM9ffa0325c9e00b41c025f41d20ec5a0c
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark4252.27
Satisfiable
(Un)Satisfiability was proved
Number of variables600
Number of clauses49070
Sum of the clauses size98700
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 249050
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 520

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385973-1305582362/watcher-3385973-1305582362 -o /tmp/evaluation-result-3385973-1305582362/solver-3385973-1305582362 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385973-1305582362.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.68 5.03 6.11 3/454 17392
/proc/meminfo: memFree=14443792/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=52984 CPUtime=0.01 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 1322 0 0 0 1 0 0 0 24 0 4 0 650652357 54255616 1009 33554432000 4194304 4625164 140734808700768 18446744073709551615 47140630067120 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17392/statm: 13246 1009 301 106 0 8749 0
[pid=17392/tid=17397] ppid=17390 vsize=52984 CPUtime=0 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 650652358 54255616 1009 33554432000 4194304 4625164 140734808700768 18446744073709551615 255106825201 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=52984 CPUtime=0 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 650652358 54255616 1009 33554432000 4194304 4625164 140734808700768 18446744073709551615 255106825201 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=52984 CPUtime=0 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 650652358 54255616 1009 33554432000 4194304 4625164 140734808700768 18446744073709551615 255106825201 0 0 4096 2 0 0 0 -1 5 0 0 0

[startup+0.0470201 s]
/proc/loadavg: 4.68 5.03 6.11 3/454 17392
/proc/meminfo: memFree=14443792/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=184656 CPUtime=0.1 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 1806 0 0 0 10 0 0 0 25 0 4 0 650652357 189087744 1488 33554432000 4194304 4625164 140734808700768 18446744073709551615 255106873838 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17392/statm: 46164 1488 331 106 0 41667 0
[pid=17392/tid=17397] ppid=17390 vsize=184656 CPUtime=0.02 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 139 0 0 0 2 0 0 0 25 0 4 0 650652358 189087744 1488 33554432000 4194304 4625164 140734808700768 18446744073709551615 4352549 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=184656 CPUtime=0.02 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 208 0 0 0 2 0 0 0 25 0 4 0 650652358 189087744 1488 33554432000 4194304 4625164 140734808700768 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=184656 CPUtime=0.02 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 125 0 0 0 2 0 0 0 25 0 4 0 650652358 189087744 1489 33554432000 4194304 4625164 140734808700768 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 184656

[startup+0.141053 s]
/proc/loadavg: 4.68 5.03 6.11 3/454 17392
/proc/meminfo: memFree=14443792/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=259900 CPUtime=0.62 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) D 17390 17392 16929 0 -1 4202496 10230 0 0 0 61 1 0 0 25 0 4 0 650652357 266137600 6104 33554432000 4194304 4625164 140734808700768 18446744073709551615 4339447 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17392/statm: 64975 6104 333 106 0 60478 0
[pid=17392/tid=17397] ppid=17390 vsize=259900 CPUtime=0.12 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 647 0 0 0 12 0 0 0 25 0 4 0 650652358 266137600 6104 33554432000 4194304 4625164 140734808700768 18446744073709551615 255106812087 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=259900 CPUtime=0.2 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 824 0 0 0 20 0 0 0 25 0 4 0 650652358 266137600 6104 33554432000 4194304 4625164 140734808700768 18446744073709551615 4467259 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=259900 CPUtime=0.2 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 564 0 0 0 20 0 0 0 18 0 4 0 650652358 266137600 6104 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.62
Current children cumulated vsize (KiB) 259900

[startup+0.300977 s]
/proc/loadavg: 4.68 5.03 6.11 3/454 17392
/proc/meminfo: memFree=14443792/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=264932 CPUtime=0.85 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 13567 0 0 0 83 2 0 0 25 0 4 0 650652357 271290368 7525 33554432000 4194304 4625164 140734808700768 18446744073709551615 255106812087 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17392/statm: 66233 7525 335 106 0 61736 0
[pid=17392/tid=17397] ppid=17390 vsize=264932 CPUtime=0.19 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 1093 0 0 0 19 0 0 0 25 0 4 0 650652358 271290368 7525 33554432000 4194304 4625164 140734808700768 18446744073709551615 4352053 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=264932 CPUtime=0.25 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 1068 0 0 0 25 0 0 0 25 0 4 0 650652358 271290368 7525 33554432000 4194304 4625164 140734808700768 18446744073709551615 255106436009 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=264932 CPUtime=0.27 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 575 0 0 0 27 0 0 0 18 0 4 0 650652358 271290368 7525 33554432000 4194304 4625164 140734808700768 18446744073709551615 4334251 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.85
Current children cumulated vsize (KiB) 264932

[startup+0.700906 s]
/proc/loadavg: 4.68 5.03 6.11 3/454 17392
/proc/meminfo: memFree=14443792/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=267560 CPUtime=2.04 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 15517 0 0 0 202 2 0 0 25 0 4 0 650652357 273981440 9163 33554432000 4194304 4625164 140734808700768 18446744073709551615 4339447 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17392/statm: 66890 9163 335 106 0 62393 0
[pid=17392/tid=17397] ppid=17390 vsize=267560 CPUtime=0.59 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 1676 0 0 0 59 0 0 0 25 0 4 0 650652358 273981440 9163 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=267560 CPUtime=0.65 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 1632 0 0 0 65 0 0 0 25 0 4 0 650652358 273981440 9163 33554432000 4194304 4625164 140734808700768 18446744073709551615 4352029 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=267560 CPUtime=0.67 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 1373 0 0 0 67 0 0 0 18 0 4 0 650652358 273981440 9163 33554432000 4194304 4625164 140734808700768 18446744073709551615 255122752539 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.04
Current children cumulated vsize (KiB) 267560

[startup+1.50077 s]
/proc/loadavg: 4.68 5.03 6.11 10/466 17404
/proc/meminfo: memFree=14367084/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=306348 CPUtime=4.42 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 36987 0 0 0 438 4 0 0 25 0 4 0 650652357 313700352 21887 33554432000 4194304 4625164 140734808700768 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17392/statm: 76587 21887 475 106 0 72090 0
[pid=17392/tid=17397] ppid=17390 vsize=306348 CPUtime=1.37 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 3372 0 0 0 137 0 0 0 25 0 4 0 650652358 313700352 21887 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351981 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=306348 CPUtime=1.45 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 3680 0 0 0 145 0 0 0 25 0 4 0 650652358 313700352 21887 33554432000 4194304 4625164 140734808700768 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=306348 CPUtime=1.26 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 2804 0 0 0 126 0 0 0 19 0 4 0 650652358 313700352 21887 33554432000 4194304 4625164 140734808700768 18446744073709551615 4547257 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4.42
Current children cumulated vsize (KiB) 306348

[startup+3.10049 s]
/proc/loadavg: 4.68 5.03 6.11 10/466 17404
/proc/meminfo: memFree=14295288/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=313232 CPUtime=9.2 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 47123 0 0 0 914 6 0 0 25 0 4 0 650652357 320749568 25447 33554432000 4194304 4625164 140734808700768 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/17392/statm: 78308 25447 586 106 0 73811 0
[pid=17392/tid=17397] ppid=17390 vsize=313232 CPUtime=2.43 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 3615 0 0 0 243 0 0 0 24 0 4 0 650652358 320749568 25447 33554432000 4194304 4625164 140734808700768 18446744073709551615 4339564 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=313232 CPUtime=2.88 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 5136 0 0 0 288 0 0 0 25 0 4 0 650652358 320749568 25447 33554432000 4194304 4625164 140734808700768 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=313232 CPUtime=2.81 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 9633 0 0 0 280 1 0 0 23 0 4 0 650652358 320749568 25447 33554432000 4194304 4625164 140734808700768 18446744073709551615 4559677 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 9.2
Current children cumulated vsize (KiB) 313232

[startup+6.30092 s]
/proc/loadavg: 5.03 5.10 6.13 10/466 17404
/proc/meminfo: memFree=14260872/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=313232 CPUtime=18.76 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 64909 0 0 0 1867 9 0 0 25 0 4 0 650652357 320749568 28343 33554432000 4194304 4625164 140734808700768 18446744073709551615 4512046 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/17392/statm: 78308 28343 638 106 0 73811 0
[pid=17392/tid=17397] ppid=17390 vsize=313232 CPUtime=4.04 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 4950 0 0 0 403 1 0 0 25 0 4 0 650652358 320749568 28343 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=313232 CPUtime=4.48 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 5348 0 0 0 448 0 0 0 25 0 4 0 650652358 320749568 28343 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=313232 CPUtime=6.02 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 25872 0 0 0 598 4 0 0 25 0 4 0 650652358 320749568 28343 33554432000 4194304 4625164 140734808700768 18446744073709551615 4579588 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 18.76
Current children cumulated vsize (KiB) 313232

[startup+12.7008 s]
/proc/loadavg: 5.34 5.16 6.14 10/466 17404
/proc/meminfo: memFree=14209800/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=319480 CPUtime=37.85 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 78805 0 0 0 3774 11 0 0 25 0 4 0 650652357 327147520 31754 33554432000 4194304 4625164 140734808700768 18446744073709551615 4512092 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/17392/statm: 79870 31754 627 106 0 75373 0
[pid=17392/tid=17397] ppid=17390 vsize=319480 CPUtime=7.33 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 7202 0 0 0 732 1 0 0 25 0 4 0 650652358 327147520 31754 33554432000 4194304 4625164 140734808700768 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=319480 CPUtime=7.58 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 7364 0 0 0 758 0 0 0 25 0 4 0 650652358 327147520 31754 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351884 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=319480 CPUtime=12.42 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 35480 0 0 0 1236 6 0 0 25 0 4 0 650652358 327147520 31754 33554432000 4194304 4625164 140734808700768 18446744073709551615 255122752539 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37.85
Current children cumulated vsize (KiB) 319480

[startup+25.5005 s]
/proc/loadavg: 6.15 5.35 6.19 10/466 17404
/proc/meminfo: memFree=14079736/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=319480 CPUtime=76.04 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 187799 0 0 0 7575 29 0 0 25 0 4 0 650652357 327147520 39732 33554432000 4194304 4625164 140734808700768 18446744073709551615 4512444 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/17392/statm: 79870 39732 657 106 0 75373 0
[pid=17392/tid=17397] ppid=17390 vsize=319480 CPUtime=13.8 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 10724 0 0 0 1379 1 0 0 25 0 4 0 650652358 327147520 39733 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=319480 CPUtime=13.91 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 7938 0 0 0 1391 0 0 0 25 0 4 0 650652358 327147520 39734 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=319480 CPUtime=25.21 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 140380 0 0 0 2498 23 0 0 25 0 4 0 650652358 327147520 39734 33554432000 4194304 4625164 140734808700768 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 76.04
Current children cumulated vsize (KiB) 319480

[startup+51.1011 s]
/proc/loadavg: 7.28 5.67 6.27 10/466 17405
/proc/meminfo: memFree=13967364/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=430720 CPUtime=152.45 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 261518 0 0 0 15202 43 0 0 25 0 4 0 650652357 441057280 50631 33554432000 4194304 4625164 140734808700768 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17392/statm: 107680 50631 402 106 0 103183 0
[pid=17392/tid=17397] ppid=17390 vsize=430720 CPUtime=39.16 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 24679 0 0 0 3912 4 0 0 25 0 4 0 650652358 441057280 50631 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=430720 CPUtime=27.61 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 13227 0 0 0 2758 3 0 0 25 0 4 0 650652358 441057280 50631 33554432000 4194304 4625164 140734808700768 18446744073709551615 4352143 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=430720 CPUtime=42.42 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 187584 0 0 0 4211 31 0 0 25 0 4 0 650652358 441057280 50631 33554432000 4194304 4625164 140734808700768 18446744073709551615 4334585 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 152.45
Current children cumulated vsize (KiB) 430720

[startup+102.318 s]
/proc/loadavg: 8.29 6.20 6.42 10/466 17406
/proc/meminfo: memFree=13731384/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=573484 CPUtime=305.29 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 524472 0 0 0 30438 91 0 0 25 0 4 0 650652357 587247616 89515 33554432000 4194304 4625164 140734808700768 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17392/statm: 143371 89515 642 106 0 138874 0
[pid=17392/tid=17397] ppid=17390 vsize=573484 CPUtime=68.94 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 29912 0 0 0 6888 6 0 0 25 0 4 0 650652358 587247616 89515 33554432000 4194304 4625164 140734808700768 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=573484 CPUtime=54.7 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 19792 0 0 0 5465 5 0 0 25 0 4 0 650652358 587247616 89515 33554432000 4194304 4625164 140734808700768 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=573484 CPUtime=92.24 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 394099 0 0 0 9156 68 0 0 25 0 4 0 650652358 587247616 89515 33554432000 4194304 4625164 140734808700768 18446744073709551615 4547277 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 305.29
Current children cumulated vsize (KiB) 573484

[startup+162.301 s]

################
# More data... #
################


[startup+762.318 s]
/proc/loadavg: 9.12 8.83 7.79 10/466 17424
/proc/meminfo: memFree=10185512/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=3576628 CPUtime=2274.63 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 4024943 0 0 0 226814 649 0 0 25 0 4 0 650652357 3662467072 709194 33554432000 4194304 4625164 140734808700768 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/17392/statm: 894157 709194 397 106 0 889660 0
[pid=17392/tid=17397] ppid=17390 vsize=3576628 CPUtime=635.66 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 138030 0 0 0 63533 33 0 0 25 0 4 0 650652358 3662467072 709194 33554432000 4194304 4625164 140734808700768 18446744073709551615 4339628 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=3576628 CPUtime=500.3 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 73753 0 0 0 49994 36 0 0 25 0 4 0 650652358 3662467072 709194 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=3576628 CPUtime=488.33 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 2368163 0 0 0 48460 373 0 0 25 0 4 0 650652358 3662467072 709194 33554432000 4194304 4625164 140734808700768 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2274.63
Current children cumulated vsize (KiB) 3576628

[startup+822.3 s]
/proc/loadavg: 9.08 8.87 7.87 10/466 17426
/proc/meminfo: memFree=10031996/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=3669636 CPUtime=2453.66 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 4091329 0 0 0 244702 664 0 0 25 0 4 0 650652357 3757707264 726080 33554432000 4194304 4625164 140734808700768 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/17392/statm: 917409 726080 397 106 0 912912 0
[pid=17392/tid=17397] ppid=17390 vsize=3669636 CPUtime=665.64 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 138994 0 0 0 66531 33 0 0 25 0 4 0 650652358 3757707264 726080 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351786 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=3669636 CPUtime=560.28 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 77050 0 0 0 55986 42 0 0 25 0 4 0 650652358 3757707264 726080 33554432000 4194304 4625164 140734808700768 18446744073709551615 4487022 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=3669636 CPUtime=518.32 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 2369561 0 0 0 51459 373 0 0 25 0 4 0 650652358 3757707264 726080 33554432000 4194304 4625164 140734808700768 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2453.66
Current children cumulated vsize (KiB) 3669636

[startup+882.301 s]
/proc/loadavg: 9.07 8.90 7.94 10/466 17427
/proc/meminfo: memFree=9855908/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=3690964 CPUtime=2632.72 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 4414921 0 0 0 262560 712 0 0 25 0 4 0 650652357 3779547136 752222 33554432000 4194304 4625164 140734808700768 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17392/statm: 922741 752222 397 106 0 918244 0
[pid=17392/tid=17397] ppid=17390 vsize=3690964 CPUtime=705.13 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 141206 0 0 0 70479 34 0 0 25 0 4 0 650652358 3779547136 752222 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=3690964 CPUtime=610.97 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 79584 0 0 0 61052 45 0 0 25 0 4 0 650652358 3779547136 752222 33554432000 4194304 4625164 140734808700768 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=3690964 CPUtime=551.29 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 2661033 0 0 0 54716 413 0 0 25 0 4 0 650652358 3779547136 752222 33554432000 4194304 4625164 140734808700768 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2632.72
Current children cumulated vsize (KiB) 3690964

[startup+942.3 s]
/proc/loadavg: 9.18 8.98 8.03 10/466 17438
/proc/meminfo: memFree=9662720/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=3755528 CPUtime=2811.77 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 4873534 0 0 0 280395 782 0 0 25 0 4 0 650652357 3845660672 788201 33554432000 4194304 4625164 140734808700768 18446744073709551615 4512046 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/17392/statm: 938882 788201 393 106 0 934385 0
[pid=17392/tid=17397] ppid=17390 vsize=3755528 CPUtime=758.3 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 150142 0 0 0 75793 37 0 0 25 0 4 0 650652358 3845660672 788201 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=3755528 CPUtime=647.51 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 81919 0 0 0 64702 49 0 0 25 0 4 0 650652358 3845660672 788201 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=3755528 CPUtime=592.66 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 3073267 0 0 0 58795 471 0 0 25 0 4 0 650652358 3845660672 788201 33554432000 4194304 4625164 140734808700768 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2811.77
Current children cumulated vsize (KiB) 3755528

[startup+1002.3 s]
/proc/loadavg: 9.06 8.98 8.09 10/466 17439
/proc/meminfo: memFree=9365360/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=3967960 CPUtime=2990.83 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 5186257 0 0 0 298254 829 0 0 25 0 4 0 650652357 4063191040 841670 33554432000 4194304 4625164 140734808700768 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/17392/statm: 991990 841670 392 106 0 987493 0
[pid=17392/tid=17397] ppid=17390 vsize=3967960 CPUtime=817.36 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 198296 0 0 0 81692 44 0 0 25 0 4 0 650652358 4063191040 841670 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=3967960 CPUtime=701.42 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 84131 0 0 0 70092 50 0 0 25 0 4 0 650652358 4063191040 841670 33554432000 4194304 4625164 140734808700768 18446744073709551615 4352170 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=3967960 CPUtime=628.73 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 3285442 0 0 0 62371 502 0 0 25 0 4 0 650652358 4063191040 841670 33554432000 4194304 4625164 140734808700768 18446744073709551615 4547216 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2990.83
Current children cumulated vsize (KiB) 3967960

[startup+1062.3 s]
/proc/loadavg: 9.25 9.04 8.16 10/466 17441
/proc/meminfo: memFree=9159880/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=3978556 CPUtime=3169.91 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 5424158 0 0 0 316127 864 0 0 25 0 4 0 650652357 4074041344 854874 33554432000 4194304 4625164 140734808700768 18446744073709551615 4511967 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/17392/statm: 994639 854874 398 106 0 990142 0
[pid=17392/tid=17397] ppid=17390 vsize=3978556 CPUtime=876.43 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 199478 0 0 0 87599 44 0 0 25 0 4 0 650652358 4074041344 854874 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=3978556 CPUtime=749.06 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 87333 0 0 0 74852 54 0 0 25 0 4 0 650652358 4074041344 854874 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=3978556 CPUtime=658.7 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 3513974 0 0 0 65338 532 0 0 25 0 4 0 650652358 4074041344 854874 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3169.91
Current children cumulated vsize (KiB) 3978556

[startup+1122.3 s]
/proc/loadavg: 9.31 9.08 8.23 10/466 17443
/proc/meminfo: memFree=8866860/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=3983828 CPUtime=3348.96 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 5689756 0 0 0 333993 903 0 0 25 0 4 0 650652357 4079439872 864577 33554432000 4194304 4625164 140734808700768 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/17392/statm: 995957 864577 396 106 0 991460 0
[pid=17392/tid=17397] ppid=17390 vsize=3983828 CPUtime=935.49 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 200858 0 0 0 93504 45 0 0 25 0 4 0 650652358 4079439872 864577 33554432000 4194304 4625164 140734808700768 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=3983828 CPUtime=779.06 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 87856 0 0 0 77852 54 0 0 25 0 4 0 650652358 4079439872 864577 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=3983828 CPUtime=688.7 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 3769973 0 0 0 68301 569 0 0 25 0 4 0 650652358 4079439872 864577 33554432000 4194304 4625164 140734808700768 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3348.96
Current children cumulated vsize (KiB) 3983828

[startup+1182.3 s]
/proc/loadavg: 9.25 9.09 8.28 10/466 17444
/proc/meminfo: memFree=8451080/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=4822452 CPUtime=3527.97 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 6412395 0 0 0 351799 998 0 0 25 0 4 0 650652357 4938190848 925654 33554432000 4194304 4625164 140734808700768 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/17392/statm: 1205613 925654 385 106 0 1201116 0
[pid=17392/tid=17397] ppid=17390 vsize=4822452 CPUtime=994.54 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 202440 0 0 0 99408 46 0 0 25 0 4 0 650652358 4938190848 925654 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=4822452 CPUtime=817.29 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 90474 0 0 0 81671 58 0 0 25 0 4 0 650652358 4938190848 925654 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=4822452 CPUtime=719.3 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 4057886 0 0 0 71319 611 0 0 25 0 4 0 650652358 4938190848 925654 33554432000 4194304 4625164 140734808700768 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3527.97
Current children cumulated vsize (KiB) 4822452

[startup+1242.3 s]
/proc/loadavg: 9.15 9.09 8.33 10/466 17477
/proc/meminfo: memFree=10391036/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=4850484 CPUtime=3744.48 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 6922225 0 0 0 373370 1078 0 0 25 0 4 0 650652357 4966895616 946175 33554432000 4194304 4625164 140734808700768 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/17392/statm: 1212621 946175 394 106 0 1208124 0
[pid=17392/tid=17397] ppid=17390 vsize=4850484 CPUtime=1046.32 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 203330 0 0 0 104586 46 0 0 25 0 4 0 650652358 4966895616 946175 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=4850484 CPUtime=875.2 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 91796 0 0 0 87460 60 0 0 25 0 4 0 650652358 4966895616 946175 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351989 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=4850484 CPUtime=776.2 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 4550182 0 0 0 76934 686 0 0 25 0 4 0 650652358 4966895616 946175 33554432000 4194304 4625164 140734808700768 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3744.48
Current children cumulated vsize (KiB) 4850484



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 9.16 9.10 8.38 10/466 17478
/proc/meminfo: memFree=9970644/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=4921064 CPUtime=3974.44 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) R 17390 17392 16929 0 -1 4202496 7529187 0 0 0 396269 1175 0 0 25 0 4 0 650652357 5039169536 968750 33554432000 4194304 4625164 140734808700768 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/17392/statm: 1230266 968750 378 106 0 1225769 0
[pid=17392/tid=17397] ppid=17390 vsize=4921064 CPUtime=1104.04 cores=1,3,5,7
/proc/17392/task/17397/stat : 17397 (SArTagnan) R 17390 17392 16929 0 -1 4202560 203894 0 0 0 110358 46 0 0 25 0 4 0 650652358 5039169536 968761 33554432000 4194304 4625164 140734808700768 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=4921064 CPUtime=932.02 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4202560 113793 0 0 0 93135 67 0 0 25 0 4 0 650652358 5039169536 968761 33554432000 4194304 4625164 140734808700768 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=17392/tid=17399] ppid=17390 vsize=4921064 CPUtime=833.92 cores=1,3,5,7
/proc/17392/task/17399/stat : 17399 (SArTagnan) R 17390 17392 16929 0 -1 4202560 5117045 0 0 0 82618 774 0 0 25 0 4 0 650652358 5039169536 968761 33554432000 4194304 4625164 140734808700768 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3974.44
Current children cumulated vsize (KiB) 4921064

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.12 s]
/proc/loadavg: 9.16 9.10 8.38 7/465 17479
/proc/meminfo: memFree=12370176/32951124 swapFree=67111348/67111528
[pid=17392] ppid=17390 vsize=0 CPUtime=3974.58 cores=1,3,5,7
/proc/17392/stat : 17392 (SArTagnan) Z 17390 17392 16929 0 -1 4203548 7529198 0 0 0 396272 1186 0 0 25 0 2 0 650652357 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/17392/statm: 0 0 0 0 0 0 0
[pid=17392/tid=17398] ppid=17390 vsize=0 CPUtime=932.14 cores=1,3,5,7
/proc/17392/task/17398/stat : 17398 (SArTagnan) R 17390 17392 16929 0 -1 4203588 113793 0 0 0 93136 78 0 0 25 0 2 0 650652358 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3974.58
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.17
CPU time (s): 3974.63
CPU user time (s): 3962.73
CPU system time (s): 11.9022
CPU usage (%): 305.7
Max. virtual memory (cumulated for all children) (KiB): 6239636

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3962.73
system time used= 11.9022
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7529198
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11289
involuntary context switches= 49978

runsolver used 5.46117 second user time and 14.8167 second system time

The end

Launcher Data 

Begin job on node144 at 2011-05-16 23:46:02
IDJOB=3385973
IDBENCH=83988
IDSOLVER=1871
FILE ID=node144/3385973-1305582362
RUNJOBID= node144-1305582362-17378
PBS_JOBID= 13350220
Free space on /tmp= 73268 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_60_20_50_3-dir.shuffled-as.sat03-114.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385973-1305582362/watcher-3385973-1305582362 -o /tmp/evaluation-result-3385973-1305582362/solver-3385973-1305582362 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385973-1305582362.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9ffa0325c9e00b41c025f41d20ec5a0c
RANDOM SEED=1704532059

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      14444088 kB
Buffers:        331256 kB
Cached:        4121744 kB
SwapCached:          0 kB
Active:       15265692 kB
Inactive:      2866520 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      14444088 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:            1640 kB
Writeback:           0 kB
AnonPages:    13679044 kB
Mapped:          37456 kB
Slab:           246256 kB
PageTables:      60888 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 136755216 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73260 MiB
End job on node144 at 2011-05-17 00:07:44