Trace number 3385858

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3880.35 1300.06

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-4-4_511.cnf
MD5SUM766a362c83d920a8f8dd49df62ed42c9
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.072988
Satisfiable
(Un)Satisfiability was proved
Number of variables509
Number of clauses4478
Sum of the clauses size17912
Maximum clause length4
Minimum clause length4
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 44478
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385858-1305581690/watcher-3385858-1305581690 -o /tmp/evaluation-result-3385858-1305581690/solver-3385858-1305581690 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385858-1305581690.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.13 7.52 8.31 7/457 1304
/proc/meminfo: memFree=12854552/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=18616 CPUtime=0 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 458 0 0 0 0 0 0 0 25 0 1 0 748399637 19062784 396 33554432000 4194304 4625164 140733781907680 18446744073709551615 4306536 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/1304/statm: 4654 397 295 106 0 157 0
[pid=1304/tid=1305] ppid=1302 vsize=50344 CPUtime=0 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 748399638 51552256 647 33554432000 4194304 4625164 140733781907680 18446744073709551615 256415448049 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=50344 CPUtime=0 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 748399638 51552256 647 33554432000 4194304 4625164 140733781907680 18446744073709551615 256415448049 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=50344 CPUtime=0 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 748399638 51552256 647 33554432000 4194304 4625164 140733781907680 18446744073709551615 47149845952434 0 0 4096 2 0 0 0 -1 0 0 0 0

[startup+0.0231161 s]
/proc/loadavg: 8.13 7.52 8.31 7/457 1304
/proc/meminfo: memFree=12854552/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=182212 CPUtime=0.03 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 961 0 0 0 3 0 0 0 25 0 4 0 748399637 186585088 892 33554432000 4194304 4625164 140733781907680 18446744073709551615 4512042 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1304/statm: 45553 893 336 106 0 41056 0
[pid=1304/tid=1305] ppid=1302 vsize=182212 CPUtime=0 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 81 0 0 0 0 0 0 0 18 0 4 0 748399638 186585088 893 33554432000 4194304 4625164 140733781907680 18446744073709551615 256415052485 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=182212 CPUtime=0 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 69 0 0 0 0 0 0 0 25 0 4 0 748399638 186585088 893 33554432000 4194304 4625164 140733781907680 18446744073709551615 4462528 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=182212 CPUtime=0.01 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 56 0 0 0 1 0 0 0 25 0 4 0 748399638 186585088 893 33554432000 4194304 4625164 140733781907680 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 182212

[startup+0.101105 s]
/proc/loadavg: 8.13 7.52 8.31 7/457 1304
/proc/meminfo: memFree=12854552/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=183376 CPUtime=0.26 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 1930 0 0 0 26 0 0 0 25 0 4 0 748399637 187777024 1312 33554432000 4194304 4625164 140733781907680 18446744073709551615 4512315 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1304/statm: 45844 1313 342 106 0 41347 0
[pid=1304/tid=1305] ppid=1302 vsize=183376 CPUtime=0.08 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 432 0 0 0 8 0 0 0 18 0 4 0 748399638 187777024 1313 33554432000 4194304 4625164 140733781907680 18446744073709551615 256415052833 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=183376 CPUtime=0.08 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 283 0 0 0 8 0 0 0 25 0 4 0 748399638 187777024 1313 33554432000 4194304 4625164 140733781907680 18446744073709551615 4339616 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=183376 CPUtime=0.01 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 56 0 0 0 1 0 0 0 25 0 4 0 748399638 187777024 1313 33554432000 4194304 4625164 140733781907680 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 183376

[startup+0.301067 s]
/proc/loadavg: 8.13 7.52 8.31 7/457 1304
/proc/meminfo: memFree=12854552/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=184332 CPUtime=0.86 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 3211 0 0 0 86 0 0 0 25 0 4 0 748399637 188755968 2089 33554432000 4194304 4625164 140733781907680 18446744073709551615 4356595 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1304/statm: 46083 2089 343 106 0 41586 0
[pid=1304/tid=1305] ppid=1302 vsize=184332 CPUtime=0.27 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 891 0 0 0 27 0 0 0 18 0 4 0 748399638 188755968 2089 33554432000 4194304 4625164 140733781907680 18446744073709551615 4486993 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=184332 CPUtime=0.28 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 706 0 0 0 28 0 0 0 25 0 4 0 748399638 188755968 2089 33554432000 4194304 4625164 140733781907680 18446744073709551615 4352855 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=184332 CPUtime=0.09 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 329 0 0 0 9 0 0 0 25 0 4 0 748399638 188755968 2089 33554432000 4194304 4625164 140733781907680 18446744073709551615 4335387 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.86
Current children cumulated vsize (KiB) 184332

[startup+0.700992 s]
/proc/loadavg: 8.13 7.52 8.31 7/457 1304
/proc/meminfo: memFree=12854552/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=187584 CPUtime=2.07 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 5500 0 0 0 206 1 0 0 25 0 4 0 748399637 192086016 3443 33554432000 4194304 4625164 140733781907680 18446744073709551615 4357415 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1304/statm: 46896 3443 343 106 0 42399 0
[pid=1304/tid=1305] ppid=1302 vsize=187584 CPUtime=0.67 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 1555 0 0 0 67 0 0 0 18 0 4 0 748399638 192086016 3443 33554432000 4194304 4625164 140733781907680 18446744073709551615 4352299 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=187584 CPUtime=0.67 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 1815 0 0 0 67 0 0 0 25 0 4 0 748399638 192086016 3443 33554432000 4194304 4625164 140733781907680 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=187584 CPUtime=0.29 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 684 0 0 0 29 0 0 0 25 0 4 0 748399638 192086016 3443 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.07
Current children cumulated vsize (KiB) 187584

[startup+1.50084 s]
/proc/loadavg: 8.13 7.52 8.31 10/461 1308
/proc/meminfo: memFree=12834308/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=191668 CPUtime=4.44 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 9249 0 0 0 443 1 0 0 25 0 4 0 748399637 196268032 5591 33554432000 4194304 4625164 140733781907680 18446744073709551615 4356423 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1304/statm: 47917 5591 344 106 0 43420 0
[pid=1304/tid=1305] ppid=1302 vsize=191668 CPUtime=1.47 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 3248 0 0 0 147 0 0 0 20 0 4 0 748399638 196268032 5591 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=191668 CPUtime=1.45 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 3052 0 0 0 145 0 0 0 25 0 4 0 748399638 196268032 5591 33554432000 4194304 4625164 140733781907680 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=191668 CPUtime=0.69 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 1093 0 0 0 69 0 0 0 25 0 4 0 748399638 196268032 5591 33554432000 4194304 4625164 140733781907680 18446744073709551615 4579356 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.44
Current children cumulated vsize (KiB) 191668

[startup+3.10054 s]
/proc/loadavg: 8.13 7.52 8.31 10/461 1308
/proc/meminfo: memFree=12821164/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=198284 CPUtime=9.23 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 17045 0 0 0 920 3 0 0 25 0 4 0 748399637 203042816 8557 33554432000 4194304 4625164 140733781907680 18446744073709551615 4512315 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1304/statm: 49571 8557 344 106 0 45074 0
[pid=1304/tid=1305] ppid=1302 vsize=198284 CPUtime=2.53 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 4575 0 0 0 253 0 0 0 22 0 4 0 748399638 203042816 8557 33554432000 4194304 4625164 140733781907680 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=198284 CPUtime=3.04 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 4486 0 0 0 304 0 0 0 25 0 4 0 748399638 203042816 8557 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=198284 CPUtime=2.12 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 5542 0 0 0 212 0 0 0 25 0 4 0 748399638 203042816 8557 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351814 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 9.23
Current children cumulated vsize (KiB) 198284

[startup+6.30094 s]
/proc/loadavg: 8.20 7.54 8.31 10/461 1309
/proc/meminfo: memFree=12761256/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=210992 CPUtime=18.77 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 24165 0 0 0 1873 4 0 0 25 0 4 0 748399637 216055808 12721 33554432000 4194304 4625164 140733781907680 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1304/statm: 52748 12721 346 106 0 48251 0
[pid=1304/tid=1305] ppid=1302 vsize=210992 CPUtime=5.21 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 6919 0 0 0 520 1 0 0 25 0 4 0 748399638 216055808 12721 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=210992 CPUtime=6.17 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 6785 0 0 0 616 1 0 0 25 0 4 0 748399638 216055808 12721 33554432000 4194304 4625164 140733781907680 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=210992 CPUtime=4.25 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 7497 0 0 0 424 1 0 0 25 0 4 0 748399638 216055808 12721 33554432000 4194304 4625164 140733781907680 18446744073709551615 4552300 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 18.77
Current children cumulated vsize (KiB) 210992

[startup+12.7007 s]
/proc/loadavg: 8.35 7.58 8.32 10/461 1309
/proc/meminfo: memFree=12730404/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=230632 CPUtime=37.87 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 37795 0 0 0 3780 7 0 0 25 0 4 0 748399637 236167168 19848 33554432000 4194304 4625164 140733781907680 18446744073709551615 4512399 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1304/statm: 57658 19848 360 106 0 53161 0
[pid=1304/tid=1305] ppid=1302 vsize=230632 CPUtime=11.28 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 10550 0 0 0 1126 2 0 0 25 0 4 0 748399638 236167168 19848 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=230632 CPUtime=12.11 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 9994 0 0 0 1210 1 0 0 25 0 4 0 748399638 236167168 19848 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351981 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=230632 CPUtime=7.86 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 12788 0 0 0 785 1 0 0 25 0 4 0 748399638 236167168 19848 33554432000 4194304 4625164 140733781907680 18446744073709551615 4552343 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37.87
Current children cumulated vsize (KiB) 230632

[startup+25.5003 s]
/proc/loadavg: 8.49 7.65 8.33 10/461 1309
/proc/meminfo: memFree=12660100/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=246120 CPUtime=76.06 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 67500 0 0 0 7594 12 0 0 25 0 4 0 748399637 252026880 28137 33554432000 4194304 4625164 140733781907680 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1304/statm: 61530 28137 380 106 0 57033 0
[pid=1304/tid=1305] ppid=1302 vsize=246120 CPUtime=20.46 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 15223 0 0 0 2043 3 0 0 25 0 4 0 748399638 252026880 28137 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351989 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=246120 CPUtime=22.1 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 14574 0 0 0 2207 3 0 0 25 0 4 0 748399638 252026880 28137 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=246120 CPUtime=17.4 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 31904 0 0 0 1736 4 0 0 25 0 4 0 748399638 252026880 28137 33554432000 4194304 4625164 140733781907680 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 76.06
Current children cumulated vsize (KiB) 246120

[startup+51.1005 s]
/proc/loadavg: 8.66 7.76 8.35 10/461 1310
/proc/meminfo: memFree=12544012/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=270800 CPUtime=152.47 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 86379 0 0 0 15230 17 0 0 25 0 4 0 748399637 277299200 41103 33554432000 4194304 4625164 140733781907680 18446744073709551615 4512891 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1304/statm: 67700 41103 437 106 0 63203 0
[pid=1304/tid=1305] ppid=1302 vsize=270800 CPUtime=37.28 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 16090 0 0 0 3725 3 0 0 25 0 4 0 748399638 277299200 41103 33554432000 4194304 4625164 140733781907680 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=270800 CPUtime=45.17 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 23189 0 0 0 4511 6 0 0 25 0 4 0 748399638 277299200 41103 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=270800 CPUtime=32.69 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 37621 0 0 0 3264 5 0 0 25 0 4 0 748399638 277299200 41103 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 152.47
Current children cumulated vsize (KiB) 270800

[startup+102.318 s]
/proc/loadavg: 8.91 7.96 8.39 10/461 1311
/proc/meminfo: memFree=12360992/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=386568 CPUtime=305.35 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 200666 0 0 0 30497 38 0 0 25 0 4 0 748399637 395845632 63379 33554432000 4194304 4625164 140733781907680 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1304/statm: 96642 63379 569 106 0 92145 0
[pid=1304/tid=1305] ppid=1302 vsize=386568 CPUtime=87.72 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 32380 0 0 0 8766 6 0 0 25 0 4 0 748399638 395845632 63379 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=386568 CPUtime=70.7 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 24846 0 0 0 7063 7 0 0 25 0 4 0 748399638 395845632 63379 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=386568 CPUtime=83.91 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 122370 0 0 0 8371 20 0 0 25 0 4 0 748399638 395845632 63379 33554432000 4194304 4625164 140733781907680 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 305.35
Current children cumulated vsize (KiB) 386568

[startup+162.301 s]

################
# More data... #
################

[pid=1304] ppid=1302 vsize=892216 CPUtime=2096.24 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 1695914 0 0 0 209353 271 0 0 25 0 4 0 748399637 913629184 168679 33554432000 4194304 4625164 140733781907680 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1304/statm: 223054 168679 349 106 0 218557 0
[pid=1304/tid=1305] ppid=1302 vsize=892216 CPUtime=586.83 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 80201 0 0 0 58665 18 0 0 25 0 4 0 748399638 913629184 168679 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=892216 CPUtime=543.72 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 87089 0 0 0 54348 24 0 0 25 0 4 0 748399638 913629184 168679 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=892216 CPUtime=499.71 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 1446050 0 0 0 49759 212 0 0 25 0 4 0 748399638 913629184 168679 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2096.24
Current children cumulated vsize (KiB) 892216

[startup+762.317 s]
/proc/loadavg: 9.18 9.05 8.79 10/461 1332
/proc/meminfo: memFree=11017380/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=933192 CPUtime=2275.37 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 1705881 0 0 0 227261 276 0 0 25 0 4 0 748399637 955588608 178569 33554432000 4194304 4625164 140733781907680 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1304/statm: 233298 178569 347 106 0 228801 0
[pid=1304/tid=1305] ppid=1302 vsize=933192 CPUtime=645.92 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 86295 0 0 0 64573 19 0 0 25 0 4 0 748399638 955588608 178569 33554432000 4194304 4625164 140733781907680 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=933192 CPUtime=603.74 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 89871 0 0 0 60347 27 0 0 25 0 4 0 748399638 955588608 178569 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=933192 CPUtime=529.72 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 1446230 0 0 0 52760 212 0 0 25 0 4 0 748399638 955588608 178569 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2275.37
Current children cumulated vsize (KiB) 933192

[startup+822.301 s]
/proc/loadavg: 9.25 9.09 8.81 11/461 1333
/proc/meminfo: memFree=10946700/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=988344 CPUtime=2454.43 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 1739150 0 0 0 245160 283 0 0 25 0 4 0 748399637 1012064256 186105 33554432000 4194304 4625164 140733781907680 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1304/statm: 247086 186105 347 106 0 242589 0
[pid=1304/tid=1305] ppid=1302 vsize=988344 CPUtime=705.01 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 87261 0 0 0 70482 19 0 0 25 0 4 0 748399638 1012064256 186105 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=988344 CPUtime=661.36 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 92407 0 0 0 66105 31 0 0 25 0 4 0 748399638 1012064256 186105 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=988344 CPUtime=562.1 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 1448865 0 0 0 55998 212 0 0 25 0 4 0 748399638 1012064256 186105 33554432000 4194304 4625164 140733781907680 18446744073709551615 4552388 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2454.43
Current children cumulated vsize (KiB) 988344

[startup+882.301 s]
/proc/loadavg: 9.18 9.10 8.83 10/461 1335
/proc/meminfo: memFree=10874532/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=990952 CPUtime=2633.5 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 1746996 0 0 0 263065 285 0 0 25 0 4 0 748399637 1014734848 190129 33554432000 4194304 4625164 140733781907680 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1304/statm: 247738 190129 346 106 0 243241 0
[pid=1304/tid=1305] ppid=1302 vsize=990952 CPUtime=764.08 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 87972 0 0 0 76388 20 0 0 25 0 4 0 748399638 1014734848 190129 33554432000 4194304 4625164 140733781907680 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=990952 CPUtime=691.37 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 92639 0 0 0 69106 31 0 0 25 0 4 0 748399638 1014734848 190129 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=990952 CPUtime=622.1 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 1450221 0 0 0 61997 213 0 0 25 0 4 0 748399638 1014734848 190129 33554432000 4194304 4625164 140733781907680 18446744073709551615 4547277 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2633.5
Current children cumulated vsize (KiB) 990952

[startup+942.3 s]
/proc/loadavg: 9.17 9.11 8.85 10/461 1336
/proc/meminfo: memFree=10784508/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=1139092 CPUtime=2812.58 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 1792998 0 0 0 280967 291 0 0 25 0 4 0 748399637 1166430208 201252 33554432000 4194304 4625164 140733781907680 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1304/statm: 284773 201252 344 106 0 280276 0
[pid=1304/tid=1305] ppid=1302 vsize=1139092 CPUtime=823.16 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 112460 0 0 0 82293 23 0 0 25 0 4 0 748399638 1166430208 201252 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351984 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=1139092 CPUtime=721.37 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 93324 0 0 0 72106 31 0 0 25 0 4 0 748399638 1166430208 201252 33554432000 4194304 4625164 140733781907680 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=1139092 CPUtime=682.1 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 1466849 0 0 0 67996 214 0 0 25 0 4 0 748399638 1166430208 201252 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2812.58
Current children cumulated vsize (KiB) 1139092

[startup+1002.3 s]
/proc/loadavg: 9.06 9.09 8.85 10/461 1338
/proc/meminfo: memFree=10725360/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=1187452 CPUtime=2991.66 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 1823401 0 0 0 298870 296 0 0 25 0 4 0 748399637 1215950848 208539 33554432000 4194304 4625164 140733781907680 18446744073709551615 4519346 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1304/statm: 296863 208539 344 106 0 292366 0
[pid=1304/tid=1305] ppid=1302 vsize=1187452 CPUtime=882.24 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 113965 0 0 0 88200 24 0 0 25 0 4 0 748399638 1215950848 208539 33554432000 4194304 4625164 140733781907680 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=1187452 CPUtime=751.37 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 118133 0 0 0 75103 34 0 0 25 0 4 0 748399638 1215950848 208539 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=1187452 CPUtime=742.11 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 1468436 0 0 0 73996 215 0 0 25 0 4 0 748399638 1215950848 208539 33554432000 4194304 4625164 140733781907680 18446744073709551615 4552377 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2991.66
Current children cumulated vsize (KiB) 1187452

[startup+1062.3 s]
/proc/loadavg: 9.12 9.10 8.87 10/461 1340
/proc/meminfo: memFree=10662984/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=1188656 CPUtime=3170.76 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 2161202 0 0 0 316731 345 0 0 25 0 4 0 748399637 1217183744 213890 33554432000 4194304 4625164 140733781907680 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1304/statm: 297164 213890 386 106 0 292667 0
[pid=1304/tid=1305] ppid=1302 vsize=1188656 CPUtime=941.33 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 114864 0 0 0 94108 25 0 0 25 0 4 0 748399638 1217183744 213890 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=1188656 CPUtime=781.58 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 118587 0 0 0 78124 34 0 0 25 0 4 0 748399638 1217183744 213890 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=1188656 CPUtime=802.11 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 1799233 0 0 0 79949 262 0 0 25 0 4 0 748399638 1217183744 213890 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3170.76
Current children cumulated vsize (KiB) 1188656

[startup+1122.3 s]
/proc/loadavg: 9.04 9.08 8.88 10/461 1372
/proc/meminfo: memFree=12361468/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=1188656 CPUtime=3349.84 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 2514602 0 0 0 334589 395 0 0 25 0 4 0 748399637 1217183744 216524 33554432000 4194304 4625164 140733781907680 18446744073709551615 4519319 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1304/statm: 297164 216524 356 106 0 292667 0
[pid=1304/tid=1305] ppid=1302 vsize=1188656 CPUtime=1000.4 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 116129 0 0 0 100015 25 0 0 25 0 4 0 748399638 1217183744 216524 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=1188656 CPUtime=811.58 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 118737 0 0 0 81124 34 0 0 25 0 4 0 748399638 1217183744 216524 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=1188656 CPUtime=862.11 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 2144692 0 0 0 85902 309 0 0 25 0 4 0 748399638 1217183744 216524 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3349.84
Current children cumulated vsize (KiB) 1188656

[startup+1182.3 s]
/proc/loadavg: 9.09 9.09 8.89 10/461 1374
/proc/meminfo: memFree=12082768/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=1191956 CPUtime=3528.94 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 2864675 0 0 0 352450 444 0 0 25 0 4 0 748399637 1220562944 222150 33554432000 4194304 4625164 140733781907680 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1304/statm: 297989 222150 390 106 0 293492 0
[pid=1304/tid=1305] ppid=1302 vsize=1191956 CPUtime=1059.5 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 118021 0 0 0 105924 26 0 0 25 0 4 0 748399638 1220562944 222150 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=1191956 CPUtime=841.59 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 118878 0 0 0 84124 35 0 0 25 0 4 0 748399638 1220562944 222150 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=1191956 CPUtime=922.11 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 2485218 0 0 0 91856 355 0 0 25 0 4 0 748399638 1220562944 222150 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3528.94
Current children cumulated vsize (KiB) 1191956

[startup+1242.3 s]
/proc/loadavg: 9.15 9.11 8.91 10/461 1376
/proc/meminfo: memFree=11947468/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=1197236 CPUtime=3708.02 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 3216951 0 0 0 370312 490 0 0 25 0 4 0 748399637 1225969664 227573 33554432000 4194304 4625164 140733781907680 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1304/statm: 299309 227573 408 106 0 294812 0
[pid=1304/tid=1305] ppid=1302 vsize=1197236 CPUtime=1118.58 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 120015 0 0 0 111831 27 0 0 25 0 4 0 748399638 1225969664 227573 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=1197236 CPUtime=871.59 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 119218 0 0 0 87123 36 0 0 25 0 4 0 748399638 1225969664 227573 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=1197236 CPUtime=982.11 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 2826274 0 0 0 97812 399 0 0 25 0 4 0 748399638 1225969664 227573 33554432000 4194304 4625164 140733781907680 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3708.02
Current children cumulated vsize (KiB) 1197236



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 9.16 9.12 8.92 10/461 1377
/proc/meminfo: memFree=11870596/32950928 swapFree=67111200/67111528
[pid=1304] ppid=1302 vsize=1203176 CPUtime=3880.26 cores=0,2,4,6
/proc/1304/stat : 1304 (SArTagnan) R 1302 1304 617 0 -1 4202496 3545260 0 0 0 387490 536 0 0 25 0 4 0 748399637 1232052224 232548 33554432000 4194304 4625164 140733781907680 18446744073709551615 4519359 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1304/statm: 300794 232548 367 106 0 296297 0
[pid=1304/tid=1305] ppid=1302 vsize=1203176 CPUtime=1175.41 cores=0,2,4,6
/proc/1304/task/1305/stat : 1305 (SArTagnan) R 1302 1304 617 0 -1 4202560 121702 0 0 0 117513 28 0 0 25 0 4 0 748399638 1232052224 232548 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351839 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1304/tid=1306] ppid=1302 vsize=1203176 CPUtime=900.43 cores=0,2,4,6
/proc/1304/task/1306/stat : 1306 (SArTagnan) R 1302 1304 617 0 -1 4202560 119442 0 0 0 90007 36 0 0 25 0 4 0 748399638 1232052224 232548 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1304/tid=1307] ppid=1302 vsize=1203176 CPUtime=1039.83 cores=0,2,4,6
/proc/1304/task/1307/stat : 1307 (SArTagnan) R 1302 1304 617 0 -1 4202560 3142870 0 0 0 103541 442 0 0 25 0 4 0 748399638 1232052224 232548 33554432000 4194304 4625164 140733781907680 18446744073709551615 4351801 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3880.26
Current children cumulated vsize (KiB) 1203176

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.06
CPU time (s): 3880.35
CPU user time (s): 3874.95
CPU system time (s): 5.39918
CPU usage (%): 298.474
Max. virtual memory (cumulated for all children) (KiB): 1273828

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3874.95
system time used= 5.39918
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3545262
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 221
involuntary context switches= 31444

runsolver used 5.85811 second user time and 14.0159 second system time

The end

Launcher Data 

Begin job on node115 at 2011-05-16 23:34:50
IDJOB=3385858
IDBENCH=83250
IDSOLVER=1871
FILE ID=node115/3385858-1305581690
RUNJOBID= node115-1305581604-1069
PBS_JOBID= 13350213
Free space on /tmp= 73268 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-4-4_511.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385858-1305581690/watcher-3385858-1305581690 -o /tmp/evaluation-result-3385858-1305581690/solver-3385858-1305581690 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385858-1305581690.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 766a362c83d920a8f8dd49df62ed42c9
RANDOM SEED=522939056

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12854576 kB
Buffers:        284440 kB
Cached:        3261616 kB
SwapCached:          0 kB
Active:       16669912 kB
Inactive:      3095112 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12854576 kB
SwapTotal:    67111528 kB
SwapFree:     67111200 kB
Dirty:             424 kB
Writeback:           0 kB
AnonPages:    16219168 kB
Mapped:          36964 kB
Slab:           196884 kB
PageTables:      67060 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 123068832 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73268 MiB
End job on node115 at 2011-05-16 23:56:32