Trace number 3439056

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.9 5013.14

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-4-5_4231.cnf
MD5SUMa52d60bf6e72caa628ad712a5fe0fb7a
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables4229
Number of clauses100397
Sum of the clauses size411595
Maximum clause length5
Minimum clause length4
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 490390
Number of clauses of size 510007
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439056-1306925603/watcher-3439056-1306925603 -o /tmp/evaluation-result-3439056-1306925603/solver-3439056-1306925603 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439056-1306925603.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.08 8.08 8.02 2/523 13561
/proc/meminfo: memFree=15342444/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=23036 CPUtime=0.01 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 1374 0 0 0 1 0 0 0 25 0 1 0 804158926 23588864 926 33554432000 4194304 4625164 140735287962864 18446744073709551615 4361099 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/13561/statm: 5759 928 296 106 0 1262 0

[startup+0.152938 s]
/proc/loadavg: 8.08 8.08 8.02 2/523 13561
/proc/meminfo: memFree=15342444/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=356588 CPUtime=0.59 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 18896 0 0 0 57 2 0 0 18 0 8 0 804158926 365146112 15509 33554432000 4194304 4625164 140735287962864 18446744073709551615 242970208832 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/13561/statm: 89147 15037 344 106 0 84650 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 356588

[startup+0.201927 s]
/proc/loadavg: 8.08 8.08 8.02 2/523 13561
/proc/meminfo: memFree=15342444/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=365596 CPUtime=9.76 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 34545 0 0 0 970 6 0 0 19 0 8 0 804158926 374370304 24017 33554432000 4194304 4625164 140735287962864 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/13561/statm: 91399 24017 344 106 0 86902 0
Current children cumulated CPU time (s) 9.76
Current children cumulated vsize (KiB) 365596

[startup+1.39933 s]
/proc/loadavg: 8.08 8.08 8.02 2/523 13561
/proc/meminfo: memFree=15342444/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=433328 CPUtime=10.56 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 36701 0 0 0 1050 6 0 0 19 0 8 0 804158926 443727872 24626 33554432000 4194304 4625164 140735287962864 18446744073709551615 242970217474 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/13561/statm: 108332 24626 344 106 0 103835 0
Current children cumulated CPU time (s) 10.56
Current children cumulated vsize (KiB) 433328

[startup+1.49931 s]
/proc/loadavg: 8.08 8.08 8.02 2/523 13561
/proc/meminfo: memFree=15342444/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=435536 CPUtime=11.36 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 38911 0 0 0 1130 6 0 0 20 0 8 0 804158926 445988864 25452 33554432000 4194304 4625164 140735287962864 18446744073709551615 4513941 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/13561/statm: 108884 25452 344 106 0 104387 0
Current children cumulated CPU time (s) 11.36
Current children cumulated vsize (KiB) 435536

[startup+1.59929 s]
/proc/loadavg: 8.08 8.08 8.02 2/523 13561
/proc/meminfo: memFree=15342444/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=441268 CPUtime=12.16 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 42373 0 0 0 1210 6 0 0 20 0 8 0 804158926 451858432 26872 33554432000 4194304 4625164 140735287962864 18446744073709551615 242970247536 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/13561/statm: 110317 26894 348 106 0 105820 0
Current children cumulated CPU time (s) 12.16
Current children cumulated vsize (KiB) 441268

[startup+3.10104 s]
/proc/loadavg: 8.15 8.10 8.02 10/531 13569
/proc/meminfo: memFree=15222124/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=650480 CPUtime=22.79 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 59698 0 0 0 2237 42 0 0 23 0 8 0 804158926 666091520 36247 33554432000 4194304 4625164 140735287962864 18446744073709551615 4356404 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/13561/statm: 162620 36249 348 106 0 158123 0
[pid=13561/tid=13563] ppid=13559 vsize=650480 CPUtime=2.8 cores=0-7
/proc/13561/task/13563/stat : 13563 (SArTagnan) R 13559 13561 13535 0 -1 4202560 4002 0 0 0 279 1 0 0 25 0 8 0 804158934 666091520 36249 33554432000 4194304 4625164 140735287962864 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=13561/tid=13564] ppid=13559 vsize=650480 CPUtime=2.89 cores=0-7
/proc/13561/task/13564/stat : 13564 (SArTagnan) R 13559 13561 13535 0 -1 4202560 3827 0 0 0 287 2 0 0 22 0 8 0 804158934 666091520 36249 33554432000 4194304 4625164 140735287962864 18446744073709551615 4351981 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=13561/tid=13565] ppid=13559 vsize=650480 CPUtime=2.85 cores=0-7
/proc/13561/task/13565/stat : 13565 (SArTagnan) R 13559 13561 13535 0 -1 4202560 18817 0 0 0 271 14 0 0 23 0 8 0 804158934 666091520 36249 33554432000 4194304 4625164 140735287962864 18446744073709551615 4547257 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=13561/tid=13566] ppid=13559 vsize=650480 CPUtime=2.86 cores=0-7
/proc/13561/task/13566/stat : 13566 (SArTagnan) R 13559 13561 13535 0 -1 4202560 3971 0 0 0 285 1 0 0 21 0 8 0 804158934 666091520 36249 33554432000 4194304 4625164 140735287962864 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=13561/tid=13567] ppid=13559 vsize=650480 CPUtime=2.67 cores=0-7
/proc/13561/task/13567/stat : 13567 (SArTagnan) R 13559 13561 13535 0 -1 4202560 3764 0 0 0 257 10 0 0 25 0 8 0 804158934 666091520 36250 33554432000 4194304 4625164 140735287962864 18446744073709551615 4349847 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13561/tid=13568] ppid=13559 vsize=650480 CPUtime=2.89 cores=0-7
/proc/13561/task/13568/stat : 13568 (SArTagnan) R 13559 13561 13535 0 -1 4202560 4175 0 0 0 287 2 0 0 18 0 8 0 804158934 666091520 36250 33554432000 4194304 4625164 140735287962864 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13561/tid=13569] ppid=13559 vsize=650480 CPUtime=2.92 cores=0-7
/proc/13561/task/13569/stat : 13569 (SArTagnan) R 13559 13561 13535 0 -1 4202560 4141 0 0 0 287 5 0 0 21 0 8 0 804158934 666091520 36250 33554432000 4194304 4625164 140735287962864 18446744073709551615 4339581 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 22.79
Current children cumulated vsize (KiB) 650480

[startup+6.30049 s]
/proc/loadavg: 8.14 8.10 8.02 9/531 13569
/proc/meminfo: memFree=15140424/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=671860 CPUtime=48.32 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 98453 0 0 0 4778 54 0 0 25 0 8 0 804158926 687984640 54859 33554432000 4194304 4625164 140735287962864 18446744073709551615 4397056 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/13561/statm: 167965 54859 348 106 0 163468 0
[pid=13561/tid=13563] ppid=13559 vsize=671860 CPUtime=5.99 cores=0-7
/proc/13561/task/13563/stat : 13563 (SArTagnan) R 13559 13561 13535 0 -1 4202560 8592 0 0 0 597 2 0 0 25 0 8 0 804158934 687984640 54859 33554432000 4194304 4625164 140735287962864 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=13561/tid=13564] ppid=13559 vsize=671860 CPUtime=6.1 cores=0-7
/proc/13561/task/13564/stat : 13564 (SArTagnan) R 13559 13561 13535 0 -1 4202560 8311 0 0 0 605 5 0 0 25 0 8 0 804158934 687984640 54859 33554432000 4194304 4625164 140735287962864 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=13561/tid=13565] ppid=13559 vsize=671860 CPUtime=6.05 cores=0-7
/proc/13561/task/13565/stat : 13565 (SArTagnan) R 13559 13561 13535 0 -1 4202560 30134 0 0 0 590 15 0 0 25 0 8 0 804158934 687984640 54860 33554432000 4194304 4625164 140735287962864 18446744073709551615 4547614 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=13561/tid=13566] ppid=13559 vsize=671860 CPUtime=6.07 cores=0-7
/proc/13561/task/13566/stat : 13566 (SArTagnan) R 13559 13561 13535 0 -1 4202560 8243 0 0 0 604 3 0 0 25 0 8 0 804158934 687984640 54860 33554432000 4194304 4625164 140735287962864 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=13561/tid=13567] ppid=13559 vsize=671860 CPUtime=5.87 cores=0-7
/proc/13561/task/13567/stat : 13567 (SArTagnan) R 13559 13561 13535 0 -1 4202560 7457 0 0 0 576 11 0 0 18 0 8 0 804158934 687984640 54860 33554432000 4194304 4625164 140735287962864 18446744073709551615 4349061 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13561/tid=13568] ppid=13559 vsize=671860 CPUtime=6.03 cores=0-7
/proc/13561/task/13568/stat : 13568 (SArTagnan) R 13559 13561 13535 0 -1 4202560 7493 0 0 0 600 3 0 0 25 0 8 0 804158934 687984640 54860 33554432000 4194304 4625164 140735287962864 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13561/tid=13569] ppid=13559 vsize=671860 CPUtime=6.11 cores=0-7
/proc/13561/task/13569/stat : 13569 (SArTagnan) R 13559 13561 13535 0 -1 4202560 9377 0 0 0 604 7 0 0 25 0 8 0 804158934 687984640 54860 33554432000 4194304 4625164 140735287962864 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 48.32
Current children cumulated vsize (KiB) 671860

[startup+12.7004 s]
/proc/loadavg: 8.13 8.09 8.02 9/531 13569
/proc/meminfo: memFree=15003808/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=706392 CPUtime=99.2 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 194762 0 0 0 9838 82 0 0 25 0 8 0 804158926 723345408 87502 33554432000 4194304 4625164 140735287962864 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/13561/statm: 176598 87502 380 106 0 172101 0
[pid=13561/tid=13563] ppid=13559 vsize=706392 CPUtime=12.37 cores=0-7
/proc/13561/task/13563/stat : 13563 (SArTagnan) R 13559 13561 13535 0 -1 4202560 16041 0 0 0 1231 6 0 0 25 0 8 0 804158934 723345408 87503 33554432000 4194304 4625164 140735287962864 18446744073709551615 4467840 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13561/tid=13564] ppid=13559 vsize=706392 CPUtime=12.48 cores=0-7
/proc/13561/task/13564/stat : 13564 (SArTagnan) R 13559 13561 13535 0 -1 4202560 16966 0 0 0 1239 9 0 0 25 0 8 0 804158934 723345408 87503 33554432000 4194304 4625164 140735287962864 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=13561/tid=13565] ppid=13559 vsize=706392 CPUtime=12.42 cores=0-7
/proc/13561/task/13565/stat : 13565 (SArTagnan) R 13559 13561 13535 0 -1 4202560 76752 0 0 0 1219 23 0 0 25 0 8 0 804158934 723345408 87503 33554432000 4194304 4625164 140735287962864 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=13561/tid=13566] ppid=13559 vsize=706392 CPUtime=12.46 cores=0-7
/proc/13561/task/13566/stat : 13566 (SArTagnan) R 13559 13561 13535 0 -1 4202560 11928 0 0 0 1240 6 0 0 25 0 8 0 804158934 723345408 87504 33554432000 4194304 4625164 140735287962864 18446744073709551615 4339680 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=13561/tid=13567] ppid=13559 vsize=706392 CPUtime=12.26 cores=0-7
/proc/13561/task/13567/stat : 13567 (SArTagnan) R 13559 13561 13535 0 -1 4202560 16113 0 0 0 1211 15 0 0 25 0 8 0 804158934 723345408 87504 33554432000 4194304 4625164 140735287962864 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=13561/tid=13568] ppid=13559 vsize=706392 CPUtime=12.3 cores=0-7
/proc/13561/task/13568/stat : 13568 (SArTagnan) R 13559 13561 13535 0 -1 4202560 18564 0 0 0 1225 5 0 0 25 0 8 0 804158934 723345408 87504 33554432000 4194304 4625164 140735287962864 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13561/tid=13569] ppid=13559 vsize=706392 CPUtime=12.5 cores=0-7
/proc/13561/task/13569/stat : 13569 (SArTagnan) R 13559 13561 13535 0 -1 4202560 17083 0 0 0 1240 10 0 0 25 0 8 0 804158934 723345408 87504 33554432000 4194304 4625164 140735287962864 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 99.2
Current children cumulated vsize (KiB) 706392

[startup+25.5012 s]
/proc/loadavg: 8.11 8.09 8.02 9/531 13569
/proc/meminfo: memFree=14816868/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=873376 CPUtime=201.33 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 341432 0 0 0 20006 127 0 0 19 0 8 0 804158926 894337024 132668 33554432000 4194304 4625164 140735287962864 18446744073709551615 4338057 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/13561/statm: 218344 132668 460 106 0 213847 0
[pid=13561/tid=13563] ppid=13559 vsize=873376 CPUtime=25.17 cores=0-7
/proc/13561/task/13563/stat : 13563 (SArTagnan) R 13559 13561 13535 0 -1 4202560 23534 0 0 0 2505 12 0 0 25 0 8 0 804158934 894337024 132668 33554432000 4194304 4625164 140735287962864 18446744073709551615 4352831 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13561/tid=13564] ppid=13559 vsize=873376 CPUtime=25.28 cores=0-7
/proc/13561/task/13564/stat : 13564 (SArTagnan) R 13559 13561 13535 0 -1 4202560 28859 0 0 0 2512 16 0 0 25 0 8 0 804158934 894337024 132668 33554432000 4194304 4625164 140735287962864 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=13561/tid=13565] ppid=13559 vsize=873376 CPUtime=25.21 cores=0-7
/proc/13561/task/13565/stat : 13565 (SArTagnan) R 13559 13561 13535 0 -1 4202560 161642 0 0 0 2484 37 0 0 25 0 8 0 804158934 894337024 132668 33554432000 4194304 4625164 140735287962864 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=13561/tid=13566] ppid=13559 vsize=873376 CPUtime=25.25 cores=0-7
/proc/13561/task/13566/stat : 13566 (SArTagnan) R 13559 13561 13535 0 -1 4202560 21740 0 0 0 2513 12 0 0 25 0 8 0 804158934 894337024 132668 33554432000 4194304 4625164 140735287962864 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=13561/tid=13567] ppid=13559 vsize=873376 CPUtime=25.05 cores=0-7
/proc/13561/task/13567/stat : 13567 (SArTagnan) R 13559 13561 13535 0 -1 4202560 26592 0 0 0 2487 18 0 0 25 0 8 0 804158934 894337024 132668 33554432000 4194304 4625164 140735287962864 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=13561/tid=13568] ppid=13559 vsize=873376 CPUtime=24.87 cores=0-7
/proc/13561/task/13568/stat : 13568 (SArTagnan) R 13559 13561 13535 0 -1 4202560 27046 0 0 0 2480 7 0 0 25 0 8 0 804158934 894337024 132668 33554432000 4194304 4625164 140735287962864 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13561/tid=13569] ppid=13559 vsize=873376 CPUtime=25.3 cores=0-7
/proc/13561/task/13569/stat : 13569 (SArTagnan) R 13559 13561 13535 0 -1 4202560 25333 0 0 0 2513 17 0 0 25 0 8 0 804158934 894337024 132668 33554432000 4194304 4625164 140735287962864 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 201.33
Current children cumulated vsize (KiB) 873376

[startup+51.1008 s]
/proc/loadavg: 8.06 8.08 8.02 9/531 13571
/proc/meminfo: memFree=14499504/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=1189356 CPUtime=405.55 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 591943 0 0 0 40353 202 0 0 25 0 8 0 804158926 1217900544 212474 33554432000 4194304 4625164 140735287962864 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/13561/statm: 297339 212474 716 106 0 292842 0
[pid=13561/tid=13563] ppid=13559 vsize=1189356 CPUtime=50.76 cores=0-7
/proc/13561/task/13563/stat : 13563 (SArTagnan) R 13559 13561 13535 0 -1 4202560 38611 0 0 0 5054 22 0 0 25 0 8 0 804158934 1217900544 212474 33554432000 4194304 4625164 140735287962864 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13561/tid=13564] ppid=13559 vsize=1189356 CPUtime=50.86 cores=0-7
/proc/13561/task/13564/stat : 13564 (SArTagnan) R 13559 13561 13535 0 -1 4202560 48047 0 0 0 5058 28 0 0 25 0 8 0 804158934 1217900544 212474 33554432000 4194304 4625164 140735287962864 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=13561/tid=13565] ppid=13559 vsize=1189356 CPUtime=50.8 cores=0-7
/proc/13561/task/13565/stat : 13565 (SArTagnan) R 13559 13561 13535 0 -1 4202560 310919 0 0 0 5018 62 0 0 25 0 8 0 804158934 1217900544 212474 33554432000 4194304 4625164 140735287962864 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=13561/tid=13566] ppid=13559 vsize=1189356 CPUtime=50.83 cores=0-7
/proc/13561/task/13566/stat : 13566 (SArTagnan) R 13559 13561 13535 0 -1 4202560 35941 0 0 0 5063 20 0 0 25 0 8 0 804158934 1217900544 212474 33554432000 4194304 4625164 140735287962864 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=13561/tid=13567] ppid=13559 vsize=1189356 CPUtime=50.63 cores=0-7
/proc/13561/task/13567/stat : 13567 (SArTagnan) R 13559 13561 13535 0 -1 4202560 37413 0 0 0 5039 24 0 0 25 0 8 0 804158934 1217900544 212474 33554432000 4194304 4625164 140735287962864 18446744073709551615 4348821 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=13561/tid=13568] ppid=13559 vsize=1189356 CPUtime=50 cores=0-7
/proc/13561/task/13568/stat : 13568 (SArTagnan) R 13559 13561 13535 0 -1 4202560 41667 0 0 0 4990 10 0 0 25 0 8 0 804158934 1217900544 212474 33554432000 4194304 4625164 140735287962864 18446744073709551615 242970217474 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13561/tid=13569] ppid=13559 vsize=1189356 CPUtime=50.89 cores=0-7
/proc/13561/task/13569/stat : 13569 (SArTagnan) R 13559 13561 13535 0 -1 4202560 38207 0 0 0 5066 23 0 0 25 0 8 0 804158934 1217900544 212474 33554432000 4194304 4625164 140735287962864 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 405.55
Current children cumulated vsize (KiB) 1189356

[startup+102.321 s]
/proc/loadavg: 8.03 8.07 8.01 9/531 13571
/proc/meminfo: memFree=14075416/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=1687016 CPUtime=814.26 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 982241 0 0 0 81105 321 0 0 25 0 8 0 804158926 1727504384 318161 33554432000 4194304 4625164 140735287962864 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/13561/statm: 421754 318161 717 106 0 417257 0
[pid=13561/tid=13563] ppid=13559 vsize=1687016 CPUtime=101.07 cores=0-7
/proc/13561/task/13563/stat : 13563 (SArTagnan) R 13559 13561 13535 0 -1 4202560 58479 0 0 0 10071 36 0 0 25 0 8 0 804158934 1727504384 318161 33554432000 4194304 4625164 140735287962864 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13561/tid=13564] ppid=13559 vsize=1687016 CPUtime=102.05 cores=0-7
/proc/13561/task/13564/stat : 13564 (SArTagnan) R 13559 13561 13535 0 -1 4202560 75487 0 0 0 10160 45 0 0 25 0 8 0 804158934 1727504384 318163 33554432000 4194304 4625164 140735287962864 18446744073709551615 4352831 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=13561/tid=13565] ppid=13559 vsize=1687016 CPUtime=102 cores=0-7
/proc/13561/task/13565/stat : 13565 (SArTagnan) R 13559 13561 13535 0 -1 4202560 551862 0 0 0 10097 103 0 0 20 0 8 0 804158934 1727504384 318169 33554432000 4194304 4625164 140735287962864 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 2 0 0 0

################
# More data... #
################

[pid=13561/tid=13565] ppid=13559 vsize=4915496 CPUtime=4658.76 cores=0-7
/proc/13561/task/13565/stat : 13565 (SArTagnan) R 13559 13561 13535 0 -1 4202560 20238985 0 0 0 461855 4021 0 0 25 0 8 0 804158934 5033467904 1054474 33554432000 4194304 4625164 140735287962864 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=13561/tid=13566] ppid=13559 vsize=4915496 CPUtime=4661.61 cores=0-7
/proc/13561/task/13566/stat : 13566 (SArTagnan) R 13559 13561 13535 0 -1 4202560 164223 0 0 0 466018 143 0 0 25 0 8 0 804158934 5033467904 1054474 33554432000 4194304 4625164 140735287962864 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=13561/tid=13567] ppid=13559 vsize=4915496 CPUtime=4661.29 cores=0-7
/proc/13561/task/13567/stat : 13567 (SArTagnan) R 13559 13561 13535 0 -1 4202560 171092 0 0 0 466018 111 0 0 25 0 8 0 804158934 5033467904 1054474 33554432000 4194304 4625164 140735287962864 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13561/tid=13568] ppid=13559 vsize=4915496 CPUtime=4660.96 cores=0-7
/proc/13561/task/13568/stat : 13568 (SArTagnan) R 13559 13561 13535 0 -1 4202560 350824 0 0 0 465954 142 0 0 25 0 8 0 804158934 5033467904 1054474 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=13561/tid=13569] ppid=13559 vsize=4915496 CPUtime=4660.3 cores=0-7
/proc/13561/task/13569/stat : 13569 (SArTagnan) R 13559 13561 13535 0 -1 4202560 130888 0 0 0 465909 121 0 0 25 0 8 0 804158934 5033467904 1054474 33554432000 4194304 4625164 140735287962864 18446744073709551615 4330859 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37202.5
Current children cumulated vsize (KiB) 4915496

[startup+4722.32 s]
/proc/loadavg: 8.00 8.07 8.02 9/531 13719
/proc/meminfo: memFree=11106936/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=4915496 CPUtime=37681.5 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 21923986 0 0 0 3763269 4877 0 0 25 0 8 0 804158926 5033467904 1058464 33554432000 4194304 4625164 140735287962864 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/13561/statm: 1228874 1058464 374 106 0 1224377 0
[pid=13561/tid=13563] ppid=13559 vsize=4915496 CPUtime=4635.93 cores=0-7
/proc/13561/task/13563/stat : 13563 (SArTagnan) R 13559 13561 13535 0 -1 4202560 142674 0 0 0 463486 107 0 0 25 0 8 0 804158934 5033467904 1058464 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13561/tid=13564] ppid=13559 vsize=4915496 CPUtime=4720.72 cores=0-7
/proc/13561/task/13564/stat : 13564 (SArTagnan) R 13559 13561 13535 0 -1 4202560 170414 0 0 0 471967 105 0 0 25 0 8 0 804158934 5033467904 1058464 33554432000 4194304 4625164 140735287962864 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=13561/tid=13565] ppid=13559 vsize=4915496 CPUtime=4718.78 cores=0-7
/proc/13561/task/13565/stat : 13565 (SArTagnan) R 13559 13561 13535 0 -1 4202560 20325874 0 0 0 467841 4037 0 0 25 0 8 0 804158934 5033467904 1058464 33554432000 4194304 4625164 140735287962864 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=13561/tid=13566] ppid=13559 vsize=4915496 CPUtime=4721.63 cores=0-7
/proc/13561/task/13566/stat : 13566 (SArTagnan) R 13559 13561 13535 0 -1 4202560 164250 0 0 0 472020 143 0 0 25 0 8 0 804158934 5033467904 1058464 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=13561/tid=13567] ppid=13559 vsize=4915496 CPUtime=4721.31 cores=0-7
/proc/13561/task/13567/stat : 13567 (SArTagnan) R 13559 13561 13535 0 -1 4202560 171119 0 0 0 472020 111 0 0 25 0 8 0 804158934 5033467904 1058464 33554432000 4194304 4625164 140735287962864 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13561/tid=13568] ppid=13559 vsize=4915496 CPUtime=4720.98 cores=0-7
/proc/13561/task/13568/stat : 13568 (SArTagnan) R 13559 13561 13535 0 -1 4202560 350839 0 0 0 471956 142 0 0 25 0 8 0 804158934 5033467904 1058464 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=13561/tid=13569] ppid=13559 vsize=4915496 CPUtime=4720.27 cores=0-7
/proc/13561/task/13569/stat : 13569 (SArTagnan) R 13559 13561 13535 0 -1 4202560 130912 0 0 0 471906 121 0 0 25 0 8 0 804158934 5033467904 1058464 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37681.5
Current children cumulated vsize (KiB) 4915496

[startup+4782.3 s]
/proc/loadavg: 8.00 8.06 8.02 9/531 13721
/proc/meminfo: memFree=11107160/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=4918100 CPUtime=38160.1 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 22124798 0 0 0 3811091 4924 0 0 25 0 8 0 804158926 5036134400 1057019 33554432000 4194304 4625164 140735287962864 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/13561/statm: 1229525 1057019 348 106 0 1225028 0
[pid=13561/tid=13563] ppid=13559 vsize=4918100 CPUtime=4694.81 cores=0-7
/proc/13561/task/13563/stat : 13563 (SArTagnan) R 13559 13561 13535 0 -1 4202560 142705 0 0 0 469374 107 0 0 25 0 8 0 804158934 5036134400 1057019 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13561/tid=13564] ppid=13559 vsize=4918100 CPUtime=4780.69 cores=0-7
/proc/13561/task/13564/stat : 13564 (SArTagnan) R 13559 13561 13535 0 -1 4202560 170464 0 0 0 477964 105 0 0 25 0 8 0 804158934 5036134400 1057019 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=13561/tid=13565] ppid=13559 vsize=4918100 CPUtime=4778.76 cores=0-7
/proc/13561/task/13565/stat : 13565 (SArTagnan) R 13559 13561 13535 0 -1 4202560 20526264 0 0 0 473793 4083 0 0 25 0 8 0 804158934 5036134400 1057019 33554432000 4194304 4625164 140735287962864 18446744073709551615 4547221 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=13561/tid=13566] ppid=13559 vsize=4918100 CPUtime=4781.61 cores=0-7
/proc/13561/task/13566/stat : 13566 (SArTagnan) R 13559 13561 13535 0 -1 4202560 164285 0 0 0 478018 143 0 0 25 0 8 0 804158934 5036134400 1057019 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=13561/tid=13567] ppid=13559 vsize=4918100 CPUtime=4781.29 cores=0-7
/proc/13561/task/13567/stat : 13567 (SArTagnan) R 13559 13561 13535 0 -1 4202560 171135 0 0 0 478018 111 0 0 25 0 8 0 804158934 5036134400 1057019 33554432000 4194304 4625164 140735287962864 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13561/tid=13568] ppid=13559 vsize=4918100 CPUtime=4780.96 cores=0-7
/proc/13561/task/13568/stat : 13568 (SArTagnan) R 13559 13561 13535 0 -1 4202560 350855 0 0 0 477954 142 0 0 25 0 8 0 804158934 5036134400 1057019 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=13561/tid=13569] ppid=13559 vsize=4918100 CPUtime=4780.21 cores=0-7
/proc/13561/task/13569/stat : 13569 (SArTagnan) R 13559 13561 13535 0 -1 4202560 130942 0 0 0 477899 122 0 0 25 0 8 0 804158934 5036134400 1057019 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38160.1
Current children cumulated vsize (KiB) 4918100

[startup+4842.3 s]
/proc/loadavg: 8.07 8.06 8.01 9/531 13723
/proc/meminfo: memFree=11091032/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=4922736 CPUtime=38639 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 22142922 0 0 0 3858969 4929 0 0 25 0 8 0 804158926 5040881664 1058540 33554432000 4194304 4625164 140735287962864 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/13561/statm: 1230684 1058540 348 106 0 1226187 0
[pid=13561/tid=13563] ppid=13559 vsize=4922736 CPUtime=4753.7 cores=0-7
/proc/13561/task/13563/stat : 13563 (SArTagnan) R 13559 13561 13535 0 -1 4202560 142746 0 0 0 475263 107 0 0 25 0 8 0 804158934 5040881664 1058540 33554432000 4194304 4625164 140735287962864 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13561/tid=13564] ppid=13559 vsize=4922736 CPUtime=4840.68 cores=0-7
/proc/13561/task/13564/stat : 13564 (SArTagnan) R 13559 13561 13535 0 -1 4202560 170481 0 0 0 483963 105 0 0 25 0 8 0 804158934 5040881664 1058540 33554432000 4194304 4625164 140735287962864 18446744073709551615 4330822 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=13561/tid=13565] ppid=13559 vsize=4922736 CPUtime=4838.76 cores=0-7
/proc/13561/task/13565/stat : 13565 (SArTagnan) R 13559 13561 13535 0 -1 4202560 20543956 0 0 0 479789 4087 0 0 25 0 8 0 804158934 5040881664 1058540 33554432000 4194304 4625164 140735287962864 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=13561/tid=13566] ppid=13559 vsize=4922736 CPUtime=4841.61 cores=0-7
/proc/13561/task/13566/stat : 13566 (SArTagnan) R 13559 13561 13535 0 -1 4202560 164321 0 0 0 484018 143 0 0 25 0 8 0 804158934 5040881664 1058540 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=13561/tid=13567] ppid=13559 vsize=4922736 CPUtime=4841.29 cores=0-7
/proc/13561/task/13567/stat : 13567 (SArTagnan) R 13559 13561 13535 0 -1 4202560 171167 0 0 0 484018 111 0 0 25 0 8 0 804158934 5040881664 1058540 33554432000 4194304 4625164 140735287962864 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13561/tid=13568] ppid=13559 vsize=4922736 CPUtime=4840.96 cores=0-7
/proc/13561/task/13568/stat : 13568 (SArTagnan) R 13559 13561 13535 0 -1 4202560 350870 0 0 0 483954 142 0 0 25 0 8 0 804158934 5040881664 1058540 33554432000 4194304 4625164 140735287962864 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=13561/tid=13569] ppid=13559 vsize=4922736 CPUtime=4840.16 cores=0-7
/proc/13561/task/13569/stat : 13569 (SArTagnan) R 13559 13561 13535 0 -1 4202560 130985 0 0 0 483893 123 0 0 25 0 8 0 804158934 5040881664 1058540 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38639
Current children cumulated vsize (KiB) 4922736

[startup+4902.3 s]
/proc/loadavg: 8.09 8.06 8.01 9/531 13723
/proc/meminfo: memFree=11084820/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=4922736 CPUtime=39117.8 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 22420604 0 0 0 3906796 4987 0 0 25 0 8 0 804158926 5040881664 1059137 33554432000 4194304 4625164 140735287962864 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/13561/statm: 1230684 1059137 348 106 0 1226187 0
[pid=13561/tid=13563] ppid=13559 vsize=4922736 CPUtime=4812.61 cores=0-7
/proc/13561/task/13563/stat : 13563 (SArTagnan) R 13559 13561 13535 0 -1 4202560 142779 0 0 0 481154 107 0 0 25 0 8 0 804158934 5040881664 1059137 33554432000 4194304 4625164 140735287962864 18446744073709551615 4488054 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13561/tid=13564] ppid=13559 vsize=4922736 CPUtime=4900.65 cores=0-7
/proc/13561/task/13564/stat : 13564 (SArTagnan) R 13559 13561 13535 0 -1 4202560 170507 0 0 0 489960 105 0 0 25 0 8 0 804158934 5040881664 1059137 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=13561/tid=13565] ppid=13559 vsize=4922736 CPUtime=4898.76 cores=0-7
/proc/13561/task/13565/stat : 13565 (SArTagnan) R 13559 13561 13535 0 -1 4202560 20821114 0 0 0 485732 4144 0 0 25 0 8 0 804158934 5040881664 1059137 33554432000 4194304 4625164 140735287962864 18446744073709551615 4579358 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=13561/tid=13566] ppid=13559 vsize=4922736 CPUtime=4901.61 cores=0-7
/proc/13561/task/13566/stat : 13566 (SArTagnan) R 13559 13561 13535 0 -1 4202560 164367 0 0 0 490018 143 0 0 25 0 8 0 804158934 5040881664 1059137 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=13561/tid=13567] ppid=13559 vsize=4922736 CPUtime=4901.29 cores=0-7
/proc/13561/task/13567/stat : 13567 (SArTagnan) R 13559 13561 13535 0 -1 4202560 171223 0 0 0 490018 111 0 0 25 0 8 0 804158934 5040881664 1059137 33554432000 4194304 4625164 140735287962864 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13561/tid=13568] ppid=13559 vsize=4922736 CPUtime=4900.96 cores=0-7
/proc/13561/task/13568/stat : 13568 (SArTagnan) R 13559 13561 13535 0 -1 4202560 350886 0 0 0 489954 142 0 0 25 0 8 0 804158934 5040881664 1059137 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=13561/tid=13569] ppid=13559 vsize=4922736 CPUtime=4900.13 cores=0-7
/proc/13561/task/13569/stat : 13569 (SArTagnan) R 13559 13561 13535 0 -1 4202560 131048 0 0 0 489890 123 0 0 25 0 8 0 804158934 5040881664 1059137 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39117.8
Current children cumulated vsize (KiB) 4922736

[startup+4962.3 s]
/proc/loadavg: 8.09 8.06 8.01 9/531 13725
/proc/meminfo: memFree=11095596/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=4922736 CPUtime=39596.7 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 22495667 0 0 0 3954662 5006 0 0 25 0 8 0 804158926 5040881664 1059713 33554432000 4194304 4625164 140735287962864 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/13561/statm: 1230684 1059713 348 106 0 1226187 0
[pid=13561/tid=13563] ppid=13559 vsize=4922736 CPUtime=4871.5 cores=0-7
/proc/13561/task/13563/stat : 13563 (SArTagnan) R 13559 13561 13535 0 -1 4202560 142820 0 0 0 487043 107 0 0 25 0 8 0 804158934 5040881664 1059713 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13561/tid=13564] ppid=13559 vsize=4922736 CPUtime=4960.65 cores=0-7
/proc/13561/task/13564/stat : 13564 (SArTagnan) R 13559 13561 13535 0 -1 4202560 170535 0 0 0 495959 106 0 0 25 0 8 0 804158934 5040881664 1059713 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=13561/tid=13565] ppid=13559 vsize=4922736 CPUtime=4958.76 cores=0-7
/proc/13561/task/13565/stat : 13565 (SArTagnan) R 13559 13561 13535 0 -1 4202560 20895655 0 0 0 491715 4161 0 0 25 0 8 0 804158934 5040881664 1059713 33554432000 4194304 4625164 140735287962864 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=13561/tid=13566] ppid=13559 vsize=4922736 CPUtime=4961.61 cores=0-7
/proc/13561/task/13566/stat : 13566 (SArTagnan) R 13559 13561 13535 0 -1 4202560 164406 0 0 0 496018 143 0 0 25 0 8 0 804158934 5040881664 1059713 33554432000 4194304 4625164 140735287962864 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=13561/tid=13567] ppid=13559 vsize=4922736 CPUtime=4961.29 cores=0-7
/proc/13561/task/13567/stat : 13567 (SArTagnan) R 13559 13561 13535 0 -1 4202560 171278 0 0 0 496018 111 0 0 25 0 8 0 804158934 5040881664 1059713 33554432000 4194304 4625164 140735287962864 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13561/tid=13568] ppid=13559 vsize=4922736 CPUtime=4960.96 cores=0-7
/proc/13561/task/13568/stat : 13568 (SArTagnan) R 13559 13561 13535 0 -1 4202560 350900 0 0 0 495954 142 0 0 25 0 8 0 804158934 5040881664 1059713 33554432000 4194304 4625164 140735287962864 18446744073709551615 4330855 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=13561/tid=13569] ppid=13559 vsize=4922736 CPUtime=4960.08 cores=0-7
/proc/13561/task/13569/stat : 13569 (SArTagnan) R 13559 13561 13535 0 -1 4202560 131106 0 0 0 495884 124 0 0 25 0 8 0 804158934 5040881664 1059713 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39596.7
Current children cumulated vsize (KiB) 4922736



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5012.9 s]
/proc/loadavg: 8.17 8.08 8.02 9/531 13727
/proc/meminfo: memFree=11089128/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=4922736 CPUtime=40000.6 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) R 13559 13561 13535 0 -1 4202496 22520677 0 0 0 3995048 5011 0 0 25 0 8 0 804158926 5040881664 1061400 33554432000 4194304 4625164 140735287962864 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/13561/statm: 1230684 1061400 348 106 0 1226187 0
[pid=13561/tid=13563] ppid=13559 vsize=4922736 CPUtime=4921.38 cores=0-7
/proc/13561/task/13563/stat : 13563 (SArTagnan) R 13559 13561 13535 0 -1 4202560 142862 0 0 0 492031 107 0 0 25 0 8 0 804158934 5040881664 1061400 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=13561/tid=13564] ppid=13559 vsize=4922736 CPUtime=5011.25 cores=0-7
/proc/13561/task/13564/stat : 13564 (SArTagnan) R 13559 13561 13535 0 -1 4202560 170548 0 0 0 501019 106 0 0 25 0 8 0 804158934 5040881664 1061400 33554432000 4194304 4625164 140735287962864 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=13561/tid=13565] ppid=13559 vsize=4922736 CPUtime=5009.37 cores=0-7
/proc/13561/task/13565/stat : 13565 (SArTagnan) R 13559 13561 13535 0 -1 4202560 20920138 0 0 0 496771 4166 0 0 25 0 8 0 804158934 5040881664 1061400 33554432000 4194304 4625164 140735287962864 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=13561/tid=13566] ppid=13559 vsize=4922736 CPUtime=5012.23 cores=0-7
/proc/13561/task/13566/stat : 13566 (SArTagnan) R 13559 13561 13535 0 -1 4202560 164428 0 0 0 501080 143 0 0 25 0 8 0 804158934 5040881664 1061400 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=13561/tid=13567] ppid=13559 vsize=4922736 CPUtime=5011.9 cores=0-7
/proc/13561/task/13567/stat : 13567 (SArTagnan) R 13559 13561 13535 0 -1 4202560 171291 0 0 0 501079 111 0 0 25 0 8 0 804158934 5040881664 1061400 33554432000 4194304 4625164 140735287962864 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13561/tid=13568] ppid=13559 vsize=4922736 CPUtime=5011.58 cores=0-7
/proc/13561/task/13568/stat : 13568 (SArTagnan) R 13559 13561 13535 0 -1 4202560 350913 0 0 0 501016 142 0 0 25 0 8 0 804158934 5040881664 1061400 33554432000 4194304 4625164 140735287962864 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=13561/tid=13569] ppid=13559 vsize=4922736 CPUtime=5010.46 cores=0-7
/proc/13561/task/13569/stat : 13569 (SArTagnan) R 13559 13561 13535 0 -1 4202560 131134 0 0 0 500921 125 0 0 25 0 8 0 804158934 5040881664 1061400 33554432000 4194304 4625164 140735287962864 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 4922736

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5013.1 s]
/proc/loadavg: 8.17 8.08 8.02 9/531 13727
/proc/meminfo: memFree=11089128/32951132 swapFree=46579808/67111528
[pid=13561] ppid=13559 vsize=0 CPUtime=40000.9 cores=0-7
/proc/13561/stat : 13561 (SArTagnan) Z 13559 13561 13535 0 -1 4203548 22520677 0 0 0 3995057 5029 0 0 25 0 2 0 804158926 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/13561/statm: 0 0 0 0 0 0 0
[pid=13561/tid=13569] ppid=13559 vsize=0 CPUtime=5010.64 cores=0-7
/proc/13561/task/13569/stat : 13569 (SArTagnan) R 13559 13561 13535 0 -1 4203588 131134 0 0 0 500922 142 0 0 25 0 2 0 804158934 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.9
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5013.14
CPU time (s): 40000.9
CPU user time (s): 39950.6
CPU system time (s): 50.3323
CPU usage (%): 797.921
Max. virtual memory (cumulated for all children) (KiB): 4988272

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39950.6
system time used= 50.3323
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 22520677
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17133
involuntary context switches= 178926

runsolver used 22.5506 second user time and 69.7634 second system time

The end

Launcher Data 

Begin job on node128 at 2011-06-01 12:53:23
IDJOB=3439056
IDBENCH=83248
IDSOLVER=1936
FILE ID=node128/3439056-1306925603
RUNJOBID= node128-1306925603-13549
PBS_JOBID= 13488556
Free space on /tmp= 73800 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-4-5_4231.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439056-1306925603/watcher-3439056-1306925603 -o /tmp/evaluation-result-3439056-1306925603/solver-3439056-1306925603 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439056-1306925603.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= a52d60bf6e72caa628ad712a5fe0fb7a
RANDOM SEED=253685953

node128.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5434.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      15342848 kB
Buffers:        291936 kB
Cached:        3414108 kB
SwapCached:      35620 kB
Active:        8782880 kB
Inactive:      8508228 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      15342848 kB
SwapTotal:    67111528 kB
SwapFree:     46579808 kB
Dirty:            2732 kB
Writeback:           0 kB
AnonPages:    13558852 kB
Mapped:          16328 kB
Slab:           133536 kB
PageTables:     111880 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 174773724 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73800 MiB
End job on node128 at 2011-06-01 14:16:58