Trace number 3385943

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3172.67 1300.06

General information on the benchmark

NameSAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/
mod2c-rand3bip-sat-240-2.shuffled-as.sat05-2519.cnf
MD5SUMb6a88c8ae73b20cfc873207d1a0caa09
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark139.097
Satisfiable
(Un)Satisfiability was proved
Number of variables338
Number of clauses2376
Sum of the clauses size10480
Maximum clause length6
Minimum clause length4
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 41520
Number of clauses of size 5736
Number of clauses of size over 5120

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385943-1305583009/watcher-3385943-1305583009 -o /tmp/evaluation-result-3385943-1305583009/solver-3385943-1305583009 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385943-1305583009.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.96 10.25 11.37 10/493 8972
/proc/meminfo: memFree=21334068/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=49892 CPUtime=0.03 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 590 0 0 0 3 0 0 0 18 0 4 0 669898010 51089408 528 33554432000 4194304 4625164 140737010398016 18446744073709551615 47418027673522 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8972/statm: 12473 528 300 106 0 7976 0
[pid=8972/tid=8973] ppid=8967 vsize=49892 CPUtime=0 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 0 0 0 0 0 0 0 0 19 0 4 0 669898011 51089408 528 33554432000 4194304 4625164 140737010398016 18446744073709551615 239476751345 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=49892 CPUtime=0 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 0 0 0 0 0 0 0 0 19 0 4 0 669898011 51089408 528 33554432000 4194304 4625164 140737010398016 18446744073709551615 239476751345 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=49892 CPUtime=0.01 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 1 0 0 0 1 0 0 0 19 0 4 0 669898011 51089408 528 33554432000 4194304 4625164 140737010398016 18446744073709551615 47418027673522 0 0 4096 2 0 0 0 -1 7 0 0 0

[startup+0.129161 s]
/proc/loadavg: 7.96 10.25 11.37 10/493 8972
/proc/meminfo: memFree=21334068/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=117312 CPUtime=0.26 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 1248 0 0 0 26 0 0 0 19 0 4 0 669898010 120127488 1055 33554432000 4194304 4625164 140737010398016 18446744073709551615 4393124 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8972/statm: 29328 1055 343 106 0 24831 0
[pid=8972/tid=8973] ppid=8967 vsize=117312 CPUtime=0.01 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 168 0 0 0 1 0 0 0 20 0 4 0 669898011 120127488 1055 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=117312 CPUtime=0.02 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 0 0 0 0 2 0 0 0 20 0 4 0 669898011 120127488 1055 33554432000 4194304 4625164 140737010398016 18446744073709551615 47418027673522 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=117312 CPUtime=0.11 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 266 0 0 0 11 0 0 0 20 0 4 0 669898011 120127488 1055 33554432000 4194304 4625164 140737010398016 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 117312

[startup+0.229142 s]
/proc/loadavg: 7.96 10.25 11.37 10/493 8972
/proc/meminfo: memFree=21334068/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=183532 CPUtime=0.55 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 1981 0 0 0 55 0 0 0 19 0 4 0 669898010 187936768 1401 33554432000 4194304 4625164 140737010398016 18446744073709551615 239476350995 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8972/statm: 45883 1401 343 106 0 41386 0
[pid=8972/tid=8973] ppid=8967 vsize=183532 CPUtime=0.04 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 270 0 0 0 4 0 0 0 20 0 4 0 669898011 187936768 1401 33554432000 4194304 4625164 140737010398016 18446744073709551615 4464333 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=183532 CPUtime=0.11 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 298 0 0 0 11 0 0 0 20 0 4 0 669898011 187936768 1401 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=183532 CPUtime=0.2 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 487 0 0 0 20 0 0 0 20 0 4 0 669898011 187936768 1401 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 0.55
Current children cumulated vsize (KiB) 183532

[startup+0.329123 s]
/proc/loadavg: 7.96 10.25 11.37 10/493 8972
/proc/meminfo: memFree=21334068/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=184268 CPUtime=0.75 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 2281 0 0 0 75 0 0 0 19 0 4 0 669898010 188690432 1685 33554432000 4194304 4625164 140737010398016 18446744073709551615 4512326 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8972/statm: 46067 1685 343 106 0 41570 0
[pid=8972/tid=8973] ppid=8967 vsize=184268 CPUtime=0.05 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 274 0 0 0 5 0 0 0 20 0 4 0 669898011 188690432 1685 33554432000 4194304 4625164 140737010398016 18446744073709551615 239476799982 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=184268 CPUtime=0.12 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 301 0 0 0 12 0 0 0 20 0 4 0 669898011 188690432 1685 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=184268 CPUtime=0.3 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 670 0 0 0 30 0 0 0 20 0 4 0 669898011 188690432 1685 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 0.75
Current children cumulated vsize (KiB) 184268

[startup+0.701052 s]
/proc/loadavg: 7.96 10.25 11.37 10/493 8972
/proc/meminfo: memFree=21334068/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=184664 CPUtime=1.7 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 4338 0 0 0 169 1 0 0 19 0 4 0 669898010 189095936 2350 33554432000 4194304 4625164 140737010398016 18446744073709551615 4292316 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8972/statm: 46166 2350 343 106 0 41669 0
[pid=8972/tid=8973] ppid=8967 vsize=184664 CPUtime=0.17 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 456 0 0 0 17 0 0 0 19 0 4 0 669898011 189095936 2350 33554432000 4194304 4625164 140737010398016 18446744073709551615 4462448 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=184664 CPUtime=0.32 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 558 0 0 0 32 0 0 0 20 0 4 0 669898011 189095936 2350 33554432000 4194304 4625164 140737010398016 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=184664 CPUtime=0.6 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 1961 0 0 0 60 0 0 0 21 0 4 0 669898011 189095936 2350 33554432000 4194304 4625164 140737010398016 18446744073709551615 4339554 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1.7
Current children cumulated vsize (KiB) 184664

[startup+1.5009 s]
/proc/loadavg: 7.96 10.25 11.37 14/498 8977
/proc/meminfo: memFree=21310104/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=188776 CPUtime=3.68 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 6940 0 0 0 367 1 0 0 21 0 4 0 669898010 193306624 3566 33554432000 4194304 4625164 140737010398016 18446744073709551615 4511997 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8972/statm: 47194 3566 343 106 0 42697 0
[pid=8972/tid=8973] ppid=8967 vsize=188776 CPUtime=0.55 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 768 0 0 0 55 0 0 0 19 0 4 0 669898011 193306624 3566 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351998 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=188776 CPUtime=0.72 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 1176 0 0 0 72 0 0 0 21 0 4 0 669898011 193306624 3566 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=188776 CPUtime=1 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 3076 0 0 0 100 0 0 0 21 0 4 0 669898011 193306624 3566 33554432000 4194304 4625164 140737010398016 18446744073709551615 4547445 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.68
Current children cumulated vsize (KiB) 188776

[startup+3.1006 s]
/proc/loadavg: 7.96 10.25 11.37 14/498 8977
/proc/meminfo: memFree=21298076/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=194228 CPUtime=7.66 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 11298 0 0 0 764 2 0 0 25 0 4 0 669898010 198889472 5273 33554432000 4194304 4625164 140737010398016 18446744073709551615 4397112 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/8972/statm: 48557 5273 344 106 0 44060 0
[pid=8972/tid=8973] ppid=8967 vsize=194228 CPUtime=1.34 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 1691 0 0 0 134 0 0 0 21 0 4 0 669898011 198889472 5273 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=194228 CPUtime=1.52 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 1927 0 0 0 152 0 0 0 24 0 4 0 669898011 198889472 5273 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=194228 CPUtime=1.79 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 5028 0 0 0 178 1 0 0 25 0 4 0 669898011 198889472 5273 33554432000 4194304 4625164 140737010398016 18446744073709551615 4551099 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 7.66
Current children cumulated vsize (KiB) 194228

[startup+6.30098 s]
/proc/loadavg: 8.28 10.28 11.37 14/498 8977
/proc/meminfo: memFree=21273772/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=268284 CPUtime=15.43 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 21053 0 0 0 1538 5 0 0 25 0 4 0 669898010 274722816 8277 33554432000 4194304 4625164 140737010398016 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/8972/statm: 67071 8277 344 106 0 62574 0
[pid=8972/tid=8973] ppid=8967 vsize=268284 CPUtime=4.14 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 4189 0 0 0 414 0 0 0 25 0 4 0 669898011 274722816 8277 33554432000 4194304 4625164 140737010398016 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=268284 CPUtime=3.01 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 3088 0 0 0 301 0 0 0 25 0 4 0 669898011 274722816 8277 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351989 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=268284 CPUtime=3.23 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 9949 0 0 0 321 2 0 0 25 0 4 0 669898011 274722816 8277 33554432000 4194304 4625164 140737010398016 18446744073709551615 239492678683 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 15.43
Current children cumulated vsize (KiB) 268284

[startup+12.7008 s]
/proc/loadavg: 8.66 10.32 11.38 14/498 8977
/proc/meminfo: memFree=21229472/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=275792 CPUtime=28.66 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 47765 0 0 0 2857 9 0 0 25 0 4 0 669898010 282411008 12608 33554432000 4194304 4625164 140737010398016 18446744073709551615 4512872 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8972/statm: 68948 12608 347 106 0 64451 0
[pid=8972/tid=8973] ppid=8967 vsize=275792 CPUtime=7.89 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 5330 0 0 0 788 1 0 0 25 0 4 0 669898011 282411008 12608 33554432000 4194304 4625164 140737010398016 18446744073709551615 4339581 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=275792 CPUtime=6.02 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 5019 0 0 0 601 1 0 0 25 0 4 0 669898011 282411008 12608 33554432000 4194304 4625164 140737010398016 18446744073709551615 4352577 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=275792 CPUtime=6.33 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 32643 0 0 0 628 5 0 0 25 0 4 0 669898011 282411008 12608 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 28.66
Current children cumulated vsize (KiB) 275792

[startup+25.5013 s]
/proc/loadavg: 9.62 10.45 11.40 14/498 8977
/proc/meminfo: memFree=21181112/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=293976 CPUtime=59.05 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 115444 0 0 0 5885 20 0 0 25 0 4 0 669898010 301031424 20472 33554432000 4194304 4625164 140737010398016 18446744073709551615 4512818 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8972/statm: 73494 20472 443 106 0 68997 0
[pid=8972/tid=8973] ppid=8967 vsize=293976 CPUtime=14.24 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 10473 0 0 0 1422 2 0 0 25 0 4 0 669898011 301031424 20472 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=293976 CPUtime=12.41 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 10140 0 0 0 1240 1 0 0 25 0 4 0 669898011 301031424 20472 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=293976 CPUtime=12.73 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 86889 0 0 0 1260 13 0 0 25 0 4 0 669898011 301031424 20472 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 59.05
Current children cumulated vsize (KiB) 293976

[startup+51.1004 s]
/proc/loadavg: 10.49 10.59 11.42 14/498 8978
/proc/meminfo: memFree=21094644/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=299860 CPUtime=122.64 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 229379 0 0 0 12225 39 0 0 25 0 4 0 669898010 307056640 30891 33554432000 4194304 4625164 140737010398016 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8972/statm: 74965 30891 546 106 0 70468 0
[pid=8972/tid=8973] ppid=8967 vsize=299860 CPUtime=27.04 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 12439 0 0 0 2701 3 0 0 25 0 4 0 669898011 307056640 30891 33554432000 4194304 4625164 140737010398016 18446744073709551615 4288690 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=299860 CPUtime=25.21 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 15249 0 0 0 2519 2 0 0 25 0 4 0 669898011 307056640 30891 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=299860 CPUtime=25.53 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 189691 0 0 0 2524 29 0 0 25 0 4 0 669898011 307056640 30891 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 122.64
Current children cumulated vsize (KiB) 299860

[startup+102.301 s]
/proc/loadavg: 11.52 10.85 11.47 14/498 8979
/proc/meminfo: memFree=20972000/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=333688 CPUtime=243.37 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 400055 0 0 0 24268 69 0 0 25 0 4 0 669898010 341696512 46698 33554432000 4194304 4625164 140737010398016 18446744073709551615 4512026 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/8972/statm: 83422 46698 453 106 0 78925 0
[pid=8972/tid=8973] ppid=8967 vsize=333688 CPUtime=67.45 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 21006 0 0 0 6739 6 0 0 25 0 4 0 669898011 341696512 46699 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=333688 CPUtime=50.52 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 23664 0 0 0 5046 6 0 0 25 0 4 0 669898011 341696512 46699 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=333688 CPUtime=50.79 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 336564 0 0 0 5027 52 0 0 25 0 4 0 669898011 341696512 46699 33554432000 4194304 4625164 140737010398016 18446744073709551615 4352072 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 243.37
Current children cumulated vsize (KiB) 333688

[startup+162.301 s]

################
# More data... #
################

[pid=8972] ppid=8967 vsize=887716 CPUtime=1883.1 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 1823660 0 0 0 188004 306 0 0 25 0 4 0 669898010 909021184 142529 33554432000 4194304 4625164 140737010398016 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/8972/statm: 221929 142530 386 106 0 217432 0
[pid=8972/tid=8973] ppid=8967 vsize=887716 CPUtime=521.36 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 89763 0 0 0 52105 31 0 0 25 0 4 0 669898011 909021184 142566 33554432000 4194304 4625164 140737010398016 18446744073709551615 4352085 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=887716 CPUtime=393.46 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 74110 0 0 0 39325 21 0 0 25 0 4 0 669898011 909021184 142566 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=887716 CPUtime=400.79 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 1590963 0 0 0 39838 241 0 0 25 0 4 0 669898011 909021184 142566 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1883.1
Current children cumulated vsize (KiB) 887716

[startup+822.301 s]
/proc/loadavg: 12.19 12.08 11.85 14/498 9011
/proc/meminfo: memFree=20214136/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=909404 CPUtime=2025.66 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 2013280 0 0 0 202230 336 0 0 25 0 4 0 669898010 931229696 149481 33554432000 4194304 4625164 140737010398016 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/8972/statm: 227351 149481 384 106 0 222854 0
[pid=8972/tid=8973] ppid=8967 vsize=909404 CPUtime=554.14 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 91949 0 0 0 55382 32 0 0 25 0 4 0 669898011 931229696 149481 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=909404 CPUtime=426.85 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 75733 0 0 0 42663 22 0 0 25 0 4 0 669898011 931229696 149481 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=909404 CPUtime=430.23 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 1764269 0 0 0 42758 265 0 0 25 0 4 0 669898011 931229696 149481 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2025.66
Current children cumulated vsize (KiB) 909404

[startup+882.32 s]
/proc/loadavg: 12.20 12.09 11.86 14/498 9012
/proc/meminfo: memFree=20184492/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=909404 CPUtime=2158.31 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 2186012 0 0 0 215469 362 0 0 25 0 4 0 669898010 931229696 152868 33554432000 4194304 4625164 140737010398016 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/8972/statm: 227351 152868 400 106 0 222854 0
[pid=8972/tid=8973] ppid=8967 vsize=909404 CPUtime=583.55 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 92959 0 0 0 58321 34 0 0 25 0 4 0 669898011 931229696 152868 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=909404 CPUtime=456.46 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 76437 0 0 0 45621 25 0 0 25 0 4 0 669898011 931229696 152868 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=909404 CPUtime=458.93 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 1935146 0 0 0 45605 288 0 0 25 0 4 0 669898011 931229696 152868 33554432000 4194304 4625164 140737010398016 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2158.31
Current children cumulated vsize (KiB) 909404

[startup+942.301 s]
/proc/loadavg: 12.32 12.14 11.89 14/498 9014
/proc/meminfo: memFree=20140956/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=909404 CPUtime=2294.42 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 2400744 0 0 0 229046 396 0 0 25 0 4 0 669898010 931229696 158032 33554432000 4194304 4625164 140737010398016 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8972/statm: 227351 158032 407 106 0 222854 0
[pid=8972/tid=8973] ppid=8967 vsize=909404 CPUtime=612.99 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 94373 0 0 0 61264 35 0 0 25 0 4 0 669898011 931229696 158032 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=909404 CPUtime=486.44 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 77325 0 0 0 48618 26 0 0 25 0 4 0 669898011 931229696 158032 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=909404 CPUtime=496.53 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 2146576 0 0 0 49334 319 0 0 25 0 4 0 669898011 931229696 158032 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2294.42
Current children cumulated vsize (KiB) 909404

[startup+1002.3 s]
/proc/loadavg: 12.22 12.14 11.91 14/498 9015
/proc/meminfo: memFree=20097172/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=947424 CPUtime=2439.16 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 2582381 0 0 0 243489 427 0 0 25 0 4 0 669898010 970162176 166116 33554432000 4194304 4625164 140737010398016 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8972/statm: 236856 166116 409 106 0 232359 0
[pid=8972/tid=8973] ppid=8967 vsize=947424 CPUtime=642.98 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 99909 0 0 0 64262 36 0 0 25 0 4 0 669898011 970162176 166116 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=947424 CPUtime=516.38 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 77986 0 0 0 51611 27 0 0 25 0 4 0 669898011 970162176 166116 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=947424 CPUtime=525.62 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 2321381 0 0 0 52215 347 0 0 25 0 4 0 669898011 970162176 166116 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2439.16
Current children cumulated vsize (KiB) 947424

[startup+1062.3 s]
/proc/loadavg: 12.18 12.14 11.92 14/498 9017
/proc/meminfo: memFree=20076324/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=947424 CPUtime=2588.2 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 2766459 0 0 0 258364 456 0 0 25 0 4 0 669898010 970162176 168501 33554432000 4194304 4625164 140737010398016 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8972/statm: 236856 168501 366 106 0 232359 0
[pid=8972/tid=8973] ppid=8967 vsize=947424 CPUtime=672.99 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 100106 0 0 0 67262 37 0 0 25 0 4 0 669898011 970162176 168501 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=947424 CPUtime=546.39 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 78636 0 0 0 54610 29 0 0 25 0 4 0 669898011 970162176 168501 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=947424 CPUtime=555.62 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 2502680 0 0 0 55189 373 0 0 25 0 4 0 669898011 970162176 168501 33554432000 4194304 4625164 140737010398016 18446744073709551615 4547807 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2588.2
Current children cumulated vsize (KiB) 947424

[startup+1122.3 s]
/proc/loadavg: 12.15 12.14 11.93 14/498 9019
/proc/meminfo: memFree=20047664/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=947424 CPUtime=2737.08 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 2933745 0 0 0 273226 482 0 0 25 0 4 0 669898010 970162176 173993 33554432000 4194304 4625164 140737010398016 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8972/statm: 236856 173993 392 106 0 232359 0
[pid=8972/tid=8973] ppid=8967 vsize=947424 CPUtime=702.93 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 100453 0 0 0 70256 37 0 0 25 0 4 0 669898011 970162176 173993 33554432000 4194304 4625164 140737010398016 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=947424 CPUtime=576.32 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 80979 0 0 0 57602 30 0 0 25 0 4 0 669898011 970162176 173993 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=947424 CPUtime=585.6 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 2666818 0 0 0 58163 397 0 0 25 0 4 0 669898011 970162176 173993 33554432000 4194304 4625164 140737010398016 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2737.08
Current children cumulated vsize (KiB) 947424

[startup+1182.3 s]
/proc/loadavg: 12.10 12.13 11.94 14/498 9020
/proc/meminfo: memFree=20019004/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=947424 CPUtime=2885.57 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 3120522 0 0 0 288045 512 0 0 25 0 4 0 669898010 970162176 177036 33554432000 4194304 4625164 140737010398016 18446744073709551615 4519319 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8972/statm: 236856 177036 384 106 0 232359 0
[pid=8972/tid=8973] ppid=8967 vsize=947424 CPUtime=732.89 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 101722 0 0 0 73250 39 0 0 25 0 4 0 669898011 970162176 177036 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=947424 CPUtime=606.32 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 81771 0 0 0 60600 32 0 0 25 0 4 0 669898011 970162176 177036 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=947424 CPUtime=615.11 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 2851051 0 0 0 61087 424 0 0 25 0 4 0 669898011 970162176 177036 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2885.57
Current children cumulated vsize (KiB) 947424

[startup+1242.3 s]
/proc/loadavg: 12.15 12.13 11.95 14/498 9022
/proc/meminfo: memFree=19987876/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=947424 CPUtime=3029.27 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 3296829 0 0 0 302387 540 0 0 25 0 4 0 669898010 970162176 181381 33554432000 4194304 4625164 140737010398016 18446744073709551615 4329142 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8972/statm: 236856 181381 382 106 0 232359 0
[pid=8972/tid=8973] ppid=8967 vsize=947424 CPUtime=762.85 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 102646 0 0 0 76245 40 0 0 25 0 4 0 669898011 970162176 181381 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=947424 CPUtime=636.16 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 82403 0 0 0 63582 34 0 0 25 0 4 0 669898011 970162176 181381 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=947424 CPUtime=644.5 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 3025417 0 0 0 64001 449 0 0 25 0 4 0 669898011 970162176 181381 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3029.27
Current children cumulated vsize (KiB) 947424



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 12.09 12.12 11.95 14/498 9023
/proc/meminfo: memFree=19959344/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=947424 CPUtime=3172.6 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 3470177 0 0 0 316692 568 0 0 25 0 4 0 669898010 970162176 184261 33554432000 4194304 4625164 140737010398016 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8972/statm: 236856 184261 374 106 0 232359 0
[pid=8972/tid=8973] ppid=8967 vsize=947424 CPUtime=791.71 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 103500 0 0 0 79130 41 0 0 25 0 4 0 669898011 970162176 184274 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=947424 CPUtime=665.02 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 82472 0 0 0 66468 34 0 0 25 0 4 0 669898011 970162176 184274 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=947424 CPUtime=673.35 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 3196899 0 0 0 66859 476 0 0 25 0 4 0 669898011 970162176 184274 33554432000 4194304 4625164 140737010398016 18446744073709551615 4579396 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3172.6
Current children cumulated vsize (KiB) 947424

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 12.09 12.12 11.95 14/498 9023
/proc/meminfo: memFree=19959344/32950928 swapFree=67056568/67111528
[pid=8972] ppid=8967 vsize=947424 CPUtime=3172.6 cores=1,3,5,7
/proc/8972/stat : 8972 (SArTagnan) R 8967 8972 8278 0 -1 4202496 3470177 0 0 0 316692 568 0 0 25 0 4 0 669898010 970162176 184261 33554432000 4194304 4625164 140737010398016 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/8972/statm: 236856 184261 374 106 0 232359 0
[pid=8972/tid=8973] ppid=8967 vsize=947424 CPUtime=791.71 cores=1,3,5,7
/proc/8972/task/8973/stat : 8973 (SArTagnan) R 8967 8972 8278 0 -1 4202560 103500 0 0 0 79130 41 0 0 25 0 4 0 669898011 970162176 184274 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=8972/tid=8974] ppid=8967 vsize=947424 CPUtime=665.02 cores=1,3,5,7
/proc/8972/task/8974/stat : 8974 (SArTagnan) R 8967 8972 8278 0 -1 4202560 82472 0 0 0 66468 34 0 0 25 0 4 0 669898011 970162176 184274 33554432000 4194304 4625164 140737010398016 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=8972/tid=8975] ppid=8967 vsize=947424 CPUtime=673.35 cores=1,3,5,7
/proc/8972/task/8975/stat : 8975 (SArTagnan) R 8967 8972 8278 0 -1 4202560 3196899 0 0 0 66859 476 0 0 25 0 4 0 669898011 970162176 184274 33554432000 4194304 4625164 140737010398016 18446744073709551615 4579396 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3172.6
Current children cumulated vsize (KiB) 947424

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.06
CPU time (s): 3172.67
CPU user time (s): 3166.95
CPU system time (s): 5.71913
CPU usage (%): 244.041
Max. virtual memory (cumulated for all children) (KiB): 950460

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3166.95
system time used= 5.71913
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3470206
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1513
involuntary context switches= 46431

runsolver used 5.9481 second user time and 15.3567 second system time

The end

Launcher Data 

Begin job on node148 at 2011-05-16 23:56:49
IDJOB=3385943
IDBENCH=85362
IDSOLVER=1871
FILE ID=node148/3385943-1305583009
RUNJOBID= node148-1305583009-8951
PBS_JOBID= 13350202
Free space on /tmp= 72884 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT05/crafted/jarvisalo05/mod2c-rand3bip-sat/mod2c-rand3bip-sat-240-2.shuffled-as.sat05-2519.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385943-1305583009/watcher-3385943-1305583009 -o /tmp/evaluation-result-3385943-1305583009/solver-3385943-1305583009 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385943-1305583009.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b6a88c8ae73b20cfc873207d1a0caa09
RANDOM SEED=1430072282

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      21335116 kB
Buffers:        355068 kB
Cached:        5015676 kB
SwapCached:       8488 kB
Active:        8036416 kB
Inactive:      3212100 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      21335116 kB
SwapTotal:    67111528 kB
SwapFree:     67056568 kB
Dirty:             780 kB
Writeback:           0 kB
AnonPages:     5875996 kB
Mapped:          37592 kB
Slab:           250492 kB
PageTables:      49620 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 141735904 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72884 MiB
End job on node148 at 2011-05-17 00:18:32