Trace number 3257384

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.5 1201.97

General information on the benchmark

NameCRAFTED/edgematching/
compact/em_11_3_4_cmp.cnf
MD5SUM3b5e80540ef2fcb09cfe50ac7e3686c1
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark135.155
Satisfiable
(Un)Satisfiability was proved
Number of variables8713
Number of clauses99699
Sum of the clauses size335345
Maximum clause length81
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 210866
Number of clauses of size 367270
Number of clauses of size 410556
Number of clauses of size 510773
Number of clauses of size over 5234

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3257384-1304046671/watcher-3257384-1304046671 -o /tmp/evaluation-result-3257384-1304046671/solver-3257384-1304046671 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3257384-1304046671.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.08 8.10 8.01 5/180 19577
/proc/meminfo: memFree=18494832/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=22068 CPUtime=0 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 752 0 0 0 0 0 0 0 20 0 1 0 516265098 22597632 654 33554432000 4194304 4623224 140735475355104 18446744073709551615 4388779 0 0 4096 2 0 0 0 17 3 0 0 0
/proc/19577/statm: 5517 655 297 105 0 1021 0

[startup+0.0820649 s]
/proc/loadavg: 8.08 8.10 8.01 5/180 19577
/proc/meminfo: memFree=18494832/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=212672 CPUtime=0.11 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 10599 0 0 0 10 1 0 0 21 0 4 0 516265098 217776128 7195 33554432000 4194304 4623224 140735475355104 18446744073709551615 4516371 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 53168 7196 336 105 0 48672 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 212672

[startup+0.101061 s]
/proc/loadavg: 8.08 8.10 8.01 5/180 19577
/proc/meminfo: memFree=18494832/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=280404 CPUtime=0.2 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 12205 0 0 0 18 2 0 0 21 0 4 0 516265098 287133696 7704 33554432000 4194304 4623224 140735475355104 18446744073709551615 4413440 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 70101 7705 337 105 0 65605 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 280404

[startup+0.301027 s]
/proc/loadavg: 8.08 8.10 8.01 5/180 19577
/proc/meminfo: memFree=18494832/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=284832 CPUtime=0.99 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 17932 0 0 0 97 2 0 0 21 0 4 0 516265098 291667968 9843 33554432000 4194304 4623224 140735475355104 18446744073709551615 4510105 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 71208 9843 337 105 0 66712 0
Current children cumulated CPU time (s) 0.99
Current children cumulated vsize (KiB) 284832

[startup+0.700955 s]
/proc/loadavg: 8.08 8.10 8.01 5/180 19577
/proc/meminfo: memFree=18494832/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=288664 CPUtime=2.59 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 27691 0 0 0 255 4 0 0 22 0 4 0 516265098 295591936 11987 33554432000 4194304 4623224 140735475355104 18446744073709551615 4510900 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 72166 11987 339 105 0 67670 0
Current children cumulated CPU time (s) 2.59
Current children cumulated vsize (KiB) 288664

[startup+1.50081 s]
/proc/loadavg: 8.07 8.10 8.01 9/184 19581
/proc/meminfo: memFree=18438264/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=288664 CPUtime=5.79 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 40314 0 0 0 572 7 0 0 25 0 4 0 516265098 295591936 15956 33554432000 4194304 4623224 140735475355104 18446744073709551615 4280478 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 72166 15956 339 105 0 67670 0
[pid=19577/tid=19579] ppid=19575 vsize=288664 CPUtime=1.42 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 4700 0 0 0 142 0 0 0 25 0 4 0 516265104 295591936 15956 33554432000 4194304 4623224 140735475355104 18446744073709551615 4376832 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=288664 CPUtime=1.41 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 5290 0 0 0 140 1 0 0 25 0 4 0 516265104 295591936 15956 33554432000 4194304 4623224 140735475355104 18446744073709551615 4463294 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=288664 CPUtime=1.43 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 19638 0 0 0 140 3 0 0 25 0 4 0 516265104 295591936 15956 33554432000 4194304 4623224 140735475355104 18446744073709551615 4545317 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.79
Current children cumulated vsize (KiB) 288664

[startup+3.10052 s]
/proc/loadavg: 8.07 8.10 8.01 9/184 19581
/proc/meminfo: memFree=18415200/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=292808 CPUtime=12.18 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 63788 0 0 0 1207 11 0 0 25 0 4 0 516265098 299835392 23305 33554432000 4194304 4623224 140735475355104 18446744073709551615 4510183 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 73202 23305 339 105 0 68706 0
[pid=19577/tid=19579] ppid=19575 vsize=292808 CPUtime=3.03 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 9034 0 0 0 301 2 0 0 19 0 4 0 516265104 299835392 23305 33554432000 4194304 4623224 140735475355104 18446744073709551615 4376829 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=292808 CPUtime=3.01 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 9499 0 0 0 299 2 0 0 25 0 4 0 516265104 299835392 23305 33554432000 4194304 4623224 140735475355104 18446744073709551615 4466086 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=292808 CPUtime=3.03 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 32923 0 0 0 299 4 0 0 25 0 4 0 516265104 299835392 23305 33554432000 4194304 4623224 140735475355104 18446744073709551615 4354994 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.18
Current children cumulated vsize (KiB) 292808

[startup+6.30095 s]
/proc/loadavg: 8.07 8.10 8.01 9/184 19581
/proc/meminfo: memFree=18383668/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=300128 CPUtime=24.96 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 99417 0 0 0 2479 17 0 0 25 0 4 0 516265098 307331072 28024 33554432000 4194304 4623224 140735475355104 18446744073709551615 4359817 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 75032 28024 345 105 0 70536 0
[pid=19577/tid=19579] ppid=19575 vsize=300128 CPUtime=6.22 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 9737 0 0 0 620 2 0 0 25 0 4 0 516265104 307331072 28024 33554432000 4194304 4623224 140735475355104 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=300128 CPUtime=6.2 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 10204 0 0 0 617 3 0 0 25 0 4 0 516265104 307331072 28024 33554432000 4194304 4623224 140735475355104 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=300128 CPUtime=6.22 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 63169 0 0 0 614 8 0 0 25 0 4 0 516265104 307331072 28024 33554432000 4194304 4623224 140735475355104 18446744073709551615 228122411335 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.96
Current children cumulated vsize (KiB) 300128

[startup+12.7008 s]
/proc/loadavg: 8.06 8.09 8.01 9/184 19582
/proc/meminfo: memFree=18324156/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=344520 CPUtime=50.52 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 158378 0 0 0 5025 27 0 0 25 0 4 0 516265098 352788480 41354 33554432000 4194304 4623224 140735475355104 18446744073709551615 4414984 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 86130 41354 345 105 0 81634 0
[pid=19577/tid=19579] ppid=19575 vsize=344520 CPUtime=12.63 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 19108 0 0 0 1259 4 0 0 25 0 4 0 516265104 352788480 41354 33554432000 4194304 4623224 140735475355104 18446744073709551615 4376732 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=344520 CPUtime=12.56 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 18915 0 0 0 1251 5 0 0 25 0 4 0 516265104 352788480 41354 33554432000 4194304 4623224 140735475355104 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=344520 CPUtime=12.63 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 93853 0 0 0 1250 13 0 0 25 0 4 0 516265104 352788480 41354 33554432000 4194304 4623224 140735475355104 18446744073709551615 4545943 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.52
Current children cumulated vsize (KiB) 344520

[startup+25.5005 s]
/proc/loadavg: 8.05 8.09 8.01 9/184 19582
/proc/meminfo: memFree=18193828/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=408220 CPUtime=101.65 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 279898 0 0 0 10115 50 0 0 25 0 4 0 516265098 418017280 72131 33554432000 4194304 4623224 140735475355104 18446744073709551615 4510127 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 102055 72132 345 105 0 97559 0
[pid=19577/tid=19579] ppid=19575 vsize=408220 CPUtime=25.42 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 25585 0 0 0 2537 5 0 0 25 0 4 0 516265104 418017280 72133 33554432000 4194304 4623224 140735475355104 18446744073709551615 4377484 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=408220 CPUtime=25.28 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 37992 0 0 0 2516 12 0 0 25 0 4 0 516265104 418017280 72133 33554432000 4194304 4623224 140735475355104 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=408220 CPUtime=25.42 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 169114 0 0 0 2519 23 0 0 25 0 4 0 516265104 418017280 72133 33554432000 4194304 4623224 140735475355104 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.65
Current children cumulated vsize (KiB) 408220

[startup+51.1009 s]
/proc/loadavg: 8.03 8.08 8.01 9/184 19583
/proc/meminfo: memFree=17855420/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=845908 CPUtime=203.9 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 560887 0 0 0 20295 95 0 0 25 0 4 0 516265098 866209792 152465 33554432000 4194304 4623224 140735475355104 18446744073709551615 4415028 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 211477 152465 373 105 0 206981 0
[pid=19577/tid=19579] ppid=19575 vsize=845908 CPUtime=51.03 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 37477 0 0 0 5096 7 0 0 25 0 4 0 516265104 866209792 152465 33554432000 4194304 4623224 140735475355104 18446744073709551615 4289853 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=845908 CPUtime=50.73 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 62473 0 0 0 5055 18 0 0 25 0 4 0 516265104 866209792 152465 33554432000 4194304 4623224 140735475355104 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=845908 CPUtime=51.02 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 291559 0 0 0 5059 43 0 0 25 0 4 0 516265104 866209792 152465 33554432000 4194304 4623224 140735475355104 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.9
Current children cumulated vsize (KiB) 845908

[startup+102.307 s]
/proc/loadavg: 8.08 8.08 8.01 9/184 19584
/proc/meminfo: memFree=17354952/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=1380188 CPUtime=408.42 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 913311 0 0 0 40689 153 0 0 25 0 4 0 516265098 1413312512 267047 33554432000 4194304 4623224 140735475355104 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 345047 267047 345 105 0 340551 0
[pid=19577/tid=19579] ppid=19575 vsize=1380188 CPUtime=102.23 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 54880 0 0 0 10213 10 0 0 25 0 4 0 516265104 1413312512 267047 33554432000 4194304 4623224 140735475355104 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=1380188 CPUtime=101.66 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 81736 0 0 0 10142 24 0 0 25 0 4 0 516265104 1413312512 267047 33554432000 4194304 4623224 140735475355104 18446744073709551615 4376579 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=1380188 CPUtime=102.22 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 387679 0 0 0 10166 56 0 0 25 0 4 0 516265104 1413312512 267047 33554432000 4194304 4623224 140735475355104 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.42
Current children cumulated vsize (KiB) 1380188

[startup+162.301 s]
/proc/loadavg: 8.10 8.08 8.01 9/184 19586
/proc/meminfo: memFree=16786876/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=1941104 CPUtime=648.03 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 1413152 0 0 0 64562 241 0 0 25 0 4 0 516265098 1987690496 401000 33554432000 4194304 4623224 140735475355104 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 485276 401000 346 105 0 480780 0
[pid=19577/tid=19579] ppid=19575 vsize=1941104 CPUtime=162.21 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 92048 0 0 0 16196 25 0 0 25 0 4 0 516265104 1987690496 401000 33554432000 4194304 4623224 140735475355104 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=1941104 CPUtime=161.31 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 112214 0 0 0 16099 32 0 0 25 0 4 0 516265104 1987690496 401000 33554432000 4194304 4623224 140735475355104 18446744073709551615 4376579 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=1941104 CPUtime=162.2 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 609532 0 0 0 16131 89 0 0 25 0 4 0 516265104 1987690496 401000 33554432000 4194304 4623224 140735475355104 18446744073709551615 47750661660249 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 648.03
Current children cumulated vsize (KiB) 1941104

[startup+222.301 s]
/proc/loadavg: 8.14 8.09 8.01 9/184 19587
/proc/meminfo: memFree=16005160/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=2798680 CPUtime=887.67 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 2084621 0 0 0 88412 355 0 0 25 0 4 0 516265098 2865848320 583858 33554432000 4194304 4623224 140735475355104 18446744073709551615 4413744 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 699670 583858 345 105 0 695174 0
[pid=19577/tid=19579] ppid=19575 vsize=2798680 CPUtime=222.19 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 134092 0 0 0 22183 36 0 0 25 0 4 0 516265104 2865848320 583858 33554432000 4194304 4623224 140735475355104 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=2798680 CPUtime=220.97 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 154415 0 0 0 22054 43 0 0 25 0 4 0 516265104 2865848320 583858 33554432000 4194304 4623224 140735475355104 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=2798680 CPUtime=222.2 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 872821 0 0 0 22090 130 0 0 25 0 4 0 516265104 2865848320 583858 33554432000 4194304 4623224 140735475355104 18446744073709551615 4276086 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 887.67
Current children cumulated vsize (KiB) 2798680

[startup+282.3 s]

################
# More data... #
################


[startup+702.301 s]
/proc/loadavg: 8.04 8.07 8.02 9/184 19600
/proc/meminfo: memFree=14864864/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=3893876 CPUtime=2804.96 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 3701652 0 0 0 279865 631 0 0 25 0 4 0 516265098 3987329024 788956 33554432000 4194304 4623224 140735475355104 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 973469 788956 345 105 0 968973 0
[pid=19577/tid=19579] ppid=19575 vsize=3893876 CPUtime=702.19 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 142964 0 0 0 70179 40 0 0 25 0 4 0 516265104 3987329024 788956 33554432000 4194304 4623224 140735475355104 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=3893876 CPUtime=698.36 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 155265 0 0 0 69793 43 0 0 25 0 4 0 516265104 3987329024 788956 33554432000 4194304 4623224 140735475355104 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=3893876 CPUtime=702.21 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 2030251 0 0 0 69893 328 0 0 25 0 4 0 516265104 3987329024 788956 33554432000 4194304 4623224 140735475355104 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2804.96
Current children cumulated vsize (KiB) 3893876

[startup+762.307 s]
/proc/loadavg: 8.05 8.07 8.02 9/184 19602
/proc/meminfo: memFree=14737852/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=3940088 CPUtime=3044.66 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 3927034 0 0 0 303797 669 0 0 25 0 4 0 516265098 4034650112 810736 33554432000 4194304 4623224 140735475355104 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 985022 810736 345 105 0 980526 0
[pid=19577/tid=19579] ppid=19575 vsize=3940088 CPUtime=762.19 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 142987 0 0 0 76179 40 0 0 25 0 4 0 516265104 4034650112 810736 33554432000 4194304 4623224 140735475355104 18446744073709551615 4357622 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=3940088 CPUtime=758.04 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 155295 0 0 0 75761 43 0 0 25 0 4 0 516265104 4034650112 810736 33554432000 4194304 4623224 140735475355104 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=3940088 CPUtime=762.21 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 2236579 0 0 0 75859 362 0 0 25 0 4 0 516265104 4034650112 810736 33554432000 4194304 4623224 140735475355104 18446744073709551615 4363989 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3044.66
Current children cumulated vsize (KiB) 3940088

[startup+822.301 s]
/proc/loadavg: 8.05 8.07 8.02 9/184 19664
/proc/meminfo: memFree=15147884/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=3976952 CPUtime=3284.32 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 4186297 0 0 0 327721 711 0 0 25 0 4 0 516265098 4072398848 834695 33554432000 4194304 4623224 140735475355104 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 994238 834695 345 105 0 989742 0
[pid=19577/tid=19579] ppid=19575 vsize=3976952 CPUtime=822.19 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 143019 0 0 0 82179 40 0 0 25 0 4 0 516265104 4072398848 834695 33554432000 4194304 4623224 140735475355104 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=3976952 CPUtime=817.71 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 155326 0 0 0 81728 43 0 0 25 0 4 0 516265104 4072398848 834695 33554432000 4194304 4623224 140735475355104 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=3976952 CPUtime=822.22 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 2474518 0 0 0 81821 401 0 0 25 0 4 0 516265104 4072398848 834695 33554432000 4194304 4623224 140735475355104 18446744073709551615 4363989 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3284.32
Current children cumulated vsize (KiB) 3976952

[startup+882.301 s]
/proc/loadavg: 8.05 8.06 8.02 9/184 19696
/proc/meminfo: memFree=15173920/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=4057580 CPUtime=3523.99 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 4361273 0 0 0 351660 739 0 0 25 0 4 0 516265098 4154961920 875277 33554432000 4194304 4623224 140735475355104 18446744073709551615 4513493 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 1014395 875277 345 105 0 1009899 0
[pid=19577/tid=19579] ppid=19575 vsize=4057580 CPUtime=882.19 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 143074 0 0 0 88179 40 0 0 25 0 4 0 516265104 4154961920 875277 33554432000 4194304 4623224 140735475355104 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=4057580 CPUtime=877.39 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 155366 0 0 0 87696 43 0 0 25 0 4 0 516265104 4154961920 875277 33554432000 4194304 4623224 140735475355104 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=4057580 CPUtime=882.21 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 2611682 0 0 0 87798 423 0 0 25 0 4 0 516265104 4154961920 875277 33554432000 4194304 4623224 140735475355104 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3523.99
Current children cumulated vsize (KiB) 4057580

[startup+942.3 s]
/proc/loadavg: 8.10 8.08 8.02 10/184 19697
/proc/meminfo: memFree=15018508/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=4201352 CPUtime=3763.67 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 4427110 0 0 0 375613 754 0 0 25 0 4 0 516265098 4302184448 901594 33554432000 4194304 4623224 140735475355104 18446744073709551615 4510142 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 1050338 901594 345 105 0 1045842 0
[pid=19577/tid=19579] ppid=19575 vsize=4201352 CPUtime=942.19 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 143095 0 0 0 94179 40 0 0 25 0 4 0 516265104 4302184448 901594 33554432000 4194304 4623224 140735475355104 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=4201352 CPUtime=937.06 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 155394 0 0 0 93663 43 0 0 25 0 4 0 516265104 4302184448 901594 33554432000 4194304 4623224 140735475355104 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=4201352 CPUtime=942.21 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 2651072 0 0 0 93791 430 0 0 25 0 4 0 516265104 4302184448 901594 33554432000 4194304 4623224 140735475355104 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3763.67
Current children cumulated vsize (KiB) 4201352

[startup+1002.3 s]
/proc/loadavg: 8.14 8.09 8.03 9/184 19729
/proc/meminfo: memFree=14345996/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=4266888 CPUtime=4003.35 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 4459521 0 0 0 399571 764 0 0 25 0 4 0 516265098 4369293312 929783 33554432000 4194304 4623224 140735475355104 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 1066722 929783 345 105 0 1062226 0
[pid=19577/tid=19579] ppid=19575 vsize=4266888 CPUtime=1002.19 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 143115 0 0 0 100179 40 0 0 25 0 4 0 516265104 4369293312 929783 33554432000 4194304 4623224 140735475355104 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=4266888 CPUtime=996.74 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 155413 0 0 0 99631 43 0 0 25 0 4 0 516265104 4369293312 929783 33554432000 4194304 4623224 140735475355104 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=4266888 CPUtime=1002.22 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 2651958 0 0 0 99791 431 0 0 25 0 4 0 516265104 4369293312 929783 33554432000 4194304 4623224 140735475355104 18446744073709551615 4363970 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4003.35
Current children cumulated vsize (KiB) 4266888

[startup+1062.3 s]
/proc/loadavg: 8.15 8.10 8.03 9/184 19731
/proc/meminfo: memFree=14002760/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=4982344 CPUtime=4243.04 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 4889699 0 0 0 423480 824 0 0 25 0 4 0 516265098 5101920256 997920 33554432000 4194304 4623224 140735475355104 18446744073709551615 4356035 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 1245586 997920 345 105 0 1241090 0
[pid=19577/tid=19579] ppid=19575 vsize=4982344 CPUtime=1062.2 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 143156 0 0 0 106180 40 0 0 25 0 4 0 516265104 5101920256 997920 33554432000 4194304 4623224 140735475355104 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=4982344 CPUtime=1056.41 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 155456 0 0 0 105598 43 0 0 25 0 4 0 516265104 5101920256 997920 33554432000 4194304 4623224 140735475355104 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=4982344 CPUtime=1062.22 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 2653727 0 0 0 105791 431 0 0 25 0 4 0 516265104 5101920256 997920 33554432000 4194304 4623224 140735475355104 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4243.04
Current children cumulated vsize (KiB) 4982344

[startup+1122.3 s]
/proc/loadavg: 8.11 8.10 8.03 9/184 19732
/proc/meminfo: memFree=13873248/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=5143220 CPUtime=4482.71 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 4958911 0 0 0 447435 836 0 0 25 0 4 0 516265098 5266657280 1018117 33554432000 4194304 4623224 140735475355104 18446744073709551615 4415001 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 1285805 1018117 345 105 0 1281309 0
[pid=19577/tid=19579] ppid=19575 vsize=5143220 CPUtime=1122.2 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 143186 0 0 0 112180 40 0 0 25 0 4 0 516265104 5266657280 1018117 33554432000 4194304 4623224 140735475355104 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=5143220 CPUtime=1116.09 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 155478 0 0 0 111566 43 0 0 25 0 4 0 516265104 5266657280 1018117 33554432000 4194304 4623224 140735475355104 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=5143220 CPUtime=1122.23 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 2655679 0 0 0 111791 432 0 0 25 0 4 0 516265104 5266657280 1018117 33554432000 4194304 4623224 140735475355104 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4482.71
Current children cumulated vsize (KiB) 5143220

[startup+1182.3 s]
/proc/loadavg: 8.09 8.09 8.03 9/184 19734
/proc/meminfo: memFree=13789892/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=5208756 CPUtime=4722.39 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 4976834 0 0 0 471397 842 0 0 25 0 4 0 516265098 5333766144 1035168 33554432000 4194304 4623224 140735475355104 18446744073709551615 4510192 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 1302189 1035168 345 105 0 1297693 0
[pid=19577/tid=19579] ppid=19575 vsize=5208756 CPUtime=1182.2 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 143235 0 0 0 118180 40 0 0 25 0 4 0 516265104 5333766144 1035168 33554432000 4194304 4623224 140735475355104 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=5208756 CPUtime=1175.76 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 155519 0 0 0 117533 43 0 0 25 0 4 0 516265104 5333766144 1035168 33554432000 4194304 4623224 140735475355104 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=5208756 CPUtime=1182.22 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 2656401 0 0 0 117790 432 0 0 25 0 4 0 516265104 5333766144 1035168 33554432000 4194304 4623224 140735475355104 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4722.39
Current children cumulated vsize (KiB) 5208756



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 8.13 8.10 8.04 9/184 19734
/proc/meminfo: memFree=13758392/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=5208756 CPUtime=4800.31 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) R 19575 19577 19389 0 -1 4202496 4984129 0 0 0 479186 845 0 0 25 0 4 0 516265098 5333766144 1041932 33554432000 4194304 4623224 140735475355104 18446744073709551615 4415031 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 1302189 1041932 345 105 0 1297693 0
[pid=19577/tid=19579] ppid=19575 vsize=5208756 CPUtime=1201.7 cores=1,3,5,7
/proc/19577/task/19579/stat : 19579 (SArTagnan) R 19575 19577 19389 0 -1 4202560 143269 0 0 0 120130 40 0 0 25 0 4 0 516265104 5333766144 1041932 33554432000 4194304 4623224 140735475355104 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=5208756 CPUtime=1195.16 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4202560 155520 0 0 0 119473 43 0 0 25 0 4 0 516265104 5333766144 1041932 33554432000 4194304 4623224 140735475355104 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=19577/tid=19581] ppid=19575 vsize=5208756 CPUtime=1201.73 cores=1,3,5,7
/proc/19577/task/19581/stat : 19581 (SArTagnan) R 19575 19577 19389 0 -1 4202560 2656714 0 0 0 119741 432 0 0 25 0 4 0 516265104 5333766144 1041932 33554432000 4194304 4623224 140735475355104 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.31
Current children cumulated vsize (KiB) 5208756

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.91 s]
/proc/loadavg: 8.13 8.10 8.04 9/184 19734
/proc/meminfo: memFree=13758392/32951124 swapFree=67111528/67111528
[pid=19577] ppid=19575 vsize=0 CPUtime=4800.43 cores=1,3,5,7
/proc/19577/stat : 19577 (SArTagnan) Z 19575 19577 19389 0 -1 4203548 4984130 0 0 0 479188 855 0 0 25 0 2 0 516265098 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/19577/statm: 0 0 0 0 0 0 0
[pid=19577/tid=19580] ppid=19575 vsize=0 CPUtime=1195.26 cores=1,3,5,7
/proc/19577/task/19580/stat : 19580 (SArTagnan) R 19575 19577 19389 0 -1 4203588 155520 0 0 0 119473 53 0 0 25 0 2 0 516265104 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.43
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.97
CPU time (s): 4800.5
CPU user time (s): 4791.88
CPU system time (s): 8.61569
CPU usage (%): 399.385
Max. virtual memory (cumulated for all children) (KiB): 6411944

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4791.88
system time used= 8.61569
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4984130
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5437
involuntary context switches= 33066

runsolver used 1.87371 second user time and 4.69029 second system time

The end

Launcher Data 

Begin job on node138 at 2011-04-29 05:11:11
IDJOB=3257384
IDBENCH=70910
IDSOLVER=1656
FILE ID=node138/3257384-1304046671
RUNJOBID= node138-1304045043-19408
PBS_JOBID= 13170394
Free space on /tmp= 71812 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT09/CRAFTED/edgematching/compact/em_11_3_4_cmp.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3257384-1304046671/watcher-3257384-1304046671 -o /tmp/evaluation-result-3257384-1304046671/solver-3257384-1304046671 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3257384-1304046671.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3b5e80540ef2fcb09cfe50ac7e3686c1
RANDOM SEED=740691229

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18494988 kB
Buffers:       2040104 kB
Cached:       11471036 kB
SwapCached:          0 kB
Active:        3521504 kB
Inactive:     10372008 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18494988 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            2356 kB
Writeback:           0 kB
AnonPages:      381288 kB
Mapped:          15468 kB
Slab:           499176 kB
PageTables:       5056 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   610340 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71764 MiB
End job on node138 at 2011-04-29 05:31:15