Trace number 3386391

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.31 1203.78

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
rpoc_xits_09_UNSAT.cnf
MD5SUMfeb620c17f2a4d7899a2e7883baa7391
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1430
Number of clauses87044
Sum of the clauses size258924
Maximum clause length10
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22369
Number of clauses of size 384652
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 523

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386391-1305577883/watcher-3386391-1305577883 -o /tmp/evaluation-result-3386391-1305577883/solver-3386391-1305577883 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386391-1305577883.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.05 8.08 8.17 7/376 5192
/proc/meminfo: memFree=26515396/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=22240 CPUtime=0 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 1239 0 0 0 0 0 0 0 25 0 1 0 669388728 22773760 858 33554432000 4194304 4625164 140735018063904 18446744073709551615 4361099 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/5192/statm: 5560 859 296 106 0 1063 0

[startup+0.0505751 s]
/proc/loadavg: 8.05 8.08 8.17 7/376 5192
/proc/meminfo: memFree=26515396/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=70392 CPUtime=0.04 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 7399 0 0 0 4 0 0 0 25 0 4 0 669388728 72081408 5201 33554432000 4194304 4625164 140735018063904 18446744073709551615 47507640301488 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 17598 5201 303 106 0 13101 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 70392

[startup+0.120339 s]
/proc/loadavg: 8.05 8.08 8.17 7/376 5192
/proc/meminfo: memFree=26515396/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=283084 CPUtime=0.31 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 10044 0 0 0 31 0 0 0 25 0 4 0 669388728 289878016 7133 33554432000 4194304 4625164 140735018063904 18446744073709551615 4518211 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 70771 7156 341 106 0 66274 0
Current children cumulated CPU time (s) 0.31
Current children cumulated vsize (KiB) 283084

[startup+0.300487 s]
/proc/loadavg: 8.05 8.08 8.17 7/376 5192
/proc/meminfo: memFree=26515396/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=279596 CPUtime=1.03 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 13967 0 0 0 102 1 0 0 25 0 4 0 669388728 286306304 7478 33554432000 4194304 4625164 140735018063904 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 69899 7478 341 106 0 65402 0
Current children cumulated CPU time (s) 1.03
Current children cumulated vsize (KiB) 279596

[startup+0.700413 s]
/proc/loadavg: 8.05 8.08 8.17 7/376 5192
/proc/meminfo: memFree=26515396/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=279596 CPUtime=2.63 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 21640 0 0 0 261 2 0 0 25 0 4 0 669388728 286306304 7958 33554432000 4194304 4625164 140735018063904 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 69899 7975 341 106 0 65402 0
Current children cumulated CPU time (s) 2.63
Current children cumulated vsize (KiB) 279596

[startup+1.50027 s]
/proc/loadavg: 8.05 8.08 8.17 9/380 5196
/proc/meminfo: memFree=26481148/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=281340 CPUtime=5.81 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 34691 0 0 0 577 4 0 0 25 0 4 0 669388728 288092160 9372 33554432000 4194304 4625164 140735018063904 18446744073709551615 4512463 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 70335 9372 341 106 0 65838 0
[pid=5192/tid=5194] ppid=5190 vsize=281340 CPUtime=1.44 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 1308 0 0 0 144 0 0 0 25 0 4 0 669388733 288092160 9372 33554432000 4194304 4625164 140735018063904 18446744073709551615 4340391 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=281340 CPUtime=1.42 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 3102 0 0 0 142 0 0 0 25 0 4 0 669388733 288092160 9372 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=281340 CPUtime=1.44 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 22068 0 0 0 141 3 0 0 25 0 4 0 669388733 288092160 9372 33554432000 4194304 4625164 140735018063904 18446744073709551615 4352017 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.81
Current children cumulated vsize (KiB) 281340

[startup+3.10097 s]
/proc/loadavg: 8.05 8.08 8.17 9/380 5196
/proc/meminfo: memFree=26473088/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=288684 CPUtime=12.2 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 61971 0 0 0 1212 8 0 0 25 0 4 0 669388728 295612416 11793 33554432000 4194304 4625164 140735018063904 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 72171 11793 343 106 0 67674 0
[pid=5192/tid=5194] ppid=5190 vsize=288684 CPUtime=3.04 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 2787 0 0 0 304 0 0 0 25 0 4 0 669388733 295612416 11793 33554432000 4194304 4625164 140735018063904 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=288684 CPUtime=3.01 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 5471 0 0 0 300 1 0 0 25 0 4 0 669388733 295612416 11793 33554432000 4194304 4625164 140735018063904 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=288684 CPUtime=3.04 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 45470 0 0 0 299 5 0 0 25 0 4 0 669388733 295612416 11793 33554432000 4194304 4625164 140735018063904 18446744073709551615 4335584 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.2
Current children cumulated vsize (KiB) 288684

[startup+6.30039 s]
/proc/loadavg: 8.05 8.08 8.17 9/380 5196
/proc/meminfo: memFree=26452312/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=295196 CPUtime=24.96 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 110526 0 0 0 2481 15 0 0 25 0 4 0 669388728 302280704 15728 33554432000 4194304 4625164 140735018063904 18446744073709551615 4512057 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 73799 15728 343 106 0 69302 0
[pid=5192/tid=5194] ppid=5190 vsize=295196 CPUtime=6.23 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 5542 0 0 0 623 0 0 0 25 0 4 0 669388733 302280704 15728 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351981 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=295196 CPUtime=6.17 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 6729 0 0 0 615 2 0 0 25 0 4 0 669388733 302280704 15536 33554432000 4194304 4625164 140735018063904 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=295196 CPUtime=6.24 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 89878 0 0 0 613 11 0 0 25 0 4 0 669388733 302280704 15381 33554432000 4194304 4625164 140735018063904 18446744073709551615 230809209191 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.96
Current children cumulated vsize (KiB) 295196

[startup+12.7002 s]
/proc/loadavg: 8.04 8.07 8.17 9/380 5196
/proc/meminfo: memFree=26421468/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=298432 CPUtime=50.48 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 189156 0 0 0 5022 26 0 0 25 0 4 0 669388728 305594368 21113 33554432000 4194304 4625164 140735018063904 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 74608 21113 347 106 0 70111 0
[pid=5192/tid=5194] ppid=5190 vsize=298432 CPUtime=12.63 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 9231 0 0 0 1262 1 0 0 25 0 4 0 669388733 305594368 21113 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=298432 CPUtime=12.5 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 9706 0 0 0 1247 3 0 0 25 0 4 0 669388733 305594368 21113 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=298432 CPUtime=12.64 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 160724 0 0 0 1244 20 0 0 25 0 4 0 669388733 305594368 21113 33554432000 4194304 4625164 140735018063904 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.48
Current children cumulated vsize (KiB) 298432

[startup+25.5009 s]
/proc/loadavg: 8.03 8.07 8.16 9/380 5197
/proc/meminfo: memFree=26367516/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=308624 CPUtime=101.53 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 358292 0 0 0 10100 53 0 0 25 0 4 0 669388728 316030976 31783 33554432000 4194304 4625164 140735018063904 18446744073709551615 4511973 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 77156 31783 347 106 0 72659 0
[pid=5192/tid=5194] ppid=5190 vsize=308624 CPUtime=25.44 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 15602 0 0 0 2541 3 0 0 25 0 4 0 669388733 316030976 31783 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=308624 CPUtime=25.14 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 16268 0 0 0 2510 4 0 0 25 0 4 0 669388733 316030976 31783 33554432000 4194304 4625164 140735018063904 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=308624 CPUtime=25.44 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 313594 0 0 0 2500 44 0 0 25 0 4 0 669388733 316030976 31783 33554432000 4194304 4625164 140735018063904 18446744073709551615 4334599 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.53
Current children cumulated vsize (KiB) 308624

[startup+51.1012 s]
/proc/loadavg: 8.02 8.06 8.16 9/380 5197
/proc/meminfo: memFree=26281560/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=340000 CPUtime=203.62 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 499246 0 0 0 20289 73 0 0 25 0 4 0 669388728 348160000 50251 33554432000 4194304 4625164 140735018063904 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 85000 50251 368 106 0 80503 0
[pid=5192/tid=5194] ppid=5190 vsize=340000 CPUtime=51.04 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 24334 0 0 0 5100 4 0 0 25 0 4 0 669388733 348160000 50251 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=340000 CPUtime=50.44 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 23602 0 0 0 5038 6 0 0 25 0 4 0 669388733 348160000 50251 33554432000 4194304 4625164 140735018063904 18446744073709551615 4352053 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=340000 CPUtime=51.04 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 434509 0 0 0 5044 60 0 0 25 0 4 0 669388733 348160000 50251 33554432000 4194304 4625164 140735018063904 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 203.62
Current children cumulated vsize (KiB) 340000

[startup+102.315 s]
/proc/loadavg: 8.05 8.06 8.15 9/380 5259
/proc/meminfo: memFree=27581432/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=415788 CPUtime=407.86 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 630507 0 0 0 40688 98 0 0 25 0 4 0 669388728 425766912 74017 33554432000 4194304 4625164 140735018063904 18446744073709551615 4339541 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 103947 74017 353 106 0 99450 0
[pid=5192/tid=5194] ppid=5190 vsize=415788 CPUtime=102.26 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 49341 0 0 0 10216 10 0 0 25 0 4 0 669388733 425766912 74017 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=415788 CPUtime=101.04 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 37235 0 0 0 10095 9 0 0 25 0 4 0 669388733 425766912 74017 33554432000 4194304 4625164 140735018063904 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=415788 CPUtime=102.25 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 521741 0 0 0 10150 75 0 0 25 0 4 0 669388733 425766912 74017 33554432000 4194304 4625164 140735018063904 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 407.86
Current children cumulated vsize (KiB) 415788

[startup+162.301 s]
/proc/loadavg: 8.09 8.08 8.15 9/380 5260
/proc/meminfo: memFree=27385180/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=593236 CPUtime=647.09 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 726224 0 0 0 64597 112 0 0 25 0 4 0 669388728 607473664 107352 33554432000 4194304 4625164 140735018063904 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 148309 107352 1274 106 0 143812 0
[pid=5192/tid=5194] ppid=5190 vsize=593236 CPUtime=162.24 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 52442 0 0 0 16213 11 0 0 25 0 4 0 669388733 607473664 107352 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=593236 CPUtime=160.33 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 51609 0 0 0 16022 11 0 0 25 0 4 0 669388733 607473664 107352 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=593236 CPUtime=162.23 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 575091 0 0 0 16140 83 0 0 25 0 4 0 669388733 607473664 107352 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 647.09
Current children cumulated vsize (KiB) 593236

[startup+222.301 s]
/proc/loadavg: 8.14 8.09 8.15 9/380 5262
/proc/meminfo: memFree=27178208/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=864960 CPUtime=886.36 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 986861 0 0 0 88487 149 0 0 25 0 4 0 669388728 885719040 148607 33554432000 4194304 4625164 140735018063904 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 216240 148607 1390 106 0 211743 0
[pid=5192/tid=5194] ppid=5190 vsize=864960 CPUtime=222.24 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 73819 0 0 0 22210 14 0 0 25 0 4 0 669388733 885719040 148607 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=864960 CPUtime=219.61 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 54054 0 0 0 21949 12 0 0 25 0 4 0 669388733 885719040 148607 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351942 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=864960 CPUtime=222.23 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 763716 0 0 0 22114 109 0 0 25 0 4 0 669388733 885719040 148607 33554432000 4194304 4625164 140735018063904 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 886.36
Current children cumulated vsize (KiB) 864960

[startup+282.301 s]

################
# More data... #
################

[pid=5192] ppid=5190 vsize=1243808 CPUtime=2800.6 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 3089244 0 0 0 279587 473 0 0 25 0 4 0 669388728 1273659392 250592 33554432000 4194304 4625164 140735018063904 18446744073709551615 4512125 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 310952 250592 375 106 0 306455 0
[pid=5192/tid=5194] ppid=5190 vsize=1243808 CPUtime=702.26 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 118927 0 0 0 70195 31 0 0 25 0 4 0 669388733 1273659392 250592 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=1243808 CPUtime=693.93 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 116083 0 0 0 69364 29 0 0 25 0 4 0 669388733 1273659392 250592 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=1243808 CPUtime=702.23 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 2591200 0 0 0 69852 371 0 0 25 0 4 0 669388733 1273659392 250592 33554432000 4194304 4625164 140735018063904 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2800.6
Current children cumulated vsize (KiB) 1243808

[startup+762.315 s]
/proc/loadavg: 8.10 8.11 8.11 9/380 5276
/proc/meminfo: memFree=26416588/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=1278940 CPUtime=3039.93 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 3116649 0 0 0 303513 480 0 0 25 0 4 0 669388728 1309634560 260509 33554432000 4194304 4625164 140735018063904 18446744073709551615 4512042 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 319735 260509 375 106 0 315238 0
[pid=5192/tid=5194] ppid=5190 vsize=1278940 CPUtime=762.26 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 123489 0 0 0 76193 33 0 0 25 0 4 0 669388733 1309634560 260509 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=1278940 CPUtime=753.22 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 116797 0 0 0 75293 29 0 0 25 0 4 0 669388733 1309634560 260509 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=1278940 CPUtime=762.24 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 2608439 0 0 0 75851 373 0 0 25 0 4 0 669388733 1309634560 260509 33554432000 4194304 4625164 140735018063904 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3039.93
Current children cumulated vsize (KiB) 1278940

[startup+822.301 s]
/proc/loadavg: 8.12 8.11 8.11 9/380 5278
/proc/meminfo: memFree=26325932/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=1352116 CPUtime=3279.15 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 3130524 0 0 0 327430 485 0 0 25 0 4 0 669388728 1384566784 271480 33554432000 4194304 4625164 140735018063904 18446744073709551615 4511967 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 338029 271480 375 106 0 333532 0
[pid=5192/tid=5194] ppid=5190 vsize=1352116 CPUtime=822.26 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 126036 0 0 0 82190 36 0 0 25 0 4 0 669388733 1384566784 271480 33554432000 4194304 4625164 140735018063904 18446744073709551615 4352760 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=1352116 CPUtime=812.51 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 117623 0 0 0 81221 30 0 0 25 0 4 0 669388733 1384566784 271480 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=1352116 CPUtime=822.22 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 2610929 0 0 0 81849 373 0 0 25 0 4 0 669388733 1384566784 271480 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3279.15
Current children cumulated vsize (KiB) 1352116

[startup+882.301 s]
/proc/loadavg: 8.13 8.12 8.11 9/380 5279
/proc/meminfo: memFree=26146968/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=1548616 CPUtime=3518.43 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 3619657 0 0 0 351289 554 0 0 25 0 4 0 669388728 1585782784 309742 33554432000 4194304 4625164 140735018063904 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 387154 309742 375 106 0 382657 0
[pid=5192/tid=5194] ppid=5190 vsize=1548616 CPUtime=882.26 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 133008 0 0 0 88189 37 0 0 25 0 4 0 669388733 1585782784 309742 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=1548616 CPUtime=871.78 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 118881 0 0 0 87148 30 0 0 25 0 4 0 669388733 1585782784 309742 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=1548616 CPUtime=882.22 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 3013855 0 0 0 87792 430 0 0 25 0 4 0 669388733 1585782784 309742 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3518.43
Current children cumulated vsize (KiB) 1548616

[startup+942.301 s]
/proc/loadavg: 8.17 8.14 8.11 9/380 5281
/proc/meminfo: memFree=26044388/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=1707080 CPUtime=3757.72 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 4099160 0 0 0 375150 622 0 0 25 0 4 0 669388728 1748049920 330033 33554432000 4194304 4625164 140735018063904 18446744073709551615 4512023 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 426770 330033 374 106 0 422273 0
[pid=5192/tid=5194] ppid=5190 vsize=1707080 CPUtime=942.26 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 174474 0 0 0 94184 42 0 0 25 0 4 0 669388733 1748049920 330033 33554432000 4194304 4625164 140735018063904 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=1707080 CPUtime=931.09 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 120768 0 0 0 93078 31 0 0 25 0 4 0 669388733 1748049920 330033 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=1707080 CPUtime=942.23 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 3416256 0 0 0 93734 489 0 0 25 0 4 0 669388733 1748049920 330033 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351996 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3757.72
Current children cumulated vsize (KiB) 1707080

[startup+1002.3 s]
/proc/loadavg: 8.06 8.11 8.10 9/380 5283
/proc/meminfo: memFree=25992028/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=1708424 CPUtime=3996.99 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 4479663 0 0 0 399025 674 0 0 25 0 4 0 669388728 1749426176 336707 33554432000 4194304 4625164 140735018063904 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 427106 336707 374 106 0 422609 0
[pid=5192/tid=5194] ppid=5190 vsize=1708424 CPUtime=1002.26 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 175153 0 0 0 100184 42 0 0 25 0 4 0 669388733 1749426176 336707 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=1708424 CPUtime=990.37 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 121932 0 0 0 99006 31 0 0 25 0 4 0 669388733 1749426176 336707 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=1708424 CPUtime=1002.23 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 3791993 0 0 0 99684 539 0 0 25 0 4 0 669388733 1749426176 336707 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3996.99
Current children cumulated vsize (KiB) 1708424

[startup+1062.3 s]
/proc/loadavg: 8.09 8.12 8.10 9/380 5284
/proc/meminfo: memFree=25928136/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=1784580 CPUtime=4236.28 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 4867566 0 0 0 422899 729 0 0 25 0 4 0 669388728 1827409920 347842 33554432000 4194304 4625164 140735018063904 18446744073709551615 4512066 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 446145 347842 388 106 0 441648 0
[pid=5192/tid=5194] ppid=5190 vsize=1784580 CPUtime=1062.27 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 176961 0 0 0 106182 45 0 0 25 0 4 0 669388733 1827409920 347842 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=1784580 CPUtime=1049.66 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 122809 0 0 0 104935 31 0 0 25 0 4 0 669388733 1827409920 347842 33554432000 4194304 4625164 140735018063904 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=1784580 CPUtime=1062.22 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 4172864 0 0 0 105632 590 0 0 25 0 4 0 669388733 1827409920 347842 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4236.28
Current children cumulated vsize (KiB) 1784580

[startup+1122.3 s]
/proc/loadavg: 8.22 8.14 8.10 9/380 5286
/proc/meminfo: memFree=25867960/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=1786428 CPUtime=4475.56 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 5252604 0 0 0 446775 781 0 0 25 0 4 0 669388728 1829302272 355674 33554432000 4194304 4625164 140735018063904 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 446607 355674 390 106 0 442110 0
[pid=5192/tid=5194] ppid=5190 vsize=1786428 CPUtime=1122.26 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 178251 0 0 0 112181 45 0 0 25 0 4 0 669388733 1829302272 355674 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=1786428 CPUtime=1108.95 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 123418 0 0 0 110863 32 0 0 25 0 4 0 669388733 1829302272 355674 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=1786428 CPUtime=1122.23 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 4552080 0 0 0 111582 641 0 0 25 0 4 0 669388733 1829302272 355674 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4475.56
Current children cumulated vsize (KiB) 1786428

[startup+1182.3 s]
/proc/loadavg: 8.27 8.16 8.11 9/380 5287
/proc/meminfo: memFree=25816844/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=1792632 CPUtime=4714.84 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 5450050 0 0 0 470674 810 0 0 25 0 4 0 669388728 1835655168 362234 33554432000 4194304 4625164 140735018063904 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 448158 362234 374 106 0 443661 0
[pid=5192/tid=5194] ppid=5190 vsize=1792632 CPUtime=1182.27 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 180339 0 0 0 118180 47 0 0 25 0 4 0 669388733 1835655168 362234 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=1792632 CPUtime=1168.24 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 123971 0 0 0 116792 32 0 0 25 0 4 0 669388733 1835655168 362234 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=1792632 CPUtime=1182.23 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 4742011 0 0 0 117556 667 0 0 25 0 4 0 669388733 1835655168 362234 33554432000 4194304 4625164 140735018063904 18446744073709551615 230808863047 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4714.84
Current children cumulated vsize (KiB) 1792632



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.7 s]
/proc/loadavg: 8.19 8.15 8.11 9/380 5288
/proc/meminfo: memFree=25789052/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=1794184 CPUtime=4800.21 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 5455085 0 0 0 479210 811 0 0 25 0 4 0 669388728 1837244416 366760 33554432000 4194304 4625164 140735018063904 18446744073709551615 4519319 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 448546 366760 374 106 0 444049 0
[pid=5192/tid=5194] ppid=5190 vsize=1794184 CPUtime=1203.68 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 182325 0 0 0 120321 47 0 0 25 0 4 0 669388733 1837244416 366761 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=1794184 CPUtime=1189.38 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 124326 0 0 0 118906 32 0 0 25 0 4 0 669388733 1837244416 366761 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=1794184 CPUtime=1203.64 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 4742025 0 0 0 119697 667 0 0 25 0 4 0 669388733 1837244416 366761 33554432000 4194304 4625164 140735018063904 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 1794184

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.7 s]
/proc/loadavg: 8.19 8.15 8.11 9/380 5288
/proc/meminfo: memFree=25789052/32951124 swapFree=37160408/67111528
[pid=5192] ppid=5190 vsize=1794184 CPUtime=4800.21 cores=0,2,4,6
/proc/5192/stat : 5192 (SArTagnan) R 5190 5192 5006 0 -1 4202496 5455085 0 0 0 479210 811 0 0 25 0 4 0 669388728 1837244416 366760 33554432000 4194304 4625164 140735018063904 18446744073709551615 4519319 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/5192/statm: 448546 366760 374 106 0 444049 0
[pid=5192/tid=5194] ppid=5190 vsize=1794184 CPUtime=1203.68 cores=0,2,4,6
/proc/5192/task/5194/stat : 5194 (SArTagnan) R 5190 5192 5006 0 -1 4202560 182325 0 0 0 120321 47 0 0 25 0 4 0 669388733 1837244416 366761 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5192/tid=5195] ppid=5190 vsize=1794184 CPUtime=1189.38 cores=0,2,4,6
/proc/5192/task/5195/stat : 5195 (SArTagnan) R 5190 5192 5006 0 -1 4202560 124326 0 0 0 118906 32 0 0 25 0 4 0 669388733 1837244416 366761 33554432000 4194304 4625164 140735018063904 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5192/tid=5196] ppid=5190 vsize=1794184 CPUtime=1203.64 cores=0,2,4,6
/proc/5192/task/5196/stat : 5196 (SArTagnan) R 5190 5192 5006 0 -1 4202560 4742025 0 0 0 119697 667 0 0 25 0 4 0 669388733 1837244416 366761 33554432000 4194304 4625164 140735018063904 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 1794184

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.78
CPU time (s): 4800.31
CPU user time (s): 4792.14
CPU system time (s): 8.17876
CPU usage (%): 398.77
Max. virtual memory (cumulated for all children) (KiB): 1800536

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4792.14
system time used= 8.17876
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5455086
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 658
involuntary context switches= 23035

runsolver used 4.05938 second user time and 10.2564 second system time

The end

Launcher Data 

Begin job on node104 at 2011-05-16 22:31:23
IDJOB=3386391
IDBENCH=71089
IDSOLVER=1871
FILE ID=node104/3386391-1305577883
RUNJOBID= node104-1305576965-5024
PBS_JOBID= 13350212
Free space on /tmp= 73260 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/rpoc_xits_09_UNSAT.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386391-1305577883/watcher-3386391-1305577883 -o /tmp/evaluation-result-3386391-1305577883/solver-3386391-1305577883 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386391-1305577883.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= feb620c17f2a4d7899a2e7883baa7391
RANDOM SEED=1490605727

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      26515552 kB
Buffers:        300004 kB
Cached:        2627000 kB
SwapCached:     152312 kB
Active:        2698548 kB
Inactive:      3453528 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      26515552 kB
SwapTotal:    67111528 kB
SwapFree:     37160408 kB
Dirty:            1600 kB
Writeback:           4 kB
AnonPages:     3085960 kB
Mapped:          11564 kB
Slab:           127544 kB
PageTables:      91832 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 89421940 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73268 MiB
End job on node104 at 2011-05-16 22:51:29