Trace number 3282091

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.38 1201.88

General information on the benchmark

NameAPPLICATIONS/bitverif/countbitsrotate/
countbitsrotate032.cnf
MD5SUM8d76aa747359ea8ccf15726792949452
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables8527
Number of clauses25484
Sum of the clauses size59460
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 216988
Number of clauses of size 38494
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3282091-1304041646/watcher-3282091-1304041646 -o /tmp/evaluation-result-3282091-1304041646/solver-3282091-1304041646 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3282091-1304041646.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.91 5.00 6.15 5/180 29001
/proc/meminfo: memFree=19517000/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=20300 CPUtime=0 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 739 0 0 0 0 0 0 0 25 0 1 0 594395261 20787200 676 33554432000 4194304 4623224 140733337693760 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/29001/statm: 5075 676 297 105 0 579 0

[startup+0.062763 s]
/proc/loadavg: 5.91 5.00 6.15 5/180 29001
/proc/meminfo: memFree=19517000/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=187224 CPUtime=0.19 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 2376 0 0 0 19 0 0 0 25 0 4 0 594395261 191717376 2098 33554432000 4194304 4623224 140733337693760 18446744073709551615 4511524 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 46806 2098 341 105 0 42310 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 187224

[startup+0.162747 s]
/proc/loadavg: 5.91 5.00 6.15 5/180 29001
/proc/meminfo: memFree=19517000/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=201428 CPUtime=0.6 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 11305 0 0 0 59 1 0 0 25 0 4 0 594395261 206262272 7002 33554432000 4194304 4623224 140733337693760 18446744073709551615 47769472278490 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 50357 7003 342 105 0 45861 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 201428

[startup+0.300723 s]
/proc/loadavg: 5.91 5.00 6.15 5/180 29001
/proc/meminfo: memFree=19517000/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=264644 CPUtime=1.14 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 13912 0 0 0 113 1 0 0 25 0 4 0 594395261 270995456 8438 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 66161 8438 344 105 0 61665 0
Current children cumulated CPU time (s) 1.14
Current children cumulated vsize (KiB) 264644

[startup+0.70065 s]
/proc/loadavg: 5.91 5.00 6.15 5/180 29001
/proc/meminfo: memFree=19517000/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=267240 CPUtime=2.75 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 14937 0 0 0 273 2 0 0 25 0 4 0 594395261 273653760 8886 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510285 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 66810 8886 344 105 0 62314 0
Current children cumulated CPU time (s) 2.75
Current children cumulated vsize (KiB) 267240

[startup+1.5005 s]
/proc/loadavg: 5.91 5.00 6.15 9/184 29005
/proc/meminfo: memFree=19478536/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=267528 CPUtime=5.94 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 19908 0 0 0 592 2 0 0 25 0 4 0 594395261 273948672 9606 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 66882 9606 344 105 0 62386 0
[pid=29001/tid=29003] ppid=28999 vsize=267528 CPUtime=1.47 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 1625 0 0 0 147 0 0 0 25 0 4 0 594395262 273948672 9606 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=267528 CPUtime=1.48 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 1756 0 0 0 148 0 0 0 25 0 4 0 594395262 273948672 9606 33554432000 4194304 4623224 140733337693760 18446744073709551615 4462966 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=267528 CPUtime=1.47 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 6769 0 0 0 147 0 0 0 25 0 4 0 594395262 273948672 9606 33554432000 4194304 4623224 140733337693760 18446744073709551615 4565106 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 267528

[startup+3.1012 s]
/proc/loadavg: 6.08 5.05 6.16 9/184 29005
/proc/meminfo: memFree=19472956/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=272176 CPUtime=12.33 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 31483 0 0 0 1229 4 0 0 25 0 4 0 594395261 278708224 11250 33554432000 4194304 4623224 140733337693760 18446744073709551615 4511032 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 68044 11250 345 105 0 63548 0
[pid=29001/tid=29003] ppid=28999 vsize=272176 CPUtime=3.06 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 2228 0 0 0 306 0 0 0 25 0 4 0 594395262 278708224 11250 33554432000 4194304 4623224 140733337693760 18446744073709551615 4465904 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=272176 CPUtime=3.08 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 1789 0 0 0 308 0 0 0 25 0 4 0 594395262 278708224 11250 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=272176 CPUtime=3.08 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 17679 0 0 0 305 3 0 0 25 0 4 0 594395262 278708224 11250 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376895 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 272176

[startup+6.3006 s]
/proc/loadavg: 6.08 5.05 6.16 9/184 29005
/proc/meminfo: memFree=19453608/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=275668 CPUtime=25.11 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 52966 0 0 0 2503 8 0 0 25 0 4 0 594395261 282284032 13443 33554432000 4194304 4623224 140733337693760 18446744073709551615 4511014 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 68917 13443 345 105 0 64421 0
[pid=29001/tid=29003] ppid=28999 vsize=275668 CPUtime=6.24 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 2254 0 0 0 624 0 0 0 25 0 4 0 594395262 282284032 13443 33554432000 4194304 4623224 140733337693760 18446744073709551615 4377166 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=275668 CPUtime=6.28 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 2526 0 0 0 628 0 0 0 25 0 4 0 594395262 282284032 13443 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=275668 CPUtime=6.27 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 38330 0 0 0 621 6 0 0 25 0 4 0 594395262 282284032 13443 33554432000 4194304 4623224 140733337693760 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 275668

[startup+12.7004 s]
/proc/loadavg: 6.23 5.10 6.17 10/184 29006
/proc/meminfo: memFree=19421876/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=279196 CPUtime=50.68 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 102439 0 0 0 5051 17 0 0 25 0 4 0 594395261 285896704 16601 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510475 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 69799 16601 345 105 0 65303 0
[pid=29001/tid=29003] ppid=28999 vsize=279196 CPUtime=12.61 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 2308 0 0 0 1261 0 0 0 25 0 4 0 594395262 285896704 16601 33554432000 4194304 4623224 140733337693760 18446744073709551615 4289917 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=279196 CPUtime=12.68 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 2635 0 0 0 1268 0 0 0 25 0 4 0 594395262 285896704 16601 33554432000 4194304 4623224 140733337693760 18446744073709551615 4289685 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=279196 CPUtime=12.68 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 86632 0 0 0 1252 16 0 0 25 0 4 0 594395262 285896704 16601 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.68
Current children cumulated vsize (KiB) 279196

[startup+25.501 s]
/proc/loadavg: 6.62 5.24 6.20 9/184 29006
/proc/meminfo: memFree=19379240/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=288388 CPUtime=101.81 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 206638 0 0 0 10146 35 0 0 25 0 4 0 594395261 295309312 22779 33554432000 4194304 4623224 140733337693760 18446744073709551615 4422597 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 72097 22779 344 105 0 67601 0
[pid=29001/tid=29003] ppid=28999 vsize=288388 CPUtime=25.34 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 2415 0 0 0 2534 0 0 0 25 0 4 0 594395262 295309312 22779 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376692 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=288388 CPUtime=25.47 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 5681 0 0 0 2547 0 0 0 25 0 4 0 594395262 295309312 22779 33554432000 4194304 4623224 140733337693760 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=288388 CPUtime=25.48 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 187515 0 0 0 2515 33 0 0 25 0 4 0 594395262 295309312 22779 33554432000 4194304 4623224 140733337693760 18446744073709551615 4366866 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.81
Current children cumulated vsize (KiB) 288388

[startup+51.1002 s]
/proc/loadavg: 7.09 5.46 6.25 10/184 29007
/proc/meminfo: memFree=19300244/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=358912 CPUtime=204.08 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 399101 0 0 0 20339 69 0 0 25 0 4 0 594395261 367525888 34095 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 89728 34095 345 105 0 85232 0
[pid=29001/tid=29003] ppid=28999 vsize=358912 CPUtime=50.79 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 4249 0 0 0 5079 0 0 0 25 0 4 0 594395262 367525888 34095 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=358912 CPUtime=51.07 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 8914 0 0 0 5106 1 0 0 25 0 4 0 594395262 367525888 34096 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=358912 CPUtime=51.08 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 373683 0 0 0 5043 65 0 0 25 0 4 0 594395262 367525888 34096 33554432000 4194304 4623224 140733337693760 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 204.08
Current children cumulated vsize (KiB) 358912

[startup+102.307 s]
/proc/loadavg: 7.64 5.89 6.34 9/184 29008
/proc/meminfo: memFree=19135440/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=411132 CPUtime=408.62 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 519857 0 0 0 40769 93 0 0 25 0 4 0 594395261 420999168 56086 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510150 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 102783 56086 426 105 0 98287 0
[pid=29001/tid=29003] ppid=28999 vsize=411132 CPUtime=101.72 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 6972 0 0 0 10171 1 0 0 25 0 4 0 594395262 420999168 56086 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376692 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=411132 CPUtime=102.29 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 20609 0 0 0 10225 4 0 0 25 0 4 0 594395262 420999168 56086 33554432000 4194304 4623224 140733337693760 18446744073709551615 4464136 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=411132 CPUtime=102.29 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 478118 0 0 0 10143 86 0 0 25 0 4 0 594395262 420999168 56086 33554432000 4194304 4623224 140733337693760 18446744073709551615 4377071 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 408.62
Current children cumulated vsize (KiB) 411132

[startup+162.3 s]
/proc/loadavg: 7.89 6.25 6.44 9/184 29010
/proc/meminfo: memFree=18975580/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=449516 CPUtime=648.28 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 675175 0 0 0 64706 122 0 0 25 0 4 0 594395261 460304384 78658 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 112379 78658 446 105 0 107883 0
[pid=29001/tid=29003] ppid=28999 vsize=449516 CPUtime=161.39 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 10287 0 0 0 16137 2 0 0 25 0 4 0 594395262 460304384 78658 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376662 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=449516 CPUtime=162.28 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 22789 0 0 0 16223 5 0 0 25 0 4 0 594395262 460304384 78658 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=449516 CPUtime=162.28 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 624150 0 0 0 16117 111 0 0 25 0 4 0 594395262 460304384 78658 33554432000 4194304 4623224 140733337693760 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 648.28
Current children cumulated vsize (KiB) 449516

[startup+222.301 s]
/proc/loadavg: 8.11 6.64 6.56 10/184 29011
/proc/meminfo: memFree=18817960/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=577376 CPUtime=887.96 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 984961 0 0 0 88618 178 0 0 25 0 4 0 594395261 591233024 100068 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 144344 100068 428 105 0 139848 0
[pid=29001/tid=29003] ppid=28999 vsize=577376 CPUtime=221.06 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 11168 0 0 0 22104 2 0 0 25 0 4 0 594395262 591233024 100068 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=577376 CPUtime=222.28 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 30867 0 0 0 22222 6 0 0 25 0 4 0 594395262 591233024 100068 33554432000 4194304 4623224 140733337693760 18446744073709551615 4289678 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=577376 CPUtime=222.28 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 915543 0 0 0 22064 164 0 0 25 0 4 0 594395262 591233024 100068 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 887.96
Current children cumulated vsize (KiB) 577376

[startup+282.301 s]

################
# More data... #
################

[pid=29001] ppid=28999 vsize=1201004 CPUtime=2565.73 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 2457093 0 0 0 256137 436 0 0 25 0 4 0 594395261 1229828096 227100 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510093 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 300251 227100 346 105 0 295755 0
[pid=29001/tid=29003] ppid=28999 vsize=1201004 CPUtime=638.78 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 33952 0 0 0 63869 9 0 0 25 0 4 0 594395262 1229828096 227100 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=1201004 CPUtime=642.3 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 70976 0 0 0 64217 13 0 0 25 0 4 0 594395262 1229828096 227100 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=1201004 CPUtime=642.3 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 2263955 0 0 0 63833 397 0 0 25 0 4 0 594395262 1229828096 227100 33554432000 4194304 4623224 140733337693760 18446744073709551615 231895181400 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2565.73
Current children cumulated vsize (KiB) 1201004

[startup+702.3 s]
/proc/loadavg: 8.19 7.85 7.18 10/184 29024
/proc/meminfo: memFree=17780996/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=1245712 CPUtime=2805.38 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 2472708 0 0 0 280099 439 0 0 25 0 4 0 594395261 1275609088 242469 33554432000 4194304 4623224 140733337693760 18446744073709551615 4517479 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 311428 242469 344 105 0 306932 0
[pid=29001/tid=29003] ppid=28999 vsize=1245712 CPUtime=698.45 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 35160 0 0 0 69835 10 0 0 25 0 4 0 594395262 1275609088 242469 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=1245712 CPUtime=702.3 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 71690 0 0 0 70217 13 0 0 25 0 4 0 594395262 1275609088 242469 33554432000 4194304 4623224 140733337693760 18446744073709551615 4377707 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=1245712 CPUtime=702.29 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 2275304 0 0 0 69830 399 0 0 25 0 4 0 594395262 1275609088 242469 33554432000 4194304 4623224 140733337693760 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2805.38
Current children cumulated vsize (KiB) 1245712

[startup+762.307 s]
/proc/loadavg: 8.16 7.90 7.25 9/184 29026
/proc/meminfo: memFree=17659324/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=1261416 CPUtime=3045.09 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 2761821 0 0 0 304020 489 0 0 25 0 4 0 594395261 1291689984 261011 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510066 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 315354 261011 353 105 0 310858 0
[pid=29001/tid=29003] ppid=28999 vsize=1261416 CPUtime=758.12 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 37122 0 0 0 75802 10 0 0 25 0 4 0 594395262 1291689984 261011 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=1261416 CPUtime=762.31 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 75388 0 0 0 76217 14 0 0 25 0 4 0 594395262 1291689984 261011 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=1261416 CPUtime=762.3 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 2556255 0 0 0 75783 447 0 0 25 0 4 0 594395262 1291689984 261011 33554432000 4194304 4623224 140733337693760 18446744073709551615 4549745 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3045.09
Current children cumulated vsize (KiB) 1261416

[startup+822.301 s]
/proc/loadavg: 8.16 7.95 7.30 9/184 29036
/proc/meminfo: memFree=17525020/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=1378388 CPUtime=3284.74 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 3008829 0 0 0 327945 529 0 0 25 0 4 0 594395261 1411469312 280876 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 344597 280876 420 105 0 340101 0
[pid=29001/tid=29003] ppid=28999 vsize=1378388 CPUtime=817.8 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 38209 0 0 0 81769 11 0 0 25 0 4 0 594395262 1411469312 280876 33554432000 4194304 4623224 140733337693760 18446744073709551615 4289853 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=1378388 CPUtime=822.3 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 75990 0 0 0 82216 14 0 0 25 0 4 0 594395262 1411469312 280876 33554432000 4194304 4623224 140733337693760 18446744073709551615 4289723 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=1378388 CPUtime=822.29 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 2799975 0 0 0 81743 486 0 0 25 0 4 0 594395262 1411469312 280876 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3284.74
Current children cumulated vsize (KiB) 1378388

[startup+882.301 s]
/proc/loadavg: 8.32 8.02 7.36 11/189 29356
/proc/meminfo: memFree=17391392/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=1453940 CPUtime=3524.04 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 3410648 0 0 0 351805 599 0 0 25 0 4 0 594395261 1488834560 301569 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 363485 301569 417 105 0 358989 0
[pid=29001/tid=29003] ppid=28999 vsize=1453940 CPUtime=877.45 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 51728 0 0 0 87733 12 0 0 25 0 4 0 594395262 1488834560 301569 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=1453940 CPUtime=882.19 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 107118 0 0 0 88201 18 0 0 25 0 4 0 594395262 1488834560 301569 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=1453940 CPUtime=882.06 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 3155768 0 0 0 87656 550 0 0 25 0 4 0 594395262 1488834560 301569 33554432000 4194304 4623224 140733337693760 18446744073709551615 4364657 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3524.04
Current children cumulated vsize (KiB) 1453940

[startup+942.3 s]
/proc/loadavg: 8.73 8.18 7.45 10/189 29453
/proc/meminfo: memFree=17298828/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=1519476 CPUtime=3763.66 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 3762131 0 0 0 375707 659 0 0 25 0 4 0 594395261 1555943424 314654 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 379869 314654 420 105 0 375373 0
[pid=29001/tid=29003] ppid=28999 vsize=1519476 CPUtime=937.13 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 52025 0 0 0 93701 12 0 0 25 0 4 0 594395262 1555943424 314654 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=1519476 CPUtime=942.15 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 108159 0 0 0 94196 19 0 0 25 0 4 0 594395262 1555943424 314654 33554432000 4194304 4623224 140733337693760 18446744073709551615 4462984 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=1519476 CPUtime=942.05 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 3504726 0 0 0 93596 609 0 0 25 0 4 0 594395262 1555943424 314654 33554432000 4194304 4623224 140733337693760 18446744073709551615 4546872 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3763.66
Current children cumulated vsize (KiB) 1519476

[startup+1002.3 s]
/proc/loadavg: 8.91 8.34 7.56 11/189 29455
/proc/meminfo: memFree=17197752/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=1630732 CPUtime=4003.34 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 4142131 0 0 0 399613 721 0 0 25 0 4 0 594395261 1669869568 327876 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 407683 327876 423 105 0 403187 0
[pid=29001/tid=29003] ppid=28999 vsize=1630732 CPUtime=996.8 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 52366 0 0 0 99668 12 0 0 25 0 4 0 594395262 1669869568 327876 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=1630732 CPUtime=1002.15 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 108584 0 0 0 100196 19 0 0 25 0 4 0 594395262 1669869568 327876 33554432000 4194304 4623224 140733337693760 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=1630732 CPUtime=1002.05 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 3859289 0 0 0 99537 668 0 0 25 0 4 0 594395262 1669869568 327876 33554432000 4194304 4623224 140733337693760 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4003.34
Current children cumulated vsize (KiB) 1630732

[startup+1062.3 s]
/proc/loadavg: 8.36 8.28 7.58 10/184 29509
/proc/meminfo: memFree=17106804/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=1633372 CPUtime=4243.01 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 4477453 0 0 0 423524 777 0 0 25 0 4 0 594395261 1672572928 339191 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510026 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 408343 339193 422 105 0 403847 0
[pid=29001/tid=29003] ppid=28999 vsize=1633372 CPUtime=1056.48 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 52469 0 0 0 105636 12 0 0 25 0 4 0 594395262 1672572928 339193 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=1633372 CPUtime=1062.14 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 109361 0 0 0 106195 19 0 0 25 0 4 0 594395262 1672572928 339196 33554432000 4194304 4623224 140733337693760 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=1633372 CPUtime=1062.05 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 4192611 0 0 0 105481 724 0 0 25 0 4 0 594395262 1672572928 339196 33554432000 4194304 4623224 140733337693760 18446744073709551615 4577678 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4243.01
Current children cumulated vsize (KiB) 1633372

[startup+1122.3 s]
/proc/loadavg: 8.12 8.22 7.60 9/184 29510
/proc/meminfo: memFree=17002632/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=1727208 CPUtime=4482.69 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 4834140 0 0 0 447429 840 0 0 25 0 4 0 594395261 1768660992 355494 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 431802 355494 419 105 0 427306 0
[pid=29001/tid=29003] ppid=28999 vsize=1727208 CPUtime=1116.15 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 52758 0 0 0 111603 12 0 0 25 0 4 0 594395262 1768660992 355494 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=1727208 CPUtime=1122.15 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 110396 0 0 0 112195 20 0 0 25 0 4 0 594395262 1768660992 355494 33554432000 4194304 4623224 140733337693760 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=1727208 CPUtime=1122.04 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 4535295 0 0 0 111421 783 0 0 25 0 4 0 594395262 1768660992 355494 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4482.69
Current children cumulated vsize (KiB) 1727208

[startup+1182.3 s]
/proc/loadavg: 8.08 8.20 7.63 9/184 29543
/proc/meminfo: memFree=18931468/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=1727208 CPUtime=4722.37 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 5178173 0 0 0 471339 898 0 0 25 0 4 0 594395261 1768660992 367942 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 431802 367942 422 105 0 427306 0
[pid=29001/tid=29003] ppid=28999 vsize=1727208 CPUtime=1175.83 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 53066 0 0 0 117570 13 0 0 25 0 4 0 594395262 1768660992 367942 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376643 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=1727208 CPUtime=1182.15 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 110496 0 0 0 118195 20 0 0 25 0 4 0 594395262 1768660992 367942 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=1727208 CPUtime=1182.05 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 4877185 0 0 0 117364 841 0 0 25 0 4 0 594395262 1768660992 367942 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4722.37
Current children cumulated vsize (KiB) 1727208



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 8.21 8.22 7.65 9/184 29543
/proc/meminfo: memFree=18104860/32950928 swapFree=67111524/67111528
[pid=29001] ppid=28999 vsize=1740072 CPUtime=4800.28 cores=1,3,5,7
/proc/29001/stat : 29001 (SArTagnan) R 28999 29001 28251 0 -1 4202496 5217107 0 0 0 479122 906 0 0 25 0 4 0 594395261 1781833728 372902 33554432000 4194304 4623224 140733337693760 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29001/statm: 435018 372902 419 105 0 430522 0
[pid=29001/tid=29003] ppid=28999 vsize=1740072 CPUtime=1195.22 cores=1,3,5,7
/proc/29001/task/29003/stat : 29003 (SArTagnan) R 28999 29001 28251 0 -1 4202560 53100 0 0 0 119509 13 0 0 25 0 4 0 594395262 1781833728 372902 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29001/tid=29004] ppid=28999 vsize=1740072 CPUtime=1201.66 cores=1,3,5,7
/proc/29001/task/29004/stat : 29004 (SArTagnan) R 28999 29001 28251 0 -1 4202560 110522 0 0 0 120146 20 0 0 25 0 4 0 594395262 1781833728 372902 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29001/tid=29005] ppid=28999 vsize=1740072 CPUtime=1201.55 cores=1,3,5,7
/proc/29001/task/29005/stat : 29005 (SArTagnan) R 28999 29001 28251 0 -1 4202560 4914920 0 0 0 119307 848 0 0 25 0 4 0 594395262 1781833728 372902 33554432000 4194304 4623224 140733337693760 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.28
Current children cumulated vsize (KiB) 1740072

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.88
CPU time (s): 4800.38
CPU user time (s): 4791.25
CPU system time (s): 9.12661
CPU usage (%): 399.406
Max. virtual memory (cumulated for all children) (KiB): 1794348

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4791.25
system time used= 9.12661
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5217107
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 145
involuntary context switches= 32089

runsolver used 1.78973 second user time and 4.77427 second system time

The end

Launcher Data 

Begin job on node114 at 2011-04-29 03:47:26
IDJOB=3282091
IDBENCH=70775
IDSOLVER=1656
FILE ID=node114/3282091-1304041646
RUNJOBID= node114-1304041602-28948
PBS_JOBID= 13170369
Free space on /tmp= 71788 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT09/APPLICATIONS/bitverif/countbitsrotate/countbitsrotate032.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3282091-1304041646/watcher-3282091-1304041646 -o /tmp/evaluation-result-3282091-1304041646/solver-3282091-1304041646 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3282091-1304041646.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8d76aa747359ea8ccf15726792949452
RANDOM SEED=125718687

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      19517032 kB
Buffers:       2249888 kB
Cached:        9551040 kB
SwapCached:          4 kB
Active:        4358328 kB
Inactive:      8495108 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      19517032 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            5856 kB
Writeback:           0 kB
AnonPages:     1051392 kB
Mapped:          15384 kB
Slab:           515448 kB
PageTables:       6572 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  1577688 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71800 MiB
End job on node114 at 2011-04-29 04:07:30