Trace number 3262356

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.3 1201.97

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-22_443.cnf
MD5SUM91ac0151536835225f21cbe5a3574a2d
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.435933
Satisfiable
(Un)Satisfiability was proved
Number of variables222
Number of clauses26201
Sum of the clauses size115467
Maximum clause length22
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2294
Number of clauses of size 323935
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51972

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3262356-1304094655/watcher-3262356-1304094655 -o /tmp/evaluation-result-3262356-1304094655/solver-3262356-1304094655 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3262356-1304094655.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.00 7.97 7.91 6/180 21437
/proc/meminfo: memFree=30625688/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=19784 CPUtime=0 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 673 0 0 0 0 0 0 0 25 0 1 0 599696068 20258816 572 33554432000 4194304 4623224 140737032330976 18446744073709551615 4388779 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/21437/statm: 4946 572 297 105 0 450 0

[startup+0.0178429 s]
/proc/loadavg: 8.00 7.97 7.91 6/180 21437
/proc/meminfo: memFree=30625688/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=23720 CPUtime=0.01 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 2105 0 0 0 1 0 0 0 25 0 1 0 599696068 24289280 1378 33554432000 4194304 4623224 140737032330976 18446744073709551615 260020093136 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/21437/statm: 5930 1400 299 105 0 1434 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 23720

[startup+0.681981 s]
/proc/loadavg: 8.00 7.97 7.91 6/180 21437
/proc/meminfo: memFree=30625688/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=196152 CPUtime=2.65 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 11097 0 0 0 264 1 0 0 25 0 4 0 599696068 200859648 4281 33554432000 4194304 4623224 140737032330976 18446744073709551615 4415167 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 49040 4280 337 105 0 44544 0
Current children cumulated CPU time (s) 2.65
Current children cumulated vsize (KiB) 196152

[startup+0.930633 s]
/proc/loadavg: 8.00 7.97 7.91 6/180 21437
/proc/meminfo: memFree=30625688/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=196956 CPUtime=3.65 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 14233 0 0 0 364 1 0 0 25 0 4 0 599696068 201682944 4918 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 49239 4918 337 105 0 44743 0
Current children cumulated CPU time (s) 3.65
Current children cumulated vsize (KiB) 196956

[startup+1.00062 s]
/proc/loadavg: 8.00 7.97 7.91 6/180 21437
/proc/meminfo: memFree=30625688/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=196956 CPUtime=3.93 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 15097 0 0 0 392 1 0 0 25 0 4 0 599696068 201682944 4994 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510217 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 49239 4994 337 105 0 44743 0
Current children cumulated CPU time (s) 3.93
Current children cumulated vsize (KiB) 196956

[startup+1.50053 s]
/proc/loadavg: 8.00 7.97 7.91 6/180 21437
/proc/meminfo: memFree=30625688/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=198616 CPUtime=5.93 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 19277 0 0 0 592 1 0 0 25 0 4 0 599696068 203382784 6065 33554432000 4194304 4623224 140737032330976 18446744073709551615 4384403 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 49654 6065 342 105 0 45158 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 198616

[startup+3.10024 s]
/proc/loadavg: 8.08 7.99 7.92 9/184 21441
/proc/meminfo: memFree=30590820/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=205172 CPUtime=12.32 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 31167 0 0 0 1229 3 0 0 25 0 4 0 599696068 210096128 8786 33554432000 4194304 4623224 140737032330976 18446744073709551615 4511545 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 51293 8786 342 105 0 46797 0
[pid=21437/tid=21439] ppid=21435 vsize=205172 CPUtime=3.07 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 2835 0 0 0 307 0 0 0 25 0 4 0 599696070 210096128 8786 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=205172 CPUtime=3.07 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 2483 0 0 0 307 0 0 0 25 0 4 0 599696070 210096128 8786 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=205172 CPUtime=3.06 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 22184 0 0 0 304 2 0 0 25 0 4 0 599696070 210096128 8786 33554432000 4194304 4623224 140737032330976 18446744073709551615 4276336 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.32
Current children cumulated vsize (KiB) 205172

[startup+6.30065 s]
/proc/loadavg: 8.07 7.99 7.92 9/184 21441
/proc/meminfo: memFree=30568248/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=216380 CPUtime=25.1 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 58425 0 0 0 2503 7 0 0 25 0 4 0 599696068 221573120 14367 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510020 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 54095 14367 342 105 0 49599 0
[pid=21437/tid=21439] ppid=21435 vsize=216380 CPUtime=6.27 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 6476 0 0 0 627 0 0 0 25 0 4 0 599696070 221573120 14367 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376920 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=216380 CPUtime=6.27 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 4386 0 0 0 627 0 0 0 25 0 4 0 599696070 221573120 14367 33554432000 4194304 4623224 140737032330976 18446744073709551615 4377144 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=216380 CPUtime=6.25 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 43313 0 0 0 619 6 0 0 25 0 4 0 599696070 221573120 14367 33554432000 4194304 4623224 140737032330976 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.1
Current children cumulated vsize (KiB) 216380

[startup+12.7005 s]
/proc/loadavg: 8.07 7.99 7.92 9/184 21442
/proc/meminfo: memFree=30519612/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=225712 CPUtime=50.69 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 101698 0 0 0 5053 16 0 0 25 0 4 0 599696068 231129088 21054 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510298 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 56428 21054 342 105 0 51932 0
[pid=21437/tid=21439] ppid=21435 vsize=225712 CPUtime=12.68 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 10002 0 0 0 1267 1 0 0 25 0 4 0 599696070 231129088 21054 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=225712 CPUtime=12.67 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 6663 0 0 0 1267 0 0 0 25 0 4 0 599696070 231129088 21054 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=225712 CPUtime=12.61 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 79656 0 0 0 1248 13 0 0 25 0 4 0 599696070 231129088 21054 33554432000 4194304 4623224 140737032330976 18446744073709551615 4545903 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.69
Current children cumulated vsize (KiB) 225712

[startup+25.5011 s]
/proc/loadavg: 8.06 7.99 7.92 9/184 21442
/proc/meminfo: memFree=30441228/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=244232 CPUtime=101.8 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 189418 0 0 0 10150 30 0 0 25 0 4 0 599696068 250093568 33029 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510472 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 61058 33029 356 105 0 56562 0
[pid=21437/tid=21439] ppid=21435 vsize=244232 CPUtime=25.47 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 15640 0 0 0 2545 2 0 0 25 0 4 0 599696070 250093568 33029 33554432000 4194304 4623224 140737032330976 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=244232 CPUtime=25.47 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 10812 0 0 0 2546 1 0 0 25 0 4 0 599696070 250093568 33029 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=244232 CPUtime=25.34 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 157122 0 0 0 2509 25 0 0 25 0 4 0 599696070 250093568 33029 33554432000 4194304 4623224 140737032330976 18446744073709551615 4550439 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.8
Current children cumulated vsize (KiB) 244232

[startup+51.1004 s]
/proc/loadavg: 8.11 8.00 7.93 9/184 21442
/proc/meminfo: memFree=30356636/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=335220 CPUtime=204.06 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 349129 0 0 0 20351 55 0 0 25 0 4 0 599696068 343265280 48273 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510475 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 83805 48273 370 105 0 79309 0
[pid=21437/tid=21439] ppid=21435 vsize=335220 CPUtime=51.07 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 23263 0 0 0 5104 3 0 0 25 0 4 0 599696070 343265280 48273 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=335220 CPUtime=51.08 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 15162 0 0 0 5106 2 0 0 25 0 4 0 599696070 343265280 48273 33554432000 4194304 4623224 140737032330976 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=335220 CPUtime=50.8 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 303670 0 0 0 5032 48 0 0 25 0 4 0 599696070 343265280 48273 33554432000 4194304 4623224 140737032330976 18446744073709551615 47011497955000 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 204.06
Current children cumulated vsize (KiB) 335220

[startup+102.301 s]
/proc/loadavg: 8.12 8.02 7.93 9/184 21444
/proc/meminfo: memFree=30223656/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=422396 CPUtime=408.58 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 515073 0 0 0 40775 83 0 0 25 0 4 0 599696068 432533504 71631 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510472 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 105599 71631 536 105 0 101103 0
[pid=21437/tid=21439] ppid=21435 vsize=422396 CPUtime=102.27 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 36070 0 0 0 10222 5 0 0 25 0 4 0 599696070 432533504 71631 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=422396 CPUtime=102.26 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 24497 0 0 0 10223 3 0 0 25 0 4 0 599696070 432533504 71631 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=422396 CPUtime=101.72 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 442433 0 0 0 10101 71 0 0 25 0 4 0 599696070 432533504 71631 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 408.58
Current children cumulated vsize (KiB) 422396

[startup+162.301 s]
/proc/loadavg: 8.11 8.03 7.94 9/184 21446
/proc/meminfo: memFree=30064000/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=530868 CPUtime=648.27 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 599638 0 0 0 64728 99 0 0 25 0 4 0 599696068 543608832 100051 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 132717 100051 1489 105 0 128221 0
[pid=21437/tid=21439] ppid=21435 vsize=530868 CPUtime=162.28 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 50748 0 0 0 16220 8 0 0 25 0 4 0 599696070 543608832 100051 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=530868 CPUtime=162.27 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 34532 0 0 0 16222 5 0 0 25 0 4 0 599696070 543608832 100051 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376823 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=530868 CPUtime=161.4 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 495262 0 0 0 16059 81 0 0 25 0 4 0 599696070 543608832 100051 33554432000 4194304 4623224 140737032330976 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 648.27
Current children cumulated vsize (KiB) 530868

[startup+222.301 s]
/proc/loadavg: 8.19 8.06 7.95 9/184 21447
/proc/meminfo: memFree=29935808/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=639984 CPUtime=887.92 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 793831 0 0 0 88665 127 0 0 25 0 4 0 599696068 655343616 121199 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 159996 121199 694 105 0 155500 0
[pid=21437/tid=21439] ppid=21435 vsize=639984 CPUtime=222.28 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 73297 0 0 0 22217 11 0 0 25 0 4 0 599696070 655343616 121199 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=639984 CPUtime=222.26 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 48950 0 0 0 22219 7 0 0 25 0 4 0 599696070 655343616 121199 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=639984 CPUtime=221.07 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 649360 0 0 0 22004 103 0 0 25 0 4 0 599696070 655343616 121199 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 887.92
Current children cumulated vsize (KiB) 639984

[startup+282.307 s]
/proc/loadavg: 8.18 8.08 7.96 9/184 21449
/proc/meminfo: memFree=29835780/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=686904 CPUtime=1127.62 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 811588 0 0 0 112631 131 0 0 25 0 4 0 599696068 703389696 138445 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 171726 138445 378 105 0 167230 0
[pid=21437/tid=21439] ppid=21435 vsize=686904 CPUtime=282.29 cores=0,2,4,6

################
# More data... #
################

[pid=21437] ppid=21435 vsize=1028676 CPUtime=2564.82 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 2544819 0 0 0 256081 401 0 0 25 0 4 0 599696068 1053364224 206791 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510127 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 257169 206791 379 105 0 252673 0
[pid=21437/tid=21439] ppid=21435 vsize=1028676 CPUtime=642.29 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 118942 0 0 0 64208 21 0 0 25 0 4 0 599696070 1053364224 206791 33554432000 4194304 4623224 140737032330976 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=1028676 CPUtime=642.28 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 77005 0 0 0 64216 12 0 0 25 0 4 0 599696070 1053364224 206791 33554432000 4194304 4623224 140737032330976 18446744073709551615 4366416 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=1028676 CPUtime=638.65 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 2250990 0 0 0 63517 348 0 0 25 0 4 0 599696070 1053364224 206791 33554432000 4194304 4623224 140737032330976 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2564.82
Current children cumulated vsize (KiB) 1028676

[startup+702.3 s]
/proc/loadavg: 8.11 8.14 8.02 9/184 21493
/proc/meminfo: memFree=29453876/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=1030744 CPUtime=2804.5 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 2848700 0 0 0 279999 451 0 0 25 0 4 0 599696068 1055481856 211976 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 257686 211976 342 105 0 253190 0
[pid=21437/tid=21439] ppid=21435 vsize=1030744 CPUtime=702.29 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 121030 0 0 0 70208 21 0 0 25 0 4 0 599696070 1055481856 211976 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=1030744 CPUtime=702.28 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 77953 0 0 0 70215 13 0 0 25 0 4 0 599696070 1055481856 211976 33554432000 4194304 4623224 140737032330976 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=1030744 CPUtime=698.33 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 2544488 0 0 0 69438 395 0 0 25 0 4 0 599696070 1055481856 211976 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2804.5
Current children cumulated vsize (KiB) 1030744

[startup+762.3 s]
/proc/loadavg: 8.07 8.12 8.02 9/184 21495
/proc/meminfo: memFree=29356460/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=1118944 CPUtime=3044.17 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 3203796 0 0 0 303913 504 0 0 25 0 4 0 599696068 1145798656 224892 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 279736 224892 359 105 0 275240 0
[pid=21437/tid=21439] ppid=21435 vsize=1118944 CPUtime=762.29 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 167853 0 0 0 76201 28 0 0 25 0 4 0 599696070 1145798656 224892 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=1118944 CPUtime=762.28 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 78482 0 0 0 76215 13 0 0 25 0 4 0 599696070 1145798656 224892 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=1118944 CPUtime=757.99 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 2838683 0 0 0 75361 438 0 0 25 0 4 0 599696070 1145798656 224892 33554432000 4194304 4623224 140737032330976 18446744073709551615 4545650 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3044.17
Current children cumulated vsize (KiB) 1118944

[startup+822.3 s]
/proc/loadavg: 8.02 8.10 8.01 9/184 21496
/proc/meminfo: memFree=29225408/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=1206224 CPUtime=3283.86 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 3626923 0 0 0 327818 568 0 0 25 0 4 0 599696068 1235173376 242510 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 301556 242510 342 105 0 297060 0
[pid=21437/tid=21439] ppid=21435 vsize=1206224 CPUtime=822.29 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 170001 0 0 0 82200 29 0 0 25 0 4 0 599696070 1235173376 242510 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=1206224 CPUtime=822.28 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 85807 0 0 0 82214 14 0 0 25 0 4 0 599696070 1235173376 242510 33554432000 4194304 4623224 140737032330976 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=1206224 CPUtime=817.67 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 3227216 0 0 0 81271 496 0 0 25 0 4 0 599696070 1235173376 242510 33554432000 4194304 4623224 140737032330976 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3283.86
Current children cumulated vsize (KiB) 1206224

[startup+882.3 s]
/proc/loadavg: 8.01 8.08 8.01 9/184 21498
/proc/meminfo: memFree=29142120/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=1258040 CPUtime=3523.51 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 3826339 0 0 0 351749 602 0 0 25 0 4 0 599696068 1288232960 252617 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510932 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 314510 252617 342 105 0 310014 0
[pid=21437/tid=21439] ppid=21435 vsize=1258040 CPUtime=882.29 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 176931 0 0 0 88199 30 0 0 25 0 4 0 599696070 1288232960 252617 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=1258040 CPUtime=882.29 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 87966 0 0 0 88213 16 0 0 25 0 4 0 599696070 1288232960 252617 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=1258040 CPUtime=877.34 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 3402849 0 0 0 87209 525 0 0 25 0 4 0 599696070 1288232960 252617 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3523.51
Current children cumulated vsize (KiB) 1258040

[startup+942.306 s]
/proc/loadavg: 8.00 8.06 8.00 9/184 21499
/proc/meminfo: memFree=29052140/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=1323576 CPUtime=3763.21 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 4002223 0 0 0 375692 629 0 0 25 0 4 0 599696068 1355341824 258658 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 330894 258658 358 105 0 326398 0
[pid=21437/tid=21439] ppid=21435 vsize=1323576 CPUtime=942.3 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 177363 0 0 0 94199 31 0 0 25 0 4 0 599696070 1355341824 258658 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=1323576 CPUtime=942.29 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 89195 0 0 0 94213 16 0 0 25 0 4 0 599696070 1355341824 258658 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=1323576 CPUtime=937.02 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 3572735 0 0 0 93152 550 0 0 25 0 4 0 599696070 1355341824 258658 33554432000 4194304 4623224 140737032330976 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3763.21
Current children cumulated vsize (KiB) 1323576

[startup+1002.3 s]
/proc/loadavg: 8.00 8.05 8.00 9/184 21501
/proc/meminfo: memFree=28984100/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=1401992 CPUtime=4002.87 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 4301235 0 0 0 399612 675 0 0 25 0 4 0 599696068 1435639808 266638 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 350498 266638 342 105 0 346002 0
[pid=21437/tid=21439] ppid=21435 vsize=1401992 CPUtime=1002.29 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 179784 0 0 0 100198 31 0 0 25 0 4 0 599696070 1435639808 266638 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=1401992 CPUtime=1002.29 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 118983 0 0 0 100208 21 0 0 25 0 4 0 599696070 1435639808 266638 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376646 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=1401992 CPUtime=996.7 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 3826818 0 0 0 99080 590 0 0 25 0 4 0 599696070 1435639808 266638 33554432000 4194304 4623224 140737032330976 18446744073709551615 4364923 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4002.87
Current children cumulated vsize (KiB) 1401992

[startup+1062.3 s]
/proc/loadavg: 8.11 8.07 8.01 9/184 21503
/proc/meminfo: memFree=28912092/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=1419464 CPUtime=4242.54 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 4647989 0 0 0 423530 724 0 0 25 0 4 0 599696068 1453531136 273967 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 354866 273967 342 105 0 350370 0
[pid=21437/tid=21439] ppid=21435 vsize=1419464 CPUtime=1062.3 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 180280 0 0 0 106199 31 0 0 25 0 4 0 599696070 1453531136 273967 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376662 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=1419464 CPUtime=1062.29 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 119772 0 0 0 106208 21 0 0 25 0 4 0 599696070 1453531136 273967 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=1419464 CPUtime=1056.37 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 4168352 0 0 0 104999 638 0 0 25 0 4 0 599696070 1453531136 273967 33554432000 4194304 4623224 140737032330976 18446744073709551615 4366443 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4242.54
Current children cumulated vsize (KiB) 1419464

[startup+1122.3 s]
/proc/loadavg: 8.15 8.08 8.01 9/184 21504
/proc/meminfo: memFree=28876560/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=1421736 CPUtime=4482.21 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 5188450 0 0 0 447415 806 0 0 25 0 4 0 599696068 1455857664 279328 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 355434 279328 396 105 0 350938 0
[pid=21437/tid=21439] ppid=21435 vsize=1421736 CPUtime=1122.31 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 180959 0 0 0 112199 32 0 0 25 0 4 0 599696070 1455857664 279328 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=1421736 CPUtime=1122.29 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 120147 0 0 0 112208 21 0 0 25 0 4 0 599696070 1455857664 279328 33554432000 4194304 4623224 140737032330976 18446744073709551615 4377071 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=1421736 CPUtime=1116.04 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 4704481 0 0 0 110886 718 0 0 25 0 4 0 599696070 1455857664 279328 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4482.21
Current children cumulated vsize (KiB) 1421736

[startup+1182.3 s]
/proc/loadavg: 8.15 8.10 8.02 9/184 21506
/proc/meminfo: memFree=28773072/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=1498764 CPUtime=4721.89 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 5624277 0 0 0 471316 873 0 0 25 0 4 0 599696068 1534734336 290394 33554432000 4194304 4623224 140737032330976 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 374691 290394 421 105 0 370195 0
[pid=21437/tid=21439] ppid=21435 vsize=1498764 CPUtime=1182.31 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 184372 0 0 0 118198 33 0 0 25 0 4 0 599696070 1534734336 290394 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=1498764 CPUtime=1182.29 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 120388 0 0 0 118208 21 0 0 25 0 4 0 599696070 1534734336 290394 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=1498764 CPUtime=1175.72 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 5121969 0 0 0 116790 782 0 0 25 0 4 0 599696070 1534734336 290394 33554432000 4194304 4623224 140737032330976 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4721.89
Current children cumulated vsize (KiB) 1498764



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.91 s]
/proc/loadavg: 8.18 8.10 8.02 10/184 21506
/proc/meminfo: memFree=28757796/32951124 swapFree=67111464/67111528
[pid=21437] ppid=21435 vsize=1498764 CPUtime=4800.22 cores=0,2,4,6
/proc/21437/stat : 21437 (SArTagnan) R 21435 21437 20765 0 -1 4202496 5800182 0 0 0 479123 899 0 0 25 0 4 0 599696068 1534734336 290123 33554432000 4194304 4623224 140737032330976 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21437/statm: 374691 290123 342 105 0 370195 0
[pid=21437/tid=21439] ppid=21435 vsize=1498764 CPUtime=1201.92 cores=0,2,4,6
/proc/21437/task/21439/stat : 21439 (SArTagnan) R 21435 21437 20765 0 -1 4202560 184714 0 0 0 120159 33 0 0 25 0 4 0 599696070 1534734336 290123 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=21437/tid=21440] ppid=21435 vsize=1498764 CPUtime=1201.91 cores=0,2,4,6
/proc/21437/task/21440/stat : 21440 (SArTagnan) R 21435 21437 20765 0 -1 4202560 120523 0 0 0 120170 21 0 0 25 0 4 0 599696070 1534734336 290123 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=21437/tid=21441] ppid=21435 vsize=1498764 CPUtime=1195.22 cores=0,2,4,6
/proc/21437/task/21441/stat : 21441 (SArTagnan) R 21435 21437 20765 0 -1 4202560 5285842 0 0 0 118717 805 0 0 25 0 4 0 599696070 1534734336 290123 33554432000 4194304 4623224 140737032330976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.22
Current children cumulated vsize (KiB) 1498764

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.97
CPU time (s): 4800.3
CPU user time (s): 4791.25
CPU system time (s): 9.05162
CPU usage (%): 399.368
Max. virtual memory (cumulated for all children) (KiB): 1498764

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4791.25
system time used= 9.05162
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5800834
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1014
involuntary context switches= 20257

runsolver used 1.9977 second user time and 4.56231 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-29 18:30:55
IDJOB=3262356
IDBENCH=83293
IDSOLVER=1656
FILE ID=node110/3262356-1304094655
RUNJOBID= node110-1304094529-21381
PBS_JOBID= 13170568
Free space on /tmp= 72840 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/VanDerWaerden_pd_2-3-22_443.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3262356-1304094655/watcher-3262356-1304094655 -o /tmp/evaluation-result-3262356-1304094655/solver-3262356-1304094655 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3262356-1304094655.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 91ac0151536835225f21cbe5a3574a2d
RANDOM SEED=904997871

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30625844 kB
Buffers:        901568 kB
Cached:         694812 kB
SwapCached:         64 kB
Active:         378700 kB
Inactive:      1540928 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30625844 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:             804 kB
Writeback:           0 kB
AnonPages:      322708 kB
Mapped:          15360 kB
Slab:           341664 kB
PageTables:       5052 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   528264 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72836 MiB
End job on node110 at 2011-04-29 18:50:59