Trace number 3299843

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.43 1202.38

General information on the benchmark

Nameindustrial/IBM_FV_2002_13_rule_1/
SAT_dat.k100.cnf
MD5SUMcf1b8194ff6d413d396ac9e26bb031ef
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark202.908
Satisfiable
(Un)Satisfiability was proved
Number of variables50797
Number of clauses177980
Sum of the clauses size470252
Maximum clause length37
Minimum clause length1
Number of clauses of size 11318
Number of clauses of size 295086
Number of clauses of size 374860
Number of clauses of size 4486
Number of clauses of size 5945
Number of clauses of size over 55285

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...039986/instance-3299843-1304039986.cnf
0.29/0.37	c Solving...
4800.24/1202.21	
4800.24/1202.21	*** INTERRUPTED! ***
4800.24/1202.21	*** Shutting down threads...
4800.36/1202.37	s UNKNOWN
4800.36/1202.37	
4800.36/1202.37	c INTERRUPTED   : 1
4800.36/1202.37	c Models        : 0+    
4800.36/1202.37	c Time          : 1202.215s (Solving: 1201.85s 1st Model: 0.00s Unsat: 0.00s)
4800.36/1202.37	c CPU Time      : 4800.260s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299843-1304039986/watcher-3299843-1304039986 -o /tmp/evaluation-result-3299843-1304039986/solver-3299843-1304039986 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299843-1304039986.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.71 4.86 6.45 3/174 26805
/proc/meminfo: memFree=19760228/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=20876 CPUtime=0 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 507 0 0 0 0 0 0 0 22 0 1 0 594229266 21377024 436 33554432000 4194304 4964704 140734239495184 18446744073709551615 251367546624 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/26805/statm: 5219 436 372 189 0 93 0

[startup+0.0843961 s]
/proc/loadavg: 3.71 4.86 6.45 3/174 26805
/proc/meminfo: memFree=19760228/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=43372 CPUtime=0.07 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 7652 0 0 0 7 0 0 0 22 0 1 0 594229266 44412928 5944 33554432000 4194304 4964704 140734239495184 18446744073709551615 4625031 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/26805/statm: 10843 5944 399 189 0 5717 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 43372

[startup+0.100374 s]
/proc/loadavg: 3.71 4.86 6.45 3/174 26805
/proc/meminfo: memFree=19760228/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=45624 CPUtime=0.09 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 8168 0 0 0 9 0 0 0 22 0 1 0 594229266 46718976 6460 33554432000 4194304 4964704 140734239495184 18446744073709551615 4618467 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/26805/statm: 11406 6460 399 189 0 6280 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 45624

[startup+0.300337 s]
/proc/loadavg: 3.71 4.86 6.45 3/174 26805
/proc/meminfo: memFree=19760228/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=51088 CPUtime=0.29 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 9532 0 0 0 28 1 0 0 23 0 1 0 594229266 52314112 7824 33554432000 4194304 4964704 140734239495184 18446744073709551615 4621747 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/26805/statm: 12772 7825 403 189 0 7646 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 51088

[startup+0.700215 s]
/proc/loadavg: 3.71 4.86 6.45 3/174 26805
/proc/meminfo: memFree=19760228/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=270760 CPUtime=1.61 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 18015 0 0 0 156 5 0 0 25 0 4 0 594229266 277258240 14268 33554432000 4194304 4964704 140734239495184 18446744073709551615 4370264 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 67690 14268 458 189 0 62039 0
Current children cumulated CPU time (s) 1.61
Current children cumulated vsize (KiB) 270760

[startup+1.50106 s]
/proc/loadavg: 3.71 4.86 6.45 6/181 26815
/proc/meminfo: memFree=19601696/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=270760 CPUtime=4.8 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 19084 0 0 0 469 11 0 0 25 0 4 0 594229266 277258240 15337 33554432000 4194304 4964704 140734239495184 18446744073709551615 4668931 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 67690 15337 458 189 0 62039 0
[pid=26805/tid=26807] ppid=26803 vsize=270760 CPUtime=1.11 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 2318 0 0 0 108 3 0 0 19 0 4 0 594229303 277258240 15337 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=270760 CPUtime=1.09 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 3405 0 0 0 106 3 0 0 19 0 4 0 594229303 277258240 15337 33554432000 4194304 4964704 140734239495184 18446744073709551615 4320879 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=270760 CPUtime=1.11 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 2883 0 0 0 108 3 0 0 19 0 4 0 594229303 277258240 15337 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4.8
Current children cumulated vsize (KiB) 270760

[startup+3.1007 s]
/proc/loadavg: 3.71 4.86 6.45 6/181 26815
/proc/meminfo: memFree=19574540/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=271980 CPUtime=11.19 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 21478 0 0 0 1099 20 0 0 25 0 4 0 594229266 278507520 17731 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670100 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 67995 17731 458 189 0 62344 0
[pid=26805/tid=26807] ppid=26803 vsize=271980 CPUtime=2.7 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 2943 0 0 0 265 5 0 0 23 0 4 0 594229303 278507520 17731 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=271980 CPUtime=2.69 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 4169 0 0 0 262 7 0 0 19 0 4 0 594229303 278507520 17731 33554432000 4194304 4964704 140734239495184 18446744073709551615 4677991 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=271980 CPUtime=2.71 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 3646 0 0 0 265 6 0 0 23 0 4 0 594229303 278507520 17731 33554432000 4194304 4964704 140734239495184 18446744073709551615 4683916 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.19
Current children cumulated vsize (KiB) 271980

[startup+6.30111 s]
/proc/loadavg: 4.13 4.93 6.46 9/184 26818
/proc/meminfo: memFree=19484444/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=274876 CPUtime=23.97 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 24679 0 0 0 2374 23 0 0 25 0 4 0 594229266 281473024 20932 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 68719 20932 458 189 0 63068 0
[pid=26805/tid=26807] ppid=26803 vsize=274876 CPUtime=5.9 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 3572 0 0 0 584 6 0 0 25 0 4 0 594229303 281473024 20932 33554432000 4194304 4964704 140734239495184 18446744073709551615 4668907 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=274876 CPUtime=5.88 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 5130 0 0 0 580 8 0 0 25 0 4 0 594229303 281473024 20932 33554432000 4194304 4964704 140734239495184 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=274876 CPUtime=5.91 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 4810 0 0 0 585 6 0 0 25 0 4 0 594229303 281473024 20932 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 23.97
Current children cumulated vsize (KiB) 274876

[startup+12.7009 s]
/proc/loadavg: 4.52 4.99 6.47 9/184 26818
/proc/meminfo: memFree=19457792/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=277420 CPUtime=49.54 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 28834 0 0 0 4927 27 0 0 25 0 4 0 594229266 284078080 25087 33554432000 4194304 4964704 140734239495184 18446744073709551615 4658272 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 69355 25087 460 189 0 63704 0
[pid=26805/tid=26807] ppid=26803 vsize=277420 CPUtime=12.3 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 4072 0 0 0 1224 6 0 0 25 0 4 0 594229303 284078080 25087 33554432000 4194304 4964704 140734239495184 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=277420 CPUtime=12.23 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 6468 0 0 0 1215 8 0 0 25 0 4 0 594229303 284078080 25087 33554432000 4194304 4964704 140734239495184 18446744073709551615 4658299 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=277420 CPUtime=12.31 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 6875 0 0 0 1222 9 0 0 25 0 4 0 594229303 284078080 25087 33554432000 4194304 4964704 140734239495184 18446744073709551615 4361321 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 49.54
Current children cumulated vsize (KiB) 277420

[startup+25.5006 s]
/proc/loadavg: 5.29 5.14 6.50 9/184 26818
/proc/meminfo: memFree=19407760/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=284820 CPUtime=100.66 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 35250 0 0 0 10034 32 0 0 25 0 4 0 594229266 291655680 31503 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 71205 31503 460 189 0 65554 0
[pid=26805/tid=26807] ppid=26803 vsize=284820 CPUtime=25.1 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 5399 0 0 0 2502 8 0 0 25 0 4 0 594229303 291655680 31503 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670291 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=284820 CPUtime=24.97 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 8790 0 0 0 2487 10 0 0 25 0 4 0 594229303 291655680 31503 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=284820 CPUtime=25.11 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 8402 0 0 0 2501 10 0 0 25 0 4 0 594229303 291655680 31503 33554432000 4194304 4964704 140734239495184 18446744073709551615 4668635 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 100.66
Current children cumulated vsize (KiB) 284820

[startup+51.1008 s]
/proc/loadavg: 6.21 5.37 6.54 9/184 26819
/proc/meminfo: memFree=19338956/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=295680 CPUtime=202.92 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 43907 0 0 0 20253 39 0 0 25 0 4 0 594229266 302776320 40160 33554432000 4194304 4964704 140734239495184 18446744073709551615 4669399 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 73920 40160 460 189 0 68269 0
[pid=26805/tid=26807] ppid=26803 vsize=295680 CPUtime=50.69 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 6360 0 0 0 5061 8 0 0 25 0 4 0 594229303 302776320 40160 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=295680 CPUtime=50.42 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 10929 0 0 0 5032 10 0 0 25 0 4 0 594229303 302776320 40160 33554432000 4194304 4964704 140734239495184 18446744073709551615 4668527 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=295680 CPUtime=50.71 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 12282 0 0 0 5057 14 0 0 25 0 4 0 594229303 302776320 40160 33554432000 4194304 4964704 140734239495184 18446744073709551615 4668527 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 202.92
Current children cumulated vsize (KiB) 295680

[startup+102.306 s]
/proc/loadavg: 7.26 5.79 6.62 9/184 26820
/proc/meminfo: memFree=19201244/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=312764 CPUtime=407.47 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 62781 0 0 0 40686 61 0 0 25 0 4 0 594229266 320270336 59034 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 78191 59034 460 189 0 72540 0
[pid=26805/tid=26807] ppid=26803 vsize=312764 CPUtime=101.89 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 10694 0 0 0 10177 12 0 0 25 0 4 0 594229303 320270336 59034 33554432000 4194304 4964704 140734239495184 18446744073709551615 4370264 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=312764 CPUtime=101.35 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 14271 0 0 0 10121 14 0 0 25 0 4 0 594229303 320270336 59034 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670252 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=312764 CPUtime=101.91 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 18281 0 0 0 10170 21 0 0 25 0 4 0 594229303 320270336 59034 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 407.47
Current children cumulated vsize (KiB) 312764

[startup+162.3 s]
/proc/loadavg: 7.77 6.20 6.70 9/184 26822
/proc/meminfo: memFree=19078600/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=464536 CPUtime=647.12 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 80977 0 0 0 64637 75 0 0 25 0 4 0 594229266 475684864 76606 33554432000 4194304 4964704 140734239495184 18446744073709551615 4668488 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 116134 76606 460 189 0 110483 0
[pid=26805/tid=26807] ppid=26803 vsize=464536 CPUtime=161.89 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 14765 0 0 0 16173 16 0 0 25 0 4 0 594229303 475684864 76606 33554432000 4194304 4964704 140734239495184 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=464536 CPUtime=161.02 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 18358 0 0 0 16086 16 0 0 25 0 4 0 594229303 475684864 76606 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=464536 CPUtime=161.91 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 25354 0 0 0 16163 28 0 0 25 0 4 0 594229303 475684864 76606 33554432000 4194304 4964704 140734239495184 18446744073709551615 4669309 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 647.12
Current children cumulated vsize (KiB) 464536

[startup+222.301 s]
/proc/loadavg: 7.81 6.50 6.77 9/184 26853
/proc/meminfo: memFree=19214544/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=473780 CPUtime=886.78 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 92669 0 0 0 88588 90 0 0 25 0 4 0 594229266 485150720 88272 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 118445 88272 460 189 0 112794 0
[pid=26805/tid=26807] ppid=26803 vsize=473780 CPUtime=221.89 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 19070 0 0 0 22166 23 0 0 25 0 4 0 594229303 485150720 88272 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=473780 CPUtime=220.69 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 21842 0 0 0 22049 20 0 0 25 0 4 0 594229303 485150720 88272 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670075 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=473780 CPUtime=221.92 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 27092 0 0 0 22161 31 0 0 25 0 4 0 594229303 485150720 88272 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 886.78
Current children cumulated vsize (KiB) 473780

[startup+282.301 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2564.48
Current children cumulated vsize (KiB) 698380

[startup+702.3 s]
/proc/loadavg: 8.00 7.69 7.25 9/184 26896
/proc/meminfo: memFree=15811520/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=712360 CPUtime=2804.13 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 151196 0 0 0 280253 160 0 0 25 0 4 0 594229266 729456640 146496 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 178090 146496 460 189 0 172439 0
[pid=26805/tid=26807] ppid=26803 vsize=712360 CPUtime=701.82 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 31098 0 0 0 70148 34 0 0 25 0 4 0 594229303 729456640 146496 33554432000 4194304 4964704 140734239495184 18446744073709551615 4370264 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=712360 CPUtime=698.08 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 37492 0 0 0 69769 39 0 0 25 0 4 0 594229303 729456640 146496 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=712360 CPUtime=701.92 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 54025 0 0 0 70127 65 0 0 25 0 4 0 594229303 729456640 146496 33554432000 4194304 4964704 140734239495184 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2804.13
Current children cumulated vsize (KiB) 712360

[startup+762.306 s]
/proc/loadavg: 8.00 7.75 7.29 10/184 26898
/proc/meminfo: memFree=15309172/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=712360 CPUtime=3043.84 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 152491 0 0 0 304222 162 0 0 25 0 4 0 594229266 729456640 147791 33554432000 4194304 4964704 140734239495184 18446744073709551615 4677956 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 178090 147791 460 189 0 172439 0
[pid=26805/tid=26807] ppid=26803 vsize=712360 CPUtime=761.83 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 31098 0 0 0 76149 34 0 0 25 0 4 0 594229303 729456640 147791 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=712360 CPUtime=757.76 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 37527 0 0 0 75737 39 0 0 25 0 4 0 594229303 729456640 147791 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=712360 CPUtime=761.93 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 54044 0 0 0 76128 65 0 0 25 0 4 0 594229303 729456640 147791 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3043.84
Current children cumulated vsize (KiB) 712360

[startup+822.3 s]
/proc/loadavg: 8.05 7.80 7.34 10/184 26899
/proc/meminfo: memFree=14731792/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=713116 CPUtime=3283.5 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 154131 0 0 0 328186 164 0 0 25 0 4 0 594229266 730230784 149430 33554432000 4194304 4964704 140734239495184 18446744073709551615 4669333 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 178279 149430 460 189 0 172628 0
[pid=26805/tid=26807] ppid=26803 vsize=713116 CPUtime=821.82 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 31145 0 0 0 82148 34 0 0 25 0 4 0 594229303 730230784 149430 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=713116 CPUtime=817.43 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 37750 0 0 0 81704 39 0 0 25 0 4 0 594229303 730230784 149430 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670416 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=713116 CPUtime=821.93 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 54081 0 0 0 82128 65 0 0 25 0 4 0 594229303 730230784 149430 33554432000 4194304 4964704 140734239495184 18446744073709551615 4669423 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3283.5
Current children cumulated vsize (KiB) 713116

[startup+882.301 s]
/proc/loadavg: 8.11 7.87 7.39 10/184 26901
/proc/meminfo: memFree=14071460/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=716916 CPUtime=3523.18 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 157233 0 0 0 352150 168 0 0 25 0 4 0 594229266 734121984 152517 33554432000 4194304 4964704 140734239495184 18446744073709551615 4684027 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 179229 152517 460 189 0 173578 0
[pid=26805/tid=26807] ppid=26803 vsize=716916 CPUtime=881.83 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 31150 0 0 0 88148 35 0 0 25 0 4 0 594229303 734121984 152517 33554432000 4194304 4964704 140734239495184 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=716916 CPUtime=877.1 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 38698 0 0 0 87671 39 0 0 25 0 4 0 594229303 734121984 152517 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=716916 CPUtime=881.93 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 54669 0 0 0 88127 66 0 0 25 0 4 0 594229303 734121984 152517 33554432000 4194304 4964704 140734239495184 18446744073709551615 4653420 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3523.18
Current children cumulated vsize (KiB) 716916

[startup+942.301 s]
/proc/loadavg: 8.09 7.90 7.43 9/184 26902
/proc/meminfo: memFree=13850724/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=717516 CPUtime=3762.85 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 157977 0 0 0 376116 169 0 0 25 0 4 0 594229266 734736384 153261 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 179379 153261 460 189 0 173728 0
[pid=26805/tid=26807] ppid=26803 vsize=717516 CPUtime=941.83 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 31332 0 0 0 94148 35 0 0 25 0 4 0 594229303 734736384 153261 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=717516 CPUtime=936.77 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 38829 0 0 0 93638 39 0 0 25 0 4 0 594229303 734736384 153261 33554432000 4194304 4964704 140734239495184 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=717516 CPUtime=941.93 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 54669 0 0 0 94127 66 0 0 25 0 4 0 594229303 734736384 153261 33554432000 4194304 4964704 140734239495184 18446744073709551615 4669427 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3762.85
Current children cumulated vsize (KiB) 717516

[startup+1002.3 s]
/proc/loadavg: 8.07 7.93 7.47 9/184 26904
/proc/meminfo: memFree=13295168/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=725936 CPUtime=4002.51 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 161224 0 0 0 400080 171 0 0 25 0 4 0 594229266 743358464 156508 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 181484 156508 460 189 0 175833 0
[pid=26805/tid=26807] ppid=26803 vsize=725936 CPUtime=1001.81 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 31778 0 0 0 100146 35 0 0 20 0 4 0 594229303 743358464 156508 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=725936 CPUtime=996.45 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 39287 0 0 0 99605 40 0 0 25 0 4 0 594229303 743358464 156508 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=725936 CPUtime=1001.93 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 56765 0 0 0 100126 67 0 0 25 0 4 0 594229303 743358464 156508 33554432000 4194304 4964704 140734239495184 18446744073709551615 4669214 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4002.51
Current children cumulated vsize (KiB) 725936

[startup+1062.3 s]
/proc/loadavg: 8.07 7.96 7.50 9/184 26906
/proc/meminfo: memFree=13007228/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=792152 CPUtime=4242.19 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 165409 0 0 0 424044 175 0 0 25 0 4 0 594229266 811163648 160693 33554432000 4194304 4964704 140734239495184 18446744073709551615 4342213 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 198038 160693 460 189 0 192387 0
[pid=26805/tid=26807] ppid=26803 vsize=792152 CPUtime=1061.81 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 31781 0 0 0 106146 35 0 0 25 0 4 0 594229303 811163648 160693 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=792152 CPUtime=1056.12 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 39466 0 0 0 105572 40 0 0 25 0 4 0 594229303 811163648 160693 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=792152 CPUtime=1061.94 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 59198 0 0 0 106125 69 0 0 25 0 4 0 594229303 811163648 160693 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4242.19
Current children cumulated vsize (KiB) 792152

[startup+1122.3 s]
/proc/loadavg: 8.10 7.99 7.54 10/184 26907
/proc/meminfo: memFree=12583856/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=801420 CPUtime=4481.86 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 169514 0 0 0 448008 178 0 0 25 0 4 0 594229266 820654080 164798 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 200355 164798 460 189 0 194704 0
[pid=26805/tid=26807] ppid=26803 vsize=801420 CPUtime=1121.81 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 31826 0 0 0 112146 35 0 0 25 0 4 0 594229303 820654080 164798 33554432000 4194304 4964704 140734239495184 18446744073709551615 4654632 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=801420 CPUtime=1115.79 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 40013 0 0 0 111539 40 0 0 25 0 4 0 594229303 820654080 164798 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=801420 CPUtime=1121.93 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 62711 0 0 0 112121 72 0 0 25 0 4 0 594229303 820654080 164798 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4481.86
Current children cumulated vsize (KiB) 801420

[startup+1182.3 s]
/proc/loadavg: 8.31 8.07 7.59 10/184 26912
/proc/meminfo: memFree=12345800/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=816796 CPUtime=4720.72 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 173530 0 0 0 471891 181 0 0 25 0 4 0 594229266 836399104 168664 33554432000 4194304 4964704 140734239495184 18446744073709551615 4658352 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 204199 168664 460 189 0 198548 0
[pid=26805/tid=26807] ppid=26803 vsize=816796 CPUtime=1181.62 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 32063 0 0 0 118127 35 0 0 25 0 4 0 594229303 836399104 168664 33554432000 4194304 4964704 140734239495184 18446744073709551615 4669477 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=816796 CPUtime=1175.49 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 40103 0 0 0 117508 41 0 0 25 0 4 0 594229303 836399104 168664 33554432000 4194304 4964704 140734239495184 18446744073709551615 4653161 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=816796 CPUtime=1181.28 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 63044 0 0 0 118056 72 0 0 25 0 4 0 594229303 836399104 168664 33554432000 4194304 4964704 140734239495184 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4720.72
Current children cumulated vsize (KiB) 816796



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.2 s]
/proc/loadavg: 8.28 8.08 7.61 10/184 26913
/proc/meminfo: memFree=12164572/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=816796 CPUtime=4800.24 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 173534 0 0 0 479843 181 0 0 25 0 4 0 594229266 836399104 168664 33554432000 4194304 4964704 140734239495184 18446744073709551615 4668654 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26805/statm: 204199 168664 460 189 0 198548 0
[pid=26805/tid=26807] ppid=26803 vsize=816796 CPUtime=1201.42 cores=0,2,4,6
/proc/26805/task/26807/stat : 26807 (claspmt) R 26803 26805 26261 0 -1 4202560 32063 0 0 0 120107 35 0 0 25 0 4 0 594229303 836399104 168664 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26805/tid=26808] ppid=26803 vsize=816796 CPUtime=1195.41 cores=0,2,4,6
/proc/26805/task/26808/stat : 26808 (claspmt) R 26803 26805 26261 0 -1 4202560 40105 0 0 0 119500 41 0 0 25 0 4 0 594229303 836399104 168664 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26805/tid=26809] ppid=26803 vsize=816796 CPUtime=1201.19 cores=0,2,4,6
/proc/26805/task/26809/stat : 26809 (claspmt) R 26803 26805 26261 0 -1 4202560 63045 0 0 0 120047 72 0 0 25 0 4 0 594229303 836399104 168664 33554432000 4194304 4964704 140734239495184 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 816796

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.32 s]
/proc/loadavg: 8.28 8.08 7.61 10/184 26913
/proc/meminfo: memFree=12164572/32950928 swapFree=67111364/67111528
[pid=26805] ppid=26803 vsize=802028 CPUtime=4800.36 cores=0,2,4,6
/proc/26805/stat : 26805 (claspmt) R 26803 26805 26261 0 -1 4202496 173544 0 0 0 479855 181 0 0 25 0 1 0 594229266 821276672 165064 33554432000 4194304 4964704 140734239495184 18446744073709551615 251367202156 0 0 4096 18946 0 0 0 17 0 0 0 0
/proc/26805/statm: 200507 165064 470 189 0 194856 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 802028

Child status: 0
Real time (s): 1202.38
CPU time (s): 4800.43
CPU user time (s): 4798.58
CPU system time (s): 1.84772
CPU usage (%): 399.244
Max. virtual memory (cumulated for all children) (KiB): 816796

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.58
system time used= 1.84772
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 173546
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4118
involuntary context switches= 22299

runsolver used 1.86871 second user time and 4.70228 second system time

The end

Launcher Data 

Begin job on node113 at 2011-04-29 03:19:46
IDJOB=3299843
IDBENCH=20536
IDSOLVER=1683
FILE ID=node113/3299843-1304039986
RUNJOBID= node113-1304039986-26791
PBS_JOBID= 13170352
Free space on /tmp= 71156 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT07/industrial/IBM_FV_2002_13_rule_1/SAT_dat.k100.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299843-1304039986/watcher-3299843-1304039986 -o /tmp/evaluation-result-3299843-1304039986/solver-3299843-1304039986 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299843-1304039986.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cf1b8194ff6d413d396ac9e26bb031ef
RANDOM SEED=1123109226

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      19760500 kB
Buffers:       1733160 kB
Cached:       10800200 kB
SwapCached:        164 kB
Active:        6290156 kB
Inactive:      6310728 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      19760500 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           10196 kB
Writeback:           0 kB
AnonPages:       66696 kB
Mapped:          14484 kB
Slab:           526108 kB
PageTables:       4316 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   191432 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71032 MiB
End job on node113 at 2011-04-29 03:39:50