Trace number 3321475

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 40001.5 5006.68

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v2400c266431g10.cnf
MD5SUM885d1d8595262b8f0aa94d123211b47c
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2400
Number of clauses266431
Sum of the clauses size535112
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2266356
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 575

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...341393/instance-3321475-1304341393.cnf
1.39/1.41	c Solving...
40000.66/5005.91	
40000.66/5005.91	*** INTERRUPTED! ***
40000.66/5005.91	*** Shutting down threads...
40001.40/5006.67	s UNKNOWN
40001.40/5006.67	
40001.40/5006.67	c INTERRUPTED   : 1
40001.40/5006.67	c Models        : 0+    
40001.40/5006.67	c Time          : 5005.914s (Solving: 5004.50s 1st Model: 0.00s Unsat: 0.00s)
40001.40/5006.67	c CPU Time      : 40000.720s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321475-1304341393/watcher-3321475-1304341393 -o /tmp/evaluation-result-3321475-1304341393/solver-3321475-1304341393 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3321475-1304341393.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.04 1.01 1.01 2/214 5471
/proc/meminfo: memFree=5125292/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=22316 CPUtime=0 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 853 0 0 0 0 0 0 0 21 0 1 0 545739715 22851584 765 33554432000 4194304 4964704 140734242000160 18446744073709551615 244446642384 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/5471/statm: 5579 739 386 189 0 453 0

[startup+0.0776469 s]
/proc/loadavg: 1.04 1.01 1.01 2/214 5471
/proc/meminfo: memFree=5125292/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=35932 CPUtime=0.07 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 5279 0 0 0 7 0 0 0 21 0 1 0 545739715 36794368 4017 33554432000 4194304 4964704 140734242000160 18446744073709551615 244446642553 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/5471/statm: 8983 4038 397 189 0 3857 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 35932

[startup+0.100643 s]
/proc/loadavg: 1.04 1.01 1.01 2/214 5471
/proc/meminfo: memFree=5125292/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=37892 CPUtime=0.09 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 5839 0 0 0 9 0 0 0 21 0 1 0 545739715 38801408 4577 33554432000 4194304 4964704 140734242000160 18446744073709551615 4607536 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/5471/statm: 9473 4577 399 189 0 4347 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 37892

[startup+0.300606 s]
/proc/loadavg: 1.04 1.01 1.01 2/214 5471
/proc/meminfo: memFree=5125292/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=37892 CPUtime=0.29 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 5839 0 0 0 29 0 0 0 22 0 1 0 545739715 38801408 4577 33554432000 4194304 4964704 140734242000160 18446744073709551615 4607562 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/5471/statm: 9473 4577 399 189 0 4347 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 37892

[startup+0.700534 s]
/proc/loadavg: 1.04 1.01 1.01 2/214 5471
/proc/meminfo: memFree=5125292/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=38156 CPUtime=0.69 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 5900 0 0 0 69 0 0 0 23 0 1 0 545739715 39071744 4638 33554432000 4194304 4964704 140734242000160 18446744073709551615 4600559 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/5471/statm: 9539 4638 400 189 0 4413 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 38156

[startup+1.50038 s]
/proc/loadavg: 1.04 1.01 1.01 2/215 5472
/proc/meminfo: memFree=5106876/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=464412 CPUtime=1.51 cores=0-7
/proc/5471/stat : 5471 (claspmt) S 5469 5471 5060 0 -1 4202496 8413 0 0 0 151 0 0 0 18 0 8 0 545739715 475557888 6593 33554432000 4194304 4964704 140734242000160 18446744073709551615 244458761113 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/5471/statm: 116103 6593 435 189 0 110452 0
Current children cumulated CPU time (s) 1.51
Current children cumulated vsize (KiB) 464412

[startup+3.10105 s]
/proc/loadavg: 1.60 1.13 1.05 10/222 5479
/proc/meminfo: memFree=5079416/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=464412 CPUtime=13.28 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 19678 0 0 0 1320 8 0 0 18 0 8 0 545739715 475557888 17858 33554432000 4194304 4964704 140734242000160 18446744073709551615 4627204 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/5471/statm: 116103 17859 464 189 0 110452 0
[pid=5471/tid=5473] ppid=5469 vsize=464412 CPUtime=1.47 cores=0-7
/proc/5471/task/5473/stat : 5473 (claspmt) R 5469 5471 5060 0 -1 4202560 1404 0 0 0 146 1 0 0 17 0 8 0 545739856 475557888 17859 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670281 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5471/tid=5474] ppid=5469 vsize=464412 CPUtime=1.42 cores=0-7
/proc/5471/task/5474/stat : 5474 (claspmt) R 5469 5471 5060 0 -1 4202560 1423 0 0 0 142 0 0 0 17 0 8 0 545739856 475557888 17859 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670416 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=5471/tid=5475] ppid=5469 vsize=464412 CPUtime=1.44 cores=0-7
/proc/5471/task/5475/stat : 5475 (claspmt) R 5469 5471 5060 0 -1 4202560 1573 0 0 0 144 0 0 0 17 0 8 0 545739856 475557888 17859 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5471/tid=5476] ppid=5469 vsize=464412 CPUtime=1.46 cores=0-7
/proc/5471/task/5476/stat : 5476 (claspmt) R 5469 5471 5060 0 -1 4202560 1863 0 0 0 146 0 0 0 17 0 8 0 545739856 475557888 17859 33554432000 4194304 4964704 140734242000160 18446744073709551615 4668907 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=5471/tid=5477] ppid=5469 vsize=464412 CPUtime=1.67 cores=0-7
/proc/5471/task/5477/stat : 5477 (claspmt) R 5469 5471 5060 0 -1 4202560 866 0 0 0 167 0 0 0 20 0 8 0 545739856 475557888 17859 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=5471/tid=5478] ppid=5469 vsize=464412 CPUtime=1.45 cores=0-7
/proc/5471/task/5478/stat : 5478 (claspmt) R 5469 5471 5060 0 -1 4202560 1761 0 0 0 145 0 0 0 17 0 8 0 545739856 475557888 17859 33554432000 4194304 4964704 140734242000160 18446744073709551615 4627259 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=5471/tid=5479] ppid=5469 vsize=464412 CPUtime=1.45 cores=0-7
/proc/5471/task/5479/stat : 5479 (claspmt) R 5469 5471 5060 0 -1 4202560 2735 0 0 0 143 2 0 0 17 0 8 0 545739856 475557888 17859 33554432000 4194304 4964704 140734242000160 18446744073709551615 4367143 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 13.28
Current children cumulated vsize (KiB) 464412

[startup+6.30046 s]
/proc/loadavg: 1.60 1.13 1.05 9/222 5479
/proc/meminfo: memFree=5017168/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=471420 CPUtime=38.84 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 34691 0 0 0 3869 15 0 0 25 0 8 0 545739715 482734080 32871 33554432000 4194304 4964704 140734242000160 18446744073709551615 4321079 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/5471/statm: 117855 32871 466 189 0 112204 0
[pid=5471/tid=5473] ppid=5469 vsize=471420 CPUtime=4.67 cores=0-7
/proc/5471/task/5473/stat : 5473 (claspmt) R 5469 5471 5060 0 -1 4202560 2977 0 0 0 465 2 0 0 25 0 8 0 545739856 482734080 32871 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5471/tid=5474] ppid=5469 vsize=471420 CPUtime=4.62 cores=0-7
/proc/5471/task/5474/stat : 5474 (claspmt) R 5469 5471 5060 0 -1 4202560 3247 0 0 0 461 1 0 0 24 0 8 0 545739856 482734080 32871 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670269 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=5471/tid=5475] ppid=5469 vsize=471420 CPUtime=4.65 cores=0-7
/proc/5471/task/5475/stat : 5475 (claspmt) R 5469 5471 5060 0 -1 4202560 2895 0 0 0 464 1 0 0 24 0 8 0 545739856 482734080 32871 33554432000 4194304 4964704 140734242000160 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5471/tid=5476] ppid=5469 vsize=471420 CPUtime=4.66 cores=0-7
/proc/5471/task/5476/stat : 5476 (claspmt) R 5469 5471 5060 0 -1 4202560 4060 0 0 0 465 1 0 0 25 0 8 0 545739856 482734080 32871 33554432000 4194304 4964704 140734242000160 18446744073709551615 4627928 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=5471/tid=5477] ppid=5469 vsize=471420 CPUtime=4.86 cores=0-7
/proc/5471/task/5477/stat : 5477 (claspmt) R 5469 5471 5060 0 -1 4202560 1600 0 0 0 486 0 0 0 25 0 8 0 545739856 482734080 32871 33554432000 4194304 4964704 140734242000160 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=5471/tid=5478] ppid=5469 vsize=471420 CPUtime=4.63 cores=0-7
/proc/5471/task/5478/stat : 5478 (claspmt) R 5469 5471 5060 0 -1 4202560 3297 0 0 0 462 1 0 0 25 0 8 0 545739856 482734080 32871 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=5471/tid=5479] ppid=5469 vsize=471420 CPUtime=4.65 cores=0-7
/proc/5471/task/5479/stat : 5479 (claspmt) R 5469 5471 5060 0 -1 4202560 7285 0 0 0 461 4 0 0 24 0 8 0 545739856 482734080 32871 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38.84
Current children cumulated vsize (KiB) 471420

[startup+12.7013 s]
/proc/loadavg: 2.58 1.35 1.12 9/222 5480
/proc/meminfo: memFree=4910628/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=485400 CPUtime=89.99 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 58463 0 0 0 8971 28 0 0 25 0 8 0 545739715 497049600 56643 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/5471/statm: 121350 56643 466 189 0 115699 0
[pid=5471/tid=5473] ppid=5469 vsize=485400 CPUtime=11.07 cores=0-7
/proc/5471/task/5473/stat : 5473 (claspmt) R 5469 5471 5060 0 -1 4202560 5419 0 0 0 1104 3 0 0 25 0 8 0 545739856 497049600 56643 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5471/tid=5474] ppid=5469 vsize=485400 CPUtime=11.02 cores=0-7
/proc/5471/task/5474/stat : 5474 (claspmt) R 5469 5471 5060 0 -1 4202560 5726 0 0 0 1099 3 0 0 25 0 8 0 545739856 497049600 56643 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670233 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=5471/tid=5475] ppid=5469 vsize=485400 CPUtime=11.04 cores=0-7
/proc/5471/task/5475/stat : 5475 (claspmt) R 5469 5471 5060 0 -1 4202560 5002 0 0 0 1103 1 0 0 25 0 8 0 545739856 497049600 56643 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5471/tid=5476] ppid=5469 vsize=485400 CPUtime=11.07 cores=0-7
/proc/5471/task/5476/stat : 5476 (claspmt) R 5469 5471 5060 0 -1 4202560 6475 0 0 0 1104 3 0 0 25 0 8 0 545739856 497049600 56643 33554432000 4194304 4964704 140734242000160 18446744073709551615 4342180 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=5471/tid=5477] ppid=5469 vsize=485400 CPUtime=11.26 cores=0-7
/proc/5471/task/5477/stat : 5477 (claspmt) R 5469 5471 5060 0 -1 4202560 4142 0 0 0 1125 1 0 0 19 0 8 0 545739856 497049600 56643 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670565 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=5471/tid=5478] ppid=5469 vsize=485400 CPUtime=10.98 cores=0-7
/proc/5471/task/5478/stat : 5478 (claspmt) R 5469 5471 5060 0 -1 4202560 5304 0 0 0 1097 1 0 0 20 0 8 0 545739856 497049600 56644 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670277 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=5471/tid=5479] ppid=5469 vsize=485400 CPUtime=11.04 cores=0-7
/proc/5471/task/5479/stat : 5479 (claspmt) R 5469 5471 5060 0 -1 4202560 14914 0 0 0 1095 9 0 0 25 0 8 0 545739856 497049600 56644 33554432000 4194304 4964704 140734242000160 18446744073709551615 244446606369 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 89.99
Current children cumulated vsize (KiB) 485400

[startup+25.5009 s]
/proc/loadavg: 3.42 1.57 1.19 9/222 5480
/proc/meminfo: memFree=4817396/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=496240 CPUtime=192.28 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 79839 0 0 0 19187 41 0 0 25 0 8 0 545739715 508149760 78019 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/5471/statm: 124060 78019 466 189 0 118409 0
[pid=5471/tid=5473] ppid=5469 vsize=496240 CPUtime=23.86 cores=0-7
/proc/5471/task/5473/stat : 5473 (claspmt) R 5469 5471 5060 0 -1 4202560 6944 0 0 0 2382 4 0 0 25 0 8 0 545739856 508149760 78019 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670233 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5471/tid=5474] ppid=5469 vsize=496240 CPUtime=23.82 cores=0-7
/proc/5471/task/5474/stat : 5474 (claspmt) R 5469 5471 5060 0 -1 4202560 8071 0 0 0 2378 4 0 0 25 0 8 0 545739856 508149760 78019 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=5471/tid=5475] ppid=5469 vsize=496240 CPUtime=23.84 cores=0-7
/proc/5471/task/5475/stat : 5475 (claspmt) R 5469 5471 5060 0 -1 4202560 6346 0 0 0 2382 2 0 0 25 0 8 0 545739856 508149760 78019 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5471/tid=5476] ppid=5469 vsize=496240 CPUtime=23.86 cores=0-7
/proc/5471/task/5476/stat : 5476 (claspmt) R 5469 5471 5060 0 -1 4202560 9060 0 0 0 2381 5 0 0 25 0 8 0 545739856 508149760 78019 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=5471/tid=5477] ppid=5469 vsize=496240 CPUtime=24.06 cores=0-7
/proc/5471/task/5477/stat : 5477 (claspmt) R 5469 5471 5060 0 -1 4202560 6630 0 0 0 2404 2 0 0 25 0 8 0 545739856 508149760 78019 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=5471/tid=5478] ppid=5469 vsize=496240 CPUtime=23.7 cores=0-7
/proc/5471/task/5478/stat : 5478 (claspmt) R 5469 5471 5060 0 -1 4202560 6310 0 0 0 2368 2 0 0 25 0 8 0 545739856 508149760 78019 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=5471/tid=5479] ppid=5469 vsize=496240 CPUtime=23.83 cores=0-7
/proc/5471/task/5479/stat : 5479 (claspmt) R 5469 5471 5060 0 -1 4202560 23403 0 0 0 2369 14 0 0 25 0 8 0 545739856 508149760 78019 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 192.28
Current children cumulated vsize (KiB) 496240

[startup+51.1011 s]
/proc/loadavg: 5.13 2.12 1.39 10/223 5484
/proc/meminfo: memFree=4728856/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=506908 CPUtime=396.69 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 99109 0 0 0 39611 58 0 0 25 0 8 0 545739715 519073792 97285 33554432000 4194304 4964704 140734242000160 18446744073709551615 4627843 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/5471/statm: 126727 97285 466 189 0 121076 0
[pid=5471/tid=5473] ppid=5469 vsize=506908 CPUtime=49.45 cores=0-7
/proc/5471/task/5473/stat : 5473 (claspmt) R 5469 5471 5060 0 -1 4202560 8311 0 0 0 4939 6 0 0 25 0 8 0 545739856 519073792 97285 33554432000 4194304 4964704 140734242000160 18446744073709551615 4627263 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5471/tid=5474] ppid=5469 vsize=506908 CPUtime=49.41 cores=0-7
/proc/5471/task/5474/stat : 5474 (claspmt) R 5469 5471 5060 0 -1 4202560 10648 0 0 0 4936 5 0 0 25 0 8 0 545739856 519073792 97285 33554432000 4194304 4964704 140734242000160 18446744073709551615 4627356 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=5471/tid=5475] ppid=5469 vsize=506908 CPUtime=49.44 cores=0-7
/proc/5471/task/5475/stat : 5475 (claspmt) R 5469 5471 5060 0 -1 4202560 7266 0 0 0 4941 3 0 0 25 0 8 0 545739856 519073792 97285 33554432000 4194304 4964704 140734242000160 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5471/tid=5476] ppid=5469 vsize=506908 CPUtime=49.47 cores=0-7
/proc/5471/task/5476/stat : 5476 (claspmt) R 5469 5471 5060 0 -1 4202560 10597 0 0 0 4939 8 0 0 25 0 8 0 545739856 519073792 97285 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670241 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=5471/tid=5477] ppid=5469 vsize=506908 CPUtime=49.66 cores=0-7
/proc/5471/task/5477/stat : 5477 (claspmt) R 5469 5471 5060 0 -1 4202560 8783 0 0 0 4962 4 0 0 25 0 8 0 545739856 519073792 97285 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=5471/tid=5478] ppid=5469 vsize=506908 CPUtime=49.13 cores=0-7
/proc/5471/task/5478/stat : 5478 (claspmt) R 5469 5471 5060 0 -1 4202560 7540 0 0 0 4910 3 0 0 25 0 8 0 545739856 519073792 97285 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=5471/tid=5479] ppid=5469 vsize=506908 CPUtime=49.27 cores=0-7
/proc/5471/task/5479/stat : 5479 (claspmt) R 5469 5471 5060 0 -1 4202560 30912 0 0 0 4908 19 0 0 25 0 8 0 545739856 519073792 97285 33554432000 4194304 4964704 140734242000160 18446744073709551615 244446606369 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 396.69
Current children cumulated vsize (KiB) 506908

[startup+102.309 s]
/proc/loadavg: 7.04 3.17 1.78 9/222 5485
/proc/meminfo: memFree=4614512/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=920316 CPUtime=805.39 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 130657 0 0 0 80449 90 0 0 25 0 8 0 545739715 942403584 128817 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670252 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/5471/statm: 230079 128817 466 189 0 224428 0
[pid=5471/tid=5473] ppid=5469 vsize=920316 CPUtime=100.66 cores=0-7
/proc/5471/task/5473/stat : 5473 (claspmt) R 5469 5471 5060 0 -1 4202560 12360 0 0 0 10055 11 0 0 25 0 8 0 545739856 942403584 128817 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5471/tid=5474] ppid=5469 vsize=920316 CPUtime=100.62 cores=0-7
/proc/5471/task/5474/stat : 5474 (claspmt) R 5469 5471 5060 0 -1 4202560 13501 0 0 0 10053 9 0 0 25 0 8 0 545739856 942403584 128817 33554432000 4194304 4964704 140734242000160 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=5471/tid=5475] ppid=5469 vsize=920316 CPUtime=100.65 cores=0-7
/proc/5471/task/5475/stat : 5475 (claspmt) R 5469 5471 5060 0 -1 4202560 8582 0 0 0 10060 5 0 0 25 0 8 0 545739856 942403584 128817 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 5 0 0 0

################
# More data... #
################

/proc/5471/task/5478/stat : 5478 (claspmt) R 5469 5471 5060 0 -1 4202560 17883 0 0 0 465023 24 0 0 25 0 8 0 545739856 2500116480 558458 33554432000 4194304 4964704 140734242000160 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5471/tid=5479] ppid=5469 vsize=2441520 CPUtime=4659.88 cores=0-7
/proc/5471/task/5479/stat : 5479 (claspmt) R 5469 5471 5060 0 -1 4202560 319200 0 0 0 465648 340 0 0 25 0 8 0 545739856 2500116480 558458 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37254.1
Current children cumulated vsize (KiB) 2441520

[startup+4722.31 s]
/proc/loadavg: 8.01 8.02 7.95 9/222 5620
/proc/meminfo: memFree=2884012/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=2441520 CPUtime=37733.8 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 570200 0 0 0 3772718 657 0 0 25 0 8 0 545739715 2500116480 560041 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670450 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/5471/statm: 610380 560041 466 189 0 604729 0
[pid=5471/tid=5473] ppid=5469 vsize=2441520 CPUtime=4715.9 cores=0-7
/proc/5471/task/5473/stat : 5473 (claspmt) R 5469 5471 5060 0 -1 4202560 44053 0 0 0 471533 57 0 0 25 0 8 0 545739856 2500116480 560041 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=5471/tid=5474] ppid=5469 vsize=2441520 CPUtime=4720.63 cores=0-7
/proc/5471/task/5474/stat : 5474 (claspmt) R 5469 5471 5060 0 -1 4202560 35943 0 0 0 472028 35 0 0 25 0 8 0 545739856 2500116480 560041 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=5471/tid=5475] ppid=5469 vsize=2441520 CPUtime=4720.66 cores=0-7
/proc/5471/task/5475/stat : 5475 (claspmt) R 5469 5471 5060 0 -1 4202560 20337 0 0 0 472040 26 0 0 25 0 8 0 545739856 2500116480 560041 33554432000 4194304 4964704 140734242000160 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5471/tid=5476] ppid=5469 vsize=2441520 CPUtime=4704.8 cores=0-7
/proc/5471/task/5476/stat : 5476 (claspmt) R 5469 5471 5060 0 -1 4202560 39140 0 0 0 470421 59 0 0 25 0 8 0 545739856 2500116480 560041 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=5471/tid=5477] ppid=5469 vsize=2441520 CPUtime=4720.19 cores=0-7
/proc/5471/task/5477/stat : 5477 (claspmt) R 5469 5471 5060 0 -1 4202560 25188 0 0 0 471993 26 0 0 25 0 8 0 545739856 2500116480 560041 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=5471/tid=5478] ppid=5469 vsize=2441520 CPUtime=4710.47 cores=0-7
/proc/5471/task/5478/stat : 5478 (claspmt) R 5469 5471 5060 0 -1 4202560 17883 0 0 0 471023 24 0 0 25 0 8 0 545739856 2500116480 560041 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5471/tid=5479] ppid=5469 vsize=2441520 CPUtime=4719.89 cores=0-7
/proc/5471/task/5479/stat : 5479 (claspmt) R 5469 5471 5060 0 -1 4202560 319624 0 0 0 471649 340 0 0 25 0 8 0 545739856 2500116480 560041 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37733.8
Current children cumulated vsize (KiB) 2441520

[startup+4782.3 s]
/proc/loadavg: 8.00 8.02 7.95 9/222 5622
/proc/meminfo: memFree=2883980/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=2442188 CPUtime=38213.3 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 570400 0 0 0 3820674 657 0 0 25 0 8 0 545739715 2500800512 560241 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/5471/statm: 610547 560241 466 189 0 604896 0
[pid=5471/tid=5473] ppid=5469 vsize=2442188 CPUtime=4775.89 cores=0-7
/proc/5471/task/5473/stat : 5473 (claspmt) R 5469 5471 5060 0 -1 4202560 44055 0 0 0 477532 57 0 0 25 0 8 0 545739856 2500800512 560241 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=5471/tid=5474] ppid=5469 vsize=2442188 CPUtime=4780.62 cores=0-7
/proc/5471/task/5474/stat : 5474 (claspmt) R 5469 5471 5060 0 -1 4202560 35945 0 0 0 478027 35 0 0 25 0 8 0 545739856 2500800512 560241 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=5471/tid=5475] ppid=5469 vsize=2442188 CPUtime=4780.66 cores=0-7
/proc/5471/task/5475/stat : 5475 (claspmt) R 5469 5471 5060 0 -1 4202560 20337 0 0 0 478040 26 0 0 25 0 8 0 545739856 2500800512 560241 33554432000 4194304 4964704 140734242000160 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5471/tid=5476] ppid=5469 vsize=2442188 CPUtime=4764.42 cores=0-7
/proc/5471/task/5476/stat : 5476 (claspmt) R 5469 5471 5060 0 -1 4202560 39147 0 0 0 476383 59 0 0 25 0 8 0 545739856 2500800512 560241 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=5471/tid=5477] ppid=5469 vsize=2442188 CPUtime=4780.18 cores=0-7
/proc/5471/task/5477/stat : 5477 (claspmt) R 5469 5471 5060 0 -1 4202560 25191 0 0 0 477992 26 0 0 25 0 8 0 545739856 2500800512 560241 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=5471/tid=5478] ppid=5469 vsize=2442188 CPUtime=4770.47 cores=0-7
/proc/5471/task/5478/stat : 5478 (claspmt) R 5469 5471 5060 0 -1 4202560 17883 0 0 0 477023 24 0 0 25 0 8 0 545739856 2500800512 560241 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5471/tid=5479] ppid=5469 vsize=2442188 CPUtime=4779.88 cores=0-7
/proc/5471/task/5479/stat : 5479 (claspmt) R 5469 5471 5060 0 -1 4202560 319810 0 0 0 477648 340 0 0 25 0 8 0 545739856 2500800512 560241 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38213.3
Current children cumulated vsize (KiB) 2442188

[startup+4842.3 s]
/proc/loadavg: 8.04 8.03 7.95 9/222 5624
/proc/meminfo: memFree=2862324/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=2457464 CPUtime=38692.9 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 575682 0 0 0 3868628 662 0 0 25 0 8 0 545739715 2516443136 565523 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/5471/statm: 614366 565523 466 189 0 608715 0
[pid=5471/tid=5473] ppid=5469 vsize=2457464 CPUtime=4835.89 cores=0-7
/proc/5471/task/5473/stat : 5473 (claspmt) R 5469 5471 5060 0 -1 4202560 44055 0 0 0 483532 57 0 0 25 0 8 0 545739856 2516443136 565523 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=5471/tid=5474] ppid=5469 vsize=2457464 CPUtime=4840.62 cores=0-7
/proc/5471/task/5474/stat : 5474 (claspmt) R 5469 5471 5060 0 -1 4202560 35948 0 0 0 484027 35 0 0 25 0 8 0 545739856 2516443136 565523 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=5471/tid=5475] ppid=5469 vsize=2457464 CPUtime=4840.66 cores=0-7
/proc/5471/task/5475/stat : 5475 (claspmt) R 5469 5471 5060 0 -1 4202560 20730 0 0 0 484039 27 0 0 25 0 8 0 545739856 2516443136 565523 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5471/tid=5476] ppid=5469 vsize=2457464 CPUtime=4824.01 cores=0-7
/proc/5471/task/5476/stat : 5476 (claspmt) R 5469 5471 5060 0 -1 4202560 39194 0 0 0 482342 59 0 0 25 0 8 0 545739856 2516443136 565523 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=5471/tid=5477] ppid=5469 vsize=2457464 CPUtime=4840.19 cores=0-7
/proc/5471/task/5477/stat : 5477 (claspmt) R 5469 5471 5060 0 -1 4202560 25424 0 0 0 483992 27 0 0 25 0 8 0 545739856 2516443136 565523 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=5471/tid=5478] ppid=5469 vsize=2457464 CPUtime=4830.47 cores=0-7
/proc/5471/task/5478/stat : 5478 (claspmt) R 5469 5471 5060 0 -1 4202560 17891 0 0 0 483023 24 0 0 25 0 8 0 545739856 2516443136 565523 33554432000 4194304 4964704 140734242000160 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5471/tid=5479] ppid=5469 vsize=2457464 CPUtime=4839.88 cores=0-7
/proc/5471/task/5479/stat : 5479 (claspmt) R 5469 5471 5060 0 -1 4202560 323943 0 0 0 483645 343 0 0 25 0 8 0 545739856 2516443136 565523 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38692.9
Current children cumulated vsize (KiB) 2457464

[startup+4902.3 s]
/proc/loadavg: 8.06 8.03 7.96 9/222 5625
/proc/meminfo: memFree=2830480/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=2523000 CPUtime=39172.5 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 584004 0 0 0 3916575 675 0 0 25 0 8 0 545739715 2583552000 573845 33554432000 4194304 4964704 140734242000160 18446744073709551615 4320951 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/5471/statm: 630750 573845 466 189 0 625099 0
[pid=5471/tid=5473] ppid=5469 vsize=2523000 CPUtime=4895.89 cores=0-7
/proc/5471/task/5473/stat : 5473 (claspmt) R 5469 5471 5060 0 -1 4202560 44056 0 0 0 489532 57 0 0 25 0 8 0 545739856 2583552000 573845 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=5471/tid=5474] ppid=5469 vsize=2523000 CPUtime=4900.62 cores=0-7
/proc/5471/task/5474/stat : 5474 (claspmt) R 5469 5471 5060 0 -1 4202560 35996 0 0 0 490027 35 0 0 25 0 8 0 545739856 2583552000 573845 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=5471/tid=5475] ppid=5469 vsize=2523000 CPUtime=4900.66 cores=0-7
/proc/5471/task/5475/stat : 5475 (claspmt) R 5469 5471 5060 0 -1 4202560 20843 0 0 0 490039 27 0 0 25 0 8 0 545739856 2583552000 573845 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5471/tid=5476] ppid=5469 vsize=2523000 CPUtime=4883.6 cores=0-7
/proc/5471/task/5476/stat : 5476 (claspmt) R 5469 5471 5060 0 -1 4202560 39228 0 0 0 488301 59 0 0 25 0 8 0 545739856 2583552000 573845 33554432000 4194304 4964704 140734242000160 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=5471/tid=5477] ppid=5469 vsize=2523000 CPUtime=4900.19 cores=0-7
/proc/5471/task/5477/stat : 5477 (claspmt) R 5469 5471 5060 0 -1 4202560 25424 0 0 0 489992 27 0 0 25 0 8 0 545739856 2583552000 573845 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=5471/tid=5478] ppid=5469 vsize=2523000 CPUtime=4890.47 cores=0-7
/proc/5471/task/5478/stat : 5478 (claspmt) R 5469 5471 5060 0 -1 4202560 17939 0 0 0 489023 24 0 0 25 0 8 0 545739856 2583552000 573845 33554432000 4194304 4964704 140734242000160 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5471/tid=5479] ppid=5469 vsize=2523000 CPUtime=4899.88 cores=0-7
/proc/5471/task/5479/stat : 5479 (claspmt) R 5469 5471 5060 0 -1 4202560 328918 0 0 0 489638 350 0 0 25 0 8 0 545739856 2583552000 573845 33554432000 4194304 4964704 140734242000160 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39172.5
Current children cumulated vsize (KiB) 2523000

[startup+4962.3 s]
/proc/loadavg: 8.06 8.04 7.96 9/222 5627
/proc/meminfo: memFree=2799616/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=2588536 CPUtime=39652.1 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 591423 0 0 0 3964522 687 0 0 25 0 8 0 545739715 2650660864 581264 33554432000 4194304 4964704 140734242000160 18446744073709551615 4320966 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/5471/statm: 647134 581264 466 189 0 641483 0
[pid=5471/tid=5473] ppid=5469 vsize=2588536 CPUtime=4955.9 cores=0-7
/proc/5471/task/5473/stat : 5473 (claspmt) R 5469 5471 5060 0 -1 4202560 44310 0 0 0 495533 57 0 0 25 0 8 0 545739856 2650660864 581264 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=5471/tid=5474] ppid=5469 vsize=2588536 CPUtime=4960.62 cores=0-7
/proc/5471/task/5474/stat : 5474 (claspmt) R 5469 5471 5060 0 -1 4202560 36011 0 0 0 496027 35 0 0 25 0 8 0 545739856 2650660864 581264 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=5471/tid=5475] ppid=5469 vsize=2588536 CPUtime=4960.66 cores=0-7
/proc/5471/task/5475/stat : 5475 (claspmt) R 5469 5471 5060 0 -1 4202560 20890 0 0 0 496039 27 0 0 25 0 8 0 545739856 2650660864 581264 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5471/tid=5476] ppid=5469 vsize=2588536 CPUtime=4943.18 cores=0-7
/proc/5471/task/5476/stat : 5476 (claspmt) R 5469 5471 5060 0 -1 4202560 39252 0 0 0 494258 60 0 0 25 0 8 0 545739856 2650660864 581264 33554432000 4194304 4964704 140734242000160 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=5471/tid=5477] ppid=5469 vsize=2588536 CPUtime=4960.19 cores=0-7
/proc/5471/task/5477/stat : 5477 (claspmt) R 5469 5471 5060 0 -1 4202560 25424 0 0 0 495992 27 0 0 25 0 8 0 545739856 2650660864 581264 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=5471/tid=5478] ppid=5469 vsize=2588536 CPUtime=4950.47 cores=0-7
/proc/5471/task/5478/stat : 5478 (claspmt) R 5469 5471 5060 0 -1 4202560 18234 0 0 0 495023 24 0 0 25 0 8 0 545739856 2650660864 581264 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5471/tid=5479] ppid=5469 vsize=2588536 CPUtime=4959.87 cores=0-7
/proc/5471/task/5479/stat : 5479 (claspmt) R 5469 5471 5060 0 -1 4202560 335702 0 0 0 495628 359 0 0 25 0 8 0 545739856 2650660864 581264 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39652.1
Current children cumulated vsize (KiB) 2588536



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5005.9 s]
/proc/loadavg: 8.02 8.03 7.96 9/222 5628
/proc/meminfo: memFree=2794912/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=2588536 CPUtime=40000.7 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 592585 0 0 0 3999379 687 0 0 25 0 8 0 545739715 2650660864 582426 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/5471/statm: 647134 582426 466 189 0 641483 0
[pid=5471/tid=5473] ppid=5469 vsize=2588536 CPUtime=4999.51 cores=0-7
/proc/5471/task/5473/stat : 5473 (claspmt) R 5469 5471 5060 0 -1 4202560 45316 0 0 0 499893 58 0 0 25 0 8 0 545739856 2650660864 582426 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=5471/tid=5474] ppid=5469 vsize=2588536 CPUtime=5004.23 cores=0-7
/proc/5471/task/5474/stat : 5474 (claspmt) R 5469 5471 5060 0 -1 4202560 36011 0 0 0 500388 35 0 0 25 0 8 0 545739856 2650660864 582426 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=5471/tid=5475] ppid=5469 vsize=2588536 CPUtime=5004.27 cores=0-7
/proc/5471/task/5475/stat : 5475 (claspmt) R 5469 5471 5060 0 -1 4202560 20891 0 0 0 500400 27 0 0 25 0 8 0 545739856 2650660864 582426 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=5471/tid=5476] ppid=5469 vsize=2588536 CPUtime=4986.51 cores=0-7
/proc/5471/task/5476/stat : 5476 (claspmt) R 5469 5471 5060 0 -1 4202560 39252 0 0 0 498591 60 0 0 25 0 8 0 545739856 2650660864 582426 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=5471/tid=5477] ppid=5469 vsize=2588536 CPUtime=5003.8 cores=0-7
/proc/5471/task/5477/stat : 5477 (claspmt) R 5469 5471 5060 0 -1 4202560 25424 0 0 0 500353 27 0 0 25 0 8 0 545739856 2650660864 582426 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=5471/tid=5478] ppid=5469 vsize=2588536 CPUtime=4994.08 cores=0-7
/proc/5471/task/5478/stat : 5478 (claspmt) R 5469 5471 5060 0 -1 4202560 18234 0 0 0 499384 24 0 0 25 0 8 0 545739856 2650660864 582426 33554432000 4194304 4964704 140734242000160 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=5471/tid=5479] ppid=5469 vsize=2588536 CPUtime=5003.49 cores=0-7
/proc/5471/task/5479/stat : 5479 (claspmt) R 5469 5471 5060 0 -1 4202560 335857 0 0 0 499989 360 0 0 25 0 8 0 545739856 2650660864 582426 33554432000 4194304 4964704 140734242000160 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 2588536

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5006.2 s]
/proc/loadavg: 8.02 8.03 7.96 2/216 5629
/proc/meminfo: memFree=2803640/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=2580028 CPUtime=40001 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 592597 0 0 0 3999413 687 0 0 25 0 1 0 545739715 2641948672 578308 33554432000 4194304 4964704 140734242000160 18446744073709551615 244446601371 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/5471/statm: 645007 578308 476 189 0 639356 0
Current children cumulated CPU time (s) 40001
Current children cumulated vsize (KiB) 2580028

[startup+5006.6 s]
/proc/loadavg: 8.02 8.03 7.96 2/216 5629
/proc/meminfo: memFree=2803640/32951124 swapFree=67111524/67111528
[pid=5471] ppid=5469 vsize=2348308 CPUtime=40001.4 cores=0-7
/proc/5471/stat : 5471 (claspmt) R 5469 5471 5060 0 -1 4202496 592597 0 0 0 3999452 688 0 0 25 0 1 0 545739715 2404667392 509085 33554432000 4194304 4964704 140734242000160 18446744073709551615 244446970986 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/5471/statm: 587077 508573 476 189 0 581426 0
Current children cumulated CPU time (s) 40001.4
Current children cumulated vsize (KiB) 2348308

Child status: 0
Real time (s): 5006.68
CPU time (s): 40001.5
CPU user time (s): 39994.5
CPU system time (s): 6.96394
CPU usage (%): 798.962
Max. virtual memory (cumulated for all children) (KiB): 2588536

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39994.5
system time used= 6.96394
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 592598
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 54344
involuntary context switches= 189343

runsolver used 8.73667 second user time and 23.6754 second system time

The end

Launcher Data 

Begin job on node105 at 2011-05-02 15:03:13
IDJOB=3321475
IDBENCH=71270
IDSOLVER=1711
FILE ID=node105/3321475-1304341393
RUNJOBID= node105-1304335839-5074
PBS_JOBID= 13178020
Free space on /tmp= 73768 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v2400c266431g10.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321475-1304341393/watcher-3321475-1304341393 -o /tmp/evaluation-result-3321475-1304341393/solver-3321475-1304341393 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3321475-1304341393.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 885d1d8595262b8f0aa94d123211b47c
RANDOM SEED=1542514098

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       5125696 kB
Buffers:       2193980 kB
Cached:        6335748 kB
SwapCached:          4 kB
Active:       19962204 kB
Inactive:      7262592 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       5125696 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            4304 kB
Writeback:           0 kB
AnonPages:    18695000 kB
Mapped:          20552 kB
Slab:           493384 kB
PageTables:      45648 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 20954352 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73768 MiB
End job on node105 at 2011-05-02 16:26:41