Trace number 3321379

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 40001.2 5005.67

General information on the benchmark

NameAPPLICATIONS/bitverif/
countbitssrl/countbitssrl064.cnf
MD5SUM4f9c883534eb89cad9b9cad9e6eccbd0
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables75103
Number of clauses225116
Sum of the clauses size525268
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2150076
Number of clauses of size 375038
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...337603/instance-3321379-1304337603.cnf
0.59/0.64	c Solving...
40000.39/5004.92	
40000.39/5004.92	*** INTERRUPTED! ***
40000.39/5004.92	*** Shutting down threads...
40001.14/5005.66	s UNKNOWN
40001.14/5005.66	
40001.14/5005.66	c INTERRUPTED   : 1
40001.14/5005.66	c Models        : 0+    
40001.14/5005.66	c Time          : 5004.927s (Solving: 5004.29s 1st Model: 0.00s Unsat: 0.00s)
40001.14/5005.66	c CPU Time      : 40000.470s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321379-1304337603/watcher-3321379-1304337603 -o /tmp/evaluation-result-3321379-1304337603/solver-3321379-1304337603 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3321379-1304337603.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.04 7.73 6.96 1/192 30514
/proc/meminfo: memFree=17173932/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=30404 CPUtime=0 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 1503 0 0 0 0 0 0 0 25 0 1 0 545360767 31133696 1433 33554432000 4194304 4964704 140734663289440 18446744073709551615 4700332 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/30514/statm: 7601 1441 376 189 0 2475 0

[startup+0.0313331 s]
/proc/loadavg: 8.04 7.73 6.96 1/192 30514
/proc/meminfo: memFree=17173932/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=38432 CPUtime=0.02 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 5575 0 0 0 2 0 0 0 25 0 1 0 545360767 39354368 4747 33554432000 4194304 4964704 140734663289440 18446744073709551615 230808826565 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/30514/statm: 9608 4748 386 189 0 4482 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 38432

[startup+0.100318 s]
/proc/loadavg: 8.04 7.73 6.96 1/192 30514
/proc/meminfo: memFree=17173932/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=53388 CPUtime=0.09 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 10797 0 0 0 8 1 0 0 25 0 1 0 545360767 54669312 8257 33554432000 4194304 4964704 140734663289440 18446744073709551615 4615998 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/30514/statm: 13347 8257 399 189 0 8221 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 53388

[startup+0.300284 s]
/proc/loadavg: 8.04 7.73 6.96 1/192 30514
/proc/meminfo: memFree=17173932/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=63288 CPUtime=0.29 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 13206 0 0 0 28 1 0 0 25 0 1 0 545360767 64806912 10666 33554432000 4194304 4964704 140734663289440 18446744073709551615 4615610 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/30514/statm: 15822 10666 404 189 0 10696 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 63288

[startup+0.700174 s]
/proc/loadavg: 8.04 7.73 6.96 1/192 30514
/proc/meminfo: memFree=17173932/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=520360 CPUtime=0.75 cores=0-7
/proc/30514/stat : 30514 (claspmt) S 30512 30514 30238 0 -1 4202496 32826 0 0 0 67 8 0 0 18 0 8 0 545360767 532848640 25001 33554432000 4194304 4964704 140734663289440 18446744073709551615 230820981657 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/30514/statm: 130090 25012 435 189 0 124439 0
Current children cumulated CPU time (s) 0.75
Current children cumulated vsize (KiB) 520360

[startup+1.50103 s]
/proc/loadavg: 8.04 7.73 6.96 2/200 30522
/proc/meminfo: memFree=17056448/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=522032 CPUtime=3.79 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 38805 0 0 0 367 12 0 0 16 0 8 0 545360767 534560768 30980 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668635 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/30514/statm: 130508 30980 461 189 0 124857 0
[pid=30514/tid=30516] ppid=30512 vsize=522032 CPUtime=0.34 cores=0-7
/proc/30514/task/30516/stat : 30516 (claspmt) R 30512 30514 30238 0 -1 4202560 2728 0 0 0 33 1 0 0 16 0 8 0 545360831 534560768 30980 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30514/tid=30517] ppid=30512 vsize=522032 CPUtime=0.35 cores=0-7
/proc/30514/task/30517/stat : 30517 (claspmt) R 30512 30514 30238 0 -1 4202560 3845 0 0 0 34 1 0 0 16 0 8 0 545360831 534560768 30980 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30514/tid=30518] ppid=30512 vsize=522032 CPUtime=0.32 cores=0-7
/proc/30514/task/30518/stat : 30518 (claspmt) R 30512 30514 30238 0 -1 4202560 3609 0 0 0 31 1 0 0 16 0 8 0 545360831 534560768 30980 33554432000 4194304 4964704 140734663289440 18446744073709551615 4683933 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30514/tid=30519] ppid=30512 vsize=522032 CPUtime=0.32 cores=0-7
/proc/30514/task/30519/stat : 30519 (claspmt) R 30512 30514 30238 0 -1 4202560 2876 0 0 0 31 1 0 0 16 0 8 0 545360831 534560768 30980 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668693 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30514/tid=30520] ppid=30512 vsize=522032 CPUtime=0.78 cores=0-7
/proc/30514/task/30520/stat : 30520 (claspmt) R 30512 30514 30238 0 -1 4202560 3682 0 0 0 77 1 0 0 18 0 8 0 545360831 534560768 30980 33554432000 4194304 4964704 140734663289440 18446744073709551615 4402864 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30514/tid=30521] ppid=30512 vsize=522032 CPUtime=0.34 cores=0-7
/proc/30514/task/30521/stat : 30521 (claspmt) R 30512 30514 30238 0 -1 4202560 3498 0 0 0 33 1 0 0 16 0 8 0 545360831 534560768 30980 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30514/tid=30522] ppid=30512 vsize=522032 CPUtime=0.35 cores=0-7
/proc/30514/task/30522/stat : 30522 (claspmt) R 30512 30514 30238 0 -1 4202560 3554 0 0 0 34 1 0 0 16 0 8 0 545360831 534560768 30980 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3.79
Current children cumulated vsize (KiB) 522032

[startup+3.10074 s]
/proc/loadavg: 8.04 7.73 6.96 11/200 30522
/proc/meminfo: memFree=17050496/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=522428 CPUtime=16.58 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 40660 0 0 0 1644 14 0 0 18 0 8 0 545360767 534966272 32835 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668635 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/30514/statm: 130607 32835 464 189 0 124956 0
[pid=30514/tid=30516] ppid=30512 vsize=522428 CPUtime=1.94 cores=0-7
/proc/30514/task/30516/stat : 30516 (claspmt) R 30512 30514 30238 0 -1 4202560 2860 0 0 0 193 1 0 0 18 0 8 0 545360831 534966272 32835 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668907 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30514/tid=30517] ppid=30512 vsize=522428 CPUtime=1.94 cores=0-7
/proc/30514/task/30517/stat : 30517 (claspmt) R 30512 30514 30238 0 -1 4202560 4017 0 0 0 193 1 0 0 18 0 8 0 545360831 534966272 32835 33554432000 4194304 4964704 140734663289440 18446744073709551615 4669192 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30514/tid=30518] ppid=30512 vsize=522428 CPUtime=1.92 cores=0-7
/proc/30514/task/30518/stat : 30518 (claspmt) R 30512 30514 30238 0 -1 4202560 3695 0 0 0 191 1 0 0 18 0 8 0 545360831 534966272 32835 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30514/tid=30519] ppid=30512 vsize=522428 CPUtime=1.92 cores=0-7
/proc/30514/task/30519/stat : 30519 (claspmt) R 30512 30514 30238 0 -1 4202560 3092 0 0 0 190 2 0 0 18 0 8 0 545360831 534966272 32835 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30514/tid=30520] ppid=30512 vsize=522428 CPUtime=2.38 cores=0-7
/proc/30514/task/30520/stat : 30520 (claspmt) R 30512 30514 30238 0 -1 4202560 3683 0 0 0 237 1 0 0 22 0 8 0 545360831 534966272 32835 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30514/tid=30521] ppid=30512 vsize=522428 CPUtime=1.94 cores=0-7
/proc/30514/task/30521/stat : 30521 (claspmt) R 30512 30514 30238 0 -1 4202560 3736 0 0 0 193 1 0 0 18 0 8 0 545360831 534966272 32835 33554432000 4194304 4964704 140734663289440 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30514/tid=30522] ppid=30512 vsize=522428 CPUtime=1.95 cores=0-7
/proc/30514/task/30522/stat : 30522 (claspmt) R 30512 30514 30238 0 -1 4202560 4499 0 0 0 193 2 0 0 18 0 8 0 545360831 534966272 32835 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 16.58
Current children cumulated vsize (KiB) 522428

[startup+6.30115 s]
/proc/loadavg: 8.28 7.78 6.99 9/200 30522
/proc/meminfo: memFree=17031276/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=524288 CPUtime=42.17 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 45679 0 0 0 4198 19 0 0 25 0 8 0 545360767 536870912 37854 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/30514/statm: 131072 37854 464 189 0 125421 0
[pid=30514/tid=30516] ppid=30512 vsize=524288 CPUtime=5.15 cores=0-7
/proc/30514/task/30516/stat : 30516 (claspmt) R 30512 30514 30238 0 -1 4202560 3278 0 0 0 513 2 0 0 25 0 8 0 545360831 536870912 37854 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30514/tid=30517] ppid=30512 vsize=524288 CPUtime=5.11 cores=0-7
/proc/30514/task/30517/stat : 30517 (claspmt) R 30512 30514 30238 0 -1 4202560 4734 0 0 0 510 1 0 0 25 0 8 0 545360831 536870912 37854 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668907 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30514/tid=30518] ppid=30512 vsize=524288 CPUtime=5.12 cores=0-7
/proc/30514/task/30518/stat : 30518 (claspmt) R 30512 30514 30238 0 -1 4202560 4473 0 0 0 511 1 0 0 25 0 8 0 545360831 536870912 37854 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30514/tid=30519] ppid=30512 vsize=524288 CPUtime=5.11 cores=0-7
/proc/30514/task/30519/stat : 30519 (claspmt) R 30512 30514 30238 0 -1 4202560 3729 0 0 0 509 2 0 0 25 0 8 0 545360831 536870912 37854 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30514/tid=30520] ppid=30512 vsize=524288 CPUtime=5.58 cores=0-7
/proc/30514/task/30520/stat : 30520 (claspmt) R 30512 30514 30238 0 -1 4202560 3688 0 0 0 557 1 0 0 25 0 8 0 545360831 536870912 37854 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30514/tid=30521] ppid=30512 vsize=524288 CPUtime=5.13 cores=0-7
/proc/30514/task/30521/stat : 30521 (claspmt) R 30512 30514 30238 0 -1 4202560 4426 0 0 0 512 1 0 0 25 0 8 0 545360831 536870912 37854 33554432000 4194304 4964704 140734663289440 18446744073709551615 4361293 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30514/tid=30522] ppid=30512 vsize=524288 CPUtime=5.15 cores=0-7
/proc/30514/task/30522/stat : 30522 (claspmt) R 30512 30514 30238 0 -1 4202560 5897 0 0 0 512 3 0 0 25 0 8 0 545360831 536870912 37854 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 42.17
Current children cumulated vsize (KiB) 524288

[startup+12.701 s]
/proc/loadavg: 8.25 7.78 6.99 9/200 30522
/proc/meminfo: memFree=16994844/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=533348 CPUtime=93.33 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 54807 0 0 0 9307 26 0 0 25 0 8 0 545360767 546148352 46982 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668928 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/30514/statm: 133337 46982 464 189 0 127686 0
[pid=30514/tid=30516] ppid=30512 vsize=533348 CPUtime=11.54 cores=0-7
/proc/30514/task/30516/stat : 30516 (claspmt) R 30512 30514 30238 0 -1 4202560 3618 0 0 0 1152 2 0 0 25 0 8 0 545360831 546148352 46982 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30514/tid=30517] ppid=30512 vsize=533348 CPUtime=11.48 cores=0-7
/proc/30514/task/30517/stat : 30517 (claspmt) R 30512 30514 30238 0 -1 4202560 6308 0 0 0 1145 3 0 0 25 0 8 0 545360831 546148352 46982 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670114 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30514/tid=30518] ppid=30512 vsize=533348 CPUtime=11.52 cores=0-7
/proc/30514/task/30518/stat : 30518 (claspmt) R 30512 30514 30238 0 -1 4202560 5546 0 0 0 1150 2 0 0 25 0 8 0 545360831 546148352 46982 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30514/tid=30519] ppid=30512 vsize=533348 CPUtime=11.52 cores=0-7
/proc/30514/task/30519/stat : 30519 (claspmt) R 30512 30514 30238 0 -1 4202560 4936 0 0 0 1148 4 0 0 25 0 8 0 545360831 546148352 46982 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30514/tid=30520] ppid=30512 vsize=533348 CPUtime=11.98 cores=0-7
/proc/30514/task/30520/stat : 30520 (claspmt) R 30512 30514 30238 0 -1 4202560 3695 0 0 0 1197 1 0 0 25 0 8 0 545360831 546148352 46982 33554432000 4194304 4964704 140734663289440 18446744073709551615 4399611 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30514/tid=30521] ppid=30512 vsize=533348 CPUtime=11.54 cores=0-7
/proc/30514/task/30521/stat : 30521 (claspmt) R 30512 30514 30238 0 -1 4202560 5171 0 0 0 1152 2 0 0 25 0 8 0 545360831 546148352 46982 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30514/tid=30522] ppid=30512 vsize=533348 CPUtime=11.56 cores=0-7
/proc/30514/task/30522/stat : 30522 (claspmt) R 30512 30514 30238 0 -1 4202560 9460 0 0 0 1151 5 0 0 25 0 8 0 545360831 546148352 46982 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 93.33
Current children cumulated vsize (KiB) 533348

[startup+25.5006 s]
/proc/loadavg: 8.20 7.79 7.01 9/200 30522
/proc/meminfo: memFree=16947128/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=534148 CPUtime=195.65 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 66522 0 0 0 19530 35 0 0 25 0 8 0 545360767 546967552 58697 33554432000 4194304 4964704 140734663289440 18446744073709551615 4660755 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/30514/statm: 133537 58697 466 189 0 127886 0
[pid=30514/tid=30516] ppid=30512 vsize=534148 CPUtime=24.34 cores=0-7
/proc/30514/task/30516/stat : 30516 (claspmt) R 30512 30514 30238 0 -1 4202560 3951 0 0 0 2432 2 0 0 25 0 8 0 545360831 546967552 58697 33554432000 4194304 4964704 140734663289440 18446744073709551615 4653282 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30514/tid=30517] ppid=30512 vsize=534148 CPUtime=24.2 cores=0-7
/proc/30514/task/30517/stat : 30517 (claspmt) R 30512 30514 30238 0 -1 4202560 6989 0 0 0 2416 4 0 0 25 0 8 0 545360831 546967552 58697 33554432000 4194304 4964704 140734663289440 18446744073709551615 4660415 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30514/tid=30518] ppid=30512 vsize=534148 CPUtime=24.32 cores=0-7
/proc/30514/task/30518/stat : 30518 (claspmt) R 30512 30514 30238 0 -1 4202560 5915 0 0 0 2430 2 0 0 25 0 8 0 545360831 546967552 58697 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30514/tid=30519] ppid=30512 vsize=534148 CPUtime=24.32 cores=0-7
/proc/30514/task/30519/stat : 30519 (claspmt) R 30512 30514 30238 0 -1 4202560 5488 0 0 0 2428 4 0 0 25 0 8 0 545360831 546967552 58697 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30514/tid=30520] ppid=30512 vsize=534148 CPUtime=24.79 cores=0-7
/proc/30514/task/30520/stat : 30520 (claspmt) R 30512 30514 30238 0 -1 4202560 4542 0 0 0 2477 2 0 0 25 0 8 0 545360831 546967552 58697 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30514/tid=30521] ppid=30512 vsize=534148 CPUtime=24.33 cores=0-7
/proc/30514/task/30521/stat : 30521 (claspmt) R 30512 30514 30238 0 -1 4202560 6003 0 0 0 2430 3 0 0 25 0 8 0 545360831 546967552 58697 33554432000 4194304 4964704 140734663289440 18446744073709551615 4684117 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30514/tid=30522] ppid=30512 vsize=534148 CPUtime=24.35 cores=0-7
/proc/30514/task/30522/stat : 30522 (claspmt) R 30512 30514 30238 0 -1 4202560 17236 0 0 0 2425 10 0 0 25 0 8 0 545360831 546967552 58697 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668907 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 195.65
Current children cumulated vsize (KiB) 534148

[startup+51.101 s]
/proc/loadavg: 8.13 7.81 7.03 9/200 30523
/proc/meminfo: memFree=16832416/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=601064 CPUtime=400.3 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 96495 0 0 0 39977 53 0 0 25 0 8 0 545360767 615489536 87237 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668488 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/30514/statm: 150266 87237 466 189 0 144615 0
[pid=30514/tid=30516] ppid=30512 vsize=601064 CPUtime=49.94 cores=0-7
/proc/30514/task/30516/stat : 30516 (claspmt) R 30512 30514 30238 0 -1 4202560 4202 0 0 0 4991 3 0 0 25 0 8 0 545360831 615489536 87237 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30514/tid=30517] ppid=30512 vsize=601064 CPUtime=49.66 cores=0-7
/proc/30514/task/30517/stat : 30517 (claspmt) R 30512 30514 30238 0 -1 4202560 8884 0 0 0 4959 7 0 0 25 0 8 0 545360831 615489536 87237 33554432000 4194304 4964704 140734663289440 18446744073709551615 4321082 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30514/tid=30518] ppid=30512 vsize=601064 CPUtime=49.92 cores=0-7
/proc/30514/task/30518/stat : 30518 (claspmt) R 30512 30514 30238 0 -1 4202560 5968 0 0 0 4989 3 0 0 25 0 8 0 545360831 615489536 87237 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30514/tid=30519] ppid=30512 vsize=601064 CPUtime=49.92 cores=0-7
/proc/30514/task/30519/stat : 30519 (claspmt) R 30512 30514 30238 0 -1 4202560 7003 0 0 0 4986 6 0 0 25 0 8 0 545360831 615489536 87237 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30514/tid=30520] ppid=30512 vsize=601064 CPUtime=50.38 cores=0-7
/proc/30514/task/30520/stat : 30520 (claspmt) R 30512 30514 30238 0 -1 4202560 6334 0 0 0 5035 3 0 0 25 0 8 0 545360831 615489536 87237 33554432000 4194304 4964704 140734663289440 18446744073709551615 4324688 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30514/tid=30521] ppid=30512 vsize=601064 CPUtime=49.93 cores=0-7
/proc/30514/task/30521/stat : 30521 (claspmt) R 30512 30514 30238 0 -1 4202560 6972 0 0 0 4989 4 0 0 25 0 8 0 545360831 615489536 87237 33554432000 4194304 4964704 140734663289440 18446744073709551615 4669429 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30514/tid=30522] ppid=30512 vsize=601064 CPUtime=49.95 cores=0-7
/proc/30514/task/30522/stat : 30522 (claspmt) R 30512 30514 30238 0 -1 4202560 40072 0 0 0 4976 19 0 0 25 0 8 0 545360831 615489536 87238 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 400.3

################
# More data... #
################

/proc/30514/task/30521/stat : 30521 (claspmt) R 30512 30514 30238 0 -1 4202560 11323 0 0 0 466099 11 0 0 25 0 8 0 545360831 4478803968 1054846 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30514/tid=30522] ppid=30512 vsize=4373832 CPUtime=4661.08 cores=0-7
/proc/30514/task/30522/stat : 30522 (claspmt) R 30512 30514 30238 0 -1 4202560 961298 0 0 0 465606 502 0 0 25 0 8 0 545360831 4478803968 1054846 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37261.5
Current children cumulated vsize (KiB) 4373832

[startup+4722.31 s]
/proc/loadavg: 8.06 8.03 8.00 9/200 30672
/proc/meminfo: memFree=12882436/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=4504904 CPUtime=37741.2 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 1201529 0 0 0 3773390 730 0 0 25 0 8 0 545360767 4613021696 1072084 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/30514/statm: 1126226 1072084 466 189 0 1120575 0
[pid=30514/tid=30516] ppid=30512 vsize=4504904 CPUtime=4720.71 cores=0-7
/proc/30514/task/30516/stat : 30516 (claspmt) R 30512 30514 30238 0 -1 4202560 7484 0 0 0 472060 11 0 0 25 0 8 0 545360831 4613021696 1072084 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30514/tid=30517] ppid=30512 vsize=4504904 CPUtime=4694.78 cores=0-7
/proc/30514/task/30517/stat : 30517 (claspmt) R 30512 30514 30238 0 -1 4202560 31933 0 0 0 469440 38 0 0 25 0 8 0 545360831 4613021696 1072084 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30514/tid=30518] ppid=30512 vsize=4504904 CPUtime=4720.6 cores=0-7
/proc/30514/task/30518/stat : 30518 (claspmt) R 30512 30514 30238 0 -1 4202560 11690 0 0 0 472050 10 0 0 25 0 8 0 545360831 4613021696 1072084 33554432000 4194304 4964704 140734663289440 18446744073709551615 4627281 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30514/tid=30519] ppid=30512 vsize=4504904 CPUtime=4721.06 cores=0-7
/proc/30514/task/30519/stat : 30519 (claspmt) R 30512 30514 30238 0 -1 4202560 59978 0 0 0 472045 61 0 0 25 0 8 0 545360831 4613021696 1072084 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30514/tid=30520] ppid=30512 vsize=4504904 CPUtime=4721.62 cores=0-7
/proc/30514/task/30520/stat : 30520 (claspmt) R 30512 30514 30238 0 -1 4202560 70701 0 0 0 472099 63 0 0 25 0 8 0 545360831 4613021696 1072084 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30514/tid=30521] ppid=30512 vsize=4504904 CPUtime=4721.1 cores=0-7
/proc/30514/task/30521/stat : 30521 (claspmt) R 30512 30514 30238 0 -1 4202560 11323 0 0 0 472099 11 0 0 25 0 8 0 545360831 4613021696 1072084 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30514/tid=30522] ppid=30512 vsize=4504904 CPUtime=4721.08 cores=0-7
/proc/30514/task/30522/stat : 30522 (claspmt) R 30512 30514 30238 0 -1 4202560 981892 0 0 0 471595 513 0 0 25 0 8 0 545360831 4613021696 1072084 33554432000 4194304 4964704 140734663289440 18446744073709551615 4660755 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37741.2
Current children cumulated vsize (KiB) 4504904

[startup+4782.3 s]
/proc/loadavg: 8.07 8.04 8.00 9/200 30673
/proc/meminfo: memFree=12882528/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=4504904 CPUtime=38220.8 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 1201529 0 0 0 3821351 730 0 0 25 0 8 0 545360767 4613021696 1072084 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670100 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/30514/statm: 1126226 1072084 466 189 0 1120575 0
[pid=30514/tid=30516] ppid=30512 vsize=4504904 CPUtime=4780.71 cores=0-7
/proc/30514/task/30516/stat : 30516 (claspmt) R 30512 30514 30238 0 -1 4202560 7484 0 0 0 478060 11 0 0 25 0 8 0 545360831 4613021696 1072084 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30514/tid=30517] ppid=30512 vsize=4504904 CPUtime=4754.45 cores=0-7
/proc/30514/task/30517/stat : 30517 (claspmt) R 30512 30514 30238 0 -1 4202560 31933 0 0 0 475407 38 0 0 25 0 8 0 545360831 4613021696 1072084 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30514/tid=30518] ppid=30512 vsize=4504904 CPUtime=4780.59 cores=0-7
/proc/30514/task/30518/stat : 30518 (claspmt) R 30512 30514 30238 0 -1 4202560 11690 0 0 0 478049 10 0 0 25 0 8 0 545360831 4613021696 1072084 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30514/tid=30519] ppid=30512 vsize=4504904 CPUtime=4781.05 cores=0-7
/proc/30514/task/30519/stat : 30519 (claspmt) R 30512 30514 30238 0 -1 4202560 59978 0 0 0 478044 61 0 0 25 0 8 0 545360831 4613021696 1072084 33554432000 4194304 4964704 140734663289440 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30514/tid=30520] ppid=30512 vsize=4504904 CPUtime=4781.61 cores=0-7
/proc/30514/task/30520/stat : 30520 (claspmt) R 30512 30514 30238 0 -1 4202560 70701 0 0 0 478098 63 0 0 25 0 8 0 545360831 4613021696 1072084 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30514/tid=30521] ppid=30512 vsize=4504904 CPUtime=4781.09 cores=0-7
/proc/30514/task/30521/stat : 30521 (claspmt) R 30512 30514 30238 0 -1 4202560 11323 0 0 0 478098 11 0 0 25 0 8 0 545360831 4613021696 1072084 33554432000 4194304 4964704 140734663289440 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30514/tid=30522] ppid=30512 vsize=4504904 CPUtime=4781.07 cores=0-7
/proc/30514/task/30522/stat : 30522 (claspmt) R 30512 30514 30238 0 -1 4202560 981892 0 0 0 477594 513 0 0 25 0 8 0 545360831 4613021696 1072084 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668618 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38220.8
Current children cumulated vsize (KiB) 4504904

[startup+4842.3 s]
/proc/loadavg: 8.07 8.04 8.00 9/200 30675
/proc/meminfo: memFree=12822108/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=4565036 CPUtime=38700.5 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 1217041 0 0 0 3869312 736 0 0 25 0 8 0 545360767 4674596864 1087206 33554432000 4194304 4964704 140734663289440 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/30514/statm: 1141259 1087206 466 189 0 1135608 0
[pid=30514/tid=30516] ppid=30512 vsize=4565036 CPUtime=4840.71 cores=0-7
/proc/30514/task/30516/stat : 30516 (claspmt) R 30512 30514 30238 0 -1 4202560 7484 0 0 0 484060 11 0 0 25 0 8 0 545360831 4674596864 1087206 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30514/tid=30517] ppid=30512 vsize=4565036 CPUtime=4814.12 cores=0-7
/proc/30514/task/30517/stat : 30517 (claspmt) R 30512 30514 30238 0 -1 4202560 31966 0 0 0 481374 38 0 0 25 0 8 0 545360831 4674596864 1087206 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670269 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30514/tid=30518] ppid=30512 vsize=4565036 CPUtime=4840.58 cores=0-7
/proc/30514/task/30518/stat : 30518 (claspmt) R 30512 30514 30238 0 -1 4202560 11690 0 0 0 484048 10 0 0 25 0 8 0 545360831 4674596864 1087206 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30514/tid=30519] ppid=30512 vsize=4565036 CPUtime=4841.05 cores=0-7
/proc/30514/task/30519/stat : 30519 (claspmt) R 30512 30514 30238 0 -1 4202560 60047 0 0 0 484043 62 0 0 25 0 8 0 545360831 4674596864 1087206 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30514/tid=30520] ppid=30512 vsize=4565036 CPUtime=4841.61 cores=0-7
/proc/30514/task/30520/stat : 30520 (claspmt) R 30512 30514 30238 0 -1 4202560 70724 0 0 0 484098 63 0 0 25 0 8 0 545360831 4674596864 1087206 33554432000 4194304 4964704 140734663289440 18446744073709551615 4669051 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30514/tid=30521] ppid=30512 vsize=4565036 CPUtime=4841.1 cores=0-7
/proc/30514/task/30521/stat : 30521 (claspmt) R 30512 30514 30238 0 -1 4202560 11323 0 0 0 484099 11 0 0 25 0 8 0 545360831 4674596864 1087206 33554432000 4194304 4964704 140734663289440 18446744073709551615 4320848 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30514/tid=30522] ppid=30512 vsize=4565036 CPUtime=4841.07 cores=0-7
/proc/30514/task/30522/stat : 30522 (claspmt) R 30512 30514 30238 0 -1 4202560 997279 0 0 0 483589 518 0 0 25 0 8 0 545360831 4674596864 1087206 33554432000 4194304 4964704 140734663289440 18446744073709551615 4653154 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38700.5
Current children cumulated vsize (KiB) 4565036

[startup+4902.3 s]
/proc/loadavg: 8.02 8.03 8.00 9/200 30676
/proc/meminfo: memFree=12822200/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=4565036 CPUtime=39180.1 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 1217041 0 0 0 3917269 737 0 0 25 0 8 0 545360767 4674596864 1087206 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670100 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/30514/statm: 1141259 1087206 466 189 0 1135608 0
[pid=30514/tid=30516] ppid=30512 vsize=4565036 CPUtime=4900.56 cores=0-7
/proc/30514/task/30516/stat : 30516 (claspmt) R 30512 30514 30238 0 -1 4202560 7484 0 0 0 490045 11 0 0 25 0 8 0 545360831 4674596864 1087206 33554432000 4194304 4964704 140734663289440 18446744073709551615 4669277 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30514/tid=30517] ppid=30512 vsize=4565036 CPUtime=4873.86 cores=0-7
/proc/30514/task/30517/stat : 30517 (claspmt) R 30512 30514 30238 0 -1 4202560 31966 0 0 0 487348 38 0 0 25 0 8 0 545360831 4674596864 1087206 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30514/tid=30518] ppid=30512 vsize=4565036 CPUtime=4900.57 cores=0-7
/proc/30514/task/30518/stat : 30518 (claspmt) R 30512 30514 30238 0 -1 4202560 11690 0 0 0 490047 10 0 0 25 0 8 0 545360831 4674596864 1087206 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30514/tid=30519] ppid=30512 vsize=4565036 CPUtime=4901.05 cores=0-7
/proc/30514/task/30519/stat : 30519 (claspmt) R 30512 30514 30238 0 -1 4202560 60047 0 0 0 490043 62 0 0 25 0 8 0 545360831 4674596864 1087206 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30514/tid=30520] ppid=30512 vsize=4565036 CPUtime=4901.61 cores=0-7
/proc/30514/task/30520/stat : 30520 (claspmt) R 30512 30514 30238 0 -1 4202560 70724 0 0 0 490098 63 0 0 25 0 8 0 545360831 4674596864 1087206 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30514/tid=30521] ppid=30512 vsize=4565036 CPUtime=4901.09 cores=0-7
/proc/30514/task/30521/stat : 30521 (claspmt) R 30512 30514 30238 0 -1 4202560 11323 0 0 0 490098 11 0 0 25 0 8 0 545360831 4674596864 1087206 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30514/tid=30522] ppid=30512 vsize=4565036 CPUtime=4901.07 cores=0-7
/proc/30514/task/30522/stat : 30522 (claspmt) R 30512 30514 30238 0 -1 4202560 997279 0 0 0 489589 518 0 0 25 0 8 0 545360831 4674596864 1087206 33554432000 4194304 4964704 140734663289440 18446744073709551615 4360553 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39180.1
Current children cumulated vsize (KiB) 4565036

[startup+4962.3 s]
/proc/loadavg: 8.01 8.02 8.00 9/200 30678
/proc/meminfo: memFree=12732268/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=4696108 CPUtime=39659.7 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 1239596 0 0 0 3965223 749 0 0 25 0 8 0 545360767 4808814592 1109761 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/30514/statm: 1174027 1109761 466 189 0 1168376 0
[pid=30514/tid=30516] ppid=30512 vsize=4696108 CPUtime=4960.22 cores=0-7
/proc/30514/task/30516/stat : 30516 (claspmt) R 30512 30514 30238 0 -1 4202560 7484 0 0 0 496011 11 0 0 25 0 8 0 545360831 4808814592 1109761 33554432000 4194304 4964704 140734663289440 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30514/tid=30517] ppid=30512 vsize=4696108 CPUtime=4933.86 cores=0-7
/proc/30514/task/30517/stat : 30517 (claspmt) R 30512 30514 30238 0 -1 4202560 31974 0 0 0 493348 38 0 0 25 0 8 0 545360831 4808814592 1109761 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30514/tid=30518] ppid=30512 vsize=4696108 CPUtime=4960.56 cores=0-7
/proc/30514/task/30518/stat : 30518 (claspmt) R 30512 30514 30238 0 -1 4202560 11690 0 0 0 496046 10 0 0 25 0 8 0 545360831 4808814592 1109761 33554432000 4194304 4964704 140734663289440 18446744073709551615 230808863370 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30514/tid=30519] ppid=30512 vsize=4696108 CPUtime=4961.05 cores=0-7
/proc/30514/task/30519/stat : 30519 (claspmt) R 30512 30514 30238 0 -1 4202560 60047 0 0 0 496043 62 0 0 25 0 8 0 545360831 4808814592 1109761 33554432000 4194304 4964704 140734663289440 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30514/tid=30520] ppid=30512 vsize=4696108 CPUtime=4961.62 cores=0-7
/proc/30514/task/30520/stat : 30520 (claspmt) R 30512 30514 30238 0 -1 4202560 70724 0 0 0 496099 63 0 0 25 0 8 0 545360831 4808814592 1109761 33554432000 4194304 4964704 140734663289440 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30514/tid=30521] ppid=30512 vsize=4696108 CPUtime=4961.09 cores=0-7
/proc/30514/task/30521/stat : 30521 (claspmt) R 30512 30514 30238 0 -1 4202560 11323 0 0 0 496098 11 0 0 25 0 8 0 545360831 4808814592 1109761 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668464 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30514/tid=30522] ppid=30512 vsize=4696108 CPUtime=4961.07 cores=0-7
/proc/30514/task/30522/stat : 30522 (claspmt) R 30512 30514 30238 0 -1 4202560 1019821 0 0 0 495577 530 0 0 25 0 8 0 545360831 4808814592 1109761 33554432000 4194304 4964704 140734663289440 18446744073709551615 4365674 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39659.7
Current children cumulated vsize (KiB) 4696108



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5004.9 s]
/proc/loadavg: 8.00 8.02 8.00 9/200 30679
/proc/meminfo: memFree=12731884/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=4696108 CPUtime=40000.4 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 1239714 0 0 0 3999290 749 0 0 25 0 8 0 545360767 4808814592 1109879 33554432000 4194304 4964704 140734663289440 18446744073709551615 4668654 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/30514/statm: 1174027 1109879 466 189 0 1168376 0
[pid=30514/tid=30516] ppid=30512 vsize=4696108 CPUtime=5002.6 cores=0-7
/proc/30514/task/30516/stat : 30516 (claspmt) R 30512 30514 30238 0 -1 4202560 7484 0 0 0 500249 11 0 0 25 0 8 0 545360831 4808814592 1109879 33554432000 4194304 4964704 140734663289440 18446744073709551615 4653475 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=30514/tid=30517] ppid=30512 vsize=4696108 CPUtime=4976.47 cores=0-7
/proc/30514/task/30517/stat : 30517 (claspmt) R 30512 30514 30238 0 -1 4202560 32077 0 0 0 497609 38 0 0 25 0 8 0 545360831 4808814592 1109879 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=30514/tid=30518] ppid=30512 vsize=4696108 CPUtime=5003.17 cores=0-7
/proc/30514/task/30518/stat : 30518 (claspmt) R 30512 30514 30238 0 -1 4202560 11690 0 0 0 500307 10 0 0 25 0 8 0 545360831 4808814592 1109879 33554432000 4194304 4964704 140734663289440 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30514/tid=30519] ppid=30512 vsize=4696108 CPUtime=5003.67 cores=0-7
/proc/30514/task/30519/stat : 30519 (claspmt) R 30512 30514 30238 0 -1 4202560 60062 0 0 0 500305 62 0 0 25 0 8 0 545360831 4808814592 1109879 33554432000 4194304 4964704 140734663289440 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=30514/tid=30520] ppid=30512 vsize=4696108 CPUtime=5004.23 cores=0-7
/proc/30514/task/30520/stat : 30520 (claspmt) R 30512 30514 30238 0 -1 4202560 70724 0 0 0 500360 63 0 0 25 0 8 0 545360831 4808814592 1109879 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30514/tid=30521] ppid=30512 vsize=4696108 CPUtime=5003.7 cores=0-7
/proc/30514/task/30521/stat : 30521 (claspmt) R 30512 30514 30238 0 -1 4202560 11323 0 0 0 500359 11 0 0 25 0 8 0 545360831 4808814592 1109879 33554432000 4194304 4964704 140734663289440 18446744073709551615 4669480 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30514/tid=30522] ppid=30512 vsize=4696108 CPUtime=5003.68 cores=0-7
/proc/30514/task/30522/stat : 30522 (claspmt) R 30512 30514 30238 0 -1 4202560 1019821 0 0 0 499838 530 0 0 25 0 8 0 545360831 4808814592 1109879 33554432000 4194304 4964704 140734663289440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 4696108

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5005.4 s]
/proc/loadavg: 8.00 8.02 8.00 9/200 30679
/proc/meminfo: memFree=12731884/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=4474368 CPUtime=40000.9 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 1239724 0 0 0 3999344 750 0 0 25 0 1 0 545360767 4581752832 1052968 33554432000 4194304 4964704 140734663289440 18446744073709551615 230808814984 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/30514/statm: 1118592 1052968 476 189 0 1112941 0
Current children cumulated CPU time (s) 40000.9
Current children cumulated vsize (KiB) 4474368

[startup+5005.6 s]
/proc/loadavg: 8.00 8.02 8.00 9/200 30679
/proc/meminfo: memFree=12731884/32951124 swapFree=67111448/67111528
[pid=30514] ppid=30512 vsize=1625720 CPUtime=40001.1 cores=0-7
/proc/30514/stat : 30514 (claspmt) R 30512 30514 30238 0 -1 4202496 1239724 0 0 0 3999352 762 0 0 25 0 1 0 545360767 1664737280 340297 33554432000 4194304 4964704 140734663289440 18446744073709551615 230809209191 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/30514/statm: 406430 340297 476 189 0 400779 0
Current children cumulated CPU time (s) 40001.1
Current children cumulated vsize (KiB) 1625720

Child status: 0
Real time (s): 5005.67
CPU time (s): 40001.2
CPU user time (s): 39993.5
CPU system time (s): 7.68883
CPU usage (%): 799.119
Max. virtual memory (cumulated for all children) (KiB): 4696108

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39993.5
system time used= 7.68883
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1239725
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 30410
involuntary context switches= 193079

runsolver used 7.45986 second user time and 20.5109 second system time

The end

Launcher Data 

Begin job on node104 at 2011-05-02 14:00:03
IDJOB=3321379
IDBENCH=70781
IDSOLVER=1711
FILE ID=node104/3321379-1304337603
RUNJOBID= node104-1304335616-30252
PBS_JOBID= 13178015
Free space on /tmp= 73432 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT09/APPLICATIONS/bitverif/countbitssrl/countbitssrl064.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321379-1304337603/watcher-3321379-1304337603 -o /tmp/evaluation-result-3321379-1304337603/solver-3321379-1304337603 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3321379-1304337603.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 4f9c883534eb89cad9b9cad9e6eccbd0
RANDOM SEED=1792607925

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17174336 kB
Buffers:        466420 kB
Cached:        2775776 kB
SwapCached:         80 kB
Active:       12482272 kB
Inactive:      2846644 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17174336 kB
SwapTotal:    67111528 kB
SwapFree:     67111448 kB
Dirty:            4700 kB
Writeback:           0 kB
AnonPages:    12086252 kB
Mapped:          20304 kB
Slab:           351072 kB
PageTables:      30884 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 13614276 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73432 MiB
End job on node104 at 2011-05-02 15:23:30