Trace number 3322383

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 40000.5 5018.42

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n130-s30940966-unsat.cnf
MD5SUMca44a78076b8228fbb99ecc0147f157f
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables133
Number of clauses276
Sum of the clauses size828
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3276
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...381705/instance-3322383-1304381705.cnf
0.00/0.00	c Solving...
40000.38/5018.41	
40000.38/5018.41	*** INTERRUPTED! ***
40000.38/5018.41	*** Shutting down threads...
40000.38/5018.41	s UNKNOWN
40000.38/5018.41	
40000.38/5018.41	c INTERRUPTED   : 1
40000.38/5018.41	c Models        : 0+    
40000.38/5018.41	c Time          : 5018.411s (Solving: 5018.41s 1st Model: 0.00s Unsat: 0.00s)
40000.38/5018.41	c CPU Time      : 40000.450s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322383-1304381705/watcher-3322383-1304381705 -o /tmp/evaluation-result-3322383-1304381705/solver-3322383-1304381705 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3322383-1304381705.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.12 8.05 6.53 1/258 3679
/proc/meminfo: memFree=23687616/32951124 swapFree=65796668/67111528
[pid=3679] ppid=3677 vsize=184084 CPUtime=0 cores=0-7
/proc/3679/stat : 3679 (claspmt) S 3677 3679 2634 0 -1 4202496 708 0 0 0 0 0 0 0 25 0 8 0 549768657 188502016 634 33554432000 4194304 4964704 140737163369248 18446744073709551615 246528650137 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/3679/statm: 46021 635 453 189 0 40370 0
[pid=3679/tid=3680] ppid=3677 vsize=184236 CPUtime=0 cores=0-7
/proc/3679/task/3680/stat : 3680 (claspmt) R 3677 3679 2634 0 -1 4202560 31 0 0 0 0 0 0 0 18 0 8 0 549768658 188657664 723 33554432000 4194304 4964704 140737163369248 18446744073709551615 4668484 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=3679/tid=3681] ppid=3677 vsize=184236 CPUtime=0 cores=0-7
/proc/3679/task/3681/stat : 3681 (claspmt) R 3677 3679 2634 0 -1 4202560 30 0 0 0 0 0 0 0 18 0 8 0 549768658 188657664 723 33554432000 4194304 4964704 140737163369248 18446744073709551615 4363491 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3679/tid=3682] ppid=3677 vsize=184236 CPUtime=0 cores=0-7
/proc/3679/task/3682/stat : 3682 (claspmt) R 3677 3679 2634 0 -1 4202560 23 0 0 0 0 0 0 0 25 0 8 0 549768658 188657664 723 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=3679/tid=3683] ppid=3677 vsize=184236 CPUtime=0 cores=0-7
/proc/3679/task/3683/stat : 3683 (claspmt) R 3677 3679 2634 0 -1 4202560 19 0 0 0 0 0 0 0 18 0 8 0 549768658 188657664 724 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=3679/tid=3684] ppid=3677 vsize=184236 CPUtime=0 cores=0-7
/proc/3679/task/3684/stat : 3684 (claspmt) R 3677 3679 2634 0 -1 4202560 18 0 0 0 0 0 0 0 17 0 8 0 549768658 188657664 724 33554432000 4194304 4964704 140737163369248 18446744073709551615 4399648 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3679/tid=3685] ppid=3677 vsize=184236 CPUtime=0 cores=0-7
/proc/3679/task/3685/stat : 3685 (claspmt) R 3677 3679 2634 0 -1 4202560 5 0 0 0 0 0 0 0 25 0 8 0 549768658 188657664 724 33554432000 4194304 4964704 140737163369248 18446744073709551615 246528660149 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=3679/tid=3686] ppid=3677 vsize=184236 CPUtime=0 cores=0-7
/proc/3679/task/3686/stat : 3686 (claspmt) R 3677 3679 2634 0 -1 4202560 56 0 0 0 0 0 0 0 25 0 8 0 549768658 188657664 724 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516495045 0 0 4096 18946 0 0 0 -1 2 0 0 0

[startup+0.079263 s]
/proc/loadavg: 8.12 8.05 6.53 1/258 3679
/proc/meminfo: memFree=23687616/32951124 swapFree=65796668/67111528
[pid=3679] ppid=3677 vsize=315572 CPUtime=0.65 cores=0-7
/proc/3679/stat : 3679 (claspmt) R 3677 3679 2634 0 -1 4202496 1170 0 0 0 65 0 0 0 18 0 8 0 549768657 323145728 1096 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/3679/statm: 78893 1141 464 189 0 73242 0
[pid=3679/tid=3680] ppid=3677 vsize=315572 CPUtime=0.09 cores=0-7
/proc/3679/task/3680/stat : 3680 (claspmt) R 3677 3679 2634 0 -1 4202560 115 0 0 0 9 0 0 0 18 0 8 0 549768658 323145728 1141 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=3679/tid=3681] ppid=3677 vsize=315572 CPUtime=0.13 cores=0-7
/proc/3679/task/3681/stat : 3681 (claspmt) S 3677 3679 2634 0 -1 4202560 102 0 0 0 13 0 0 0 18 0 8 0 549768658 323145728 1204 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939246 0 0 4096 18946 18446604444573877376 0 0 -1 7 0 0 0
[pid=3679/tid=3682] ppid=3677 vsize=315572 CPUtime=0.13 cores=0-7
/proc/3679/task/3682/stat : 3682 (claspmt) R 3677 3679 2634 0 -1 4202560 48 0 0 0 13 0 0 0 18 0 8 0 549768658 323145728 1212 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=3679/tid=3683] ppid=3677 vsize=315704 CPUtime=0.15 cores=0-7
/proc/3679/task/3683/stat : 3683 (claspmt) R 3677 3679 2634 0 -1 4202560 91 0 0 0 15 0 0 0 18 0 8 0 549768658 323280896 1259 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=3679/tid=3684] ppid=3677 vsize=315704 CPUtime=0.17 cores=0-7
/proc/3679/task/3684/stat : 3684 (claspmt) R 3677 3679 2634 0 -1 4202560 58 0 0 0 17 0 0 0 18 0 8 0 549768658 323280896 1280 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3679/tid=3685] ppid=3677 vsize=315704 CPUtime=0.17 cores=0-7
/proc/3679/task/3685/stat : 3685 (claspmt) R 3677 3679 2634 0 -1 4202560 40 0 0 0 17 0 0 0 18 0 8 0 549768658 323280896 1290 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3679/tid=3686] ppid=3677 vsize=315704 CPUtime=0.18 cores=0-7
/proc/3679/task/3686/stat : 3686 (claspmt) R 3677 3679 2634 0 -1 4202560 164 0 0 0 18 0 0 0 25 0 8 0 549768658 323280896 1346 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.65
Current children cumulated vsize (KiB) 315572

[startup+0.334145 s]
/proc/loadavg: 8.12 8.05 6.53 1/258 3679
/proc/meminfo: memFree=23687616/32951124 swapFree=65796668/67111528
[pid=3679] ppid=3677 vsize=315836 CPUtime=2.6 cores=0-7
/proc/3679/stat : 3679 (claspmt) R 3677 3679 2634 0 -1 4202496 1559 0 0 0 259 1 0 0 18 0 8 0 549768657 323416064 1485 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/3679/statm: 78959 1505 464 189 0 73308 0
[pid=3679/tid=3680] ppid=3677 vsize=315836 CPUtime=0.36 cores=0-7
/proc/3679/task/3680/stat : 3680 (claspmt) R 3677 3679 2634 0 -1 4202560 187 0 0 0 36 0 0 0 18 0 8 0 549768658 323416064 1515 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=3679/tid=3681] ppid=3677 vsize=315836 CPUtime=0.38 cores=0-7
/proc/3679/task/3681/stat : 3681 (claspmt) S 3677 3679 2634 0 -1 4202560 133 0 0 0 38 0 0 0 18 0 8 0 549768658 323416064 1527 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939246 0 0 4096 18946 18446604444573877376 0 0 -1 7 0 0 0
[pid=3679/tid=3682] ppid=3677 vsize=315836 CPUtime=0.41 cores=0-7
/proc/3679/task/3682/stat : 3682 (claspmt) R 3677 3679 2634 0 -1 4202560 69 0 0 0 41 0 0 0 18 0 8 0 549768658 323416064 1562 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=3679/tid=3683] ppid=3677 vsize=315836 CPUtime=0.43 cores=0-7
/proc/3679/task/3683/stat : 3683 (claspmt) R 3677 3679 2634 0 -1 4202560 127 0 0 0 43 0 0 0 18 0 8 0 549768658 323416064 1577 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=3679/tid=3684] ppid=3677 vsize=315836 CPUtime=0.47 cores=0-7
/proc/3679/task/3684/stat : 3684 (claspmt) R 3677 3679 2634 0 -1 4202560 67 0 0 0 47 0 0 0 18 0 8 0 549768658 323416064 1605 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3679/tid=3685] ppid=3677 vsize=315836 CPUtime=0.48 cores=0-7
/proc/3679/task/3685/stat : 3685 (claspmt) R 3677 3679 2634 0 -1 4202560 58 0 0 0 48 0 0 0 18 0 8 0 549768658 323416064 1624 33554432000 4194304 4964704 140737163369248 18446744073709551615 4668609 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3679/tid=3686] ppid=3677 vsize=315836 CPUtime=0.49 cores=0-7
/proc/3679/task/3686/stat : 3686 (claspmt) R 3677 3679 2634 0 -1 4202560 256 0 0 0 49 0 0 0 25 0 8 0 549768658 323416064 1636 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.6
Current children cumulated vsize (KiB) 315836

[startup+0.738587 s]
/proc/loadavg: 8.12 8.05 6.53 1/258 3679
/proc/meminfo: memFree=23687616/32951124 swapFree=65796668/67111528
[pid=3679] ppid=3677 vsize=315964 CPUtime=5.76 cores=0-7
/proc/3679/stat : 3679 (claspmt) R 3677 3679 2634 0 -1 4202496 1838 0 0 0 573 3 0 0 18 0 8 0 549768657 323547136 1764 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/3679/statm: 78991 1764 464 189 0 73340 0
[pid=3679/tid=3680] ppid=3677 vsize=315964 CPUtime=0.71 cores=0-7
/proc/3679/task/3680/stat : 3680 (claspmt) R 3677 3679 2634 0 -1 4202560 263 0 0 0 71 0 0 0 18 0 8 0 549768658 323547136 1764 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=3679/tid=3681] ppid=3677 vsize=315964 CPUtime=0.72 cores=0-7
/proc/3679/task/3681/stat : 3681 (claspmt) R 3677 3679 2634 0 -1 4202560 153 0 0 0 72 0 0 0 18 0 8 0 549768658 323547136 1764 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939246 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3679/tid=3682] ppid=3677 vsize=315964 CPUtime=0.71 cores=0-7
/proc/3679/task/3682/stat : 3682 (claspmt) R 3677 3679 2634 0 -1 4202560 75 0 0 0 71 0 0 0 18 0 8 0 549768658 323547136 1764 33554432000 4194304 4964704 140737163369248 18446744073709551615 4642509 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=3679/tid=3683] ppid=3677 vsize=315964 CPUtime=0.72 cores=0-7
/proc/3679/task/3683/stat : 3683 (claspmt) R 3677 3679 2634 0 -1 4202560 142 0 0 0 72 0 0 0 18 0 8 0 549768658 323547136 1764 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=3679/tid=3684] ppid=3677 vsize=315964 CPUtime=0.72 cores=0-7
/proc/3679/task/3684/stat : 3684 (claspmt) R 3677 3679 2634 0 -1 4202560 69 0 0 0 72 0 0 0 18 0 8 0 549768658 323547136 1764 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3679/tid=3685] ppid=3677 vsize=315964 CPUtime=0.7 cores=0-7
/proc/3679/task/3685/stat : 3685 (claspmt) R 3677 3679 2634 0 -1 4202560 64 0 0 0 70 0 0 0 18 0 8 0 549768658 323547136 1764 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3679/tid=3686] ppid=3677 vsize=315964 CPUtime=0.7 cores=0-7
/proc/3679/task/3686/stat : 3686 (claspmt) R 3677 3679 2634 0 -1 4202560 281 0 0 0 70 0 0 0 25 0 8 0 549768658 323547136 1764 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.76
Current children cumulated vsize (KiB) 315964

[startup+0.800867 s]
/proc/loadavg: 8.12 8.05 6.53 1/258 3679
/proc/meminfo: memFree=23687616/32951124 swapFree=65796668/67111528
[pid=3679] ppid=3677 vsize=315964 CPUtime=6.27 cores=0-7
/proc/3679/stat : 3679 (claspmt) R 3677 3679 2634 0 -1 4202496 1867 0 0 0 624 3 0 0 19 0 8 0 549768657 323547136 1793 33554432000 4194304 4964704 140737163369248 18446744073709551615 4626894 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/3679/statm: 78991 1793 464 189 0 73340 0
[pid=3679/tid=3680] ppid=3677 vsize=315964 CPUtime=0.77 cores=0-7
/proc/3679/task/3680/stat : 3680 (claspmt) R 3677 3679 2634 0 -1 4202560 268 0 0 0 77 0 0 0 19 0 8 0 549768658 323547136 1793 33554432000 4194304 4964704 140737163369248 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=3679/tid=3681] ppid=3677 vsize=315964 CPUtime=0.78 cores=0-7
/proc/3679/task/3681/stat : 3681 (claspmt) R 3677 3679 2634 0 -1 4202560 159 0 0 0 78 0 0 0 18 0 8 0 549768658 323547136 1793 33554432000 4194304 4964704 140737163369248 18446744073709551615 4658352 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3679/tid=3682] ppid=3677 vsize=315964 CPUtime=0.78 cores=0-7
/proc/3679/task/3682/stat : 3682 (claspmt) R 3677 3679 2634 0 -1 4202560 79 0 0 0 78 0 0 0 18 0 8 0 549768658 323547136 1793 33554432000 4194304 4964704 140737163369248 18446744073709551615 4653504 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=3679/tid=3683] ppid=3677 vsize=315964 CPUtime=0.78 cores=0-7
/proc/3679/task/3683/stat : 3683 (claspmt) R 3677 3679 2634 0 -1 4202560 142 0 0 0 78 0 0 0 18 0 8 0 549768658 323547136 1793 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=3679/tid=3684] ppid=3677 vsize=315964 CPUtime=0.78 cores=0-7
/proc/3679/task/3684/stat : 3684 (claspmt) R 3677 3679 2634 0 -1 4202560 70 0 0 0 78 0 0 0 18 0 8 0 549768658 323547136 1793 33554432000 4194304 4964704 140737163369248 18446744073709551615 4668693 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3679/tid=3685] ppid=3677 vsize=315964 CPUtime=0.77 cores=0-7
/proc/3679/task/3685/stat : 3685 (claspmt) R 3677 3679 2634 0 -1 4202560 70 0 0 0 77 0 0 0 18 0 8 0 549768658 323547136 1793 33554432000 4194304 4964704 140737163369248 18446744073709551615 4660083 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3679/tid=3686] ppid=3677 vsize=315964 CPUtime=0.76 cores=0-7
/proc/3679/task/3686/stat : 3686 (claspmt) R 3677 3679 2634 0 -1 4202560 284 0 0 0 76 0 0 0 25 0 8 0 549768658 323547136 1793 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 315964

[startup+1.50074 s]
/proc/loadavg: 8.12 8.05 6.53 9/266 3688
/proc/meminfo: memFree=23681236/32951124 swapFree=65796668/67111528
[pid=3679] ppid=3677 vsize=316224 CPUtime=11.89 cores=0-7
/proc/3679/stat : 3679 (claspmt) R 3677 3679 2634 0 -1 4202496 2157 0 0 0 1184 5 0 0 20 0 8 0 549768657 323813376 2083 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/3679/statm: 79056 2083 464 189 0 73405 0
[pid=3679/tid=3680] ppid=3677 vsize=316224 CPUtime=1.48 cores=0-7
/proc/3679/task/3680/stat : 3680 (claspmt) R 3677 3679 2634 0 -1 4202560 336 0 0 0 147 1 0 0 20 0 8 0 549768658 323813376 2086 33554432000 4194304 4964704 140737163369248 18446744073709551615 4342208 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=3679/tid=3681] ppid=3677 vsize=316224 CPUtime=1.47 cores=0-7
/proc/3679/task/3681/stat : 3681 (claspmt) R 3677 3679 2634 0 -1 4202560 186 0 0 0 147 0 0 0 19 0 8 0 549768658 323813376 2086 33554432000 4194304 4964704 140737163369248 18446744073709551615 4644880 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3679/tid=3682] ppid=3677 vsize=316224 CPUtime=1.48 cores=0-7
/proc/3679/task/3682/stat : 3682 (claspmt) R 3677 3679 2634 0 -1 4202560 88 0 0 0 148 0 0 0 18 0 8 0 549768658 323813376 2086 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=3679/tid=3683] ppid=3677 vsize=316224 CPUtime=1.49 cores=0-7
/proc/3679/task/3683/stat : 3683 (claspmt) R 3677 3679 2634 0 -1 4202560 158 0 0 0 149 0 0 0 19 0 8 0 549768658 323813376 2086 33554432000 4194304 4964704 140737163369248 18446744073709551615 4668697 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=3679/tid=3684] ppid=3677 vsize=316224 CPUtime=1.49 cores=0-7
/proc/3679/task/3684/stat : 3684 (claspmt) R 3677 3679 2634 0 -1 4202560 79 0 0 0 149 0 0 0 19 0 8 0 549768658 323813376 2086 33554432000 4194304 4964704 140737163369248 18446744073709551615 4362326 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3679/tid=3685] ppid=3677 vsize=316224 CPUtime=1.47 cores=0-7
/proc/3679/task/3685/stat : 3685 (claspmt) R 3677 3679 2634 0 -1 4202560 80 0 0 0 147 0 0 0 19 0 8 0 549768658 323813376 2086 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3679/tid=3686] ppid=3677 vsize=316224 CPUtime=1.48 cores=0-7
/proc/3679/task/3686/stat : 3686 (claspmt) R 3677 3679 2634 0 -1 4202560 359 0 0 0 147 1 0 0 25 0 8 0 549768658 323813376 2086 33554432000 4194304 4964704 140737163369248 18446744073709551615 4668609 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.89
Current children cumulated vsize (KiB) 316224

[startup+3.10045 s]
/proc/loadavg: 8.12 8.05 6.53 9/266 3688
/proc/meminfo: memFree=23679872/32951124 swapFree=65796668/67111528
[pid=3679] ppid=3677 vsize=316484 CPUtime=24.58 cores=0-7
/proc/3679/stat : 3679 (claspmt) R 3677 3679 2634 0 -1 4202496 2494 0 0 0 2446 12 0 0 20 0 8 0 549768657 324079616 2420 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/3679/statm: 79121 2420 464 189 0 73470 0
[pid=3679/tid=3680] ppid=3677 vsize=316484 CPUtime=3.06 cores=0-7
/proc/3679/task/3680/stat : 3680 (claspmt) R 3677 3679 2634 0 -1 4202560 455 0 0 0 304 2 0 0 25 0 8 0 549768658 324079616 2420 33554432000 4194304 4964704 140737163369248 18446744073709551615 4320872 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=3679/tid=3681] ppid=3677 vsize=316484 CPUtime=3.05 cores=0-7
/proc/3679/task/3681/stat : 3681 (claspmt) R 3677 3679 2634 0 -1 4202560 202 0 0 0 304 1 0 0 18 0 8 0 549768658 324079616 2420 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670416 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3679/tid=3682] ppid=3677 vsize=316484 CPUtime=3.06 cores=0-7
/proc/3679/task/3682/stat : 3682 (claspmt) R 3677 3679 2634 0 -1 4202560 94 0 0 0 305 1 0 0 18 0 8 0 549768658 324079616 2420 33554432000 4194304 4964704 140737163369248 18446744073709551615 4668595 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=3679/tid=3683] ppid=3677 vsize=316484 CPUtime=3.06 cores=0-7
/proc/3679/task/3683/stat : 3683 (claspmt) R 3677 3679 2634 0 -1 4202560 167 0 0 0 306 0 0 0 20 0 8 0 549768658 324079616 2420 33554432000 4194304 4964704 140737163369248 18446744073709551615 4668518 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=3679/tid=3684] ppid=3677 vsize=316484 CPUtime=3.07 cores=0-7
/proc/3679/task/3684/stat : 3684 (claspmt) R 3677 3679 2634 0 -1 4202560 96 0 0 0 306 1 0 0 18 0 8 0 549768658 324079616 2420 33554432000 4194304 4964704 140737163369248 18446744073709551615 4660383 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3679/tid=3685] ppid=3677 vsize=316484 CPUtime=3.06 cores=0-7
/proc/3679/task/3685/stat : 3685 (claspmt) R 3677 3679 2634 0 -1 4202560 94 0 0 0 305 1 0 0 18 0 8 0 549768658 324079616 2420 33554432000 4194304 4964704 140737163369248 18446744073709551615 4342208 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3679/tid=3686] ppid=3677 vsize=316484 CPUtime=3.06 cores=0-7
/proc/3679/task/3686/stat : 3686 (claspmt) R 3677 3679 2634 0 -1 4202560 450 0 0 0 305 1 0 0 18 0 8 0 549768658 324079616 2420 33554432000 4194304 4964704 140737163369248 18446744073709551615 4668505 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.58
Current children cumulated vsize (KiB) 316484

[startup+6.30087 s]
/proc/loadavg: 8.11 8.05 6.53 9/266 3688
/proc/meminfo: memFree=23678652/32951124 swapFree=65796668/67111528
[pid=3679] ppid=3677 vsize=317008 CPUtime=50.05 cores=0-7
/proc/3679/stat : 3679 (claspmt) R 3677 3679 2634 0 -1 4202496 2912 0 0 0 4982 23 0 0 25 0 8 0 549768657 324616192 2838 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/3679/statm: 79252 2838 464 189 0 73601 0
[pid=3679/tid=3680] ppid=3677 vsize=317008 CPUtime=6.25 cores=0-7
/proc/3679/task/3680/stat : 3680 (claspmt) R 3677 3679 2634 0 -1 4202560 610 0 0 0 621 4 0 0 18 0 8 0 549768658 324616192 2838 33554432000 4194304 4964704 140737163369248 18446744073709551615 4669107 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=3679/tid=3681] ppid=3677 vsize=317008 CPUtime=6.21 cores=0-7
/proc/3679/task/3681/stat : 3681 (claspmt) R 3677 3679 2634 0 -1 4202560 217 0 0 0 619 2 0 0 18 0 8 0 549768658 324616192 2838 33554432000 4194304 4964704 140737163369248 18446744073709551615 4642398 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3679/tid=3682] ppid=3677 vsize=317008 CPUtime=6.25 cores=0-7
/proc/3679/task/3682/stat : 3682 (claspmt) R 3677 3679 2634 0 -1 4202560 109 0 0 0 622 3 0 0 18 0 8 0 549768658 324616192 2838 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516494333 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=3679/tid=3683] ppid=3677 vsize=317008 CPUtime=6.26 cores=0-7
/proc/3679/task/3683/stat : 3683 (claspmt) R 3677 3679 2634 0 -1 4202560 182 0 0 0 624 2 0 0 18 0 8 0 549768658 324616192 2838 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=3679/tid=3684] ppid=3677 vsize=317008 CPUtime=6.26 cores=0-7
/proc/3679/task/3684/stat : 3684 (claspmt) R 3677 3679 2634 0 -1 4202560 108 0 0 0 624 2 0 0 18 0 8 0 549768658 324616192 2838 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3679/tid=3685] ppid=3677 vsize=317008 CPUtime=6.25 cores=0-7
/proc/3679/task/3685/stat : 3685 (claspmt) R 3677 3679 2634 0 -1 4202560 108 0 0 0 623 2 0 0 19 0 8 0 549768658 324616192 2838 33554432000 4194304 4964704 140737163369248 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3679/tid=3686] ppid=3677 vsize=317008 CPUtime=6.25 cores=0-7
/proc/3679/task/3686/stat : 3686 (claspmt) R 3677 3679 2634 0 -1 4202560 540 0 0 0 623 2 0 0 18 0 8 0 549768658 324616192 2838 33554432000 4194304 4964704 140737163369248 18446744073709551615 4668609 0 0 4096 18946 0 0 0 -1 5 0 0 0

################
# More data... #
################


[startup+4722.3 s]
/proc/loadavg: 8.18 8.09 8.03 9/266 3828
/proc/meminfo: memFree=23663700/32951124 swapFree=65796668/67111528
[pid=3679] ppid=3677 vsize=450088 CPUtime=37639.8 cores=0-7
/proc/3679/stat : 3679 (claspmt) R 3677 3679 2634 0 -1 4202496 5899 0 0 0 3753871 10113 0 0 25 0 8 0 549768657 460890112 5825 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/3679/statm: 112522 5825 468 189 0 106871 0
[pid=3679/tid=3680] ppid=3677 vsize=450088 CPUtime=4704.82 cores=0-7
/proc/3679/task/3680/stat : 3680 (claspmt) R 3677 3679 2634 0 -1 4202560 1745 0 0 0 469356 1126 0 0 25 0 8 0 549768658 460890112 5825 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=3679/tid=3681] ppid=3677 vsize=450088 CPUtime=4701.71 cores=0-7
/proc/3679/task/3681/stat : 3681 (claspmt) R 3677 3679 2634 0 -1 4202560 358 0 0 0 468749 1422 0 0 25 0 8 0 549768658 460890112 5825 33554432000 4194304 4964704 140737163369248 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3679/tid=3682] ppid=3677 vsize=450088 CPUtime=4705.18 cores=0-7
/proc/3679/task/3682/stat : 3682 (claspmt) R 3677 3679 2634 0 -1 4202560 208 0 0 0 469199 1319 0 0 18 0 8 0 549768658 460890112 5825 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=3679/tid=3683] ppid=3677 vsize=450088 CPUtime=4701.88 cores=0-7
/proc/3679/task/3683/stat : 3683 (claspmt) R 3677 3679 2634 0 -1 4202560 286 0 0 0 468850 1338 0 0 20 0 8 0 549768658 460890112 5825 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3679/tid=3684] ppid=3677 vsize=450088 CPUtime=4704.23 cores=0-7
/proc/3679/task/3684/stat : 3684 (claspmt) R 3677 3679 2634 0 -1 4202560 208 0 0 0 469086 1337 0 0 25 0 8 0 549768658 460890112 5825 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670060 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=3679/tid=3685] ppid=3677 vsize=450088 CPUtime=4701.37 cores=0-7
/proc/3679/task/3685/stat : 3685 (claspmt) R 3677 3679 2634 0 -1 4202560 196 0 0 0 468766 1371 0 0 18 0 8 0 549768658 460890112 5825 33554432000 4194304 4964704 140737163369248 18446744073709551615 4660304 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=3679/tid=3686] ppid=3677 vsize=450088 CPUtime=4712.26 cores=0-7
/proc/3679/task/3686/stat : 3686 (claspmt) R 3677 3679 2634 0 -1 4202560 1288 0 0 0 470123 1103 0 0 21 0 8 0 549768658 460890112 5825 33554432000 4194304 4964704 140737163369248 18446744073709551615 4321010 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37639.8
Current children cumulated vsize (KiB) 450088

[startup+4782.3 s]
/proc/loadavg: 8.06 8.07 8.02 9/266 3830
/proc/meminfo: memFree=23663684/32951124 swapFree=65796668/67111528
[pid=3679] ppid=3677 vsize=450088 CPUtime=38118.2 cores=0-7
/proc/3679/stat : 3679 (claspmt) R 3677 3679 2634 0 -1 4202496 5904 0 0 0 3801590 10227 0 0 19 0 8 0 549768657 460890112 5830 33554432000 4194304 4964704 140737163369248 18446744073709551615 4626894 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/3679/statm: 112522 5830 468 189 0 106871 0
[pid=3679/tid=3680] ppid=3677 vsize=450088 CPUtime=4764.61 cores=0-7
/proc/3679/task/3680/stat : 3680 (claspmt) R 3677 3679 2634 0 -1 4202560 1746 0 0 0 475322 1139 0 0 19 0 8 0 549768658 460890112 5830 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=3679/tid=3681] ppid=3677 vsize=450088 CPUtime=4761.44 cores=0-7
/proc/3679/task/3681/stat : 3681 (claspmt) R 3677 3679 2634 0 -1 4202560 358 0 0 0 474707 1437 0 0 25 0 8 0 549768658 460890112 5830 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3679/tid=3682] ppid=3677 vsize=450088 CPUtime=4765 cores=0-7
/proc/3679/task/3682/stat : 3682 (claspmt) R 3677 3679 2634 0 -1 4202560 208 0 0 0 475164 1336 0 0 25 0 8 0 549768658 460890112 5830 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=3679/tid=3683] ppid=3677 vsize=450088 CPUtime=4761.71 cores=0-7
/proc/3679/task/3683/stat : 3683 (claspmt) R 3677 3679 2634 0 -1 4202560 286 0 0 0 474818 1353 0 0 19 0 8 0 549768658 460890112 5830 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3679/tid=3684] ppid=3677 vsize=450088 CPUtime=4764.16 cores=0-7
/proc/3679/task/3684/stat : 3684 (claspmt) R 3677 3679 2634 0 -1 4202560 208 0 0 0 475065 1351 0 0 21 0 8 0 549768658 460890112 5830 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=3679/tid=3685] ppid=3677 vsize=450088 CPUtime=4761.24 cores=0-7
/proc/3679/task/3685/stat : 3685 (claspmt) R 3677 3679 2634 0 -1 4202560 196 0 0 0 474738 1386 0 0 18 0 8 0 549768658 460890112 5830 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=3679/tid=3686] ppid=3677 vsize=450088 CPUtime=4771.76 cores=0-7
/proc/3679/task/3686/stat : 3686 (claspmt) R 3677 3679 2634 0 -1 4202560 1292 0 0 0 476061 1115 0 0 18 0 8 0 549768658 460890112 5830 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38118.2
Current children cumulated vsize (KiB) 450088

[startup+4842.3 s]
/proc/loadavg: 8.02 8.06 8.01 9/266 3832
/proc/meminfo: memFree=23663796/32951124 swapFree=65796668/67111528
[pid=3679] ppid=3677 vsize=450088 CPUtime=38596.5 cores=0-7
/proc/3679/stat : 3679 (claspmt) R 3677 3679 2634 0 -1 4202496 5912 0 0 0 3849299 10354 0 0 18 0 8 0 549768657 460890112 5838 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/3679/statm: 112522 5838 468 189 0 106871 0
[pid=3679/tid=3680] ppid=3677 vsize=450088 CPUtime=4824.38 cores=0-7
/proc/3679/task/3680/stat : 3680 (claspmt) R 3677 3679 2634 0 -1 4202560 1748 0 0 0 481284 1154 0 0 19 0 8 0 549768658 460890112 5838 33554432000 4194304 4964704 140737163369248 18446744073709551615 4362182 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=3679/tid=3681] ppid=3677 vsize=450088 CPUtime=4820.83 cores=0-7
/proc/3679/task/3681/stat : 3681 (claspmt) R 3677 3679 2634 0 -1 4202560 358 0 0 0 480628 1455 0 0 25 0 8 0 549768658 460890112 5838 33554432000 4194304 4964704 140737163369248 18446744073709551615 4363081 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3679/tid=3682] ppid=3677 vsize=450088 CPUtime=4824.82 cores=0-7
/proc/3679/task/3682/stat : 3682 (claspmt) R 3677 3679 2634 0 -1 4202560 208 0 0 0 481126 1356 0 0 25 0 8 0 549768658 460890112 5838 33554432000 4194304 4964704 140737163369248 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=3679/tid=3683] ppid=3677 vsize=450088 CPUtime=4821.55 cores=0-7
/proc/3679/task/3683/stat : 3683 (claspmt) R 3677 3679 2634 0 -1 4202560 286 0 0 0 480784 1371 0 0 18 0 8 0 549768658 460890112 5838 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670277 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3679/tid=3684] ppid=3677 vsize=450088 CPUtime=4824.07 cores=0-7
/proc/3679/task/3684/stat : 3684 (claspmt) R 3677 3679 2634 0 -1 4202560 208 0 0 0 481041 1366 0 0 20 0 8 0 549768658 460890112 5838 33554432000 4194304 4964704 140737163369248 18446744073709551615 4668512 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=3679/tid=3685] ppid=3677 vsize=450088 CPUtime=4821.13 cores=0-7
/proc/3679/task/3685/stat : 3685 (claspmt) R 3677 3679 2634 0 -1 4202560 196 0 0 0 480711 1402 0 0 19 0 8 0 549768658 460890112 5838 33554432000 4194304 4964704 140737163369248 18446744073709551615 4332387 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=3679/tid=3686] ppid=3677 vsize=450088 CPUtime=4831.65 cores=0-7
/proc/3679/task/3686/stat : 3686 (claspmt) R 3677 3679 2634 0 -1 4202560 1295 0 0 0 482037 1128 0 0 20 0 8 0 549768658 460890112 5838 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38596.5
Current children cumulated vsize (KiB) 450088

[startup+4902.3 s]
/proc/loadavg: 8.01 8.05 8.01 9/266 3833
/proc/meminfo: memFree=23663780/32951124 swapFree=65796668/67111528
[pid=3679] ppid=3677 vsize=450088 CPUtime=39074.8 cores=0-7
/proc/3679/stat : 3679 (claspmt) R 3677 3679 2634 0 -1 4202496 5923 0 0 0 3896997 10484 0 0 21 0 8 0 549768657 460890112 5849 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/3679/statm: 112522 5849 468 189 0 106871 0
[pid=3679/tid=3680] ppid=3677 vsize=450088 CPUtime=4884.15 cores=0-7
/proc/3679/task/3680/stat : 3680 (claspmt) R 3677 3679 2634 0 -1 4202560 1748 0 0 0 487244 1171 0 0 25 0 8 0 549768658 460890112 5849 33554432000 4194304 4964704 140737163369248 18446744073709551615 4683587 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=3679/tid=3681] ppid=3677 vsize=450088 CPUtime=4880.21 cores=0-7
/proc/3679/task/3681/stat : 3681 (claspmt) R 3677 3679 2634 0 -1 4202560 358 0 0 0 486548 1473 0 0 20 0 8 0 549768658 460890112 5849 33554432000 4194304 4964704 140737163369248 18446744073709551615 4362960 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3679/tid=3682] ppid=3677 vsize=450088 CPUtime=4884.63 cores=0-7
/proc/3679/task/3682/stat : 3682 (claspmt) R 3677 3679 2634 0 -1 4202560 210 0 0 0 487092 1371 0 0 22 0 8 0 549768658 460890112 5849 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=3679/tid=3683] ppid=3677 vsize=450088 CPUtime=4881.4 cores=0-7
/proc/3679/task/3683/stat : 3683 (claspmt) R 3677 3679 2634 0 -1 4202560 286 0 0 0 486752 1388 0 0 18 0 8 0 549768658 460890112 5849 33554432000 4194304 4964704 140737163369248 18446744073709551615 4660088 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3679/tid=3684] ppid=3677 vsize=450088 CPUtime=4883.98 cores=0-7
/proc/3679/task/3684/stat : 3684 (claspmt) R 3677 3679 2634 0 -1 4202560 213 0 0 0 487016 1382 0 0 20 0 8 0 549768658 460890112 5849 33554432000 4194304 4964704 140737163369248 18446744073709551615 4321008 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=3679/tid=3685] ppid=3677 vsize=450088 CPUtime=4880.97 cores=0-7
/proc/3679/task/3685/stat : 3685 (claspmt) R 3677 3679 2634 0 -1 4202560 196 0 0 0 486678 1419 0 0 18 0 8 0 549768658 460890112 5849 33554432000 4194304 4964704 140737163369248 18446744073709551615 4684117 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=3679/tid=3686] ppid=3677 vsize=450088 CPUtime=4891.56 cores=0-7
/proc/3679/task/3686/stat : 3686 (claspmt) R 3677 3679 2634 0 -1 4202560 1299 0 0 0 488012 1144 0 0 18 0 8 0 549768658 460890112 5849 33554432000 4194304 4964704 140737163369248 18446744073709551615 4320942 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39074.8
Current children cumulated vsize (KiB) 450088

[startup+4962.3 s]
/proc/loadavg: 8.05 8.05 8.01 9/266 3835
/proc/meminfo: memFree=23663760/32951124 swapFree=65796668/67111528
[pid=3679] ppid=3677 vsize=450088 CPUtime=39553.1 cores=0-7
/proc/3679/stat : 3679 (claspmt) R 3677 3679 2634 0 -1 4202496 5927 0 0 0 3944705 10609 0 0 21 0 8 0 549768657 460890112 5853 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/3679/statm: 112522 5853 468 189 0 106871 0
[pid=3679/tid=3680] ppid=3677 vsize=450088 CPUtime=4943.9 cores=0-7
/proc/3679/task/3680/stat : 3680 (claspmt) R 3677 3679 2634 0 -1 4202560 1748 0 0 0 493207 1183 0 0 25 0 8 0 549768658 460890112 5853 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516939295 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=3679/tid=3681] ppid=3677 vsize=450088 CPUtime=4939.61 cores=0-7
/proc/3679/task/3681/stat : 3681 (claspmt) R 3677 3679 2634 0 -1 4202560 358 0 0 0 492469 1492 0 0 18 0 8 0 549768658 460890112 5853 33554432000 4194304 4964704 140737163369248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3679/tid=3682] ppid=3677 vsize=450088 CPUtime=4944.45 cores=0-7
/proc/3679/task/3682/stat : 3682 (claspmt) R 3677 3679 2634 0 -1 4202560 210 0 0 0 493056 1389 0 0 22 0 8 0 549768658 460890112 5853 33554432000 4194304 4964704 140737163369248 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=3679/tid=3683] ppid=3677 vsize=450088 CPUtime=4941.24 cores=0-7
/proc/3679/task/3683/stat : 3683 (claspmt) R 3677 3679 2634 0 -1 4202560 286 0 0 0 492718 1406 0 0 19 0 8 0 549768658 460890112 5853 33554432000 4194304 4964704 140737163369248 18446744073709551615 4642509 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3679/tid=3684] ppid=3677 vsize=450088 CPUtime=4943.88 cores=0-7
/proc/3679/task/3684/stat : 3684 (claspmt) R 3677 3679 2634 0 -1 4202560 213 0 0 0 492992 1396 0 0 18 0 8 0 549768658 460890112 5853 33554432000 4194304 4964704 140737163369248 18446744073709551615 4669009 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=3679/tid=3685] ppid=3677 vsize=450088 CPUtime=4940.84 cores=0-7
/proc/3679/task/3685/stat : 3685 (claspmt) R 3677 3679 2634 0 -1 4202560 196 0 0 0 492650 1434 0 0 21 0 8 0 549768658 460890112 5853 33554432000 4194304 4964704 140737163369248 18446744073709551615 246516493048 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=3679/tid=3686] ppid=3677 vsize=450088 CPUtime=4951.43 cores=0-7
/proc/3679/task/3686/stat : 3686 (claspmt) R 3677 3679 2634 0 -1 4202560 1299 0 0 0 493985 1158 0 0 22 0 8 0 549768658 460890112 5853 33554432000 4194304 4964704 140737163369248 18446744073709551615 4325296 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39553.1
Current children cumulated vsize (KiB) 450088



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5018.4 s]
/proc/loadavg: 8.14 8.08 8.02 9/266 3836
/proc/meminfo: memFree=23663744/32951124 swapFree=65796668/67111528
[pid=3679] ppid=3677 vsize=450088 CPUtime=40000.4 cores=0-7
/proc/3679/stat : 3679 (claspmt) R 3677 3679 2634 0 -1 4202496 5936 0 0 0 3989321 10717 0 0 25 0 8 0 549768657 460890112 5862 33554432000 4194304 4964704 140737163369248 18446744073709551615 4321076 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/3679/statm: 112522 5862 468 189 0 106871 0
[pid=3679/tid=3680] ppid=3677 vsize=450088 CPUtime=4999.79 cores=0-7
/proc/3679/task/3680/stat : 3680 (claspmt) R 3677 3679 2634 0 -1 4202560 1748 0 0 0 498783 1196 0 0 18 0 8 0 549768658 460890112 5862 33554432000 4194304 4964704 140737163369248 18446744073709551615 4362561 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=3679/tid=3681] ppid=3677 vsize=450088 CPUtime=4995.11 cores=0-7
/proc/3679/task/3681/stat : 3681 (claspmt) R 3677 3679 2634 0 -1 4202560 359 0 0 0 498005 1506 0 0 18 0 8 0 549768658 460890112 5862 33554432000 4194304 4964704 140737163369248 18446744073709551615 4320934 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3679/tid=3682] ppid=3677 vsize=450088 CPUtime=5000.37 cores=0-7
/proc/3679/task/3682/stat : 3682 (claspmt) R 3677 3679 2634 0 -1 4202560 210 0 0 0 498634 1403 0 0 19 0 8 0 549768658 460890112 5862 33554432000 4194304 4964704 140737163369248 18446744073709551615 4675462 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=3679/tid=3683] ppid=3677 vsize=450088 CPUtime=4997.21 cores=0-7
/proc/3679/task/3683/stat : 3683 (claspmt) R 3677 3679 2634 0 -1 4202560 286 0 0 0 498300 1421 0 0 18 0 8 0 549768658 460890112 5862 33554432000 4194304 4964704 140737163369248 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3679/tid=3684] ppid=3677 vsize=450088 CPUtime=4999.9 cores=0-7
/proc/3679/task/3684/stat : 3684 (claspmt) R 3677 3679 2634 0 -1 4202560 213 0 0 0 498582 1408 0 0 18 0 8 0 549768658 460890112 5862 33554432000 4194304 4964704 140737163369248 18446744073709551615 4654500 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=3679/tid=3685] ppid=3677 vsize=450088 CPUtime=4996.83 cores=0-7
/proc/3679/task/3685/stat : 3685 (claspmt) R 3677 3679 2634 0 -1 4202560 196 0 0 0 498236 1447 0 0 25 0 8 0 549768658 460890112 5862 33554432000 4194304 4964704 140737163369248 18446744073709551615 4669009 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=3679/tid=3686] ppid=3677 vsize=450088 CPUtime=5007.45 cores=0-7
/proc/3679/task/3686/stat : 3686 (claspmt) R 3677 3679 2634 0 -1 4202560 1307 0 0 0 499573 1172 0 0 20 0 8 0 549768658 460890112 5862 33554432000 4194304 4964704 140737163369248 18446744073709551615 4653112 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 450088

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5018.4 s]
/proc/loadavg: 8.14 8.08 8.02 9/266 3836
/proc/meminfo: memFree=23663744/32951124 swapFree=65796668/67111528
[pid=3679] ppid=3677 vsize=450088 CPUtime=40000.4 cores=0-7
/proc/3679/stat : 3679 (claspmt) R 3677 3679 2634 0 -1 4202496 5936 0 0 0 3989321 10717 0 0 25 0 8 0 549768657 460890112 5862 33554432000 4194304 4964704 140737163369248 18446744073709551615 4321076 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/3679/statm: 112522 5862 468 189 0 106871 0
[pid=3679/tid=3680] ppid=3677 vsize=450088 CPUtime=4999.79 cores=0-7
/proc/3679/task/3680/stat : 3680 (claspmt) R 3677 3679 2634 0 -1 4202560 1748 0 0 0 498783 1196 0 0 18 0 8 0 549768658 460890112 5862 33554432000 4194304 4964704 140737163369248 18446744073709551615 4362561 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=3679/tid=3681] ppid=3677 vsize=450088 CPUtime=4995.11 cores=0-7
/proc/3679/task/3681/stat : 3681 (claspmt) R 3677 3679 2634 0 -1 4202560 359 0 0 0 498005 1506 0 0 18 0 8 0 549768658 460890112 5862 33554432000 4194304 4964704 140737163369248 18446744073709551615 4320934 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3679/tid=3682] ppid=3677 vsize=450088 CPUtime=5000.37 cores=0-7
/proc/3679/task/3682/stat : 3682 (claspmt) R 3677 3679 2634 0 -1 4202560 210 0 0 0 498634 1403 0 0 19 0 8 0 549768658 460890112 5862 33554432000 4194304 4964704 140737163369248 18446744073709551615 4675462 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=3679/tid=3683] ppid=3677 vsize=450088 CPUtime=4997.21 cores=0-7
/proc/3679/task/3683/stat : 3683 (claspmt) R 3677 3679 2634 0 -1 4202560 286 0 0 0 498300 1421 0 0 18 0 8 0 549768658 460890112 5862 33554432000 4194304 4964704 140737163369248 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=3679/tid=3684] ppid=3677 vsize=450088 CPUtime=4999.9 cores=0-7
/proc/3679/task/3684/stat : 3684 (claspmt) R 3677 3679 2634 0 -1 4202560 213 0 0 0 498582 1408 0 0 18 0 8 0 549768658 460890112 5862 33554432000 4194304 4964704 140737163369248 18446744073709551615 4654500 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=3679/tid=3685] ppid=3677 vsize=450088 CPUtime=4996.83 cores=0-7
/proc/3679/task/3685/stat : 3685 (claspmt) R 3677 3679 2634 0 -1 4202560 196 0 0 0 498236 1447 0 0 25 0 8 0 549768658 460890112 5862 33554432000 4194304 4964704 140737163369248 18446744073709551615 4669009 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=3679/tid=3686] ppid=3677 vsize=450088 CPUtime=5007.45 cores=0-7
/proc/3679/task/3686/stat : 3686 (claspmt) R 3677 3679 2634 0 -1 4202560 1307 0 0 0 499573 1172 0 0 20 0 8 0 549768658 460890112 5862 33554432000 4194304 4964704 140737163369248 18446744073709551615 4653112 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 450088

Child status: 0
Real time (s): 5018.42
CPU time (s): 40000.5
CPU user time (s): 39893.3
CPU system time (s): 107.18
CPU usage (%): 797.073
Max. virtual memory (cumulated for all children) (KiB): 450088

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39893.3
system time used= 107.18
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5948
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17345252
involuntary context switches= 385531

runsolver used 12.3001 second user time and 27.5018 second system time

The end

Launcher Data 

Begin job on node134 at 2011-05-03 02:15:05
IDJOB=3322383
IDBENCH=83148
IDSOLVER=1711
FILE ID=node134/3322383-1304381705
RUNJOBID= node134-1304369188-2648
PBS_JOBID= 13181770
Free space on /tmp= 73136 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n130-s30940966-unsat.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322383-1304381705/watcher-3322383-1304381705 -o /tmp/evaluation-result-3322383-1304381705/solver-3322383-1304381705 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3322383-1304381705.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ca44a78076b8228fbb99ecc0147f157f
RANDOM SEED=1223241857

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23687772 kB
Buffers:        243956 kB
Cached:        1122552 kB
SwapCached:       8900 kB
Active:        5659700 kB
Inactive:      3275084 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23687772 kB
SwapTotal:    67111528 kB
SwapFree:     65796668 kB
Dirty:             784 kB
Writeback:           0 kB
AnonPages:     7562476 kB
Mapped:          20332 kB
Slab:           234624 kB
PageTables:      31248 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 38899456 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73132 MiB
End job on node134 at 2011-05-03 03:38:45