Trace number 3380580

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)UNSAT 6794.24 887.289

General information on the benchmark

NameAPPLICATIONS/bitverif/
minandmaxor/minandmaxor128.cnf
MD5SUM5b2e2178738883a628728bb1ec39f4a9
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1971.87
Satisfiable
(Un)Satisfiability was proved
Number of variables249327
Number of clauses746444
Sum of the clauses size1741700
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2497628
Number of clauses of size 3248814
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...481807/instance-3380580-1305481807.cnf
4.09/4.14	c Solving...
6794.14/887.26	s UNSATISFIABLE
6794.14/887.26	
6794.14/887.26	c Models        : 0     
6794.14/887.26	c Time          : 886.461s (Solving: 882.32s 1st Model: 0.00s Unsat: 882.32s)
6794.14/887.26	c CPU Time      : 6793.410s

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380580-1305481807/watcher-3380580-1305481807 -o /tmp/evaluation-result-3380580-1305481807/solver-3380580-1305481807 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380580-1305481807.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.30 4.79 2.12 2/321 20069
/proc/meminfo: memFree=8960720/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=52532 CPUtime=0 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 2959 0 0 0 0 0 0 0 21 0 1 0 659780508 53792768 2889 33554432000 4194304 4964800 140736915589296 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/20069/statm: 13133 2896 376 189 0 8007 0

[startup+0.056485 s]
/proc/loadavg: 7.30 4.79 2.12 2/321 20069
/proc/meminfo: memFree=8960720/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=72416 CPUtime=0.05 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 15246 0 0 0 4 1 0 0 21 0 1 0 659780508 74153984 13058 33554432000 4194304 4964800 140736915589296 18446744073709551615 4599599 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/20069/statm: 18104 13059 386 189 0 12978 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 72416

[startup+0.100481 s]
/proc/loadavg: 7.30 4.79 2.12 2/321 20069
/proc/meminfo: memFree=8960720/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=81664 CPUtime=0.09 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 17754 0 0 0 8 1 0 0 21 0 1 0 659780508 83623936 14993 33554432000 4194304 4964800 140736915589296 18446744073709551615 248089395669 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/20069/statm: 20416 15011 386 189 0 15290 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 81664

[startup+0.300442 s]
/proc/loadavg: 7.30 4.79 2.12 2/321 20069
/proc/meminfo: memFree=8960720/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=120172 CPUtime=0.29 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 32926 0 0 0 26 3 0 0 22 0 1 0 659780508 123056128 24376 33554432000 4194304 4964800 140736915589296 18446744073709551615 4625573 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/20069/statm: 30043 24376 399 189 0 24917 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 120172

[startup+0.700368 s]
/proc/loadavg: 7.30 4.79 2.12 2/321 20069
/proc/meminfo: memFree=8960720/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=156848 CPUtime=0.69 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 41555 0 0 0 65 4 0 0 23 0 1 0 659780508 160612352 33005 33554432000 4194304 4964800 140736915589296 18446744073709551615 4600347 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/20069/statm: 39212 33005 404 189 0 34086 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 156848

[startup+1.50016 s]
/proc/loadavg: 7.30 4.79 2.12 2/322 20070
/proc/meminfo: memFree=8813160/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=199136 CPUtime=1.49 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 51826 0 0 0 143 6 0 0 25 0 1 0 659780508 203915264 43276 33554432000 4194304 4964800 140736915589296 18446744073709551615 248089359045 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/20069/statm: 49784 43276 404 189 0 44658 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 199136

[startup+3.10088 s]
/proc/loadavg: 7.30 4.79 2.12 2/322 20070
/proc/meminfo: memFree=8774288/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=215524 CPUtime=3.09 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 55832 0 0 0 302 7 0 0 25 0 1 0 659780508 220696576 47282 33554432000 4194304 4964800 140736915589296 18446744073709551615 4608096 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/20069/statm: 53881 47282 404 189 0 48755 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 215524

[startup+6.30032 s]
/proc/loadavg: 6.79 4.73 2.11 2/329 20077
/proc/meminfo: memFree=8599028/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=780352 CPUtime=6.7 cores=0-7
/proc/20069/stat : 20069 (claspmt) S 20067 20069 19907 0 -1 4202496 117343 0 0 0 642 28 0 0 18 0 8 0 659780508 799080448 91070 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/20069/statm: 195088 91070 442 189 0 189437 0
[pid=20069/tid=20071] ppid=20067 vsize=780352 CPUtime=0.05 cores=0-7
/proc/20069/task/20071/stat : 20071 (claspmt) S 20067 20069 19907 0 -1 4202560 6431 0 0 0 4 1 0 0 18 0 8 0 659780923 799080448 91070 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 1 0 0 0
[pid=20069/tid=20072] ppid=20067 vsize=780352 CPUtime=0.07 cores=0-7
/proc/20069/task/20072/stat : 20072 (claspmt) S 20067 20069 19907 0 -1 4202560 9663 0 0 0 5 2 0 0 17 0 8 0 659780923 799080448 91070 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 0 0 0 0
[pid=20069/tid=20073] ppid=20067 vsize=780352 CPUtime=0.07 cores=0-7
/proc/20069/task/20073/stat : 20073 (claspmt) S 20067 20069 19907 0 -1 4202560 9725 0 0 0 5 2 0 0 18 0 8 0 659780923 799080448 91070 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 7 0 0 0
[pid=20069/tid=20074] ppid=20067 vsize=780352 CPUtime=0.05 cores=0-7
/proc/20069/task/20074/stat : 20074 (claspmt) S 20067 20069 19907 0 -1 4202560 7810 0 0 0 2 3 0 0 17 0 8 0 659780923 799080448 91070 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 6 0 0 0
[pid=20069/tid=20075] ppid=20067 vsize=780352 CPUtime=2.1 cores=0-7
/proc/20069/task/20075/stat : 20075 (claspmt) R 20067 20069 19907 0 -1 4202560 8253 0 0 0 208 2 0 0 21 0 8 0 659780923 799080448 91070 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20069/tid=20076] ppid=20067 vsize=780352 CPUtime=0.06 cores=0-7
/proc/20069/task/20076/stat : 20076 (claspmt) S 20067 20069 19907 0 -1 4202560 9854 0 0 0 3 3 0 0 17 0 8 0 659780923 799080448 91070 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 4 0 0 0
[pid=20069/tid=20077] ppid=20067 vsize=780352 CPUtime=0.09 cores=0-7
/proc/20069/task/20077/stat : 20077 (claspmt) S 20067 20069 19907 0 -1 4202560 8877 0 0 0 5 4 0 0 17 0 8 0 659780923 799080448 91070 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 6.7
Current children cumulated vsize (KiB) 780352

[startup+12.7012 s]
/proc/loadavg: 6.33 4.66 2.10 2/329 20077
/proc/meminfo: memFree=8599804/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=780352 CPUtime=13.1 cores=0-7
/proc/20069/stat : 20069 (claspmt) S 20067 20069 19907 0 -1 4202496 117348 0 0 0 1282 28 0 0 18 0 8 0 659780508 799080448 91075 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/20069/statm: 195088 91075 442 189 0 189437 0
[pid=20069/tid=20071] ppid=20067 vsize=780352 CPUtime=0.05 cores=0-7
/proc/20069/task/20071/stat : 20071 (claspmt) S 20067 20069 19907 0 -1 4202560 6431 0 0 0 4 1 0 0 18 0 8 0 659780923 799080448 91075 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 1 0 0 0
[pid=20069/tid=20072] ppid=20067 vsize=780352 CPUtime=0.07 cores=0-7
/proc/20069/task/20072/stat : 20072 (claspmt) S 20067 20069 19907 0 -1 4202560 9663 0 0 0 5 2 0 0 17 0 8 0 659780923 799080448 91075 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 0 0 0 0
[pid=20069/tid=20073] ppid=20067 vsize=780352 CPUtime=0.07 cores=0-7
/proc/20069/task/20073/stat : 20073 (claspmt) S 20067 20069 19907 0 -1 4202560 9725 0 0 0 5 2 0 0 18 0 8 0 659780923 799080448 91075 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 7 0 0 0
[pid=20069/tid=20074] ppid=20067 vsize=780352 CPUtime=0.05 cores=0-7
/proc/20069/task/20074/stat : 20074 (claspmt) S 20067 20069 19907 0 -1 4202560 7810 0 0 0 2 3 0 0 17 0 8 0 659780923 799080448 91075 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 6 0 0 0
[pid=20069/tid=20075] ppid=20067 vsize=780352 CPUtime=8.5 cores=0-7
/proc/20069/task/20075/stat : 20075 (claspmt) R 20067 20069 19907 0 -1 4202560 8258 0 0 0 848 2 0 0 25 0 8 0 659780923 799080448 91075 33554432000 4194304 4964800 140736915589296 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20069/tid=20076] ppid=20067 vsize=780352 CPUtime=0.06 cores=0-7
/proc/20069/task/20076/stat : 20076 (claspmt) S 20067 20069 19907 0 -1 4202560 9854 0 0 0 3 3 0 0 17 0 8 0 659780923 799080448 91075 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 4 0 0 0
[pid=20069/tid=20077] ppid=20067 vsize=780352 CPUtime=0.09 cores=0-7
/proc/20069/task/20077/stat : 20077 (claspmt) S 20067 20069 19907 0 -1 4202560 8877 0 0 0 5 4 0 0 17 0 8 0 659780923 799080448 91075 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 13.1
Current children cumulated vsize (KiB) 780352

[startup+25.5009 s]
/proc/loadavg: 5.15 4.48 2.08 2/329 20078
/proc/meminfo: memFree=8601664/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=780352 CPUtime=25.9 cores=0-7
/proc/20069/stat : 20069 (claspmt) S 20067 20069 19907 0 -1 4202496 117354 0 0 0 2562 28 0 0 18 0 8 0 659780508 799080448 91081 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/20069/statm: 195088 91081 442 189 0 189437 0
[pid=20069/tid=20071] ppid=20067 vsize=780352 CPUtime=0.05 cores=0-7
/proc/20069/task/20071/stat : 20071 (claspmt) S 20067 20069 19907 0 -1 4202560 6431 0 0 0 4 1 0 0 18 0 8 0 659780923 799080448 91081 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 1 0 0 0
[pid=20069/tid=20072] ppid=20067 vsize=780352 CPUtime=0.07 cores=0-7
/proc/20069/task/20072/stat : 20072 (claspmt) S 20067 20069 19907 0 -1 4202560 9663 0 0 0 5 2 0 0 17 0 8 0 659780923 799080448 91081 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 0 0 0 0
[pid=20069/tid=20073] ppid=20067 vsize=780352 CPUtime=0.07 cores=0-7
/proc/20069/task/20073/stat : 20073 (claspmt) S 20067 20069 19907 0 -1 4202560 9725 0 0 0 5 2 0 0 18 0 8 0 659780923 799080448 91081 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 7 0 0 0
[pid=20069/tid=20074] ppid=20067 vsize=780352 CPUtime=0.05 cores=0-7
/proc/20069/task/20074/stat : 20074 (claspmt) S 20067 20069 19907 0 -1 4202560 7810 0 0 0 2 3 0 0 17 0 8 0 659780923 799080448 91081 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 6 0 0 0
[pid=20069/tid=20075] ppid=20067 vsize=780352 CPUtime=21.3 cores=0-7
/proc/20069/task/20075/stat : 20075 (claspmt) R 20067 20069 19907 0 -1 4202560 8264 0 0 0 2128 2 0 0 25 0 8 0 659780923 799080448 91081 33554432000 4194304 4964800 140736915589296 18446744073709551615 4651383 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20069/tid=20076] ppid=20067 vsize=780352 CPUtime=0.06 cores=0-7
/proc/20069/task/20076/stat : 20076 (claspmt) S 20067 20069 19907 0 -1 4202560 9854 0 0 0 3 3 0 0 17 0 8 0 659780923 799080448 91081 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 4 0 0 0
[pid=20069/tid=20077] ppid=20067 vsize=780352 CPUtime=0.09 cores=0-7
/proc/20069/task/20077/stat : 20077 (claspmt) S 20067 20069 19907 0 -1 4202560 8877 0 0 0 5 4 0 0 17 0 8 0 659780923 799080448 91081 33554432000 4194304 4964800 140736915589296 18446744073709551615 248101514137 0 0 4096 18946 18446604453870412096 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 25.9
Current children cumulated vsize (KiB) 780352

[startup+51.1004 s]
/proc/loadavg: 4.81 4.43 2.13 9/329 20078
/proc/meminfo: memFree=8556956/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=780352 CPUtime=120.69 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 129603 0 0 0 12033 36 0 0 25 0 8 0 659780508 799080448 103330 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669509 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20069/statm: 195088 103330 464 189 0 189437 0
[pid=20069/tid=20071] ppid=20067 vsize=780352 CPUtime=9.99 cores=0-7
/proc/20069/task/20071/stat : 20071 (claspmt) R 20067 20069 19907 0 -1 4202560 7799 0 0 0 996 3 0 0 25 0 8 0 659780923 799080448 103330 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20069/tid=20072] ppid=20067 vsize=780352 CPUtime=10 cores=0-7
/proc/20069/task/20072/stat : 20072 (claspmt) R 20067 20069 19907 0 -1 4202560 11976 0 0 0 997 3 0 0 25 0 8 0 659780923 799080448 103330 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20069/tid=20073] ppid=20067 vsize=780352 CPUtime=9.9 cores=0-7
/proc/20069/task/20073/stat : 20073 (claspmt) R 20067 20069 19907 0 -1 4202560 10503 0 0 0 987 3 0 0 25 0 8 0 659780923 799080448 103330 33554432000 4194304 4964800 140736915589296 18446744073709551615 4378499 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20069/tid=20074] ppid=20067 vsize=780352 CPUtime=9.98 cores=0-7
/proc/20069/task/20074/stat : 20074 (claspmt) R 20067 20069 19907 0 -1 4202560 9804 0 0 0 994 4 0 0 25 0 8 0 659780923 799080448 103330 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670194 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20069/tid=20075] ppid=20067 vsize=780352 CPUtime=46.9 cores=0-7
/proc/20069/task/20075/stat : 20075 (claspmt) R 20067 20069 19907 0 -1 4202560 8276 0 0 0 4688 2 0 0 25 0 8 0 659780923 799080448 103330 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670020 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20069/tid=20076] ppid=20067 vsize=780352 CPUtime=9.99 cores=0-7
/proc/20069/task/20076/stat : 20076 (claspmt) R 20067 20069 19907 0 -1 4202560 11707 0 0 0 995 4 0 0 25 0 8 0 659780923 799080448 103330 33554432000 4194304 4964800 140736915589296 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20069/tid=20077] ppid=20067 vsize=780352 CPUtime=10.02 cores=0-7
/proc/20069/task/20077/stat : 20077 (claspmt) R 20067 20069 19907 0 -1 4202560 11771 0 0 0 996 6 0 0 25 0 8 0 659780923 799080448 103330 33554432000 4194304 4964800 140736915589296 18446744073709551615 4320976 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 120.69
Current children cumulated vsize (KiB) 780352

[startup+102.312 s]
/proc/loadavg: 6.67 5.00 2.44 9/329 20080
/proc/meminfo: memFree=8469156/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=780352 CPUtime=529.82 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 151110 0 0 0 52927 55 0 0 25 0 8 0 659780508 799080448 124837 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670180 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20069/statm: 195088 124837 464 189 0 189437 0
[pid=20069/tid=20071] ppid=20067 vsize=780352 CPUtime=61.2 cores=0-7
/proc/20069/task/20071/stat : 20071 (claspmt) R 20067 20069 19907 0 -1 4202560 9660 0 0 0 6116 4 0 0 25 0 8 0 659780923 799080448 124837 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20069/tid=20072] ppid=20067 vsize=780352 CPUtime=61.21 cores=0-7
/proc/20069/task/20072/stat : 20072 (claspmt) R 20067 20069 19907 0 -1 4202560 16605 0 0 0 6113 8 0 0 25 0 8 0 659780923 799080448 124837 33554432000 4194304 4964800 140736915589296 18446744073709551615 4378955 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20069/tid=20073] ppid=20067 vsize=780352 CPUtime=60.55 cores=0-7
/proc/20069/task/20073/stat : 20073 (claspmt) R 20067 20069 19907 0 -1 4202560 13000 0 0 0 6050 5 0 0 25 0 8 0 659780923 799080448 124837 33554432000 4194304 4964800 140736915589296 18446744073709551615 4683657 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20069/tid=20074] ppid=20067 vsize=780352 CPUtime=61.2 cores=0-7
/proc/20069/task/20074/stat : 20074 (claspmt) R 20067 20069 19907 0 -1 4202560 12569 0 0 0 6114 6 0 0 25 0 8 0 659780923 799080448 124837 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20069/tid=20075] ppid=20067 vsize=780352 CPUtime=98.11 cores=0-7
/proc/20069/task/20075/stat : 20075 (claspmt) R 20067 20069 19907 0 -1 4202560 8277 0 0 0 9809 2 0 0 25 0 8 0 659780923 799080448 124837 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670212 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20069/tid=20076] ppid=20067 vsize=780352 CPUtime=61.2 cores=0-7
/proc/20069/task/20076/stat : 20076 (claspmt) R 20067 20069 19907 0 -1 4202560 13198 0 0 0 6115 5 0 0 25 0 8 0 659780923 799080448 124837 33554432000 4194304 4964800 140736915589296 18446744073709551615 4627272 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20069/tid=20077] ppid=20067 vsize=780352 CPUtime=61.23 cores=0-7
/proc/20069/task/20077/stat : 20077 (claspmt) R 20067 20069 19907 0 -1 4202560 19284 0 0 0 6110 13 0 0 25 0 8 0 659780923 799080448 124837 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669507 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 529.82
Current children cumulated vsize (KiB) 780352

[startup+162.301 s]
/proc/loadavg: 7.56 5.56 2.79 9/329 20081
/proc/meminfo: memFree=8407700/32950928 swapFree=64721848/67111528

################
# More data... #
################

/proc/20069/task/20077/stat : 20077 (claspmt) R 20067 20069 19907 0 -1 4202560 57132 0 0 0 66060 52 0 0 25 0 8 0 659780923 1301598208 219399 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5323.18
Current children cumulated vsize (KiB) 1271092

[startup+762.313 s]
/proc/loadavg: 8.08 7.72 5.28 9/329 20106
/proc/meminfo: memFree=8036668/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=1271092 CPUtime=5802.62 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 258762 0 0 0 580084 178 0 0 25 0 8 0 659780508 1301598208 232484 33554432000 4194304 4964800 140736915589296 18446744073709551615 4668568 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20069/statm: 317773 232484 466 189 0 312122 0
[pid=20069/tid=20071] ppid=20067 vsize=1271092 CPUtime=721.18 cores=0-7
/proc/20069/task/20071/stat : 20071 (claspmt) R 20067 20069 19907 0 -1 4202560 12427 0 0 0 72111 7 0 0 25 0 8 0 659780923 1301598208 232484 33554432000 4194304 4964800 140736915589296 18446744073709551615 4370295 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20069/tid=20072] ppid=20067 vsize=1271092 CPUtime=721.22 cores=0-7
/proc/20069/task/20072/stat : 20072 (claspmt) R 20067 20069 19907 0 -1 4202560 57815 0 0 0 72062 60 0 0 25 0 8 0 659780923 1301598208 232484 33554432000 4194304 4964800 140736915589296 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20069/tid=20073] ppid=20067 vsize=1271092 CPUtime=713.41 cores=0-7
/proc/20069/task/20073/stat : 20073 (claspmt) R 20067 20069 19907 0 -1 4202560 17218 0 0 0 71329 12 0 0 25 0 8 0 659780923 1301598208 232484 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20069/tid=20074] ppid=20067 vsize=1271092 CPUtime=721.2 cores=0-7
/proc/20069/task/20074/stat : 20074 (claspmt) R 20067 20069 19907 0 -1 4202560 21332 0 0 0 72105 15 0 0 25 0 8 0 659780923 1301598208 232484 33554432000 4194304 4964800 140736915589296 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20069/tid=20075] ppid=20067 vsize=1271092 CPUtime=758.13 cores=0-7
/proc/20069/task/20075/stat : 20075 (claspmt) R 20067 20069 19907 0 -1 4202560 8307 0 0 0 75811 2 0 0 25 0 8 0 659780923 1301598208 232484 33554432000 4194304 4964800 140736915589296 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20069/tid=20076] ppid=20067 vsize=1271092 CPUtime=721.21 cores=0-7
/proc/20069/task/20076/stat : 20076 (claspmt) R 20067 20069 19907 0 -1 4202560 19199 0 0 0 72110 11 0 0 25 0 8 0 659780923 1301598208 232484 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20069/tid=20077] ppid=20067 vsize=1271092 CPUtime=721.11 cores=0-7
/proc/20069/task/20077/stat : 20077 (claspmt) R 20067 20069 19907 0 -1 4202560 62162 0 0 0 72056 55 0 0 25 0 8 0 659780923 1301598208 232484 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669280 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5802.62
Current children cumulated vsize (KiB) 1271092

[startup+822.301 s]
/proc/loadavg: 8.03 7.77 5.45 9/329 20108
/proc/meminfo: memFree=8004396/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=1336628 CPUtime=6281.9 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 266901 0 0 0 628003 187 0 0 25 0 8 0 659780508 1368707072 240603 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669350 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20069/statm: 334157 240603 466 189 0 328506 0
[pid=20069/tid=20071] ppid=20067 vsize=1336628 CPUtime=781.17 cores=0-7
/proc/20069/task/20071/stat : 20071 (claspmt) R 20067 20069 19907 0 -1 4202560 12488 0 0 0 78110 7 0 0 25 0 8 0 659780923 1368707072 240603 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20069/tid=20072] ppid=20067 vsize=1336628 CPUtime=781.22 cores=0-7
/proc/20069/task/20072/stat : 20072 (claspmt) R 20067 20069 19907 0 -1 4202560 64517 0 0 0 78054 68 0 0 25 0 8 0 659780923 1368707072 240603 33554432000 4194304 4964800 140736915589296 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20069/tid=20073] ppid=20067 vsize=1336628 CPUtime=772.78 cores=0-7
/proc/20069/task/20073/stat : 20073 (claspmt) R 20067 20069 19907 0 -1 4202560 17377 0 0 0 77266 12 0 0 25 0 8 0 659780923 1368707072 240603 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20069/tid=20074] ppid=20067 vsize=1336628 CPUtime=781.19 cores=0-7
/proc/20069/task/20074/stat : 20074 (claspmt) R 20067 20069 19907 0 -1 4202560 21498 0 0 0 78104 15 0 0 25 0 8 0 659780923 1368707072 240603 33554432000 4194304 4964800 140736915589296 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20069/tid=20075] ppid=20067 vsize=1336628 CPUtime=818.12 cores=0-7
/proc/20069/task/20075/stat : 20075 (claspmt) R 20067 20069 19907 0 -1 4202560 8317 0 0 0 81810 2 0 0 25 0 8 0 659780923 1368707072 240603 33554432000 4194304 4964800 140736915589296 18446744073709551615 4399339 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20069/tid=20076] ppid=20067 vsize=1336628 CPUtime=781.21 cores=0-7
/proc/20069/task/20076/stat : 20076 (claspmt) R 20067 20069 19907 0 -1 4202560 19618 0 0 0 78109 12 0 0 25 0 8 0 659780923 1368707072 240603 33554432000 4194304 4964800 140736915589296 18446744073709551615 4627252 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20069/tid=20077] ppid=20067 vsize=1336628 CPUtime=781.1 cores=0-7
/proc/20069/task/20077/stat : 20077 (claspmt) R 20067 20069 19907 0 -1 4202560 62759 0 0 0 78054 56 0 0 25 0 8 0 659780923 1368707072 240603 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669532 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 6281.9
Current children cumulated vsize (KiB) 1336628

[startup+882.3 s]
/proc/loadavg: 8.21 7.87 5.63 9/329 20113
/proc/meminfo: memFree=7986552/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=1350184 CPUtime=6760.4 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 271150 0 0 0 675851 189 0 0 25 0 8 0 659780508 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4678036 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20069/statm: 337546 244852 466 189 0 331895 0
[pid=20069/tid=20071] ppid=20067 vsize=1350184 CPUtime=840.33 cores=0-7
/proc/20069/task/20071/stat : 20071 (claspmt) R 20067 20069 19907 0 -1 4202560 12491 0 0 0 84026 7 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20069/tid=20072] ppid=20067 vsize=1350184 CPUtime=841.22 cores=0-7
/proc/20069/task/20072/stat : 20072 (claspmt) R 20067 20069 19907 0 -1 4202560 67891 0 0 0 84053 69 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669457 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20069/tid=20073] ppid=20067 vsize=1350184 CPUtime=832.12 cores=0-7
/proc/20069/task/20073/stat : 20073 (claspmt) R 20067 20069 19907 0 -1 4202560 17378 0 0 0 83200 12 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669078 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20069/tid=20074] ppid=20067 vsize=1350184 CPUtime=841.19 cores=0-7
/proc/20069/task/20074/stat : 20074 (claspmt) R 20067 20069 19907 0 -1 4202560 22132 0 0 0 84103 16 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669509 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20069/tid=20075] ppid=20067 vsize=1350184 CPUtime=878.12 cores=0-7
/proc/20069/task/20075/stat : 20075 (claspmt) R 20067 20069 19907 0 -1 4202560 8317 0 0 0 87810 2 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669940 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20069/tid=20076] ppid=20067 vsize=1350184 CPUtime=841.21 cores=0-7
/proc/20069/task/20076/stat : 20076 (claspmt) R 20067 20069 19907 0 -1 4202560 19621 0 0 0 84109 12 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20069/tid=20077] ppid=20067 vsize=1350184 CPUtime=841.09 cores=0-7
/proc/20069/task/20077/stat : 20077 (claspmt) R 20067 20069 19907 0 -1 4202560 62990 0 0 0 84053 56 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4668737 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 6760.4
Current children cumulated vsize (KiB) 1350184

Solver just ended. Dumping a history of the last processes samples

[startup+883.101 s]
/proc/loadavg: 8.21 7.87 5.63 9/329 20113
/proc/meminfo: memFree=7986552/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=1350184 CPUtime=6766.8 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 271150 0 0 0 676491 189 0 0 25 0 8 0 659780508 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4678036 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20069/statm: 337546 244852 466 189 0 331895 0
[pid=20069/tid=20071] ppid=20067 vsize=1350184 CPUtime=841.14 cores=0-7
/proc/20069/task/20071/stat : 20071 (claspmt) R 20067 20069 19907 0 -1 4202560 12491 0 0 0 84107 7 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20069/tid=20072] ppid=20067 vsize=1350184 CPUtime=842.02 cores=0-7
/proc/20069/task/20072/stat : 20072 (claspmt) R 20067 20069 19907 0 -1 4202560 67891 0 0 0 84133 69 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4668753 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20069/tid=20073] ppid=20067 vsize=1350184 CPUtime=832.92 cores=0-7
/proc/20069/task/20073/stat : 20073 (claspmt) R 20067 20069 19907 0 -1 4202560 17378 0 0 0 83280 12 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20069/tid=20074] ppid=20067 vsize=1350184 CPUtime=841.99 cores=0-7
/proc/20069/task/20074/stat : 20074 (claspmt) R 20067 20069 19907 0 -1 4202560 22132 0 0 0 84183 16 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20069/tid=20075] ppid=20067 vsize=1350184 CPUtime=878.92 cores=0-7
/proc/20069/task/20075/stat : 20075 (claspmt) R 20067 20069 19907 0 -1 4202560 8317 0 0 0 87890 2 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669026 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20069/tid=20076] ppid=20067 vsize=1350184 CPUtime=842.01 cores=0-7
/proc/20069/task/20076/stat : 20076 (claspmt) R 20067 20069 19907 0 -1 4202560 19621 0 0 0 84189 12 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20069/tid=20077] ppid=20067 vsize=1350184 CPUtime=841.89 cores=0-7
/proc/20069/task/20077/stat : 20077 (claspmt) R 20067 20069 19907 0 -1 4202560 62990 0 0 0 84133 56 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669389 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 6766.8
Current children cumulated vsize (KiB) 1350184

[startup+884.701 s]
/proc/loadavg: 8.19 7.87 5.64 9/329 20113
/proc/meminfo: memFree=7986548/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=1350184 CPUtime=6779.59 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 271150 0 0 0 677769 190 0 0 25 0 8 0 659780508 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670180 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20069/statm: 337546 244852 466 189 0 331895 0
[pid=20069/tid=20071] ppid=20067 vsize=1350184 CPUtime=842.73 cores=0-7
/proc/20069/task/20071/stat : 20071 (claspmt) R 20067 20069 19907 0 -1 4202560 12491 0 0 0 84266 7 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4668715 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20069/tid=20072] ppid=20067 vsize=1350184 CPUtime=843.62 cores=0-7
/proc/20069/task/20072/stat : 20072 (claspmt) R 20067 20069 19907 0 -1 4202560 67891 0 0 0 84293 69 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20069/tid=20073] ppid=20067 vsize=1350184 CPUtime=834.49 cores=0-7
/proc/20069/task/20073/stat : 20073 (claspmt) R 20067 20069 19907 0 -1 4202560 17378 0 0 0 83437 12 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4378499 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20069/tid=20074] ppid=20067 vsize=1350184 CPUtime=843.59 cores=0-7
/proc/20069/task/20074/stat : 20074 (claspmt) R 20067 20069 19907 0 -1 4202560 22132 0 0 0 84343 16 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669413 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20069/tid=20075] ppid=20067 vsize=1350184 CPUtime=880.52 cores=0-7
/proc/20069/task/20075/stat : 20075 (claspmt) R 20067 20069 19907 0 -1 4202560 8317 0 0 0 88050 2 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669509 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20069/tid=20076] ppid=20067 vsize=1350184 CPUtime=843.61 cores=0-7
/proc/20069/task/20076/stat : 20076 (claspmt) R 20067 20069 19907 0 -1 4202560 19621 0 0 0 84349 12 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669298 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20069/tid=20077] ppid=20067 vsize=1350184 CPUtime=843.49 cores=0-7
/proc/20069/task/20077/stat : 20077 (claspmt) R 20067 20069 19907 0 -1 4202560 62990 0 0 0 84293 56 0 0 25 0 8 0 659780923 1382588416 244852 33554432000 4194304 4964800 140736915589296 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 6779.59
Current children cumulated vsize (KiB) 1350184

[startup+886.301 s]
/proc/loadavg: 8.19 7.87 5.64 9/329 20113
/proc/meminfo: memFree=7986668/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=1350184 CPUtime=6792.36 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 271151 0 0 0 679045 191 0 0 18 0 8 0 659780508 1382588416 244853 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670180 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20069/statm: 337546 244853 466 189 0 331895 0
[pid=20069/tid=20071] ppid=20067 vsize=1350184 CPUtime=844.33 cores=0-7
/proc/20069/task/20071/stat : 20071 (claspmt) R 20067 20069 19907 0 -1 4202560 12491 0 0 0 84426 7 0 0 25 0 8 0 659780923 1382588416 244853 33554432000 4194304 4964800 140736915589296 18446744073709551615 4684760 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20069/tid=20072] ppid=20067 vsize=1350184 CPUtime=845.21 cores=0-7
/proc/20069/task/20072/stat : 20072 (claspmt) R 20067 20069 19907 0 -1 4202560 67892 0 0 0 84452 69 0 0 18 0 8 0 659780923 1382588416 244853 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20069/tid=20073] ppid=20067 vsize=1350184 CPUtime=836.08 cores=0-7
/proc/20069/task/20073/stat : 20073 (claspmt) R 20067 20069 19907 0 -1 4202560 17378 0 0 0 83595 13 0 0 25 0 8 0 659780923 1382588416 244853 33554432000 4194304 4964800 140736915589296 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20069/tid=20074] ppid=20067 vsize=1350184 CPUtime=845.19 cores=0-7
/proc/20069/task/20074/stat : 20074 (claspmt) R 20067 20069 19907 0 -1 4202560 22132 0 0 0 84503 16 0 0 18 0 8 0 659780923 1382588416 244853 33554432000 4194304 4964800 140736915589296 18446744073709551615 4669509 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20069/tid=20075] ppid=20067 vsize=1350184 CPUtime=882.12 cores=0-7
/proc/20069/task/20075/stat : 20075 (claspmt) R 20067 20069 19907 0 -1 4202560 8317 0 0 0 88210 2 0 0 25 0 8 0 659780923 1382588416 244853 33554432000 4194304 4964800 140736915589296 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20069/tid=20076] ppid=20067 vsize=1350184 CPUtime=845.2 cores=0-7
/proc/20069/task/20076/stat : 20076 (claspmt) R 20067 20069 19907 0 -1 4202560 19621 0 0 0 84508 12 0 0 25 0 8 0 659780923 1382588416 244853 33554432000 4194304 4964800 140736915589296 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20069/tid=20077] ppid=20067 vsize=1350184 CPUtime=845.09 cores=0-7
/proc/20069/task/20077/stat : 20077 (claspmt) R 20067 20069 19907 0 -1 4202560 62990 0 0 0 84453 56 0 0 18 0 8 0 659780923 1382588416 244853 33554432000 4194304 4964800 140736915589296 18446744073709551615 4668737 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 6792.36
Current children cumulated vsize (KiB) 1350184

[startup+886.701 s]
/proc/loadavg: 8.19 7.87 5.64 2/322 20113
/proc/meminfo: memFree=7986724/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=1318772 CPUtime=6793.65 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 271161 0 0 0 679174 191 0 0 17 0 1 0 659780508 1350422528 237010 33554432000 4194304 4964800 140736915589296 18446744073709551615 248089354139 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/20069/statm: 329693 237010 476 189 0 324042 0
Current children cumulated CPU time (s) 6793.65
Current children cumulated vsize (KiB) 1318772

[startup+887.101 s]
/proc/loadavg: 8.19 7.87 5.64 2/322 20113
/proc/meminfo: memFree=7986724/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=1260332 CPUtime=6794.04 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 271161 0 0 0 679213 191 0 0 18 0 1 0 659780508 1290579968 222251 33554432000 4194304 4964800 140736915589296 18446744073709551615 4628800 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/20069/statm: 315083 222251 476 189 0 309432 0
Current children cumulated CPU time (s) 6794.04
Current children cumulated vsize (KiB) 1260332

[startup+887.201 s]
/proc/loadavg: 8.19 7.87 5.64 2/322 20113
/proc/meminfo: memFree=7986724/32950928 swapFree=64721848/67111528
[pid=20069] ppid=20067 vsize=1248644 CPUtime=6794.14 cores=0-7
/proc/20069/stat : 20069 (claspmt) R 20067 20069 19907 0 -1 4202496 271161 0 0 0 679223 191 0 0 18 0 1 0 659780508 1278611456 217139 33554432000 4194304 4964800 140736915589296 18446744073709551615 248089347464 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/20069/statm: 312161 217139 476 189 0 306510 0
Current children cumulated CPU time (s) 6794.14
Current children cumulated vsize (KiB) 1248644

Child status: 20
Real time (s): 887.289
CPU time (s): 6794.24
CPU user time (s): 6792.29
CPU system time (s): 1.9547
CPU usage (%): 765.731
Max. virtual memory (cumulated for all children) (KiB): 1350184

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6792.29
system time used= 1.9547
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 271162
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 18896
involuntary context switches= 31178

runsolver used 2.54961 second user time and 7.02193 second system time

The end

Launcher Data 

Begin job on node123 at 2011-05-15 19:50:07
IDJOB=3380580
IDBENCH=70769
IDSOLVER=1865
FILE ID=node123/3380580-1305481807
RUNJOBID= node123-1305481205-19921
PBS_JOBID= 13325357
Free space on /tmp= 73392 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT09/APPLICATIONS/bitverif/minandmaxor/minandmaxor128.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380580-1305481807/watcher-3380580-1305481807 -o /tmp/evaluation-result-3380580-1305481807/solver-3380580-1305481807 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380580-1305481807.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 5b2e2178738883a628728bb1ec39f4a9
RANDOM SEED=249533919

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:       8961124 kB
Buffers:        329764 kB
Cached:        4389116 kB
SwapCached:      10528 kB
Active:       20662768 kB
Inactive:      3018164 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:       8961124 kB
SwapTotal:    67111528 kB
SwapFree:     64721848 kB
Dirty:           14408 kB
Writeback:           0 kB
AnonPages:    18959452 kB
Mapped:          24764 kB
Slab:           180412 kB
PageTables:      59248 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 69839340 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73388 MiB
End job on node123 at 2011-05-15 20:04:54