Trace number 3322593

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095UNSAT 25831.5 3687

General information on the benchmark

NameSAT03/industrial/goldberg/hard_eq_check/
x1mul.miter.shuffled-as.sat03-359.cnf
MD5SUM9edcffddbe07377cf6685697aafad673
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark622.811
Satisfiable
(Un)Satisfiability was proved
Number of variables8756
Number of clauses55571
Sum of the clauses size187746
Maximum clause length70
Minimum clause length1
Number of clauses of size 128
Number of clauses of size 212786
Number of clauses of size 325852
Number of clauses of size 40
Number of clauses of size 516904
Number of clauses of size over 51

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...390784/instance-3322593-1304390784.cnf
0.09/0.10	c Solving...
25831.41/3686.99	s UNSATISFIABLE
25831.41/3686.99	
25831.41/3686.99	c Models        : 0     
25831.41/3686.99	c Time          : 3686.901s (Solving: 3686.80s 1st Model: 0.00s Unsat: 3686.80s)
25831.41/3686.99	c CPU Time      : 25831.420s

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322593-1304390784/watcher-3322593-1304390784 -o /tmp/evaluation-result-3322593-1304390784/solver-3322593-1304390784 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3322593-1304390784.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.82 8.80 8.98 2/289 13690
/proc/meminfo: memFree=12177664/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=22824 CPUtime=0 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 1051 0 0 0 0 0 0 0 25 0 1 0 550678044 23371776 912 33554432000 4194304 4964704 140735010819088 18446744073709551615 208079893189 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/13690/statm: 5706 913 389 189 0 580 0

[startup+0.012949 s]
/proc/loadavg: 7.82 8.80 8.98 2/289 13690
/proc/meminfo: memFree=12177664/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=23172 CPUtime=0 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 1150 0 0 0 0 0 0 0 25 0 1 0 550678044 23728128 1011 33554432000 4194304 4964704 140735010819088 18446744073709551615 208080232192 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/13690/statm: 5793 1012 389 189 0 667 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 23172

[startup+0.100994 s]
/proc/loadavg: 7.82 8.80 8.98 2/289 13690
/proc/meminfo: memFree=12177664/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=28464 CPUtime=0.09 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 2717 0 0 0 9 0 0 0 25 0 1 0 550678044 29147136 2322 33554432000 4194304 4964704 140735010819088 18446744073709551615 4646249 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/13690/statm: 7116 2322 406 189 0 1990 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 28464

[startup+0.405406 s]
/proc/loadavg: 7.82 8.80 8.98 2/289 13690
/proc/meminfo: memFree=12177664/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=394252 CPUtime=1.37 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 8017 0 0 0 134 3 0 0 18 0 8 0 550678044 403714048 7012 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670145 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/13690/statm: 98563 7012 464 189 0 92912 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 394252

[startup+0.794965 s]
/proc/loadavg: 7.82 8.80 8.98 2/289 13690
/proc/meminfo: memFree=12177664/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=396248 CPUtime=12.14 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 11316 0 0 0 1209 5 0 0 20 0 8 0 550678044 405757952 10311 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669051 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/13690/statm: 99062 10311 464 189 0 93411 0
Current children cumulated CPU time (s) 12.14
Current children cumulated vsize (KiB) 396248

[startup+2.04257 s]
/proc/loadavg: 7.82 8.80 8.98 2/289 13690
/proc/meminfo: memFree=12177664/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=396512 CPUtime=12.84 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 11469 0 0 0 1279 5 0 0 20 0 8 0 550678044 406028288 10464 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669270 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/13690/statm: 99128 10464 464 189 0 93477 0
Current children cumulated CPU time (s) 12.84
Current children cumulated vsize (KiB) 396512

[startup+3.10037 s]
/proc/loadavg: 7.82 8.80 8.98 10/297 13698
/proc/meminfo: memFree=12135820/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=397928 CPUtime=20.23 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 13794 0 0 0 2017 6 0 0 20 0 8 0 550678044 407478272 12789 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/13690/statm: 99482 12789 464 189 0 93831 0
[pid=13690/tid=13692] ppid=13688 vsize=397928 CPUtime=2.06 cores=0-7
/proc/13690/task/13692/stat : 13692 (claspmt) R 13688 13690 13664 0 -1 4202560 497 0 0 0 206 0 0 0 19 0 8 0 550678055 407478272 12789 33554432000 4194304 4964704 140735010819088 18446744073709551615 4668907 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=13690/tid=13693] ppid=13688 vsize=397928 CPUtime=2.86 cores=0-7
/proc/13690/task/13693/stat : 13693 (claspmt) R 13688 13690 13664 0 -1 4202560 2387 0 0 0 285 1 0 0 21 0 8 0 550678055 407478272 12789 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670360 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=13690/tid=13694] ppid=13688 vsize=397928 CPUtime=2.84 cores=0-7
/proc/13690/task/13694/stat : 13694 (claspmt) R 13688 13690 13664 0 -1 4202560 1551 0 0 0 284 0 0 0 21 0 8 0 550678055 407478272 12789 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13690/tid=13695] ppid=13688 vsize=397928 CPUtime=2.41 cores=0-7
/proc/13690/task/13695/stat : 13695 (claspmt) R 13688 13690 13664 0 -1 4202560 1051 0 0 0 241 0 0 0 19 0 8 0 550678055 407478272 12789 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=13690/tid=13696] ppid=13688 vsize=397928 CPUtime=2.95 cores=0-7
/proc/13690/task/13696/stat : 13696 (claspmt) R 13688 13690 13664 0 -1 4202560 822 0 0 0 295 0 0 0 25 0 8 0 550678055 407478272 12789 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13690/tid=13697] ppid=13688 vsize=397928 CPUtime=2.41 cores=0-7
/proc/13690/task/13697/stat : 13697 (claspmt) R 13688 13690 13664 0 -1 4202560 1649 0 0 0 241 0 0 0 19 0 8 0 550678055 407478272 12790 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=13690/tid=13698] ppid=13688 vsize=397928 CPUtime=2.86 cores=0-7
/proc/13690/task/13698/stat : 13698 (claspmt) R 13688 13690 13664 0 -1 4202560 2559 0 0 0 285 1 0 0 21 0 8 0 550678055 407478272 12790 33554432000 4194304 4964704 140735010819088 18446744073709551615 4637196 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 20.23
Current children cumulated vsize (KiB) 397928

[startup+6.30076 s]
/proc/loadavg: 7.91 8.80 8.98 10/297 13698
/proc/meminfo: memFree=12120428/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=399712 CPUtime=42.6 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 16181 0 0 0 4253 7 0 0 25 0 8 0 550678044 409305088 15176 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/13690/statm: 99928 15176 464 189 0 94277 0
[pid=13690/tid=13692] ppid=13688 vsize=399712 CPUtime=5.26 cores=0-7
/proc/13690/task/13692/stat : 13692 (claspmt) R 13688 13690 13664 0 -1 4202560 648 0 0 0 526 0 0 0 25 0 8 0 550678055 409305088 15176 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669443 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=13690/tid=13693] ppid=13688 vsize=399712 CPUtime=6.06 cores=0-7
/proc/13690/task/13693/stat : 13693 (claspmt) R 13688 13690 13664 0 -1 4202560 2632 0 0 0 605 1 0 0 25 0 8 0 550678055 409305088 15176 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670049 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=13690/tid=13694] ppid=13688 vsize=399712 CPUtime=6.01 cores=0-7
/proc/13690/task/13694/stat : 13694 (claspmt) R 13688 13690 13664 0 -1 4202560 1702 0 0 0 601 0 0 0 25 0 8 0 550678055 409305088 15176 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13690/tid=13695] ppid=13688 vsize=399712 CPUtime=4.51 cores=0-7
/proc/13690/task/13695/stat : 13695 (claspmt) R 13688 13690 13664 0 -1 4202560 1198 0 0 0 451 0 0 0 24 0 8 0 550678055 409305088 15176 33554432000 4194304 4964704 140735010819088 18446744073709551615 4668928 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=13690/tid=13696] ppid=13688 vsize=399712 CPUtime=6.15 cores=0-7
/proc/13690/task/13696/stat : 13696 (claspmt) R 13688 13690 13664 0 -1 4202560 833 0 0 0 615 0 0 0 25 0 8 0 550678055 409305088 15176 33554432000 4194304 4964704 140735010819088 18446744073709551615 4668937 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13690/tid=13697] ppid=13688 vsize=399712 CPUtime=4.21 cores=0-7
/proc/13690/task/13697/stat : 13697 (claspmt) R 13688 13690 13664 0 -1 4202560 1745 0 0 0 421 0 0 0 24 0 8 0 550678055 409305088 15176 33554432000 4194304 4964704 140735010819088 18446744073709551615 4668742 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=13690/tid=13698] ppid=13688 vsize=399712 CPUtime=6.05 cores=0-7
/proc/13690/task/13698/stat : 13698 (claspmt) R 13688 13690 13664 0 -1 4202560 3959 0 0 0 604 1 0 0 25 0 8 0 550678055 409305088 15176 33554432000 4194304 4964704 140735010819088 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 42.6
Current children cumulated vsize (KiB) 399712

[startup+12.7005 s]
/proc/loadavg: 8.00 8.81 8.98 10/297 13698
/proc/meminfo: memFree=12094216/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=403676 CPUtime=87.27 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 22650 0 0 0 8717 10 0 0 25 0 8 0 550678044 413364224 21645 33554432000 4194304 4964704 140735010819088 18446744073709551615 4668488 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/13690/statm: 100919 21645 466 189 0 95268 0
[pid=13690/tid=13692] ppid=13688 vsize=403676 CPUtime=9.89 cores=0-7
/proc/13690/task/13692/stat : 13692 (claspmt) R 13688 13690 13664 0 -1 4202560 896 0 0 0 989 0 0 0 25 0 8 0 550678055 413364224 21645 33554432000 4194304 4964704 140735010819088 18446744073709551615 4321065 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=13690/tid=13693] ppid=13688 vsize=403676 CPUtime=10.5 cores=0-7
/proc/13690/task/13693/stat : 13693 (claspmt) R 13688 13690 13664 0 -1 4202560 3539 0 0 0 1048 2 0 0 25 0 8 0 550678055 413364224 21645 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669458 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=13690/tid=13694] ppid=13688 vsize=403676 CPUtime=12.11 cores=0-7
/proc/13690/task/13694/stat : 13694 (claspmt) R 13688 13690 13664 0 -1 4202560 2216 0 0 0 1210 1 0 0 25 0 8 0 550678055 413364224 21645 33554432000 4194304 4964704 140735010819088 18446744073709551615 4660364 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=13690/tid=13695] ppid=13688 vsize=403676 CPUtime=10.28 cores=0-7
/proc/13690/task/13695/stat : 13695 (claspmt) R 13688 13690 13664 0 -1 4202560 1560 0 0 0 1028 0 0 0 25 0 8 0 550678055 413364224 21645 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=13690/tid=13696] ppid=13688 vsize=403676 CPUtime=12.55 cores=0-7
/proc/13690/task/13696/stat : 13696 (claspmt) R 13688 13690 13664 0 -1 4202560 838 0 0 0 1255 0 0 0 25 0 8 0 550678055 413364224 21645 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13690/tid=13697] ppid=13688 vsize=403676 CPUtime=9.51 cores=0-7
/proc/13690/task/13697/stat : 13697 (claspmt) R 13688 13690 13664 0 -1 4202560 2369 0 0 0 950 1 0 0 24 0 8 0 550678055 413364224 21645 33554432000 4194304 4964704 140735010819088 18446744073709551615 4320848 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=13690/tid=13698] ppid=13688 vsize=403676 CPUtime=11.7 cores=0-7
/proc/13690/task/13698/stat : 13698 (claspmt) R 13688 13690 13664 0 -1 4202560 7523 0 0 0 1167 3 0 0 25 0 8 0 550678055 413364224 21645 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 87.27
Current children cumulated vsize (KiB) 403676

[startup+25.5011 s]
/proc/loadavg: 8.22 8.81 8.98 10/297 13699
/proc/meminfo: memFree=12054484/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=409036 CPUtime=176.73 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 32661 0 0 0 17656 17 0 0 25 0 8 0 550678044 418852864 31656 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669429 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/13690/statm: 102259 31656 466 189 0 96608 0
[pid=13690/tid=13692] ppid=13688 vsize=409036 CPUtime=18.46 cores=0-7
/proc/13690/task/13692/stat : 13692 (claspmt) R 13688 13690 13664 0 -1 4202560 1057 0 0 0 1846 0 0 0 25 0 8 0 550678055 418852864 31656 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13690/tid=13693] ppid=13688 vsize=409036 CPUtime=21.99 cores=0-7
/proc/13690/task/13693/stat : 13693 (claspmt) R 13688 13690 13664 0 -1 4202560 4499 0 0 0 2197 2 0 0 25 0 8 0 550678055 418852864 31656 33554432000 4194304 4964704 140735010819088 18446744073709551615 4668931 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=13690/tid=13694] ppid=13688 vsize=409036 CPUtime=23.25 cores=0-7
/proc/13690/task/13694/stat : 13694 (claspmt) R 13688 13690 13664 0 -1 4202560 2767 0 0 0 2324 1 0 0 25 0 8 0 550678055 418852864 31656 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13690/tid=13695] ppid=13688 vsize=409036 CPUtime=23.07 cores=0-7
/proc/13690/task/13695/stat : 13695 (claspmt) R 13688 13690 13664 0 -1 4202560 2425 0 0 0 2306 1 0 0 25 0 8 0 550678055 418852864 31656 33554432000 4194304 4964704 140735010819088 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=13690/tid=13696] ppid=13688 vsize=409036 CPUtime=24.32 cores=0-7
/proc/13690/task/13696/stat : 13696 (claspmt) R 13688 13690 13664 0 -1 4202560 2194 0 0 0 2431 1 0 0 25 0 8 0 550678055 418852864 31656 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=13690/tid=13697] ppid=13688 vsize=409036 CPUtime=21.9 cores=0-7
/proc/13690/task/13697/stat : 13697 (claspmt) R 13688 13690 13664 0 -1 4202560 2767 0 0 0 2189 1 0 0 25 0 8 0 550678055 418852864 31656 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=13690/tid=13698] ppid=13688 vsize=409036 CPUtime=22.43 cores=0-7
/proc/13690/task/13698/stat : 13698 (claspmt) R 13688 13690 13664 0 -1 4202560 12964 0 0 0 2237 6 0 0 25 0 8 0 550678055 418852864 31656 33554432000 4194304 4964704 140735010819088 18446744073709551615 4658370 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 176.73
Current children cumulated vsize (KiB) 409036

[startup+51.1012 s]
/proc/loadavg: 8.48 8.83 8.98 10/297 13699
/proc/meminfo: memFree=12026184/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=411304 CPUtime=355.66 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 39710 0 0 0 35544 22 0 0 25 0 8 0 550678044 421175296 38705 33554432000 4194304 4964704 140735010819088 18446744073709551615 4668654 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/13690/statm: 102826 38705 466 189 0 97175 0
[pid=13690/tid=13692] ppid=13688 vsize=411304 CPUtime=44.06 cores=0-7
/proc/13690/task/13692/stat : 13692 (claspmt) R 13688 13690 13664 0 -1 4202560 1695 0 0 0 4405 1 0 0 25 0 8 0 550678055 421175296 38705 33554432000 4194304 4964704 140735010819088 18446744073709551615 4658145 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13690/tid=13693] ppid=13688 vsize=411304 CPUtime=35.82 cores=0-7
/proc/13690/task/13693/stat : 13693 (claspmt) R 13688 13690 13664 0 -1 4202560 4975 0 0 0 3579 3 0 0 25 0 8 0 550678055 421175296 38705 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=13690/tid=13694] ppid=13688 vsize=411304 CPUtime=48.61 cores=0-7
/proc/13690/task/13694/stat : 13694 (claspmt) R 13688 13690 13664 0 -1 4202560 3346 0 0 0 4860 1 0 0 25 0 8 0 550678055 421175296 38705 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13690/tid=13695] ppid=13688 vsize=411304 CPUtime=48.67 cores=0-7
/proc/13690/task/13695/stat : 13695 (claspmt) R 13688 13690 13664 0 -1 4202560 3203 0 0 0 4865 2 0 0 25 0 8 0 550678055 421175296 38705 33554432000 4194304 4964704 140735010819088 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=13690/tid=13696] ppid=13688 vsize=411304 CPUtime=49.9 cores=0-7
/proc/13690/task/13696/stat : 13696 (claspmt) R 13688 13690 13664 0 -1 4202560 4084 0 0 0 4988 2 0 0 25 0 8 0 550678055 421175296 38705 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=13690/tid=13697] ppid=13688 vsize=411304 CPUtime=44.5 cores=0-7
/proc/13690/task/13697/stat : 13697 (claspmt) R 13688 13690 13664 0 -1 4202560 3055 0 0 0 4448 2 0 0 25 0 8 0 550678055 421175296 38705 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669429 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=13690/tid=13698] ppid=13688 vsize=411304 CPUtime=37.2 cores=0-7
/proc/13690/task/13698/stat : 13698 (claspmt) R 13688 13690 13664 0 -1 4202560 15138 0 0 0 3712 8 0 0 25 0 8 0 550678055 421175296 38705 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 355.66
Current children cumulated vsize (KiB) 411304

[startup+102.3 s]
/proc/loadavg: 8.85 8.88 8.99 10/297 13701
/proc/meminfo: memFree=11932524/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=434200 CPUtime=713.46 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 64092 0 0 0 71304 42 0 0 25 0 8 0 550678044 444620800 62635 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670193 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/13690/statm: 108550 62635 466 189 0 102899 0
[pid=13690/tid=13692] ppid=13688 vsize=434200 CPUtime=90.07 cores=0-7
/proc/13690/task/13692/stat : 13692 (claspmt) R 13688 13690 13664 0 -1 4202560 2339 0 0 0 9005 2 0 0 25 0 8 0 550678055 444620800 62635 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=13690/tid=13693] ppid=13688 vsize=434200 CPUtime=81.9 cores=0-7
/proc/13690/task/13693/stat : 13693 (claspmt) R 13688 13690 13664 0 -1 4202560 8378 0 0 0 8184 6 0 0 25 0 8 0 550678055 444620800 62635 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670277 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13690/tid=13694] ppid=13688 vsize=434200 CPUtime=91.9 cores=0-7
/proc/13690/task/13694/stat : 13694 (claspmt) R 13688 13690 13664 0 -1 4202560 4399 0 0 0 9187 3 0 0 25 0 8 0 550678055 444620800 62635 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0

################
# More data... #
################

/proc/loadavg: 9.02 9.05 9.03 10/297 13807
/proc/meminfo: memFree=11205696/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=1213168 CPUtime=25519.9 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 247913 0 0 0 2551715 277 0 0 25 0 8 0 550678044 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/13690/statm: 303292 242937 466 189 0 297641 0
[pid=13690/tid=13692] ppid=13688 vsize=1213168 CPUtime=3278.2 cores=0-7
/proc/13690/task/13692/stat : 13692 (claspmt) R 13688 13690 13664 0 -1 4202560 8119 0 0 0 327803 17 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=13690/tid=13693] ppid=13688 vsize=1213168 CPUtime=3348.67 cores=0-7
/proc/13690/task/13693/stat : 13693 (claspmt) R 13688 13690 13664 0 -1 4202560 21269 0 0 0 334839 28 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4668717 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=13690/tid=13694] ppid=13688 vsize=1213168 CPUtime=3050.42 cores=0-7
/proc/13690/task/13694/stat : 13694 (claspmt) R 13688 13690 13664 0 -1 4202560 8880 0 0 0 305027 15 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669112 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=13690/tid=13695] ppid=13688 vsize=1213168 CPUtime=3319.38 cores=0-7
/proc/13690/task/13695/stat : 13695 (claspmt) R 13688 13690 13664 0 -1 4202560 24631 0 0 0 331903 35 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13690/tid=13696] ppid=13688 vsize=1213168 CPUtime=3297.02 cores=0-7
/proc/13690/task/13696/stat : 13696 (claspmt) R 13688 13690 13664 0 -1 4202560 22005 0 0 0 329673 29 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4321116 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13690/tid=13697] ppid=13688 vsize=1213168 CPUtime=3026.23 cores=0-7
/proc/13690/task/13697/stat : 13697 (claspmt) R 13688 13690 13664 0 -1 4202560 9367 0 0 0 302606 17 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13690/tid=13698] ppid=13688 vsize=1213168 CPUtime=3266.37 cores=0-7
/proc/13690/task/13698/stat : 13698 (claspmt) R 13688 13690 13664 0 -1 4202560 145409 0 0 0 326516 121 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25519.9
Current children cumulated vsize (KiB) 1213168

Solver just ended. Dumping a history of the last processes samples

[startup+3662.2 s]
/proc/loadavg: 9.07 9.06 9.04 10/297 13808
/proc/meminfo: memFree=11205684/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=1213168 CPUtime=25659.1 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 247913 0 0 0 2565631 277 0 0 25 0 8 0 550678044 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669270 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/13690/statm: 303292 242937 466 189 0 297641 0
[pid=13690/tid=13692] ppid=13688 vsize=1213168 CPUtime=3298.11 cores=0-7
/proc/13690/task/13692/stat : 13692 (claspmt) R 13688 13690 13664 0 -1 4202560 8119 0 0 0 329794 17 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=13690/tid=13693] ppid=13688 vsize=1213168 CPUtime=3368.58 cores=0-7
/proc/13690/task/13693/stat : 13693 (claspmt) R 13688 13690 13664 0 -1 4202560 21269 0 0 0 336830 28 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4363491 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=13690/tid=13694] ppid=13688 vsize=1213168 CPUtime=3068.02 cores=0-7
/proc/13690/task/13694/stat : 13694 (claspmt) R 13688 13690 13664 0 -1 4202560 8880 0 0 0 306787 15 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=13690/tid=13695] ppid=13688 vsize=1213168 CPUtime=3331.18 cores=0-7
/proc/13690/task/13695/stat : 13695 (claspmt) R 13688 13690 13664 0 -1 4202560 24631 0 0 0 333083 35 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669399 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13690/tid=13696] ppid=13688 vsize=1213168 CPUtime=3307.23 cores=0-7
/proc/13690/task/13696/stat : 13696 (claspmt) R 13688 13690 13664 0 -1 4202560 22005 0 0 0 330694 29 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4362375 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=13690/tid=13697] ppid=13688 vsize=1213168 CPUtime=3046.14 cores=0-7
/proc/13690/task/13697/stat : 13697 (claspmt) R 13688 13690 13664 0 -1 4202560 9367 0 0 0 304597 17 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13690/tid=13698] ppid=13688 vsize=1213168 CPUtime=3286.28 cores=0-7
/proc/13690/task/13698/stat : 13698 (claspmt) R 13688 13690 13664 0 -1 4202560 145409 0 0 0 328507 121 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25659.1
Current children cumulated vsize (KiB) 1213168

[startup+3675 s]
/proc/loadavg: 9.06 9.05 9.04 10/297 13808
/proc/meminfo: memFree=11205560/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=1213168 CPUtime=25748.5 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 247913 0 0 0 2574573 278 0 0 25 0 8 0 550678044 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4653356 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/13690/statm: 303292 242937 466 189 0 297641 0
[pid=13690/tid=13692] ppid=13688 vsize=1213168 CPUtime=3310.9 cores=0-7
/proc/13690/task/13692/stat : 13692 (claspmt) R 13688 13690 13664 0 -1 4202560 8119 0 0 0 331073 17 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=13690/tid=13693] ppid=13688 vsize=1213168 CPUtime=3381.37 cores=0-7
/proc/13690/task/13693/stat : 13693 (claspmt) R 13688 13690 13664 0 -1 4202560 21269 0 0 0 338109 28 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=13690/tid=13694] ppid=13688 vsize=1213168 CPUtime=3074.42 cores=0-7
/proc/13690/task/13694/stat : 13694 (claspmt) R 13688 13690 13664 0 -1 4202560 8880 0 0 0 307427 15 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=13690/tid=13695] ppid=13688 vsize=1213168 CPUtime=3343.86 cores=0-7
/proc/13690/task/13695/stat : 13695 (claspmt) R 13688 13690 13664 0 -1 4202560 24631 0 0 0 334351 35 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13690/tid=13696] ppid=13688 vsize=1213168 CPUtime=3313.63 cores=0-7
/proc/13690/task/13696/stat : 13696 (claspmt) R 13688 13690 13664 0 -1 4202560 22005 0 0 0 331334 29 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=13690/tid=13697] ppid=13688 vsize=1213168 CPUtime=3058.93 cores=0-7
/proc/13690/task/13697/stat : 13697 (claspmt) R 13688 13690 13664 0 -1 4202560 9367 0 0 0 305876 17 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670590 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13690/tid=13698] ppid=13688 vsize=1213168 CPUtime=3299.07 cores=0-7
/proc/13690/task/13698/stat : 13698 (claspmt) R 13688 13690 13664 0 -1 4202560 145409 0 0 0 329786 121 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25748.5
Current children cumulated vsize (KiB) 1213168

[startup+3681.4 s]
/proc/loadavg: 9.05 9.05 9.03 10/297 13808
/proc/meminfo: memFree=11205680/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=1213168 CPUtime=25793.2 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 247913 0 0 0 2579047 278 0 0 25 0 8 0 550678044 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4660030 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/13690/statm: 303292 242937 466 189 0 297641 0
[pid=13690/tid=13692] ppid=13688 vsize=1213168 CPUtime=3315.09 cores=0-7
/proc/13690/task/13692/stat : 13692 (claspmt) R 13688 13690 13664 0 -1 4202560 8119 0 0 0 331492 17 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4668652 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=13690/tid=13693] ppid=13688 vsize=1213168 CPUtime=3387.77 cores=0-7
/proc/13690/task/13693/stat : 13693 (claspmt) R 13688 13690 13664 0 -1 4202560 21269 0 0 0 338749 28 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4342174 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=13690/tid=13694] ppid=13688 vsize=1213168 CPUtime=3079.71 cores=0-7
/proc/13690/task/13694/stat : 13694 (claspmt) R 13688 13690 13664 0 -1 4202560 8880 0 0 0 307956 15 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=13690/tid=13695] ppid=13688 vsize=1213168 CPUtime=3350.2 cores=0-7
/proc/13690/task/13695/stat : 13695 (claspmt) R 13688 13690 13664 0 -1 4202560 24631 0 0 0 334985 35 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13690/tid=13696] ppid=13688 vsize=1213168 CPUtime=3318.83 cores=0-7
/proc/13690/task/13696/stat : 13696 (claspmt) R 13688 13690 13664 0 -1 4202560 22005 0 0 0 331854 29 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=13690/tid=13697] ppid=13688 vsize=1213168 CPUtime=3065.33 cores=0-7
/proc/13690/task/13697/stat : 13697 (claspmt) R 13688 13690 13664 0 -1 4202560 9367 0 0 0 306516 17 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13690/tid=13698] ppid=13688 vsize=1213168 CPUtime=3303.6 cores=0-7
/proc/13690/task/13698/stat : 13698 (claspmt) R 13688 13690 13664 0 -1 4202560 145409 0 0 0 330239 121 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25793.2
Current children cumulated vsize (KiB) 1213168

[startup+3684.6 s]
/proc/loadavg: 9.05 9.05 9.03 10/297 13808
/proc/meminfo: memFree=11205308/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=1213168 CPUtime=25815.6 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 247913 0 0 0 2581283 278 0 0 24 0 8 0 550678044 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669429 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/13690/statm: 303292 242937 466 189 0 297641 0
[pid=13690/tid=13692] ppid=13688 vsize=1213168 CPUtime=3316.97 cores=0-7
/proc/13690/task/13692/stat : 13692 (claspmt) R 13688 13690 13664 0 -1 4202560 8119 0 0 0 331680 17 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=13690/tid=13693] ppid=13688 vsize=1213168 CPUtime=3390.97 cores=0-7
/proc/13690/task/13693/stat : 13693 (claspmt) R 13688 13690 13664 0 -1 4202560 21269 0 0 0 339069 28 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=13690/tid=13694] ppid=13688 vsize=1213168 CPUtime=3082.91 cores=0-7
/proc/13690/task/13694/stat : 13694 (claspmt) R 13688 13690 13664 0 -1 4202560 8880 0 0 0 308276 15 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=13690/tid=13695] ppid=13688 vsize=1213168 CPUtime=3353.37 cores=0-7
/proc/13690/task/13695/stat : 13695 (claspmt) R 13688 13690 13664 0 -1 4202560 24631 0 0 0 335302 35 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13690/tid=13696] ppid=13688 vsize=1213168 CPUtime=3322.03 cores=0-7
/proc/13690/task/13696/stat : 13696 (claspmt) R 13688 13690 13664 0 -1 4202560 22005 0 0 0 332174 29 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669423 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=13690/tid=13697] ppid=13688 vsize=1213168 CPUtime=3068.53 cores=0-7
/proc/13690/task/13697/stat : 13697 (claspmt) R 13688 13690 13664 0 -1 4202560 9367 0 0 0 306836 17 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13690/tid=13698] ppid=13688 vsize=1213168 CPUtime=3305.59 cores=0-7
/proc/13690/task/13698/stat : 13698 (claspmt) R 13688 13690 13664 0 -1 4202560 145409 0 0 0 330438 121 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25815.6
Current children cumulated vsize (KiB) 1213168

[startup+3686.2 s]
/proc/loadavg: 9.05 9.05 9.03 10/297 13808
/proc/meminfo: memFree=11205424/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=1213168 CPUtime=25826.8 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 247913 0 0 0 2582402 278 0 0 25 0 8 0 550678044 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669270 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/13690/statm: 303292 242937 466 189 0 297641 0
[pid=13690/tid=13692] ppid=13688 vsize=1213168 CPUtime=3318.07 cores=0-7
/proc/13690/task/13692/stat : 13692 (claspmt) R 13688 13690 13664 0 -1 4202560 8119 0 0 0 331790 17 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=13690/tid=13693] ppid=13688 vsize=1213168 CPUtime=3392.57 cores=0-7
/proc/13690/task/13693/stat : 13693 (claspmt) R 13688 13690 13664 0 -1 4202560 21269 0 0 0 339229 28 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=13690/tid=13694] ppid=13688 vsize=1213168 CPUtime=3084.51 cores=0-7
/proc/13690/task/13694/stat : 13694 (claspmt) R 13688 13690 13664 0 -1 4202560 8880 0 0 0 308436 15 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=13690/tid=13695] ppid=13688 vsize=1213168 CPUtime=3354.96 cores=0-7
/proc/13690/task/13695/stat : 13695 (claspmt) R 13688 13690 13664 0 -1 4202560 24631 0 0 0 335461 35 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13690/tid=13696] ppid=13688 vsize=1213168 CPUtime=3323.12 cores=0-7
/proc/13690/task/13696/stat : 13696 (claspmt) R 13688 13690 13664 0 -1 4202560 22005 0 0 0 332283 29 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=13690/tid=13697] ppid=13688 vsize=1213168 CPUtime=3070.13 cores=0-7
/proc/13690/task/13697/stat : 13697 (claspmt) R 13688 13690 13664 0 -1 4202560 9367 0 0 0 306996 17 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669309 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13690/tid=13698] ppid=13688 vsize=1213168 CPUtime=3307.19 cores=0-7
/proc/13690/task/13698/stat : 13698 (claspmt) R 13688 13690 13664 0 -1 4202560 145409 0 0 0 330598 121 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25826.8
Current children cumulated vsize (KiB) 1213168

[startup+3686.6 s]
/proc/loadavg: 9.05 9.05 9.03 10/297 13808
/proc/meminfo: memFree=11205424/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=1213168 CPUtime=25829.6 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202496 247913 0 0 0 2582680 278 0 0 25 0 8 0 550678044 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4668632 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/13690/statm: 303292 242937 466 189 0 297641 0
[pid=13690/tid=13692] ppid=13688 vsize=1213168 CPUtime=3318.48 cores=0-7
/proc/13690/task/13692/stat : 13692 (claspmt) R 13688 13690 13664 0 -1 4202560 8119 0 0 0 331830 18 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=13690/tid=13693] ppid=13688 vsize=1213168 CPUtime=3392.97 cores=0-7
/proc/13690/task/13693/stat : 13693 (claspmt) R 13688 13690 13664 0 -1 4202560 21269 0 0 0 339269 28 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=13690/tid=13694] ppid=13688 vsize=1213168 CPUtime=3084.91 cores=0-7
/proc/13690/task/13694/stat : 13694 (claspmt) R 13688 13690 13664 0 -1 4202560 8880 0 0 0 308476 15 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=13690/tid=13695] ppid=13688 vsize=1213168 CPUtime=3355.35 cores=0-7
/proc/13690/task/13695/stat : 13695 (claspmt) R 13688 13690 13664 0 -1 4202560 24631 0 0 0 335500 35 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4342208 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13690/tid=13696] ppid=13688 vsize=1213168 CPUtime=3323.32 cores=0-7
/proc/13690/task/13696/stat : 13696 (claspmt) R 13688 13690 13664 0 -1 4202560 22005 0 0 0 332303 29 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=13690/tid=13697] ppid=13688 vsize=1213168 CPUtime=3070.53 cores=0-7
/proc/13690/task/13697/stat : 13697 (claspmt) R 13688 13690 13664 0 -1 4202560 9367 0 0 0 307036 17 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13690/tid=13698] ppid=13688 vsize=1213168 CPUtime=3307.59 cores=0-7
/proc/13690/task/13698/stat : 13698 (claspmt) R 13688 13690 13664 0 -1 4202560 145409 0 0 0 330638 121 0 0 25 0 8 0 550678055 1242284032 242937 33554432000 4194304 4964704 140735010819088 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25829.6
Current children cumulated vsize (KiB) 1213168

[startup+3687 s]
/proc/loadavg: 9.05 9.05 9.03 10/297 13808
/proc/meminfo: memFree=11205424/32950928 swapFree=67111348/67111528
[pid=13690] ppid=13688 vsize=0 CPUtime=25831.5 cores=0-7
/proc/13690/stat : 13690 (claspmt) R 13688 13690 13664 0 -1 4202500 247924 0 0 0 2582867 284 0 0 25 0 1 0 550678044 0 0 33554432000 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/13690/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 25831.5
Current children cumulated vsize (KiB) 0

Child status: 20
Real time (s): 3687
CPU time (s): 25831.5
CPU user time (s): 25828.7
CPU system time (s): 2.84557
CPU usage (%): 700.61
Max. virtual memory (cumulated for all children) (KiB): 1213168

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 25828.7
system time used= 2.84557
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 247924
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 76708
involuntary context switches= 179361

runsolver used 9.51155 second user time and 24.0323 second system time

The end

Launcher Data 

Begin job on node127 at 2011-05-03 04:46:24
IDJOB=3322593
IDBENCH=84211
IDSOLVER=1711
FILE ID=node127/3322593-1304390784
RUNJOBID= node127-1304390784-13678
PBS_JOBID= 13181838
Free space on /tmp= 73324 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT03/industrial/goldberg/hard_eq_check/x1mul.miter.shuffled-as.sat03-359.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322593-1304390784/watcher-3322593-1304390784 -o /tmp/evaluation-result-3322593-1304390784/solver-3322593-1304390784 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3322593-1304390784.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 9edcffddbe07377cf6685697aafad673
RANDOM SEED=1961540027

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12177936 kB
Buffers:        831128 kB
Cached:        3582236 kB
SwapCached:          8 kB
Active:       16168060 kB
Inactive:      4106464 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12177936 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:            2048 kB
Writeback:           4 kB
AnonPages:    15860984 kB
Mapped:          26800 kB
Slab:           386320 kB
PageTables:      46404 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 44770088 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73320 MiB
End job on node127 at 2011-05-03 05:47:51