Trace number 3310151

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 351.341 44.4949

General information on the benchmark

Namemanol-pipe-f7nidw.cnf
MD5SUMb950ebec64dc35544d8f8bf6957e7bc2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark23.7084
Satisfiable
(Un)Satisfiability was proved
Number of variables310434
Number of clauses923497
Sum of the clauses size2154825
Maximum clause length3
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2615664
Number of clauses of size 3307832
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7
350.86/44.47	s UNSATISFIABLE
350.86/44.49	solver [5] plingeling 276-6264d55-100731 answered
350.86/44.49	Done

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310151-1303996165/watcher-3310151-1303996165 -o /tmp/evaluation-result-3310151-1303996165/solver-3310151-1303996165 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310151-1303996165.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.45 7.85 7.90 1/170 17488
/proc/meminfo: memFree=13898652/32951124 swapFree=67111528/67111528
[pid=17488] ppid=17486 vsize=18324 CPUtime=0 cores=0-7
/proc/17488/stat : 17488 (ppfolio) S 17486 17488 17409 0 -1 4202496 522 0 0 0 0 0 0 0 24 0 1 0 511217503 18763776 390 33554432000 4194304 4287625 140733224396016 18446744073709551615 270613130767 0 0 4096 65536 4594401287616856063 0 0 17 6 0 0 0
/proc/17488/statm: 4581 390 341 23 0 91 0

[startup+0.0574509 s]
/proc/loadavg: 7.45 7.85 7.90 1/170 17488
/proc/meminfo: memFree=13898652/32951124 swapFree=67111528/67111528
[pid=17488] ppid=17486 vsize=18324 CPUtime=0 cores=0-7
/proc/17488/stat : 17488 (ppfolio) S 17486 17488 17409 0 -1 4202496 522 0 0 0 0 0 0 0 24 0 1 0 511217503 18763776 390 33554432000 4194304 4287625 140733224396016 18446744073709551615 270613130767 0 0 4096 65536 4594401287616856063 0 0 17 6 0 0 0
/proc/17488/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100416 s]
/proc/loadavg: 7.45 7.85 7.90 1/170 17488
/proc/meminfo: memFree=13898652/32951124 swapFree=67111528/67111528
[pid=17488] ppid=17486 vsize=18324 CPUtime=0 cores=0-7
/proc/17488/stat : 17488 (ppfolio) S 17486 17488 17409 0 -1 4202496 522 0 0 0 0 0 0 0 24 0 1 0 511217503 18763776 390 33554432000 4194304 4287625 140733224396016 18446744073709551615 270613130767 0 0 4096 65536 4594401287616856063 0 0 17 6 0 0 0
/proc/17488/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300377 s]
/proc/loadavg: 7.45 7.85 7.90 1/170 17488
/proc/meminfo: memFree=13898652/32951124 swapFree=67111528/67111528
[pid=17488] ppid=17486 vsize=18324 CPUtime=0 cores=0-7
/proc/17488/stat : 17488 (ppfolio) S 17486 17488 17409 0 -1 4202496 522 0 0 0 0 0 0 0 24 0 1 0 511217503 18763776 390 33554432000 4194304 4287625 140733224396016 18446744073709551615 270613130767 0 0 4096 65536 4594401287616856063 0 0 17 6 0 0 0
/proc/17488/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700307 s]
/proc/loadavg: 7.45 7.85 7.90 1/170 17488
/proc/meminfo: memFree=13898652/32951124 swapFree=67111528/67111528
[pid=17488] ppid=17486 vsize=18324 CPUtime=0 cores=0-7
/proc/17488/stat : 17488 (ppfolio) S 17486 17488 17409 0 -1 4202496 522 0 0 0 0 0 0 0 21 0 1 0 511217503 18763776 390 33554432000 4194304 4287625 140733224396016 18446744073709551615 270613130767 0 0 4096 65536 4594401287616856063 0 0 17 4 0 0 0
/proc/17488/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50114 s]
/proc/loadavg: 7.45 7.85 7.90 6/176 17500
/proc/meminfo: memFree=13340480/32951124 swapFree=67111528/67111528
[pid=17488] ppid=17486 vsize=18324 CPUtime=0 cores=0-7
/proc/17488/stat : 17488 (ppfolio) S 17486 17488 17409 0 -1 4202496 522 0 0 0 0 0 0 0 21 0 1 0 511217503 18763776 390 33554432000 4194304 4287625 140733224396016 18446744073709551615 270613130767 0 0 4096 65536 4594401287616856063 0 0 17 4 0 0 0
/proc/17488/statm: 4581 390 341 23 0 91 0
[pid=17489] ppid=17488 vsize=123484 CPUtime=1.48 cores=0
/proc/17489/stat : 17489 (cryptominisat) R 17488 17488 17409 0 -1 4202496 27329 0 0 0 145 3 0 0 20 0 1 0 511217503 126447616 26429 33554432000 4194304 4587354 140735137937040 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17489/statm: 30871 26429 306 96 0 27433 0
[pid=17490] ppid=17488 vsize=173708 CPUtime=1.48 cores=1
/proc/17490/stat : 17490 (clasp) R 17488 17488 17409 0 -1 4202496 47393 0 0 0 143 5 0 0 20 0 1 0 511217503 177876992 39621 33554432000 4194304 4785740 140734091176880 18446744073709551615 270612771525 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17490/statm: 43427 39621 319 145 0 40472 0
[pid=17491] ppid=17488 vsize=516148 CPUtime=1.49 cores=2
/proc/17491/stat : 17491 (TNM) R 17488 17488 17409 0 -1 4202496 22644 0 0 0 147 2 0 0 20 0 1 0 511217503 528535552 22541 33554432000 134512640 134534564 4292394912 18446744073709551615 10786300 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17491/statm: 129037 22541 92 6 0 127703 0
[pid=17492] ppid=17488 vsize=176500 CPUtime=1.49 cores=3
/proc/17492/stat : 17492 (march_hi) R 17488 17488 17409 0 -1 4194304 66480 0 0 0 141 8 0 0 20 0 1 0 511217503 180736000 33659 33554432000 4194304 4331988 140733761174784 18446744073709551615 4251662 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17492/statm: 44125 33659 128 34 0 42567 0
[pid=17493] ppid=17488 vsize=256840 CPUtime=2.23 cores=4-7
/proc/17493/stat : 17493 (plingeling) S 17488 17488 17409 0 -1 4202496 49362 1251 0 0 217 6 0 0 22 0 5 0 511217503 263004160 36296 33554432000 4194304 4356188 140737039519040 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17493/statm: 64210 36296 142 40 0 62754 0
Current children cumulated CPU time (s) 8.17
Current children cumulated vsize (KiB) 1265004

[startup+3.10085 s]
/proc/loadavg: 7.45 7.85 7.90 9/180 17504
/proc/meminfo: memFree=13110248/32951124 swapFree=67111528/67111528
[pid=17488] ppid=17486 vsize=18324 CPUtime=0 cores=0-7
/proc/17488/stat : 17488 (ppfolio) S 17486 17488 17409 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 511217503 18763776 390 33554432000 4194304 4287625 140733224396016 18446744073709551615 270613130767 0 0 4096 65536 4594401287616856063 0 0 17 4 0 0 0
/proc/17488/statm: 4581 390 341 23 0 91 0
[pid=17489] ppid=17488 vsize=177904 CPUtime=3.09 cores=0
/proc/17489/stat : 17489 (cryptominisat) R 17488 17488 17409 0 -1 4202496 40797 0 0 0 305 4 0 0 25 0 1 0 511217503 182173696 39897 33554432000 4194304 4587354 140735137937040 18446744073709551615 4367328 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17489/statm: 44476 39897 312 96 0 41038 0
[pid=17490] ppid=17488 vsize=195972 CPUtime=3.08 cores=1
/proc/17490/stat : 17490 (clasp) R 17488 17488 17409 0 -1 4202496 52623 0 0 0 302 6 0 0 25 0 1 0 511217503 200675328 44851 33554432000 4194304 4785740 140734091176880 18446744073709551615 270612771525 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17490/statm: 48993 44851 319 145 0 46038 0
[pid=17491] ppid=17488 vsize=516544 CPUtime=3.09 cores=2
/proc/17491/stat : 17491 (TNM) R 17488 17488 17409 0 -1 4202496 31917 0 0 0 306 3 0 0 25 0 1 0 511217503 528941056 31813 33554432000 134512640 134534564 4292394912 18446744073709551615 134529953 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17491/statm: 129136 31813 95 6 0 127802 0
[pid=17492] ppid=17488 vsize=158596 CPUtime=3.08 cores=3
/proc/17492/stat : 17492 (march_hi) R 17488 17488 17409 0 -1 4202496 136306 0 0 0 290 18 0 0 25 0 1 0 511217503 162402304 29173 33554432000 4194304 4331988 140733761174784 18446744073709551615 4251963 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17492/statm: 39649 29173 140 34 0 38091 0
[pid=17493] ppid=17488 vsize=303288 CPUtime=8.63 cores=4-7
/proc/17493/stat : 17493 (plingeling) S 17488 17488 17409 0 -1 4202496 92936 1251 0 0 850 13 0 0 22 0 5 0 511217503 310566912 47891 33554432000 4194304 4356188 140737039519040 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17493/statm: 75822 47891 157 40 0 74366 0
[pid=17493/tid=17501] ppid=17488 vsize=303288 CPUtime=1.85 cores=4-7
/proc/17493/task/17501/stat : 17501 (plingeling) R 17488 17488 17409 0 -1 4202560 7463 1251 0 0 184 1 0 0 20 0 5 0 511217627 310566912 47891 33554432000 4194304 4356188 140737039519040 18446744073709551615 4244324 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17493/tid=17502] ppid=17488 vsize=303288 CPUtime=1.85 cores=4-7
/proc/17493/task/17502/stat : 17502 (plingeling) R 17488 17488 17409 0 -1 4202560 12361 1251 0 0 184 1 0 0 25 0 5 0 511217627 310566912 47891 33554432000 4194304 4356188 140737039519040 18446744073709551615 4322016 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17493/tid=17503] ppid=17488 vsize=303288 CPUtime=1.82 cores=4-7
/proc/17493/task/17503/stat : 17503 (plingeling) R 17488 17488 17409 0 -1 4202560 6107 1251 0 0 181 1 0 0 25 0 5 0 511217627 310566912 47891 33554432000 4194304 4356188 140737039519040 18446744073709551615 4258777 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17493/tid=17504] ppid=17488 vsize=303288 CPUtime=1.84 cores=4-7
/proc/17493/task/17504/stat : 17504 (plingeling) R 17488 17488 17409 0 -1 4202560 18242 1251 0 0 182 2 0 0 25 0 5 0 511217627 310566912 47891 33554432000 4194304 4356188 140737039519040 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 20.97
Current children cumulated vsize (KiB) 1370628

[startup+6.30129 s]
/proc/loadavg: 7.58 7.87 7.91 9/180 17504
/proc/meminfo: memFree=13001500/32951124 swapFree=67111528/67111528
[pid=17488] ppid=17486 vsize=18324 CPUtime=0 cores=0-7
/proc/17488/stat : 17488 (ppfolio) S 17486 17488 17409 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 511217503 18763776 390 33554432000 4194304 4287625 140733224396016 18446744073709551615 270613130767 0 0 4096 65536 4594401287616856063 0 0 17 4 0 0 0
/proc/17488/statm: 4581 390 341 23 0 91 0
[pid=17489] ppid=17488 vsize=311604 CPUtime=6.28 cores=0
/proc/17489/stat : 17489 (cryptominisat) R 17488 17488 17409 0 -1 4202496 73673 0 0 0 619 9 0 0 25 0 1 0 511217503 319082496 66117 33554432000 4194304 4587354 140735137937040 18446744073709551615 4236583 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17489/statm: 77901 66117 332 96 0 74463 0
[pid=17490] ppid=17488 vsize=194536 CPUtime=6.28 cores=1
/proc/17490/stat : 17490 (clasp) R 17488 17488 17409 0 -1 4202496 57310 0 0 0 621 7 0 0 25 0 1 0 511217503 199204864 44702 33554432000 4194304 4785740 140734091176880 18446744073709551615 4319149 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17490/statm: 48634 44702 340 145 0 45679 0
[pid=17491] ppid=17488 vsize=516544 CPUtime=6.29 cores=2
/proc/17491/stat : 17491 (TNM) R 17488 17488 17409 0 -1 4202496 31917 0 0 0 626 3 0 0 25 0 1 0 511217503 528941056 31813 33554432000 134512640 134534564 4292394912 18446744073709551615 134529352 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17491/statm: 129136 31813 95 6 0 127802 0
[pid=17492] ppid=17488 vsize=625112 CPUtime=6.28 cores=3
/proc/17492/stat : 17492 (march_hi) R 17488 17488 17409 0 -1 4202496 265073 0 0 0 592 36 0 0 25 0 1 0 511217503 640114688 72504 33554432000 4194304 4331988 140733761174784 18446744073709551615 4252228 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17492/statm: 156278 72504 151 34 0 154720 0
[pid=17493] ppid=17488 vsize=352436 CPUtime=21.4 cores=4-7
/proc/17493/stat : 17493 (plingeling) S 17488 17488 17409 0 -1 4202496 105248 1251 0 0 2125 15 0 0 22 0 5 0 511217503 360894464 60202 33554432000 4194304 4356188 140737039519040 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17493/statm: 88109 60202 163 40 0 86653 0
[pid=17493/tid=17501] ppid=17488 vsize=352436 CPUtime=5.05 cores=4-7
/proc/17493/task/17501/stat : 17501 (plingeling) R 17488 17488 17409 0 -1 4202560 11565 1251 0 0 503 2 0 0 25 0 5 0 511217627 360894464 60202 33554432000 4194304 4356188 140737039519040 18446744073709551615 4214464 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17493/tid=17502] ppid=17488 vsize=352436 CPUtime=5.05 cores=4-7
/proc/17493/task/17502/stat : 17502 (plingeling) R 17488 17488 17409 0 -1 4202560 16469 1251 0 0 503 2 0 0 25 0 5 0 511217627 360894464 60202 33554432000 4194304 4356188 140737039519040 18446744073709551615 4225315 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17493/tid=17503] ppid=17488 vsize=352436 CPUtime=5 cores=4-7
/proc/17493/task/17503/stat : 17503 (plingeling) R 17488 17488 17409 0 -1 4202560 10209 1251 0 0 498 2 0 0 25 0 5 0 511217627 360894464 60202 33554432000 4194304 4356188 140737039519040 18446744073709551615 4254795 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17493/tid=17504] ppid=17488 vsize=352436 CPUtime=5.04 cores=4-7
/proc/17493/task/17504/stat : 17504 (plingeling) R 17488 17488 17409 0 -1 4202560 18242 1251 0 0 502 2 0 0 25 0 5 0 511217627 360894464 60202 33554432000 4194304 4356188 140737039519040 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 46.53
Current children cumulated vsize (KiB) 2018556

[startup+12.7012 s]
/proc/loadavg: 7.61 7.87 7.91 9/180 17504
/proc/meminfo: memFree=12601768/32951124 swapFree=67111528/67111528
[pid=17488] ppid=17486 vsize=18324 CPUtime=0 cores=0-7
/proc/17488/stat : 17488 (ppfolio) S 17486 17488 17409 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 511217503 18763776 390 33554432000 4194304 4287625 140733224396016 18446744073709551615 270613130767 0 0 4096 65536 4594401287616856063 0 0 17 4 0 0 0
/proc/17488/statm: 4581 390 341 23 0 91 0
[pid=17489] ppid=17488 vsize=311604 CPUtime=12.69 cores=0
/proc/17489/stat : 17489 (cryptominisat) R 17488 17488 17409 0 -1 4202496 73943 0 0 0 1259 10 0 0 25 0 1 0 511217503 319082496 66375 33554432000 4194304 4587354 140735137937040 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17489/statm: 77901 66375 332 96 0 74463 0
[pid=17490] ppid=17488 vsize=194536 CPUtime=12.68 cores=1
/proc/17490/stat : 17490 (clasp) R 17488 17488 17409 0 -1 4202496 57313 0 0 0 1261 7 0 0 25 0 1 0 511217503 199204864 44705 33554432000 4194304 4785740 140734091176880 18446744073709551615 4553032 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17490/statm: 48634 44705 340 145 0 45679 0
[pid=17491] ppid=17488 vsize=516544 CPUtime=12.69 cores=2
/proc/17491/stat : 17491 (TNM) R 17488 17488 17409 0 -1 4202496 31917 0 0 0 1266 3 0 0 25 0 1 0 511217503 528941056 31813 33554432000 134512640 134534564 4292394912 18446744073709551615 134529953 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17491/statm: 129136 31813 95 6 0 127802 0
[pid=17492] ppid=17488 vsize=604960 CPUtime=12.69 cores=3
/proc/17492/stat : 17492 (march_hi) R 17488 17488 17409 0 -1 4202496 306298 0 0 0 1226 43 0 0 25 0 1 0 511217503 619479040 104234 33554432000 4194304 4331988 140733761174784 18446744073709551615 4263216 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17492/statm: 151240 104234 173 34 0 149682 0
[pid=17493] ppid=17488 vsize=405524 CPUtime=46.97 cores=4-7
/proc/17493/stat : 17493 (plingeling) S 17488 17488 17409 0 -1 4202496 122851 1251 0 0 4679 18 0 0 22 0 5 0 511217503 415256576 73474 33554432000 4194304 4356188 140737039519040 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17493/statm: 101381 73474 163 40 0 99925 0
[pid=17493/tid=17501] ppid=17488 vsize=405524 CPUtime=11.45 cores=4-7
/proc/17493/task/17501/stat : 17501 (plingeling) R 17488 17488 17409 0 -1 4202560 18773 1251 0 0 1142 3 0 0 25 0 5 0 511217627 415256576 73474 33554432000 4194304 4356188 140737039519040 18446744073709551615 4215616 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17493/tid=17502] ppid=17488 vsize=405524 CPUtime=11.46 cores=4-7
/proc/17493/task/17502/stat : 17502 (plingeling) R 17488 17488 17409 0 -1 4202560 20566 1251 0 0 1143 3 0 0 25 0 5 0 511217627 415256576 73474 33554432000 4194304 4356188 140737039519040 18446744073709551615 4239183 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17493/tid=17503] ppid=17488 vsize=405524 CPUtime=11.36 cores=4-7
/proc/17493/task/17503/stat : 17503 (plingeling) R 17488 17488 17409 0 -1 4202560 12257 1251 0 0 1134 2 0 0 25 0 5 0 511217627 415256576 73474 33554432000 4194304 4356188 140737039519040 18446744073709551615 4211178 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17493/tid=17504] ppid=17488 vsize=405524 CPUtime=11.44 cores=4-7
/proc/17493/task/17504/stat : 17504 (plingeling) R 17488 17488 17409 0 -1 4202560 22492 1251 0 0 1142 2 0 0 25 0 5 0 511217627 415256576 73474 33554432000 4194304 4356188 140737039519040 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 97.72
Current children cumulated vsize (KiB) 2051492

[startup+25.5009 s]
/proc/loadavg: 7.70 7.88 7.91 9/180 17504
/proc/meminfo: memFree=12652328/32951124 swapFree=67111528/67111528
[pid=17488] ppid=17486 vsize=18324 CPUtime=0 cores=0-7
/proc/17488/stat : 17488 (ppfolio) S 17486 17488 17409 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 511217503 18763776 390 33554432000 4194304 4287625 140733224396016 18446744073709551615 270613130767 0 0 4096 65536 4594401287616856063 0 0 17 4 0 0 0
/proc/17488/statm: 4581 390 341 23 0 91 0
[pid=17489] ppid=17488 vsize=311604 CPUtime=25.49 cores=0
/proc/17489/stat : 17489 (cryptominisat) R 17488 17488 17409 0 -1 4202496 74168 0 0 0 2539 10 0 0 25 0 1 0 511217503 319082496 66587 33554432000 4194304 4587354 140735137937040 18446744073709551615 4238297 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17489/statm: 77901 66587 338 96 0 74463 0
[pid=17490] ppid=17488 vsize=194536 CPUtime=25.48 cores=1
/proc/17490/stat : 17490 (clasp) R 17488 17488 17409 0 -1 4202496 57317 0 0 0 2541 7 0 0 25 0 1 0 511217503 199204864 44709 33554432000 4194304 4785740 140734091176880 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17490/statm: 48634 44709 340 145 0 45679 0
[pid=17491] ppid=17488 vsize=516544 CPUtime=25.49 cores=2
/proc/17491/stat : 17491 (TNM) R 17488 17488 17409 0 -1 4202496 31917 0 0 0 2546 3 0 0 25 0 1 0 511217503 528941056 31813 33554432000 134512640 134534564 4292394912 18446744073709551615 134528304 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17491/statm: 129136 31813 95 6 0 127802 0
[pid=17492] ppid=17488 vsize=604960 CPUtime=25.49 cores=3

################
# More data... #
################

/proc/17491/stat : 17491 (TNM) R 17488 17488 17409 0 -1 4202496 31917 0 0 0 3826 3 0 0 25 0 1 0 511217503 528941056 31813 33554432000 134512640 134534564 4292394912 18446744073709551615 134530659 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17491/statm: 129136 31813 95 6 0 127802 0
[pid=17492] ppid=17488 vsize=604960 CPUtime=38.29 cores=3
/proc/17492/stat : 17492 (march_hi) R 17488 17488 17409 0 -1 4202496 306298 0 0 0 3786 43 0 0 25 0 1 0 511217503 619479040 104234 33554432000 4194304 4331988 140733761174784 18446744073709551615 4229348 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17492/statm: 151240 104234 173 34 0 149682 0
[pid=17493] ppid=17488 vsize=370668 CPUtime=149.22 cores=4-7
/proc/17493/stat : 17493 (plingeling) S 17488 17488 17409 0 -1 4202496 122902 1251 0 0 14904 18 0 0 22 0 5 0 511217503 379564032 64793 33554432000 4194304 4356188 140737039519040 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17493/statm: 92667 64793 163 40 0 91211 0
[pid=17493/tid=17501] ppid=17488 vsize=370668 CPUtime=37.05 cores=4-7
/proc/17493/task/17501/stat : 17501 (plingeling) R 17488 17488 17409 0 -1 4202560 18773 1251 0 0 3702 3 0 0 25 0 5 0 511217627 379564032 64793 33554432000 4194304 4356188 140737039519040 18446744073709551615 4334501 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17493/tid=17502] ppid=17488 vsize=370668 CPUtime=37.05 cores=4-7
/proc/17493/task/17502/stat : 17502 (plingeling) R 17488 17488 17409 0 -1 4202560 20566 1251 0 0 3702 3 0 0 25 0 5 0 511217627 379564032 64793 33554432000 4194304 4356188 140737039519040 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17493/tid=17503] ppid=17488 vsize=370668 CPUtime=36.82 cores=4-7
/proc/17493/task/17503/stat : 17503 (plingeling) R 17488 17488 17409 0 -1 4202560 12308 1251 0 0 3680 2 0 0 25 0 5 0 511217627 379564032 64793 33554432000 4194304 4356188 140737039519040 18446744073709551615 4237473 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17493/tid=17504] ppid=17488 vsize=370668 CPUtime=37.03 cores=4-7
/proc/17493/task/17504/stat : 17504 (plingeling) R 17488 17488 17409 0 -1 4202560 22492 1251 0 0 3701 2 0 0 25 0 5 0 511217627 379564032 64793 33554432000 4194304 4356188 140737039519040 18446744073709551615 4331076 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 302.37
Current children cumulated vsize (KiB) 2021128

[startup+41.5011 s]
/proc/loadavg: 7.76 7.89 7.91 9/180 17505
/proc/meminfo: memFree=12630244/32951124 swapFree=67111528/67111528
[pid=17488] ppid=17486 vsize=18324 CPUtime=0 cores=0-7
/proc/17488/stat : 17488 (ppfolio) S 17486 17488 17409 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 511217503 18763776 390 33554432000 4194304 4287625 140733224396016 18446744073709551615 270613130767 0 0 4096 65536 4594401287616856063 0 0 17 4 0 0 0
/proc/17488/statm: 4581 390 341 23 0 91 0
[pid=17489] ppid=17488 vsize=316096 CPUtime=41.49 cores=0
/proc/17489/stat : 17489 (cryptominisat) R 17488 17488 17409 0 -1 4202496 80178 0 0 0 4138 11 0 0 25 0 1 0 511217503 323682304 72225 33554432000 4194304 4587354 140735137937040 18446744073709551615 4378599 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17489/statm: 79024 72225 338 96 0 75586 0
[pid=17490] ppid=17488 vsize=194536 CPUtime=41.48 cores=1
/proc/17490/stat : 17490 (clasp) R 17488 17488 17409 0 -1 4202496 57328 0 0 0 4141 7 0 0 25 0 1 0 511217503 199204864 44720 33554432000 4194304 4785740 140734091176880 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17490/statm: 48634 44720 340 145 0 45679 0
[pid=17491] ppid=17488 vsize=516544 CPUtime=41.49 cores=2
/proc/17491/stat : 17491 (TNM) R 17488 17488 17409 0 -1 4202496 31917 0 0 0 4146 3 0 0 25 0 1 0 511217503 528941056 31813 33554432000 134512640 134534564 4292394912 18446744073709551615 134529031 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17491/statm: 129136 31813 95 6 0 127802 0
[pid=17492] ppid=17488 vsize=604960 CPUtime=41.49 cores=3
/proc/17492/stat : 17492 (march_hi) R 17488 17488 17409 0 -1 4202496 306298 0 0 0 4106 43 0 0 25 0 1 0 511217503 619479040 104234 33554432000 4194304 4331988 140733761174784 18446744073709551615 4229294 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17492/statm: 151240 104234 173 34 0 149682 0
[pid=17493] ppid=17488 vsize=370588 CPUtime=162 cores=4-7
/proc/17493/stat : 17493 (plingeling) S 17488 17488 17409 0 -1 4202496 122902 1251 0 0 16182 18 0 0 22 0 5 0 511217503 379482112 64773 33554432000 4194304 4356188 140737039519040 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17493/statm: 92647 64773 163 40 0 91191 0
[pid=17493/tid=17501] ppid=17488 vsize=370588 CPUtime=40.25 cores=4-7
/proc/17493/task/17501/stat : 17501 (plingeling) R 17488 17488 17409 0 -1 4202560 18773 1251 0 0 4022 3 0 0 25 0 5 0 511217627 379482112 64773 33554432000 4194304 4356188 140737039519040 18446744073709551615 4251117 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17493/tid=17502] ppid=17488 vsize=370588 CPUtime=40.25 cores=4-7
/proc/17493/task/17502/stat : 17502 (plingeling) R 17488 17488 17409 0 -1 4202560 20566 1251 0 0 4022 3 0 0 25 0 5 0 511217627 379482112 64773 33554432000 4194304 4356188 140737039519040 18446744073709551615 4279772 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17493/tid=17503] ppid=17488 vsize=370588 CPUtime=40 cores=4-7
/proc/17493/task/17503/stat : 17503 (plingeling) R 17488 17488 17409 0 -1 4202560 12308 1251 0 0 3998 2 0 0 25 0 5 0 511217627 379482112 64773 33554432000 4194304 4356188 140737039519040 18446744073709551615 4315398 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17493/tid=17504] ppid=17488 vsize=370588 CPUtime=40.23 cores=4-7
/proc/17493/task/17504/stat : 17504 (plingeling) R 17488 17488 17409 0 -1 4202560 22492 1251 0 0 4021 2 0 0 25 0 5 0 511217627 379482112 64773 33554432000 4194304 4356188 140737039519040 18446744073709551615 4236939 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 327.95
Current children cumulated vsize (KiB) 2021048

[startup+43.1008 s]
/proc/loadavg: 7.76 7.89 7.91 9/180 17505
/proc/meminfo: memFree=12630000/32951124 swapFree=67111528/67111528
[pid=17488] ppid=17486 vsize=18324 CPUtime=0 cores=0-7
/proc/17488/stat : 17488 (ppfolio) S 17486 17488 17409 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 511217503 18763776 390 33554432000 4194304 4287625 140733224396016 18446744073709551615 270613130767 0 0 4096 65536 4594401287616856063 0 0 17 4 0 0 0
/proc/17488/statm: 4581 390 341 23 0 91 0
[pid=17489] ppid=17488 vsize=316096 CPUtime=43.09 cores=0
/proc/17489/stat : 17489 (cryptominisat) R 17488 17488 17409 0 -1 4202496 80178 0 0 0 4297 12 0 0 25 0 1 0 511217503 323682304 72225 33554432000 4194304 4587354 140735137937040 18446744073709551615 4407319 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17489/statm: 79024 72225 338 96 0 75586 0
[pid=17490] ppid=17488 vsize=194536 CPUtime=43.08 cores=1
/proc/17490/stat : 17490 (clasp) R 17488 17488 17409 0 -1 4202496 57328 0 0 0 4301 7 0 0 25 0 1 0 511217503 199204864 44720 33554432000 4194304 4785740 140734091176880 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17490/statm: 48634 44720 340 145 0 45679 0
[pid=17491] ppid=17488 vsize=516544 CPUtime=43.09 cores=2
/proc/17491/stat : 17491 (TNM) R 17488 17488 17409 0 -1 4202496 31917 0 0 0 4306 3 0 0 25 0 1 0 511217503 528941056 31813 33554432000 134512640 134534564 4292394912 18446744073709551615 134530158 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17491/statm: 129136 31813 95 6 0 127802 0
[pid=17492] ppid=17488 vsize=604960 CPUtime=43.09 cores=3
/proc/17492/stat : 17492 (march_hi) R 17488 17488 17409 0 -1 4202496 306298 0 0 0 4266 43 0 0 25 0 1 0 511217503 619479040 104234 33554432000 4194304 4331988 140733761174784 18446744073709551615 4229533 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17492/statm: 151240 104234 173 34 0 149682 0
[pid=17493] ppid=17488 vsize=370588 CPUtime=168.39 cores=4-7
/proc/17493/stat : 17493 (plingeling) S 17488 17488 17409 0 -1 4202496 122902 1251 0 0 16821 18 0 0 22 0 5 0 511217503 379482112 64773 33554432000 4194304 4356188 140737039519040 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17493/statm: 92647 64773 163 40 0 91191 0
[pid=17493/tid=17501] ppid=17488 vsize=370588 CPUtime=41.85 cores=4-7
/proc/17493/task/17501/stat : 17501 (plingeling) R 17488 17488 17409 0 -1 4202560 18773 1251 0 0 4182 3 0 0 25 0 5 0 511217627 379482112 64773 33554432000 4194304 4356188 140737039519040 18446744073709551615 4331407 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17493/tid=17502] ppid=17488 vsize=370588 CPUtime=41.85 cores=4-7
/proc/17493/task/17502/stat : 17502 (plingeling) R 17488 17488 17409 0 -1 4202560 20566 1251 0 0 4182 3 0 0 25 0 5 0 511217627 379482112 64773 33554432000 4194304 4356188 140737039519040 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17493/tid=17503] ppid=17488 vsize=370588 CPUtime=41.59 cores=4-7
/proc/17493/task/17503/stat : 17503 (plingeling) R 17488 17488 17409 0 -1 4202560 12308 1251 0 0 4157 2 0 0 25 0 5 0 511217627 379482112 64773 33554432000 4194304 4356188 140737039519040 18446744073709551615 4211178 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17493/tid=17504] ppid=17488 vsize=370588 CPUtime=41.83 cores=4-7
/proc/17493/task/17504/stat : 17504 (plingeling) R 17488 17488 17409 0 -1 4202560 22492 1251 0 0 4181 2 0 0 25 0 5 0 511217627 379482112 64773 33554432000 4194304 4356188 140737039519040 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 340.74
Current children cumulated vsize (KiB) 2021048

[startup+43.9006 s]
/proc/loadavg: 7.76 7.89 7.91 9/180 17505
/proc/meminfo: memFree=12637316/32951124 swapFree=67111528/67111528
[pid=17488] ppid=17486 vsize=18324 CPUtime=0 cores=0-7
/proc/17488/stat : 17488 (ppfolio) S 17486 17488 17409 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 511217503 18763776 390 33554432000 4194304 4287625 140733224396016 18446744073709551615 270613130767 0 0 4096 65536 4594401287616856063 0 0 17 4 0 0 0
/proc/17488/statm: 4581 390 341 23 0 91 0
[pid=17489] ppid=17488 vsize=316096 CPUtime=43.89 cores=0
/proc/17489/stat : 17489 (cryptominisat) R 17488 17488 17409 0 -1 4202496 80246 0 0 0 4377 12 0 0 25 0 1 0 511217503 323682304 72289 33554432000 4194304 4587354 140735137937040 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17489/statm: 79024 72289 338 96 0 75586 0
[pid=17490] ppid=17488 vsize=194536 CPUtime=43.89 cores=1
/proc/17490/stat : 17490 (clasp) R 17488 17488 17409 0 -1 4202496 57328 0 0 0 4382 7 0 0 25 0 1 0 511217503 199204864 44720 33554432000 4194304 4785740 140734091176880 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17490/statm: 48634 44720 340 145 0 45679 0
[pid=17491] ppid=17488 vsize=516544 CPUtime=43.89 cores=2
/proc/17491/stat : 17491 (TNM) R 17488 17488 17409 0 -1 4202496 31917 0 0 0 4386 3 0 0 25 0 1 0 511217503 528941056 31813 33554432000 134512640 134534564 4292394912 18446744073709551615 134528913 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17491/statm: 129136 31813 95 6 0 127802 0
[pid=17492] ppid=17488 vsize=604960 CPUtime=43.9 cores=3
/proc/17492/stat : 17492 (march_hi) R 17488 17488 17409 0 -1 4202496 306298 0 0 0 4347 43 0 0 25 0 1 0 511217503 619479040 104234 33554432000 4194304 4331988 140733761174784 18446744073709551615 4229520 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17492/statm: 151240 104234 173 34 0 149682 0
[pid=17493] ppid=17488 vsize=362372 CPUtime=171.6 cores=4-7
/proc/17493/stat : 17493 (plingeling) S 17488 17488 17409 0 -1 4202496 122902 1251 0 0 17142 18 0 0 22 0 5 0 511217503 371068928 62719 33554432000 4194304 4356188 140737039519040 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17493/statm: 90593 62719 163 40 0 89137 0
[pid=17493/tid=17501] ppid=17488 vsize=362372 CPUtime=42.66 cores=4-7
/proc/17493/task/17501/stat : 17501 (plingeling) R 17488 17488 17409 0 -1 4202560 18773 1251 0 0 4263 3 0 0 25 0 5 0 511217627 371068928 62719 33554432000 4194304 4356188 140737039519040 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17493/tid=17502] ppid=17488 vsize=362372 CPUtime=42.66 cores=4-7
/proc/17493/task/17502/stat : 17502 (plingeling) R 17488 17488 17409 0 -1 4202560 20566 1251 0 0 4263 3 0 0 25 0 5 0 511217627 371068928 62719 33554432000 4194304 4356188 140737039519040 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17493/tid=17503] ppid=17488 vsize=362372 CPUtime=42.39 cores=4-7
/proc/17493/task/17503/stat : 17503 (plingeling) R 17488 17488 17409 0 -1 4202560 12308 1251 0 0 4237 2 0 0 25 0 5 0 511217627 371068928 62719 33554432000 4194304 4356188 140737039519040 18446744073709551615 4261904 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17493/tid=17504] ppid=17488 vsize=362372 CPUtime=42.64 cores=4-7
/proc/17493/task/17504/stat : 17504 (plingeling) R 17488 17488 17409 0 -1 4202560 22492 1251 0 0 4262 2 0 0 25 0 5 0 511217627 371068928 62719 33554432000 4194304 4356188 140737039519040 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 347.17
Current children cumulated vsize (KiB) 2012832

[startup+44.3006 s]
/proc/loadavg: 7.76 7.89 7.91 9/180 17505
/proc/meminfo: memFree=12637316/32951124 swapFree=67111528/67111528
[pid=17488] ppid=17486 vsize=18324 CPUtime=0 cores=0-7
/proc/17488/stat : 17488 (ppfolio) S 17486 17488 17409 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 511217503 18763776 390 33554432000 4194304 4287625 140733224396016 18446744073709551615 270613130767 0 0 4096 65536 4594401287616856063 0 0 17 4 0 0 0
/proc/17488/statm: 4581 390 341 23 0 91 0
[pid=17489] ppid=17488 vsize=316096 CPUtime=44.29 cores=0
/proc/17489/stat : 17489 (cryptominisat) R 17488 17488 17409 0 -1 4202496 80281 0 0 0 4417 12 0 0 25 0 1 0 511217503 323682304 72321 33554432000 4194304 4587354 140735137937040 18446744073709551615 4250248 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17489/statm: 79024 72321 338 96 0 75586 0
[pid=17490] ppid=17488 vsize=194536 CPUtime=44.28 cores=1
/proc/17490/stat : 17490 (clasp) R 17488 17488 17409 0 -1 4202496 57328 0 0 0 4421 7 0 0 25 0 1 0 511217503 199204864 44720 33554432000 4194304 4785740 140734091176880 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17490/statm: 48634 44720 340 145 0 45679 0
[pid=17491] ppid=17488 vsize=516544 CPUtime=44.29 cores=2
/proc/17491/stat : 17491 (TNM) R 17488 17488 17409 0 -1 4202496 31917 0 0 0 4426 3 0 0 25 0 1 0 511217503 528941056 31813 33554432000 134512640 134534564 4292394912 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17491/statm: 129136 31813 95 6 0 127802 0
[pid=17492] ppid=17488 vsize=604960 CPUtime=44.29 cores=3
/proc/17492/stat : 17492 (march_hi) R 17488 17488 17409 0 -1 4202496 306298 0 0 0 4386 43 0 0 25 0 1 0 511217503 619479040 104234 33554432000 4194304 4331988 140733761174784 18446744073709551615 4229471 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17492/statm: 151240 104234 173 34 0 149682 0
[pid=17493] ppid=17488 vsize=362368 CPUtime=173.18 cores=4-7
/proc/17493/stat : 17493 (plingeling) S 17488 17488 17409 0 -1 4202496 122903 1251 0 0 17300 18 0 0 22 0 4 0 511217503 371064832 62719 33554432000 4194304 4356188 140737039519040 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17493/statm: 90592 62719 164 40 0 89136 0
[pid=17493/tid=17501] ppid=17488 vsize=362368 CPUtime=43.05 cores=4-7
/proc/17493/task/17501/stat : 17501 (plingeling) R 17488 17488 17409 0 -1 4202560 18773 1251 0 0 4302 3 0 0 25 0 4 0 511217627 371064832 62719 33554432000 4194304 4356188 140737039519040 18446744073709551615 4330859 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17493/tid=17502] ppid=17488 vsize=362368 CPUtime=43.05 cores=4-7
/proc/17493/task/17502/stat : 17502 (plingeling) R 17488 17488 17409 0 -1 4202560 20566 1251 0 0 4302 3 0 0 25 0 4 0 511217627 371064832 62719 33554432000 4194304 4356188 140737039519040 18446744073709551615 4216142 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17493/tid=17504] ppid=17488 vsize=362368 CPUtime=43.03 cores=4-7
/proc/17493/task/17504/stat : 17504 (plingeling) R 17488 17488 17409 0 -1 4202560 22492 1251 0 0 4301 2 0 0 25 0 4 0 511217627 371064832 62719 33554432000 4194304 4356188 140737039519040 18446744073709551615 4244494 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 350.33
Current children cumulated vsize (KiB) 2012828

[startup+44.4006 s]
/proc/loadavg: 7.76 7.89 7.91 9/180 17505
/proc/meminfo: memFree=12637316/32951124 swapFree=67111528/67111528
[pid=17488] ppid=17486 vsize=18324 CPUtime=0 cores=0-7
/proc/17488/stat : 17488 (ppfolio) S 17486 17488 17409 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 511217503 18763776 390 33554432000 4194304 4287625 140733224396016 18446744073709551615 270613130767 0 0 4096 65536 4594401287616856063 0 0 17 4 0 0 0
/proc/17488/statm: 4581 390 341 23 0 91 0
[pid=17489] ppid=17488 vsize=316096 CPUtime=44.39 cores=0
/proc/17489/stat : 17489 (cryptominisat) R 17488 17488 17409 0 -1 4202496 80294 0 0 0 4427 12 0 0 25 0 1 0 511217503 323682304 72334 33554432000 4194304 4587354 140735137937040 18446744073709551615 4238323 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17489/statm: 79024 72334 338 96 0 75586 0
[pid=17490] ppid=17488 vsize=194536 CPUtime=44.38 cores=1
/proc/17490/stat : 17490 (clasp) R 17488 17488 17409 0 -1 4202496 57328 0 0 0 4431 7 0 0 25 0 1 0 511217503 199204864 44720 33554432000 4194304 4785740 140734091176880 18446744073709551615 4552952 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17490/statm: 48634 44720 340 145 0 45679 0
[pid=17491] ppid=17488 vsize=516544 CPUtime=44.39 cores=2
/proc/17491/stat : 17491 (TNM) R 17488 17488 17409 0 -1 4202496 31917 0 0 0 4436 3 0 0 25 0 1 0 511217503 528941056 31813 33554432000 134512640 134534564 4292394912 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17491/statm: 129136 31813 95 6 0 127802 0
[pid=17492] ppid=17488 vsize=604960 CPUtime=44.39 cores=3
/proc/17492/stat : 17492 (march_hi) R 17488 17488 17409 0 -1 4202496 306298 0 0 0 4396 43 0 0 25 0 1 0 511217503 619479040 104234 33554432000 4194304 4331988 140733761174784 18446744073709551615 4229292 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17492/statm: 151240 104234 173 34 0 149682 0
[pid=17493] ppid=17488 vsize=362368 CPUtime=173.31 cores=4-7
/proc/17493/stat : 17493 (plingeling) S 17488 17488 17409 0 -1 4202496 122903 1251 0 0 17313 18 0 0 18 0 2 0 511217503 371064832 62719 33554432000 4194304 4356188 140737039519040 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17493/statm: 90592 62719 164 40 0 89136 0
[pid=17493/tid=17502] ppid=17488 vsize=362368 CPUtime=43.15 cores=4-7
/proc/17493/task/17502/stat : 17502 (plingeling) R 17488 17488 17409 0 -1 4202560 20566 1251 0 0 4312 3 0 0 25 0 2 0 511217627 371064832 62719 33554432000 4194304 4356188 140737039519040 18446744073709551615 4215398 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 350.86
Current children cumulated vsize (KiB) 2012828

Child status: 0
Real time (s): 44.4949
CPU time (s): 351.341
CPU user time (s): 350.413
CPU system time (s): 0.927858
CPU usage (%): 789.62
Max. virtual memory (cumulated for all children) (KiB): 2068816

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 350.413
system time used= 0.927858
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 600540
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 774
involuntary context switches= 1723

runsolver used 0.053991 second user time and 0.19297 second system time

The end

Launcher Data 

Begin job on node108 at 2011-04-28 15:09:26
IDJOB=3310151
IDBENCH=69619
IDSOLVER=1638
FILE ID=node108/3310151-1303996165
RUNJOBID= node108-1303995757-17423
PBS_JOBID= 13168782
Free space on /tmp= 72104 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT_RACE08/cnf/manol-pipe-f7nidw.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310151-1303996165/watcher-3310151-1303996165 -o /tmp/evaluation-result-3310151-1303996165/solver-3310151-1303996165 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310151-1303996165.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= b950ebec64dc35544d8f8bf6957e7bc2
RANDOM SEED=1302496998

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      13898940 kB
Buffers:       2291332 kB
Cached:       16113968 kB
SwapCached:          0 kB
Active:       10209836 kB
Inactive:      8258644 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      13898940 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           26788 kB
Writeback:           4 kB
AnonPages:       63708 kB
Mapped:          14740 kB
Slab:           518520 kB
PageTables:       4276 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   184552 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72096 MiB
End job on node108 at 2011-04-28 15:10:10