Trace number 3275031

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.3 5003.62

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v1375c111739g6.cnf
MD5SUMc7c04151ac14a13eb4a03259d055e119
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1375
Number of clauses111739
Sum of the clauses size224743
Maximum clause length25
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2111684
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 555

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3275031-1304144809/watcher-3275031-1304144809 -o /tmp/evaluation-result-3275031-1304144809/solver-3275031-1304144809 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3275031-1304144809.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.62 3.06 3.57 2/170 11883
/proc/meminfo: memFree=31129404/32951124 swapFree=67107188/67111528
[pid=11883] ppid=11881 vsize=18324 CPUtime=0 cores=0-7
/proc/11883/stat : 11883 (ppfolio) R 11881 11883 11857 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 526079394 18763776 390 33554432000 4194304 4287625 140736585524768 18446744073709551615 210204667407 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/11883/statm: 4581 390 341 23 0 91 0

[startup+0.0624199 s]
/proc/loadavg: 1.62 3.06 3.57 2/170 11883
/proc/meminfo: memFree=31129404/32951124 swapFree=67107188/67111528
[pid=11883] ppid=11881 vsize=18324 CPUtime=0 cores=0-7
/proc/11883/stat : 11883 (ppfolio) S 11881 11883 11857 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 526079394 18763776 390 33554432000 4194304 4287625 140736585524768 18446744073709551615 210204667407 0 0 4096 65536 11237721736017346559 0 0 17 4 0 0 0
/proc/11883/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.10042 s]
/proc/loadavg: 1.62 3.06 3.57 2/170 11883
/proc/meminfo: memFree=31129404/32951124 swapFree=67107188/67111528
[pid=11883] ppid=11881 vsize=18324 CPUtime=0 cores=0-7
/proc/11883/stat : 11883 (ppfolio) S 11881 11883 11857 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 526079394 18763776 390 33554432000 4194304 4287625 140736585524768 18446744073709551615 210204667407 0 0 4096 65536 11237721736017346559 0 0 17 4 0 0 0
/proc/11883/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300346 s]
/proc/loadavg: 1.62 3.06 3.57 2/170 11883
/proc/meminfo: memFree=31129404/32951124 swapFree=67107188/67111528
[pid=11883] ppid=11881 vsize=18324 CPUtime=0 cores=0-7
/proc/11883/stat : 11883 (ppfolio) S 11881 11883 11857 0 -1 4202496 523 0 0 0 0 0 0 0 23 0 1 0 526079394 18763776 390 33554432000 4194304 4287625 140736585524768 18446744073709551615 210204667407 0 0 4096 65536 11237721736017346559 0 0 17 4 0 0 0
/proc/11883/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700277 s]
/proc/loadavg: 1.62 3.06 3.57 2/170 11883
/proc/meminfo: memFree=31129404/32951124 swapFree=67107188/67111528
[pid=11883] ppid=11881 vsize=18324 CPUtime=0 cores=0-7
/proc/11883/stat : 11883 (ppfolio) R 11881 11883 11857 0 -1 4202496 523 0 0 0 0 0 0 0 21 0 1 0 526079394 18763776 390 33554432000 4194304 4287625 140736585524768 18446744073709551615 210204667407 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/11883/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50114 s]
/proc/loadavg: 2.29 3.18 3.60 9/180 11898
/proc/meminfo: memFree=31052568/32951124 swapFree=67107188/67111528
[pid=11883] ppid=11881 vsize=18324 CPUtime=0 cores=0-7
/proc/11883/stat : 11883 (ppfolio) S 11881 11883 11857 0 -1 4202496 523 0 0 0 0 0 0 0 16 0 1 0 526079394 18763776 390 33554432000 4194304 4287625 140736585524768 18446744073709551615 210204667407 0 0 4096 65536 11237721736017346559 0 0 17 4 0 0 0
/proc/11883/statm: 4581 390 341 23 0 91 0
[pid=11884] ppid=11883 vsize=983816 CPUtime=1.49 cores=0
/proc/11884/stat : 11884 (cryptominisat) R 11883 11883 11857 0 -1 4202496 8720 0 0 0 148 1 0 0 20 0 1 0 526079394 1007427584 5200 33554432000 4194304 4587354 140735817637328 18446744073709551615 210204343998 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11884/statm: 245954 5200 327 96 0 242516 0
[pid=11885] ppid=11883 vsize=20916 CPUtime=1.49 cores=1
/proc/11885/stat : 11885 (clasp) R 11883 11883 11857 0 -1 4202496 3378 0 0 0 149 0 0 0 20 0 1 0 526079394 21417984 2565 33554432000 4194304 4785740 140735788939104 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/11885/statm: 5229 2565 340 145 0 2274 0
[pid=11886] ppid=11883 vsize=461764 CPUtime=1.49 cores=2
/proc/11886/stat : 11886 (TNM) R 11883 11883 11857 0 -1 4202496 2806 0 0 0 149 0 0 0 25 0 1 0 526079394 472846336 2702 33554432000 134512640 134534564 4288510752 18446744073709551615 134525989 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/11886/statm: 115441 2702 95 6 0 114107 0
[pid=11887] ppid=11883 vsize=23340 CPUtime=1.48 cores=3
/proc/11887/stat : 11887 (march_hi) R 11883 11883 11857 0 -1 4202496 8670 0 0 0 148 0 0 0 20 0 1 0 526079394 23900160 2427 33554432000 4194304 4331988 140735441685616 18446744073709551615 4226263 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/11887/statm: 5835 2427 175 34 0 4277 0
[pid=11888] ppid=11883 vsize=143892 CPUtime=5.65 cores=4-7
/proc/11888/stat : 11888 (plingeling) S 11883 11883 11857 0 -1 4202496 9420 1258 0 0 564 1 0 0 18 0 5 0 526079394 147345408 7759 33554432000 4194304 4356188 140734487836784 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/11888/statm: 35973 7759 162 40 0 34517 0
[pid=11888/tid=11895] ppid=11883 vsize=143892 CPUtime=1.41 cores=4-7
/proc/11888/task/11895/stat : 11895 (plingeling) R 11883 11883 11857 0 -1 4202560 1029 1258 0 0 141 0 0 0 23 0 5 0 526079402 147345408 7759 33554432000 4194304 4356188 140734487836784 18446744073709551615 4270780 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11888/tid=11896] ppid=11883 vsize=143892 CPUtime=1.41 cores=4-7
/proc/11888/task/11896/stat : 11896 (plingeling) R 11883 11883 11857 0 -1 4202560 1069 1258 0 0 141 0 0 0 23 0 5 0 526079402 147345408 7759 33554432000 4194304 4356188 140734487836784 18446744073709551615 4211178 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11888/tid=11897] ppid=11883 vsize=143892 CPUtime=1.41 cores=4-7
/proc/11888/task/11897/stat : 11897 (plingeling) R 11883 11883 11857 0 -1 4202560 1101 1258 0 0 141 0 0 0 23 0 5 0 526079402 147345408 7759 33554432000 4194304 4356188 140734487836784 18446744073709551615 4270872 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11888/tid=11898] ppid=11883 vsize=143892 CPUtime=1.32 cores=4-7
/proc/11888/task/11898/stat : 11898 (plingeling) R 11883 11883 11857 0 -1 4202560 1613 1258 0 0 132 0 0 0 23 0 5 0 526079402 147345408 7759 33554432000 4194304 4356188 140734487836784 18446744073709551615 4279490 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.6
Current children cumulated vsize (KiB) 1652052

[startup+3.10088 s]
/proc/loadavg: 2.29 3.18 3.60 9/180 11898
/proc/meminfo: memFree=31041408/32951124 swapFree=67107188/67111528
[pid=11883] ppid=11881 vsize=18324 CPUtime=0 cores=0-7
/proc/11883/stat : 11883 (ppfolio) S 11881 11883 11857 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526079394 18763776 390 33554432000 4194304 4287625 140736585524768 18446744073709551615 210204667407 0 0 4096 65536 11237721736017346559 0 0 17 4 0 0 0
/proc/11883/statm: 4581 390 341 23 0 91 0
[pid=11884] ppid=11883 vsize=988988 CPUtime=3.09 cores=0
/proc/11884/stat : 11884 (cryptominisat) R 11883 11883 11857 0 -1 4202496 10115 0 0 0 308 1 0 0 25 0 1 0 526079394 1012723712 6586 33554432000 4194304 4587354 140735817637328 18446744073709551615 4365232 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11884/statm: 247247 6586 337 96 0 243809 0
[pid=11885] ppid=11883 vsize=26300 CPUtime=3.09 cores=1
/proc/11885/stat : 11885 (clasp) R 11883 11883 11857 0 -1 4202496 4737 0 0 0 309 0 0 0 25 0 1 0 526079394 26931200 3924 33554432000 4194304 4785740 140735788939104 18446744073709551615 4286930 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/11885/statm: 6575 3924 340 145 0 3620 0
[pid=11886] ppid=11883 vsize=461764 CPUtime=3.09 cores=2
/proc/11886/stat : 11886 (TNM) R 11883 11883 11857 0 -1 4202496 2806 0 0 0 309 0 0 0 25 0 1 0 526079394 472846336 2702 33554432000 134512640 134534564 4288510752 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/11886/statm: 115441 2702 95 6 0 114107 0
[pid=11887] ppid=11883 vsize=24220 CPUtime=3.08 cores=3
/proc/11887/stat : 11887 (march_hi) R 11883 11883 11857 0 -1 4202496 8855 0 0 0 308 0 0 0 25 0 1 0 526079394 24801280 2612 33554432000 4194304 4331988 140735441685616 18446744073709551615 4237136 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/11887/statm: 6055 2612 175 34 0 4497 0
[pid=11888] ppid=11883 vsize=150484 CPUtime=12.04 cores=4-7
/proc/11888/stat : 11888 (plingeling) S 11883 11883 11857 0 -1 4202496 11331 1258 0 0 1203 1 0 0 18 0 5 0 526079394 154095616 9670 33554432000 4194304 4356188 140734487836784 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/11888/statm: 37621 9670 162 40 0 36165 0
[pid=11888/tid=11895] ppid=11883 vsize=150484 CPUtime=3.01 cores=4-7
/proc/11888/task/11895/stat : 11895 (plingeling) R 11883 11883 11857 0 -1 4202560 1157 1258 0 0 301 0 0 0 25 0 5 0 526079402 154095616 9670 33554432000 4194304 4356188 140734487836784 18446744073709551615 4234339 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11888/tid=11896] ppid=11883 vsize=150484 CPUtime=3.01 cores=4-7
/proc/11888/task/11896/stat : 11896 (plingeling) R 11883 11883 11857 0 -1 4202560 1581 1258 0 0 301 0 0 0 25 0 5 0 526079402 154095616 9670 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11888/tid=11897] ppid=11883 vsize=150484 CPUtime=3.01 cores=4-7
/proc/11888/task/11897/stat : 11897 (plingeling) R 11883 11883 11857 0 -1 4202560 1493 1258 0 0 301 0 0 0 25 0 5 0 526079402 154095616 9670 33554432000 4194304 4356188 140734487836784 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11888/tid=11898] ppid=11883 vsize=150484 CPUtime=2.91 cores=4-7
/proc/11888/task/11898/stat : 11898 (plingeling) R 11883 11883 11857 0 -1 4202560 2492 1258 0 0 291 0 0 0 25 0 5 0 526079402 154095616 9670 33554432000 4194304 4356188 140734487836784 18446744073709551615 4281823 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.39
Current children cumulated vsize (KiB) 1670080

[startup+6.30134 s]
/proc/loadavg: 2.29 3.18 3.60 9/180 11898
/proc/meminfo: memFree=31004260/32951124 swapFree=67107188/67111528
[pid=11883] ppid=11881 vsize=18324 CPUtime=0 cores=0-7
/proc/11883/stat : 11883 (ppfolio) S 11881 11883 11857 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526079394 18763776 390 33554432000 4194304 4287625 140736585524768 18446744073709551615 210204667407 0 0 4096 65536 11237721736017346559 0 0 17 4 0 0 0
/proc/11883/statm: 4581 390 341 23 0 91 0
[pid=11884] ppid=11883 vsize=1005492 CPUtime=6.29 cores=0
/proc/11884/stat : 11884 (cryptominisat) R 11883 11883 11857 0 -1 4202496 14727 0 0 0 627 2 0 0 25 0 1 0 526079394 1029623808 9642 33554432000 4194304 4587354 140735817637328 18446744073709551615 4365336 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11884/statm: 251373 9642 337 96 0 247935 0
[pid=11885] ppid=11883 vsize=31048 CPUtime=6.28 cores=1
/proc/11885/stat : 11885 (clasp) R 11883 11883 11857 0 -1 4202496 5907 0 0 0 628 0 0 0 25 0 1 0 526079394 31793152 5094 33554432000 4194304 4785740 140735788939104 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/11885/statm: 7762 5094 340 145 0 4807 0
[pid=11886] ppid=11883 vsize=461764 CPUtime=6.28 cores=2
/proc/11886/stat : 11886 (TNM) R 11883 11883 11857 0 -1 4202496 2806 0 0 0 628 0 0 0 25 0 1 0 526079394 472846336 2702 33554432000 134512640 134534564 4288510752 18446744073709551615 134530593 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/11886/statm: 115441 2702 95 6 0 114107 0
[pid=11887] ppid=11883 vsize=25476 CPUtime=6.28 cores=3
/proc/11887/stat : 11887 (march_hi) R 11883 11883 11857 0 -1 4202496 9155 0 0 0 628 0 0 0 25 0 1 0 526079394 26087424 2912 33554432000 4194304 4331988 140735441685616 18446744073709551615 4237171 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/11887/statm: 6369 2912 175 34 0 4811 0
[pid=11888] ppid=11883 vsize=156644 CPUtime=24.82 cores=4-7
/proc/11888/stat : 11888 (plingeling) S 11883 11883 11857 0 -1 4202496 12879 1258 0 0 2481 1 0 0 18 0 5 0 526079394 160403456 11218 33554432000 4194304 4356188 140734487836784 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/11888/statm: 39161 11218 162 40 0 37705 0
[pid=11888/tid=11895] ppid=11883 vsize=156644 CPUtime=6.22 cores=4-7
/proc/11888/task/11895/stat : 11895 (plingeling) R 11883 11883 11857 0 -1 4202560 1406 1258 0 0 622 0 0 0 25 0 5 0 526079402 160403456 11218 33554432000 4194304 4356188 140734487836784 18446744073709551615 4210581 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11888/tid=11896] ppid=11883 vsize=156644 CPUtime=6.21 cores=4-7
/proc/11888/task/11896/stat : 11896 (plingeling) R 11883 11883 11857 0 -1 4202560 2280 1258 0 0 621 0 0 0 25 0 5 0 526079402 160403456 11218 33554432000 4194304 4356188 140734487836784 18446744073709551615 4210587 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11888/tid=11897] ppid=11883 vsize=156644 CPUtime=6.21 cores=4-7
/proc/11888/task/11897/stat : 11897 (plingeling) R 11883 11883 11857 0 -1 4202560 1816 1258 0 0 621 0 0 0 25 0 5 0 526079402 160403456 11218 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331002 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11888/tid=11898] ppid=11883 vsize=156644 CPUtime=6.09 cores=4-7
/proc/11888/task/11898/stat : 11898 (plingeling) R 11883 11883 11857 0 -1 4202560 2769 1258 0 0 609 0 0 0 25 0 5 0 526079402 160403456 11218 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331296 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.95
Current children cumulated vsize (KiB) 1698748

[startup+12.7013 s]
/proc/loadavg: 3.17 3.34 3.65 9/180 11898
/proc/meminfo: memFree=30988572/32951124 swapFree=67107188/67111528
[pid=11883] ppid=11881 vsize=18324 CPUtime=0 cores=0-7
/proc/11883/stat : 11883 (ppfolio) S 11881 11883 11857 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526079394 18763776 390 33554432000 4194304 4287625 140736585524768 18446744073709551615 210204667407 0 0 4096 65536 11237721736017346559 0 0 17 4 0 0 0
/proc/11883/statm: 4581 390 341 23 0 91 0
[pid=11884] ppid=11883 vsize=1006520 CPUtime=12.69 cores=0
/proc/11884/stat : 11884 (cryptominisat) R 11883 11883 11857 0 -1 4202496 17945 0 0 0 1266 3 0 0 25 0 1 0 526079394 1030676480 11293 33554432000 4194304 4587354 140735817637328 18446744073709551615 4238616 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11884/statm: 251630 11293 337 96 0 248192 0
[pid=11885] ppid=11883 vsize=34064 CPUtime=12.68 cores=1
/proc/11885/stat : 11885 (clasp) R 11883 11883 11857 0 -1 4202496 6612 0 0 0 1268 0 0 0 25 0 1 0 526079394 34881536 5799 33554432000 4194304 4785740 140735788939104 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/11885/statm: 8516 5799 340 145 0 5561 0
[pid=11886] ppid=11883 vsize=461764 CPUtime=12.68 cores=2
/proc/11886/stat : 11886 (TNM) R 11883 11883 11857 0 -1 4202496 2806 0 0 0 1268 0 0 0 25 0 1 0 526079394 472846336 2702 33554432000 134512640 134534564 4288510752 18446744073709551615 134528643 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/11886/statm: 115441 2702 95 6 0 114107 0
[pid=11887] ppid=11883 vsize=27860 CPUtime=12.69 cores=3
/proc/11887/stat : 11887 (march_hi) R 11883 11883 11857 0 -1 4202496 9711 0 0 0 1268 1 0 0 25 0 1 0 526079394 28528640 3468 33554432000 4194304 4331988 140735441685616 18446744073709551615 4228235 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/11887/statm: 6965 3468 175 34 0 5407 0
[pid=11888] ppid=11883 vsize=165604 CPUtime=50.38 cores=4-7
/proc/11888/stat : 11888 (plingeling) S 11883 11883 11857 0 -1 4202496 15135 1258 0 0 5037 1 0 0 18 0 5 0 526079394 169578496 13474 33554432000 4194304 4356188 140734487836784 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/11888/statm: 41401 13474 162 40 0 39945 0
[pid=11888/tid=11895] ppid=11883 vsize=165604 CPUtime=12.61 cores=4-7
/proc/11888/task/11895/stat : 11895 (plingeling) R 11883 11883 11857 0 -1 4202560 1662 1258 0 0 1261 0 0 0 25 0 5 0 526079402 169578496 13474 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331345 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11888/tid=11896] ppid=11883 vsize=165604 CPUtime=12.61 cores=4-7
/proc/11888/task/11896/stat : 11896 (plingeling) R 11883 11883 11857 0 -1 4202560 2536 1258 0 0 1261 0 0 0 25 0 5 0 526079402 169578496 13474 33554432000 4194304 4356188 140734487836784 18446744073709551615 4210791 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11888/tid=11897] ppid=11883 vsize=165604 CPUtime=12.61 cores=4-7
/proc/11888/task/11897/stat : 11897 (plingeling) R 11883 11883 11857 0 -1 4202560 1832 1258 0 0 1261 0 0 0 25 0 5 0 526079402 169578496 13474 33554432000 4194304 4356188 140734487836784 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11888/tid=11898] ppid=11883 vsize=165604 CPUtime=12.45 cores=4-7
/proc/11888/task/11898/stat : 11898 (plingeling) R 11883 11883 11857 0 -1 4202560 4497 1258 0 0 1245 0 0 0 25 0 5 0 526079402 169578496 13474 33554432000 4194304 4356188 140734487836784 18446744073709551615 4330964 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.12
Current children cumulated vsize (KiB) 1714136

[startup+25.5011 s]
/proc/loadavg: 3.91 3.49 3.70 9/180 11898
/proc/meminfo: memFree=30938588/32951124 swapFree=67107188/67111528
[pid=11883] ppid=11881 vsize=18324 CPUtime=0 cores=0-7
/proc/11883/stat : 11883 (ppfolio) S 11881 11883 11857 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526079394 18763776 390 33554432000 4194304 4287625 140736585524768 18446744073709551615 210204667407 0 0 4096 65536 11237721736017346559 0 0 17 4 0 0 0
/proc/11883/statm: 4581 390 341 23 0 91 0
[pid=11884] ppid=11883 vsize=1036712 CPUtime=25.49 cores=0
/proc/11884/stat : 11884 (cryptominisat) R 11883 11883 11857 0 -1 4202496 27661 0 0 0 2545 4 0 0 25 0 1 0 526079394 1061593088 19204 33554432000 4194304 4587354 140735817637328 18446744073709551615 4388277 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=11886] ppid=11883 vsize=461764 CPUtime=4782.2 cores=2
/proc/11886/stat : 11886 (TNM) R 11883 11883 11857 0 -1 4202496 2806 0 0 0 478218 2 0 0 25 0 1 0 526079394 472846336 2702 33554432000 134512640 134534564 4288510752 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/11886/statm: 115441 2702 95 6 0 114107 0
[pid=11887] ppid=11883 vsize=1171640 CPUtime=4782.36 cores=3
/proc/11887/stat : 11887 (march_hi) R 11883 11883 11857 0 -1 4202496 260971 0 0 0 478053 183 0 0 25 0 1 0 526079394 1199759360 254306 33554432000 4194304 4331988 140735441685616 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/11887/statm: 292910 254306 175 34 0 291352 0
[pid=11888] ppid=11883 vsize=485844 CPUtime=19101.8 cores=4-7
/proc/11888/stat : 11888 (plingeling) S 11883 11883 11857 0 -1 4202496 3163424 1258 0 0 1909760 419 0 0 18 0 5 0 526079394 497504256 93566 33554432000 4194304 4356188 140734487836784 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/11888/statm: 121461 93566 162 40 0 120005 0
[pid=11888/tid=11895] ppid=11883 vsize=485844 CPUtime=4782.27 cores=4-7
/proc/11888/task/11895/stat : 11895 (plingeling) R 11883 11883 11857 0 -1 4202560 787845 1258 0 0 478131 96 0 0 25 0 5 0 526079402 497504256 93566 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11888/tid=11896] ppid=11883 vsize=485844 CPUtime=4781.16 cores=4-7
/proc/11888/task/11896/stat : 11896 (plingeling) R 11883 11883 11857 0 -1 4202560 808069 1258 0 0 478003 113 0 0 25 0 5 0 526079402 497504256 93566 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331086 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11888/tid=11897] ppid=11883 vsize=485844 CPUtime=4782.27 cores=4-7
/proc/11888/task/11897/stat : 11897 (plingeling) R 11883 11883 11857 0 -1 4202560 805371 1258 0 0 478114 113 0 0 25 0 5 0 526079402 497504256 93566 33554432000 4194304 4356188 140734487836784 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11888/tid=11898] ppid=11883 vsize=485844 CPUtime=4755.99 cores=4-7
/proc/11888/task/11898/stat : 11898 (plingeling) R 11883 11883 11857 0 -1 4202560 757531 1258 0 0 475504 95 0 0 25 0 5 0 526079402 497504256 93566 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331296 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38231
Current children cumulated vsize (KiB) 3507760

[startup+4842.3 s]
/proc/loadavg: 8.11 8.03 7.98 9/180 12039
/proc/meminfo: memFree=29281020/32951124 swapFree=67107188/67111528
[pid=11883] ppid=11881 vsize=18324 CPUtime=0 cores=0-7
/proc/11883/stat : 11883 (ppfolio) S 11881 11883 11857 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526079394 18763776 390 33554432000 4194304 4287625 140736585524768 18446744073709551615 210204667407 0 0 4096 65536 11237721736017346559 0 0 17 4 0 0 0
/proc/11883/statm: 4581 390 341 23 0 91 0
[pid=11884] ppid=11883 vsize=1169760 CPUtime=4842.35 cores=0
/proc/11884/stat : 11884 (cryptominisat) R 11883 11883 11857 0 -1 4202496 605924 0 0 0 483938 297 0 0 25 0 1 0 526079394 1197834240 53139 33554432000 4194304 4587354 140735817637328 18446744073709551615 4238406 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11884/statm: 292440 53139 337 96 0 289002 0
[pid=11885] ppid=11883 vsize=201520 CPUtime=4842.35 cores=1
/proc/11885/stat : 11885 (clasp) R 11883 11883 11857 0 -1 4202496 45679 0 0 0 484222 13 0 0 25 0 1 0 526079394 206356480 44866 33554432000 4194304 4785740 140735788939104 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/11885/statm: 50380 44866 340 145 0 47425 0
[pid=11886] ppid=11883 vsize=461764 CPUtime=4842.2 cores=2
/proc/11886/stat : 11886 (TNM) R 11883 11883 11857 0 -1 4202496 2806 0 0 0 484218 2 0 0 25 0 1 0 526079394 472846336 2702 33554432000 134512640 134534564 4288510752 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/11886/statm: 115441 2702 95 6 0 114107 0
[pid=11887] ppid=11883 vsize=1171640 CPUtime=4842.36 cores=3
/proc/11887/stat : 11887 (march_hi) R 11883 11883 11857 0 -1 4202496 264971 0 0 0 484050 186 0 0 25 0 1 0 526079394 1199759360 258306 33554432000 4194304 4331988 140735441685616 18446744073709551615 4226479 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/11887/statm: 292910 258306 175 34 0 291352 0
[pid=11888] ppid=11883 vsize=522708 CPUtime=19341.5 cores=4-7
/proc/11888/stat : 11888 (plingeling) S 11883 11883 11857 0 -1 4202496 3204640 1258 0 0 1933722 424 0 0 18 0 5 0 526079394 535252992 102782 33554432000 4194304 4356188 140734487836784 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/11888/statm: 130677 102782 162 40 0 129221 0
[pid=11888/tid=11895] ppid=11883 vsize=522708 CPUtime=4842.26 cores=4-7
/proc/11888/task/11895/stat : 11895 (plingeling) R 11883 11883 11857 0 -1 4202560 795013 1258 0 0 484130 96 0 0 25 0 5 0 526079402 535252992 102782 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11888/tid=11896] ppid=11883 vsize=522708 CPUtime=4841.17 cores=4-7
/proc/11888/task/11896/stat : 11896 (plingeling) R 11883 11883 11857 0 -1 4202560 819333 1258 0 0 484002 115 0 0 25 0 5 0 526079402 535252992 102782 33554432000 4194304 4356188 140734487836784 18446744073709551615 4244402 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11888/tid=11897] ppid=11883 vsize=522708 CPUtime=4842.27 cores=4-7
/proc/11888/task/11897/stat : 11897 (plingeling) R 11883 11883 11857 0 -1 4202560 816379 1258 0 0 484113 114 0 0 25 0 5 0 526079402 535252992 102782 33554432000 4194304 4356188 140734487836784 18446744073709551615 4330999 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11888/tid=11898] ppid=11883 vsize=522708 CPUtime=4815.65 cores=4-7
/proc/11888/task/11898/stat : 11898 (plingeling) R 11883 11883 11857 0 -1 4202560 769307 1258 0 0 481469 96 0 0 25 0 5 0 526079402 535252992 102782 33554432000 4194304 4356188 140734487836784 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38710.7
Current children cumulated vsize (KiB) 3545716

[startup+4902.3 s]
/proc/loadavg: 8.11 8.04 7.99 9/180 12041
/proc/meminfo: memFree=29321516/32951124 swapFree=67107188/67111528
[pid=11883] ppid=11881 vsize=18324 CPUtime=0 cores=0-7
/proc/11883/stat : 11883 (ppfolio) S 11881 11883 11857 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526079394 18763776 390 33554432000 4194304 4287625 140736585524768 18446744073709551615 210204667407 0 0 4096 65536 11237721736017346559 0 0 17 4 0 0 0
/proc/11883/statm: 4581 390 341 23 0 91 0
[pid=11884] ppid=11883 vsize=1168912 CPUtime=4902.35 cores=0
/proc/11884/stat : 11884 (cryptominisat) R 11883 11883 11857 0 -1 4202496 612634 0 0 0 489934 301 0 0 25 0 1 0 526079394 1196965888 54603 33554432000 4194304 4587354 140735817637328 18446744073709551615 4238611 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11884/statm: 292228 54603 337 96 0 288790 0
[pid=11885] ppid=11883 vsize=202584 CPUtime=4902.35 cores=1
/proc/11885/stat : 11885 (clasp) R 11883 11883 11857 0 -1 4202496 45901 0 0 0 490222 13 0 0 25 0 1 0 526079394 207446016 45088 33554432000 4194304 4785740 140735788939104 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/11885/statm: 50646 45088 340 145 0 47691 0
[pid=11886] ppid=11883 vsize=461764 CPUtime=4902.2 cores=2
/proc/11886/stat : 11886 (TNM) R 11883 11883 11857 0 -1 4202496 2806 0 0 0 490218 2 0 0 25 0 1 0 526079394 472846336 2702 33554432000 134512640 134534564 4288510752 18446744073709551615 134528523 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/11886/statm: 115441 2702 95 6 0 114107 0
[pid=11887] ppid=11883 vsize=1171640 CPUtime=4902.36 cores=3
/proc/11887/stat : 11887 (march_hi) R 11883 11883 11857 0 -1 4202496 268990 0 0 0 490047 189 0 0 25 0 1 0 526079394 1199759360 262325 33554432000 4194304 4331988 140735441685616 18446744073709551615 4297280 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/11887/statm: 292910 262325 175 34 0 291352 0
[pid=11888] ppid=11883 vsize=464340 CPUtime=19581.1 cores=4-7
/proc/11888/stat : 11888 (plingeling) S 11883 11883 11857 0 -1 4202496 3235104 1258 0 0 1957684 429 0 0 18 0 5 0 526079394 475484160 88190 33554432000 4194304 4356188 140734487836784 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/11888/statm: 116085 88190 162 40 0 114629 0
[pid=11888/tid=11895] ppid=11883 vsize=464340 CPUtime=4902.27 cores=4-7
/proc/11888/task/11895/stat : 11895 (plingeling) R 11883 11883 11857 0 -1 4202560 803717 1258 0 0 490129 98 0 0 25 0 5 0 526079402 475484160 88190 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11888/tid=11896] ppid=11883 vsize=464340 CPUtime=4901.17 cores=4-7
/proc/11888/task/11896/stat : 11896 (plingeling) R 11883 11883 11857 0 -1 4202560 827013 1258 0 0 490000 117 0 0 25 0 5 0 526079402 475484160 88190 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331984 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11888/tid=11897] ppid=11883 vsize=464340 CPUtime=4902.27 cores=4-7
/proc/11888/task/11897/stat : 11897 (plingeling) R 11883 11883 11857 0 -1 4202560 822267 1258 0 0 490112 115 0 0 25 0 5 0 526079402 475484160 88190 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11888/tid=11898] ppid=11883 vsize=464340 CPUtime=4875.32 cores=4-7
/proc/11888/task/11898/stat : 11898 (plingeling) R 11883 11883 11857 0 -1 4202560 777499 1258 0 0 487435 97 0 0 25 0 5 0 526079402 475484160 88190 33554432000 4194304 4356188 140734487836784 18446744073709551615 4210615 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39190.4
Current children cumulated vsize (KiB) 3487564

[startup+4962.3 s]
/proc/loadavg: 8.04 8.03 7.99 9/180 12042
/proc/meminfo: memFree=29223264/32951124 swapFree=67107188/67111528
[pid=11883] ppid=11881 vsize=18324 CPUtime=0 cores=0-7
/proc/11883/stat : 11883 (ppfolio) S 11881 11883 11857 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526079394 18763776 390 33554432000 4194304 4287625 140736585524768 18446744073709551615 210204667407 0 0 4096 65536 11237721736017346559 0 0 17 4 0 0 0
/proc/11883/statm: 4581 390 341 23 0 91 0
[pid=11884] ppid=11883 vsize=1163092 CPUtime=4962.35 cores=0
/proc/11884/stat : 11884 (cryptominisat) R 11883 11883 11857 0 -1 4202496 619056 0 0 0 495930 305 0 0 25 0 1 0 526079394 1191006208 55773 33554432000 4194304 4587354 140735817637328 18446744073709551615 4238755 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11884/statm: 290773 55773 337 96 0 287335 0
[pid=11885] ppid=11883 vsize=203344 CPUtime=4962.35 cores=1
/proc/11885/stat : 11885 (clasp) R 11883 11883 11857 0 -1 4202496 46044 0 0 0 496222 13 0 0 25 0 1 0 526079394 208224256 45231 33554432000 4194304 4785740 140735788939104 18446744073709551615 4287244 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/11885/statm: 50836 45231 340 145 0 47881 0
[pid=11886] ppid=11883 vsize=461764 CPUtime=4962.21 cores=2
/proc/11886/stat : 11886 (TNM) R 11883 11883 11857 0 -1 4202496 2806 0 0 0 496219 2 0 0 25 0 1 0 526079394 472846336 2702 33554432000 134512640 134534564 4288510752 18446744073709551615 134530586 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/11886/statm: 115441 2702 95 6 0 114107 0
[pid=11887] ppid=11883 vsize=1870204 CPUtime=4962.36 cores=3
/proc/11887/stat : 11887 (march_hi) R 11883 11883 11857 0 -1 4202496 273010 0 0 0 496042 194 0 0 25 0 1 0 526079394 1915088896 266345 33554432000 4194304 4331988 140735441685616 18446744073709551615 4228235 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/11887/statm: 467551 266345 175 34 0 465993 0
[pid=11888] ppid=11883 vsize=536020 CPUtime=19820.8 cores=4-7
/proc/11888/stat : 11888 (plingeling) S 11883 11883 11857 0 -1 4202496 3277088 1258 0 0 1981646 434 0 0 18 0 5 0 526079394 548884480 106110 33554432000 4194304 4356188 140734487836784 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/11888/statm: 134005 106110 162 40 0 132549 0
[pid=11888/tid=11895] ppid=11883 vsize=536020 CPUtime=4962.27 cores=4-7
/proc/11888/task/11895/stat : 11895 (plingeling) R 11883 11883 11857 0 -1 4202560 816517 1258 0 0 496128 99 0 0 25 0 5 0 526079402 548884480 106110 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331319 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11888/tid=11896] ppid=11883 vsize=536020 CPUtime=4961.15 cores=4-7
/proc/11888/task/11896/stat : 11896 (plingeling) R 11883 11883 11857 0 -1 4202560 838277 1258 0 0 495997 118 0 0 25 0 5 0 526079402 548884480 106110 33554432000 4194304 4356188 140734487836784 18446744073709551615 4330999 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11888/tid=11897] ppid=11883 vsize=536020 CPUtime=4962.27 cores=4-7
/proc/11888/task/11897/stat : 11897 (plingeling) R 11883 11883 11857 0 -1 4202560 832507 1258 0 0 496111 116 0 0 25 0 5 0 526079402 548884480 106110 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11888/tid=11898] ppid=11883 vsize=536020 CPUtime=4934.99 cores=4-7
/proc/11888/task/11898/stat : 11898 (plingeling) R 11883 11883 11857 0 -1 4202560 785179 1258 0 0 493401 98 0 0 25 0 5 0 526079402 548884480 106110 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39670.1
Current children cumulated vsize (KiB) 4252748



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.6 s]
/proc/loadavg: 8.02 8.03 7.99 9/180 12044
/proc/meminfo: memFree=29278280/32951124 swapFree=67107188/67111528
[pid=11883] ppid=11881 vsize=18324 CPUtime=0 cores=0-7
/proc/11883/stat : 11883 (ppfolio) S 11881 11883 11857 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 526079394 18763776 390 33554432000 4194304 4287625 140736585524768 18446744073709551615 210204667407 0 0 4096 65536 11237721736017346559 0 0 17 4 0 0 0
/proc/11883/statm: 4581 390 341 23 0 91 0
[pid=11884] ppid=11883 vsize=1158024 CPUtime=5003.66 cores=0
/proc/11884/stat : 11884 (cryptominisat) R 11883 11883 11857 0 -1 4202496 622671 0 0 0 500059 307 0 0 25 0 1 0 526079394 1185816576 54196 33554432000 4194304 4587354 140735817637328 18446744073709551615 4238477 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/11884/statm: 289506 54196 337 96 0 286068 0
[pid=11885] ppid=11883 vsize=203344 CPUtime=5003.66 cores=1
/proc/11885/stat : 11885 (clasp) R 11883 11883 11857 0 -1 4202496 46053 0 0 0 500353 13 0 0 25 0 1 0 526079394 208224256 45240 33554432000 4194304 4785740 140735788939104 18446744073709551615 4287114 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/11885/statm: 50836 45240 340 145 0 47881 0
[pid=11886] ppid=11883 vsize=461764 CPUtime=5003.51 cores=2
/proc/11886/stat : 11886 (TNM) R 11883 11883 11857 0 -1 4202496 2806 0 0 0 500349 2 0 0 25 0 1 0 526079394 472846336 2702 33554432000 134512640 134534564 4288510752 18446744073709551615 134530002 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/11886/statm: 115441 2702 95 6 0 114107 0
[pid=11887] ppid=11883 vsize=1870204 CPUtime=5003.67 cores=3
/proc/11887/stat : 11887 (march_hi) R 11883 11883 11857 0 -1 4202496 275556 0 0 0 500171 196 0 0 25 0 1 0 526079394 1915088896 268891 33554432000 4194304 4331988 140735441685616 18446744073709551615 4297256 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/11887/statm: 467551 268891 175 34 0 465993 0
[pid=11888] ppid=11883 vsize=476628 CPUtime=19985.8 cores=4-7
/proc/11888/stat : 11888 (plingeling) S 11883 11883 11857 0 -1 4202496 3310368 1258 0 0 1998141 438 0 0 18 0 5 0 526079394 488067072 91262 33554432000 4194304 4356188 140734487836784 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/11888/statm: 119157 91262 162 40 0 117701 0
[pid=11888/tid=11895] ppid=11883 vsize=476628 CPUtime=5003.58 cores=4-7
/proc/11888/task/11895/stat : 11895 (plingeling) R 11883 11883 11857 0 -1 4202560 823173 1258 0 0 500258 100 0 0 25 0 5 0 526079402 488067072 91262 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11888/tid=11896] ppid=11883 vsize=476628 CPUtime=5002.46 cores=4-7
/proc/11888/task/11896/stat : 11896 (plingeling) R 11883 11883 11857 0 -1 4202560 848517 1258 0 0 500127 119 0 0 25 0 5 0 526079402 488067072 91262 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=11888/tid=11897] ppid=11883 vsize=476628 CPUtime=5003.58 cores=4-7
/proc/11888/task/11897/stat : 11897 (plingeling) R 11883 11883 11857 0 -1 4202560 842747 1258 0 0 500240 118 0 0 25 0 5 0 526079402 488067072 91262 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331984 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=11888/tid=11898] ppid=11883 vsize=476628 CPUtime=4976.07 cores=4-7
/proc/11888/task/11898/stat : 11898 (plingeling) R 11883 11883 11857 0 -1 4202560 791323 1258 0 0 497508 99 0 0 25 0 5 0 526079402 488067072 91262 33554432000 4194304 4356188 140734487836784 18446744073709551615 4331165 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 4188288

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 11883 and gives
#  childrusage.ru_utime.tv_sec=10007
#  childrusage.ru_utime.tv_usec=34699
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=182972
# CPU time returned by wait4() is 10007.2
# while last known CPU time is 40000.3
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.62
CPU time (s): 40000.3
CPU user time (s): 39990.7
CPU system time (s): 9.56
CPU usage (%): 799.427
Max. virtual memory (cumulated for all children) (KiB): 4465064

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 10007
system time used= 0.182972
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 49398
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 660
involuntary context switches= 21896

runsolver used 7.52186 second user time and 19.774 second system time

The end

Launcher Data 

Begin job on node130 at 2011-04-30 08:26:49
IDJOB=3275031
IDBENCH=71315
IDSOLVER=1638
FILE ID=node130/3275031-1304144809
RUNJOBID= node130-1304144809-11871
PBS_JOBID= 13170864
Free space on /tmp= 72700 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v1375c111739g6.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3275031-1304144809/watcher-3275031-1304144809 -o /tmp/evaluation-result-3275031-1304144809/solver-3275031-1304144809 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3275031-1304144809.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= c7c04151ac14a13eb4a03259d055e119
RANDOM SEED=997865149

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31129684 kB
Buffers:        187712 kB
Cached:        1295840 kB
SwapCached:       1628 kB
Active:         358808 kB
Inactive:      1185928 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31129684 kB
SwapTotal:    67111528 kB
SwapFree:     67107188 kB
Dirty:           11344 kB
Writeback:           0 kB
AnonPages:       61064 kB
Mapped:          14412 kB
Slab:           213000 kB
PageTables:       4616 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   189420 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72688 MiB
End job on node130 at 2011-04-30 09:50:15