Trace number 3310318

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 3936.64 492.533

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom14.cnf
MD5SUM7af4cc1b94644f101ccf5f2373fdbfea
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark762.1
Satisfiable
(Un)Satisfiability was proved
Number of variables22886
Number of clauses76038
Sum of the clauses size193162
Maximum clause length786
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 240006
Number of clauses of size 335619
Number of clauses of size 4104
Number of clauses of size 512
Number of clauses of size over 5296

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7
3936.36/492.52	s UNSATISFIABLE
3936.36/492.53	solver [1] cryptominisat 2.7.1 answered
3936.36/492.53	Done

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310318-1307665312/watcher-3310318-1307665312 -o /tmp/evaluation-result-3310318-1307665312/solver-3310318-1307665312 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310318-1307665312.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.58 1.91 1.89 1/167 4610
/proc/meminfo: memFree=32477108/32951124 swapFree=67060628/67111528
[pid=4610] ppid=4608 vsize=2712 CPUtime=0 cores=0-7
/proc/4610/stat : 4610 (ppfolio) D 4608 4610 4580 0 -1 4194304 82 0 1 0 0 0 0 0 23 0 1 0 878131603 2777088 36 33554432000 4194304 4287625 140736711386368 18446744073709551615 253635937714 0 0 4096 0 18446744071562234166 0 0 17 6 0 0 0
/proc/4610/statm: 678 36 26 23 0 23 0

[startup+0.0304941 s]
/proc/loadavg: 1.58 1.91 1.89 1/167 4610
/proc/meminfo: memFree=32477108/32951124 swapFree=67060628/67111528
[pid=4610] ppid=4608 vsize=18324 CPUtime=0 cores=0-7
/proc/4610/stat : 4610 (ppfolio) S 4608 4610 4580 0 -1 4202496 521 0 2 0 0 0 0 0 25 0 1 0 878131603 18763776 390 33554432000 4194304 4287625 140736711386368 18446744073709551615 253640879631 0 0 4096 65536 4320817643297701887 0 0 17 4 0 0 0
/proc/4610/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100476 s]
/proc/loadavg: 1.58 1.91 1.89 1/167 4610
/proc/meminfo: memFree=32477108/32951124 swapFree=67060628/67111528
[pid=4610] ppid=4608 vsize=18324 CPUtime=0 cores=0-7
/proc/4610/stat : 4610 (ppfolio) S 4608 4610 4580 0 -1 4202496 521 0 2 0 0 0 0 0 25 0 1 0 878131603 18763776 390 33554432000 4194304 4287625 140736711386368 18446744073709551615 253640879631 0 0 4096 65536 4320817643297701887 0 0 17 4 0 0 0
/proc/4610/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.705863 s]
/proc/loadavg: 1.58 1.91 1.89 1/167 4610
/proc/meminfo: memFree=32477108/32951124 swapFree=67060628/67111528
[pid=4610] ppid=4608 vsize=18324 CPUtime=0 cores=0-7
/proc/4610/stat : 4610 (ppfolio) S 4608 4610 4580 0 -1 4202496 521 0 2 0 0 0 0 0 19 0 1 0 878131603 18763776 390 33554432000 4194304 4287625 140736711386368 18446744073709551615 253640879631 0 0 4096 65536 4320817643297701887 0 0 17 4 0 0 0
/proc/4610/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.831306 s]
/proc/loadavg: 1.58 1.91 1.89 1/167 4610
/proc/meminfo: memFree=32477108/32951124 swapFree=67060628/67111528
[pid=4610] ppid=4608 vsize=18324 CPUtime=0 cores=0-7
/proc/4610/stat : 4610 (ppfolio) S 4608 4610 4580 0 -1 4202496 521 0 2 0 0 0 0 0 18 0 1 0 878131603 18763776 390 33554432000 4194304 4287625 140736711386368 18446744073709551615 253640879631 0 0 4096 65536 4320817643297701887 0 0 17 4 0 0 0
/proc/4610/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50618 s]
/proc/loadavg: 1.58 1.91 1.89 9/177 4625
/proc/meminfo: memFree=32370532/32951124 swapFree=67060628/67111528
[pid=4610] ppid=4608 vsize=18324 CPUtime=0 cores=0-7
/proc/4610/stat : 4610 (ppfolio) S 4608 4610 4580 0 -1 4202496 521 0 2 0 0 0 0 0 18 0 1 0 878131603 18763776 390 33554432000 4194304 4287625 140736711386368 18446744073709551615 253640879631 0 0 4096 65536 4320817643297701887 0 0 17 4 0 0 0
/proc/4610/statm: 4581 390 341 23 0 91 0
[pid=4612] ppid=4610 vsize=44444 CPUtime=1.48 cores=0
/proc/4612/stat : 4612 (cryptominisat) R 4610 4610 4580 0 -1 4202496 8331 0 0 0 148 0 0 0 25 0 1 0 878131604 45510656 6126 33554432000 4194304 4587354 140737483041584 18446744073709551615 253640556180 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4612/statm: 11111 6126 330 96 0 7673 0
[pid=4613] ppid=4610 vsize=27012 CPUtime=1.49 cores=1
/proc/4613/stat : 4613 (clasp) R 4610 4610 4580 0 -1 4202496 5066 0 0 0 149 0 0 0 20 0 1 0 878131604 27660288 4021 33554432000 4194304 4785740 140735468022512 18446744073709551615 4549029 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4613/statm: 6753 4021 340 145 0 3798 0
[pid=4614] ppid=4610 vsize=461372 CPUtime=1.39 cores=2
/proc/4614/stat : 4614 (TNM) R 4610 4610 4580 0 -1 4202496 2955 0 11 0 139 0 0 0 25 0 1 0 878131604 472444928 2862 33554432000 134512640 134534564 4293114080 18446744073709551615 134528330 0 0 4096 0 0 0 0 17 2 0 0 10
/proc/4614/statm: 115343 2862 95 6 0 114009 0
[pid=4615] ppid=4610 vsize=56768 CPUtime=1.48 cores=3
/proc/4615/stat : 4615 (march_hi) R 4610 4610 4580 0 -1 4202496 27786 0 0 0 145 3 0 0 20 0 1 0 878131604 58130432 6975 33554432000 4194304 4331988 140734872348256 18446744073709551615 253640556299 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4615/statm: 14192 6975 175 34 0 12634 0
[pid=4616] ppid=4610 vsize=139708 CPUtime=5.18 cores=4-7
/proc/4616/stat : 4616 (plingeling) S 4610 4610 4580 0 -1 4202496 11782 1246 0 3 517 1 0 0 18 0 5 0 878131604 143060992 7232 33554432000 4194304 4356188 140736603107328 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4616/statm: 34927 7232 164 40 0 33471 0
[pid=4616/tid=4622] ppid=4610 vsize=139708 CPUtime=1.27 cores=4-7
/proc/4616/task/4622/stat : 4622 (plingeling) R 4610 4610 4580 0 -1 4202560 1778 1246 0 3 127 0 0 0 19 0 5 0 878131626 143060992 7232 33554432000 4194304 4356188 140736603107328 18446744073709551615 4271376 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4616/tid=4623] ppid=4610 vsize=139708 CPUtime=1.27 cores=4-7
/proc/4616/task/4623/stat : 4623 (plingeling) R 4610 4610 4580 0 -1 4202560 2075 1246 0 3 127 0 0 0 22 0 5 0 878131626 143060992 7232 33554432000 4194304 4356188 140736603107328 18446744073709551615 4306795 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4616/tid=4624] ppid=4610 vsize=139708 CPUtime=1.27 cores=4-7
/proc/4616/task/4624/stat : 4624 (plingeling) R 4610 4610 4580 0 -1 4202560 2127 1246 0 3 127 0 0 0 22 0 5 0 878131626 143060992 7232 33554432000 4194304 4356188 140736603107328 18446744073709551615 4208763 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4616/tid=4625] ppid=4610 vsize=139708 CPUtime=1.26 cores=4-7
/proc/4616/task/4625/stat : 4625 (plingeling) R 4610 4610 4580 0 -1 4202560 1336 1246 0 3 126 0 0 0 19 0 5 0 878131626 143060992 7232 33554432000 4194304 4356188 140736603107328 18446744073709551615 4279448 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.02
Current children cumulated vsize (KiB) 747628

[startup+3.10089 s]
/proc/loadavg: 1.58 1.91 1.89 9/177 4625
/proc/meminfo: memFree=32368052/32951124 swapFree=67060628/67111528
[pid=4610] ppid=4608 vsize=18324 CPUtime=0 cores=0-7
/proc/4610/stat : 4610 (ppfolio) S 4608 4610 4580 0 -1 4202496 521 0 2 0 0 0 0 0 15 0 1 0 878131603 18763776 390 33554432000 4194304 4287625 140736711386368 18446744073709551615 253640879631 0 0 4096 65536 4320817643297701887 0 0 17 4 0 0 0
/proc/4610/statm: 4581 390 341 23 0 91 0
[pid=4612] ppid=4610 vsize=44444 CPUtime=3.09 cores=0
/proc/4612/stat : 4612 (cryptominisat) R 4610 4610 4580 0 -1 4202496 8878 0 0 0 308 1 0 0 25 0 1 0 878131604 45510656 6662 33554432000 4194304 4587354 140737483041584 18446744073709551615 4239534 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4612/statm: 11111 6662 330 96 0 7673 0
[pid=4613] ppid=4610 vsize=29136 CPUtime=3.08 cores=1
/proc/4613/stat : 4613 (clasp) R 4610 4610 4580 0 -1 4202496 5595 0 0 0 308 0 0 0 25 0 1 0 878131604 29835264 4550 33554432000 4194304 4785740 140735468022512 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4613/statm: 7284 4550 340 145 0 4329 0
[pid=4614] ppid=4610 vsize=461372 CPUtime=2.98 cores=2
/proc/4614/stat : 4614 (TNM) R 4610 4610 4580 0 -1 4202496 2955 0 11 0 298 0 0 0 25 0 1 0 878131604 472444928 2862 33554432000 134512640 134534564 4293114080 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 2 0 0 10
/proc/4614/statm: 115343 2862 95 6 0 114009 0
[pid=4615] ppid=4610 vsize=58076 CPUtime=3.08 cores=3
/proc/4615/stat : 4615 (march_hi) R 4610 4610 4580 0 -1 4202496 28107 0 0 0 305 3 0 0 25 0 1 0 878131604 59469824 7296 33554432000 4194304 4331988 140734872348256 18446744073709551615 4237426 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4615/statm: 14519 7296 175 34 0 12961 0
[pid=4616] ppid=4610 vsize=139076 CPUtime=11.55 cores=4-7
/proc/4616/stat : 4616 (plingeling) S 4610 4610 4580 0 -1 4202496 13203 1246 0 3 1154 1 0 0 18 0 5 0 878131604 142413824 6862 33554432000 4194304 4356188 140736603107328 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4616/statm: 34769 6862 164 40 0 33313 0
[pid=4616/tid=4622] ppid=4610 vsize=139076 CPUtime=2.87 cores=4-7
/proc/4616/task/4622/stat : 4622 (plingeling) R 4610 4610 4580 0 -1 4202560 1877 1246 0 3 287 0 0 0 24 0 5 0 878131626 142413824 6862 33554432000 4194304 4356188 140736603107328 18446744073709551615 4280656 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4616/tid=4623] ppid=4610 vsize=139076 CPUtime=2.86 cores=4-7
/proc/4616/task/4623/stat : 4623 (plingeling) R 4610 4610 4580 0 -1 4202560 2203 1246 0 3 286 0 0 0 25 0 5 0 878131626 142413824 6862 33554432000 4194304 4356188 140736603107328 18446744073709551615 4237217 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4616/tid=4624] ppid=4610 vsize=139076 CPUtime=2.86 cores=4-7
/proc/4616/task/4624/stat : 4624 (plingeling) R 4610 4610 4580 0 -1 4202560 2432 1246 0 3 286 0 0 0 25 0 5 0 878131626 142413824 6862 33554432000 4194304 4356188 140736603107328 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4616/tid=4625] ppid=4610 vsize=139076 CPUtime=2.85 cores=4-7
/proc/4616/task/4625/stat : 4625 (plingeling) R 4610 4610 4580 0 -1 4202560 2225 1246 0 3 285 0 0 0 24 0 5 0 878131626 142413824 6862 33554432000 4194304 4356188 140736603107328 18446744073709551615 4332333 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 23.78
Current children cumulated vsize (KiB) 750428

[startup+6.30131 s]
/proc/loadavg: 2.10 2.01 1.93 9/177 4625
/proc/meminfo: memFree=32353704/32951124 swapFree=67060628/67111528
[pid=4610] ppid=4608 vsize=18324 CPUtime=0 cores=0-7
/proc/4610/stat : 4610 (ppfolio) S 4608 4610 4580 0 -1 4202496 521 0 2 0 0 0 0 0 15 0 1 0 878131603 18763776 390 33554432000 4194304 4287625 140736711386368 18446744073709551615 253640879631 0 0 4096 65536 4320817643297701887 0 0 17 4 0 0 0
/proc/4610/statm: 4581 390 341 23 0 91 0
[pid=4612] ppid=4610 vsize=2109972 CPUtime=6.29 cores=0
/proc/4612/stat : 4612 (cryptominisat) R 4610 4610 4580 0 -1 4202496 12760 0 0 0 627 2 0 0 25 0 1 0 878131604 2160611328 8748 33554432000 4194304 4587354 140737483041584 18446744073709551615 4237603 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4612/statm: 527493 8748 336 96 0 524055 0
[pid=4613] ppid=4610 vsize=31684 CPUtime=6.28 cores=1
/proc/4613/stat : 4613 (clasp) R 4610 4610 4580 0 -1 4202496 6233 0 0 0 628 0 0 0 25 0 1 0 878131604 32444416 5188 33554432000 4194304 4785740 140735468022512 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4613/statm: 7921 5188 340 145 0 4966 0
[pid=4614] ppid=4610 vsize=461372 CPUtime=6.18 cores=2
/proc/4614/stat : 4614 (TNM) R 4610 4610 4580 0 -1 4202496 2955 0 11 0 618 0 0 0 25 0 1 0 878131604 472444928 2862 33554432000 134512640 134534564 4293114080 18446744073709551615 11793813 0 0 4096 0 0 0 0 17 2 0 0 10
/proc/4614/statm: 115343 2862 95 6 0 114009 0
[pid=4615] ppid=4610 vsize=59780 CPUtime=6.28 cores=3
/proc/4615/stat : 4615 (march_hi) R 4610 4610 4580 0 -1 4202496 28478 0 0 0 625 3 0 0 25 0 1 0 878131604 61214720 7667 33554432000 4194304 4331988 140734872348256 18446744073709551615 4242538 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4615/statm: 14945 7667 175 34 0 13387 0
[pid=4616] ppid=4610 vsize=141220 CPUtime=24.33 cores=4-7
/proc/4616/stat : 4616 (plingeling) S 4610 4610 4580 0 -1 4202496 13739 1246 0 3 2432 1 0 0 18 0 5 0 878131604 144609280 7398 33554432000 4194304 4356188 140736603107328 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4616/statm: 35305 7398 164 40 0 33849 0
[pid=4616/tid=4622] ppid=4610 vsize=141220 CPUtime=6.07 cores=4-7
/proc/4616/task/4622/stat : 4622 (plingeling) R 4610 4610 4580 0 -1 4202560 1877 1246 0 3 607 0 0 0 25 0 5 0 878131626 144609280 7398 33554432000 4194304 4356188 140736603107328 18446744073709551615 4331822 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4616/tid=4623] ppid=4610 vsize=141220 CPUtime=6.06 cores=4-7
/proc/4616/task/4623/stat : 4623 (plingeling) R 4610 4610 4580 0 -1 4202560 2473 1246 0 3 606 0 0 0 25 0 5 0 878131626 144609280 7398 33554432000 4194304 4356188 140736603107328 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4616/tid=4624] ppid=4610 vsize=141220 CPUtime=6.06 cores=4-7
/proc/4616/task/4624/stat : 4624 (plingeling) R 4610 4610 4580 0 -1 4202560 2542 1246 0 3 606 0 0 0 25 0 5 0 878131626 144609280 7398 33554432000 4194304 4356188 140736603107328 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4616/tid=4625] ppid=4610 vsize=141220 CPUtime=6.03 cores=4-7
/proc/4616/task/4625/stat : 4625 (plingeling) R 4610 4610 4580 0 -1 4202560 2381 1246 0 3 603 0 0 0 25 0 5 0 878131626 144609280 7398 33554432000 4194304 4356188 140736603107328 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.36
Current children cumulated vsize (KiB) 2822352

[startup+12.7011 s]
/proc/loadavg: 2.57 2.11 1.96 9/177 4625
/proc/meminfo: memFree=32335060/32951124 swapFree=67060628/67111528
[pid=4610] ppid=4608 vsize=18324 CPUtime=0 cores=0-7
/proc/4610/stat : 4610 (ppfolio) S 4608 4610 4580 0 -1 4202496 521 0 2 0 0 0 0 0 15 0 1 0 878131603 18763776 390 33554432000 4194304 4287625 140736711386368 18446744073709551615 253640879631 0 0 4096 65536 4320817643297701887 0 0 17 4 0 0 0
/proc/4610/statm: 4581 390 341 23 0 91 0
[pid=4612] ppid=4610 vsize=2101436 CPUtime=12.68 cores=0
/proc/4612/stat : 4612 (cryptominisat) R 4610 4610 4580 0 -1 4202496 17531 0 0 0 1266 2 0 0 25 0 1 0 878131604 2151870464 10004 33554432000 4194304 4587354 140737483041584 18446744073709551615 4388345 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4612/statm: 525359 10004 336 96 0 521921 0
[pid=4613] ppid=4610 vsize=36460 CPUtime=12.68 cores=1
/proc/4613/stat : 4613 (clasp) R 4610 4610 4580 0 -1 4202496 7400 0 0 0 1267 1 0 0 25 0 1 0 878131604 37335040 6355 33554432000 4194304 4785740 140735468022512 18446744073709551615 4552970 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4613/statm: 9115 6355 340 145 0 6160 0
[pid=4614] ppid=4610 vsize=461372 CPUtime=12.58 cores=2
/proc/4614/stat : 4614 (TNM) R 4610 4610 4580 0 -1 4202496 2955 0 11 0 1258 0 0 0 25 0 1 0 878131604 472444928 2862 33554432000 134512640 134534564 4293114080 18446744073709551615 134525871 0 0 4096 0 0 0 0 17 2 0 0 10
/proc/4614/statm: 115343 2862 95 6 0 114009 0
[pid=4615] ppid=4610 vsize=61628 CPUtime=12.69 cores=3
/proc/4615/stat : 4615 (march_hi) R 4610 4610 4580 0 -1 4202496 28949 0 0 0 1265 4 0 0 25 0 1 0 878131604 63107072 8124 33554432000 4194304 4331988 140734872348256 18446744073709551615 4226242 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4615/statm: 15407 8124 175 34 0 13849 0
[pid=4616] ppid=4610 vsize=152040 CPUtime=49.9 cores=4-7
/proc/4616/stat : 4616 (plingeling) S 4610 4610 4580 0 -1 4202496 16444 1246 0 3 4988 2 0 0 18 0 5 0 878131604 155688960 10103 33554432000 4194304 4356188 140736603107328 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4616/statm: 38010 10103 164 40 0 36554 0
[pid=4616/tid=4622] ppid=4610 vsize=152040 CPUtime=12.47 cores=4-7
/proc/4616/task/4622/stat : 4622 (plingeling) R 4610 4610 4580 0 -1 4202560 2659 1246 0 3 1247 0 0 0 25 0 5 0 878131626 155688960 10103 33554432000 4194304 4356188 140736603107328 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4616/tid=4623] ppid=4610 vsize=152040 CPUtime=12.46 cores=4-7
/proc/4616/task/4623/stat : 4623 (plingeling) R 4610 4610 4580 0 -1 4202560 3319 1246 0 3 1246 0 0 0 25 0 5 0 878131626 155688960 10103 33554432000 4194304 4356188 140736603107328 18446744073709551615 4330964 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4616/tid=4624] ppid=4610 vsize=152040 CPUtime=12.46 cores=4-7
/proc/4616/task/4624/stat : 4624 (plingeling) R 4610 4610 4580 0 -1 4202560 3218 1246 0 3 1246 0 0 0 25 0 5 0 878131626 155688960 10103 33554432000 4194304 4356188 140736603107328 18446744073709551615 4282000 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4616/tid=4625] ppid=4610 vsize=152040 CPUtime=12.4 cores=4-7
/proc/4616/task/4625/stat : 4625 (plingeling) R 4610 4610 4580 0 -1 4202560 2782 1246 0 3 1240 0 0 0 25 0 5 0 878131626 155688960 10103 33554432000 4194304 4356188 140736603107328 18446744073709551615 4331047 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 100.53
Current children cumulated vsize (KiB) 2831260

[startup+25.5008 s]
/proc/loadavg: 3.77 2.39 2.05 9/177 4625
/proc/meminfo: memFree=32313900/32951124 swapFree=67060628/67111528
[pid=4610] ppid=4608 vsize=18324 CPUtime=0 cores=0-7
/proc/4610/stat : 4610 (ppfolio) S 4608 4610 4580 0 -1 4202496 521 0 2 0 0 0 0 0 15 0 1 0 878131603 18763776 390 33554432000 4194304 4287625 140736711386368 18446744073709551615 253640879631 0 0 4096 65536 4320817643297701887 0 0 17 4 0 0 0
/proc/4610/statm: 4581 390 341 23 0 91 0
[pid=4612] ppid=4610 vsize=2096236 CPUtime=25.48 cores=0
/proc/4612/stat : 4612 (cryptominisat) R 4610 4610 4580 0 -1 4202496 23124 0 0 0 2544 4 0 0 25 0 1 0 878131604 2146545664 11640 33554432000 4194304 4587354 140737483041584 18446744073709551615 4237695 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=4616/tid=4622] ppid=4610 vsize=230912 CPUtime=480.06 cores=4-7
/proc/4616/task/4622/stat : 4622 (plingeling) R 4610 4610 4580 0 -1 4202560 28650 1246 0 3 48002 4 0 0 25 0 5 0 878131626 236453888 29821 33554432000 4194304 4356188 140736603107328 18446744073709551615 4330976 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4616/tid=4623] ppid=4610 vsize=230912 CPUtime=480.07 cores=4-7
/proc/4616/task/4623/stat : 4623 (plingeling) R 4610 4610 4580 0 -1 4202560 27442 1246 0 3 48004 3 0 0 25 0 5 0 878131626 236453888 29821 33554432000 4194304 4356188 140736603107328 18446744073709551615 4210557 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4616/tid=4624] ppid=4610 vsize=230912 CPUtime=480.07 cores=4-7
/proc/4616/task/4624/stat : 4624 (plingeling) R 4610 4610 4580 0 -1 4202560 31333 1246 0 3 48003 4 0 0 25 0 5 0 878131626 236453888 29821 33554432000 4194304 4356188 140736603107328 18446744073709551615 4233920 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4616/tid=4625] ppid=4610 vsize=230912 CPUtime=477.46 cores=4-7
/proc/4616/task/4625/stat : 4625 (plingeling) R 4610 4610 4580 0 -1 4202560 11087 1246 0 3 47745 1 0 0 25 0 5 0 878131626 236453888 29821 33554432000 4194304 4356188 140736603107328 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3838.83
Current children cumulated vsize (KiB) 3055104

[startup+486.701 s]
/proc/loadavg: 8.01 6.82 4.38 9/177 4638
/proc/meminfo: memFree=32117424/32951124 swapFree=67060628/67111528
[pid=4610] ppid=4608 vsize=18324 CPUtime=0 cores=0-7
/proc/4610/stat : 4610 (ppfolio) S 4608 4610 4580 0 -1 4202496 521 0 2 0 0 0 0 0 15 0 1 0 878131603 18763776 390 33554432000 4194304 4287625 140736711386368 18446744073709551615 253640879631 0 0 4096 65536 4320817643297701887 0 0 17 4 0 0 0
/proc/4610/statm: 4581 390 341 23 0 91 0
[pid=4612] ppid=4610 vsize=2165688 CPUtime=486.7 cores=0
/proc/4612/stat : 4612 (cryptominisat) R 4610 4610 4580 0 -1 4202496 75085 0 0 0 48649 21 0 0 25 0 1 0 878131604 2217664512 26000 33554432000 4194304 4587354 140737483041584 18446744073709551615 4238593 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4612/statm: 541422 26000 337 96 0 537984 0
[pid=4613] ppid=4610 vsize=91532 CPUtime=486.7 cores=1
/proc/4613/stat : 4613 (clasp) R 4610 4610 4580 0 -1 4202496 20522 0 0 0 48664 6 0 0 25 0 1 0 878131604 93728768 19477 33554432000 4194304 4785740 140735468022512 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4613/statm: 22883 19477 340 145 0 19928 0
[pid=4614] ppid=4610 vsize=461372 CPUtime=486.54 cores=2
/proc/4614/stat : 4614 (TNM) R 4610 4610 4580 0 -1 4202496 2955 0 11 0 48654 0 0 0 25 0 1 0 878131604 472444928 2862 33554432000 134512640 134534564 4293114080 18446744073709551615 11793889 0 0 4096 0 0 0 0 17 2 0 0 10
/proc/4614/statm: 115343 2862 95 6 0 114009 0
[pid=4615] ppid=4610 vsize=93484 CPUtime=486.7 cores=3
/proc/4615/stat : 4615 (march_hi) R 4610 4610 4580 0 -1 4202496 36431 0 0 0 48662 8 0 0 25 0 1 0 878131604 95727616 15593 33554432000 4194304 4331988 140734872348256 18446744073709551615 4237147 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4615/statm: 23371 15593 175 34 0 21813 0
[pid=4616] ppid=4610 vsize=218116 CPUtime=1943.35 cores=4-7
/proc/4616/stat : 4616 (plingeling) S 4610 4610 4580 0 -1 4202496 103875 1246 0 3 194320 15 0 0 18 0 5 0 878131604 223350784 26622 33554432000 4194304 4356188 140736603107328 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4616/statm: 54529 26622 164 40 0 53073 0
[pid=4616/tid=4622] ppid=4610 vsize=218116 CPUtime=486.46 cores=4-7
/proc/4616/task/4622/stat : 4622 (plingeling) R 4610 4610 4580 0 -1 4202560 28650 1246 0 3 48642 4 0 0 25 0 5 0 878131626 223350784 26622 33554432000 4194304 4356188 140736603107328 18446744073709551615 4331728 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4616/tid=4623] ppid=4610 vsize=218116 CPUtime=486.47 cores=4-7
/proc/4616/task/4623/stat : 4623 (plingeling) R 4610 4610 4580 0 -1 4202560 28211 1246 0 3 48644 3 0 0 25 0 5 0 878131626 223350784 26622 33554432000 4194304 4356188 140736603107328 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4616/tid=4624] ppid=4610 vsize=218116 CPUtime=486.47 cores=4-7
/proc/4616/task/4624/stat : 4624 (plingeling) R 4610 4610 4580 0 -1 4202560 31333 1246 0 3 48643 4 0 0 25 0 5 0 878131626 223350784 26622 33554432000 4194304 4356188 140736603107328 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4616/tid=4625] ppid=4610 vsize=218116 CPUtime=483.82 cores=4-7
/proc/4616/task/4625/stat : 4625 (plingeling) R 4610 4610 4580 0 -1 4202560 11215 1246 0 3 48381 1 0 0 25 0 5 0 878131626 223350784 26622 33554432000 4194304 4356188 140736603107328 18446744073709551615 4332322 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3889.99
Current children cumulated vsize (KiB) 3048516

[startup+489.906 s]
/proc/loadavg: 8.09 6.86 4.40 9/177 4638
/proc/meminfo: memFree=32117300/32951124 swapFree=67060628/67111528
[pid=4610] ppid=4608 vsize=18324 CPUtime=0 cores=0-7
/proc/4610/stat : 4610 (ppfolio) S 4608 4610 4580 0 -1 4202496 521 0 2 0 0 0 0 0 15 0 1 0 878131603 18763776 390 33554432000 4194304 4287625 140736711386368 18446744073709551615 253640879631 0 0 4096 65536 4320817643297701887 0 0 17 4 0 0 0
/proc/4610/statm: 4581 390 341 23 0 91 0
[pid=4612] ppid=4610 vsize=2165688 CPUtime=489.9 cores=0
/proc/4612/stat : 4612 (cryptominisat) R 4610 4610 4580 0 -1 4202496 75085 0 0 0 48969 21 0 0 25 0 1 0 878131604 2217664512 26000 33554432000 4194304 4587354 140737483041584 18446744073709551615 4239575 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4612/statm: 541422 26000 337 96 0 537984 0
[pid=4613] ppid=4610 vsize=91532 CPUtime=489.9 cores=1
/proc/4613/stat : 4613 (clasp) R 4610 4610 4580 0 -1 4202496 20522 0 0 0 48984 6 0 0 25 0 1 0 878131604 93728768 19477 33554432000 4194304 4785740 140735468022512 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4613/statm: 22883 19477 340 145 0 19928 0
[pid=4614] ppid=4610 vsize=461372 CPUtime=489.75 cores=2
/proc/4614/stat : 4614 (TNM) R 4610 4610 4580 0 -1 4202496 2955 0 11 0 48975 0 0 0 25 0 1 0 878131604 472444928 2862 33554432000 134512640 134534564 4293114080 18446744073709551615 134530445 0 0 4096 0 0 0 0 17 2 0 0 10
/proc/4614/statm: 115343 2862 95 6 0 114009 0
[pid=4615] ppid=4610 vsize=93484 CPUtime=489.9 cores=3
/proc/4615/stat : 4615 (march_hi) R 4610 4610 4580 0 -1 4202496 36451 0 0 0 48982 8 0 0 25 0 1 0 878131604 95727616 15613 33554432000 4194304 4331988 140734872348256 18446744073709551615 4226260 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4615/statm: 23371 15613 175 34 0 21813 0
[pid=4616] ppid=4610 vsize=218116 CPUtime=1956.15 cores=4-7
/proc/4616/stat : 4616 (plingeling) S 4610 4610 4580 0 -1 4202496 103875 1246 0 3 195600 15 0 0 18 0 5 0 878131604 223350784 26622 33554432000 4194304 4356188 140736603107328 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4616/statm: 54529 26622 164 40 0 53073 0
[pid=4616/tid=4622] ppid=4610 vsize=218116 CPUtime=489.66 cores=4-7
/proc/4616/task/4622/stat : 4622 (plingeling) R 4610 4610 4580 0 -1 4202560 28650 1246 0 3 48962 4 0 0 25 0 5 0 878131626 223350784 26622 33554432000 4194304 4356188 140736603107328 18446744073709551615 4211045 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4616/tid=4623] ppid=4610 vsize=218116 CPUtime=489.67 cores=4-7
/proc/4616/task/4623/stat : 4623 (plingeling) R 4610 4610 4580 0 -1 4202560 28211 1246 0 3 48964 3 0 0 25 0 5 0 878131626 223350784 26622 33554432000 4194304 4356188 140736603107328 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4616/tid=4624] ppid=4610 vsize=218116 CPUtime=489.68 cores=4-7
/proc/4616/task/4624/stat : 4624 (plingeling) R 4610 4610 4580 0 -1 4202560 31333 1246 0 3 48964 4 0 0 25 0 5 0 878131626 223350784 26622 33554432000 4194304 4356188 140736603107328 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4616/tid=4625] ppid=4610 vsize=218116 CPUtime=487.01 cores=4-7
/proc/4616/task/4625/stat : 4625 (plingeling) R 4610 4610 4580 0 -1 4202560 11215 1246 0 3 48700 1 0 0 25 0 5 0 878131626 223350784 26622 33554432000 4194304 4356188 140736603107328 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3915.6
Current children cumulated vsize (KiB) 3048516

[startup+491.501 s]
/proc/loadavg: 8.09 6.86 4.40 9/177 4638
/proc/meminfo: memFree=32116804/32951124 swapFree=67060628/67111528
[pid=4610] ppid=4608 vsize=18324 CPUtime=0 cores=0-7
/proc/4610/stat : 4610 (ppfolio) S 4608 4610 4580 0 -1 4202496 521 0 2 0 0 0 0 0 15 0 1 0 878131603 18763776 390 33554432000 4194304 4287625 140736711386368 18446744073709551615 253640879631 0 0 4096 65536 4320817643297701887 0 0 17 4 0 0 0
/proc/4610/statm: 4581 390 341 23 0 91 0
[pid=4612] ppid=4610 vsize=2165688 CPUtime=491.5 cores=0
/proc/4612/stat : 4612 (cryptominisat) R 4610 4610 4580 0 -1 4202496 75085 0 0 0 49129 21 0 0 25 0 1 0 878131604 2217664512 26000 33554432000 4194304 4587354 140737483041584 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4612/statm: 541422 26000 337 96 0 537984 0
[pid=4613] ppid=4610 vsize=91724 CPUtime=491.5 cores=1
/proc/4613/stat : 4613 (clasp) R 4610 4610 4580 0 -1 4202496 20557 0 0 0 49144 6 0 0 25 0 1 0 878131604 93925376 19512 33554432000 4194304 4785740 140735468022512 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4613/statm: 22931 19512 340 145 0 19976 0
[pid=4614] ppid=4610 vsize=461372 CPUtime=491.34 cores=2
/proc/4614/stat : 4614 (TNM) R 4610 4610 4580 0 -1 4202496 2955 0 11 0 49134 0 0 0 25 0 1 0 878131604 472444928 2862 33554432000 134512640 134534564 4293114080 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 10
/proc/4614/statm: 115343 2862 95 6 0 114009 0
[pid=4615] ppid=4610 vsize=93616 CPUtime=491.5 cores=3
/proc/4615/stat : 4615 (march_hi) R 4610 4610 4580 0 -1 4202496 36471 0 0 0 49142 8 0 0 25 0 1 0 878131604 95862784 15633 33554432000 4194304 4331988 140734872348256 18446744073709551615 4242536 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4615/statm: 23404 15633 175 34 0 21846 0
[pid=4616] ppid=4610 vsize=219140 CPUtime=1962.52 cores=4-7
/proc/4616/stat : 4616 (plingeling) S 4610 4610 4580 0 -1 4202496 104131 1246 0 3 196237 15 0 0 18 0 5 0 878131604 224399360 26878 33554432000 4194304 4356188 140736603107328 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4616/statm: 54785 26878 164 40 0 53329 0
[pid=4616/tid=4622] ppid=4610 vsize=219140 CPUtime=491.26 cores=4-7
/proc/4616/task/4622/stat : 4622 (plingeling) R 4610 4610 4580 0 -1 4202560 28650 1246 0 3 49122 4 0 0 25 0 5 0 878131626 224399360 26878 33554432000 4194304 4356188 140736603107328 18446744073709551615 4331047 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4616/tid=4623] ppid=4610 vsize=219140 CPUtime=491.27 cores=4-7
/proc/4616/task/4623/stat : 4623 (plingeling) R 4610 4610 4580 0 -1 4202560 28211 1246 0 3 49124 3 0 0 25 0 5 0 878131626 224399360 26878 33554432000 4194304 4356188 140736603107328 18446744073709551615 4279691 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4616/tid=4624] ppid=4610 vsize=219140 CPUtime=491.27 cores=4-7
/proc/4616/task/4624/stat : 4624 (plingeling) R 4610 4610 4580 0 -1 4202560 31589 1246 0 3 49123 4 0 0 25 0 5 0 878131626 224399360 26878 33554432000 4194304 4356188 140736603107328 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4616/tid=4625] ppid=4610 vsize=219140 CPUtime=488.6 cores=4-7
/proc/4616/task/4625/stat : 4625 (plingeling) R 4610 4610 4580 0 -1 4202560 11215 1246 0 3 48859 1 0 0 25 0 5 0 878131626 224399360 26878 33554432000 4194304 4356188 140736603107328 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3928.36
Current children cumulated vsize (KiB) 3049864

[startup+492.301 s]
/proc/loadavg: 8.09 6.86 4.40 9/177 4638
/proc/meminfo: memFree=32116184/32951124 swapFree=67060628/67111528
[pid=4610] ppid=4608 vsize=18324 CPUtime=0 cores=0-7
/proc/4610/stat : 4610 (ppfolio) S 4608 4610 4580 0 -1 4202496 521 0 2 0 0 0 0 0 15 0 1 0 878131603 18763776 390 33554432000 4194304 4287625 140736711386368 18446744073709551615 253640879631 0 0 4096 65536 4320817643297701887 0 0 17 4 0 0 0
/proc/4610/statm: 4581 390 341 23 0 91 0
[pid=4612] ppid=4610 vsize=2165688 CPUtime=492.3 cores=0
/proc/4612/stat : 4612 (cryptominisat) R 4610 4610 4580 0 -1 4202496 75085 0 0 0 49209 21 0 0 25 0 1 0 878131604 2217664512 26000 33554432000 4194304 4587354 140737483041584 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4612/statm: 541422 26000 337 96 0 537984 0
[pid=4613] ppid=4610 vsize=91724 CPUtime=492.3 cores=1
/proc/4613/stat : 4613 (clasp) R 4610 4610 4580 0 -1 4202496 20557 0 0 0 49224 6 0 0 25 0 1 0 878131604 93925376 19512 33554432000 4194304 4785740 140735468022512 18446744073709551615 4287061 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4613/statm: 22931 19512 340 145 0 19976 0
[pid=4614] ppid=4610 vsize=461372 CPUtime=492.14 cores=2
/proc/4614/stat : 4614 (TNM) R 4610 4610 4580 0 -1 4202496 2955 0 11 0 49214 0 0 0 25 0 1 0 878131604 472444928 2862 33554432000 134512640 134534564 4293114080 18446744073709551615 134530126 0 0 4096 0 0 0 0 17 2 0 0 10
/proc/4614/statm: 115343 2862 95 6 0 114009 0
[pid=4615] ppid=4610 vsize=93616 CPUtime=492.3 cores=3
/proc/4615/stat : 4615 (march_hi) R 4610 4610 4580 0 -1 4202496 36480 0 0 0 49222 8 0 0 25 0 1 0 878131604 95862784 15642 33554432000 4194304 4331988 140734872348256 18446744073709551615 4242649 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4615/statm: 23404 15642 175 34 0 21846 0
[pid=4616] ppid=4610 vsize=220676 CPUtime=1965.72 cores=4-7
/proc/4616/stat : 4616 (plingeling) S 4610 4610 4580 0 -1 4202496 104515 1246 0 3 196557 15 0 0 18 0 5 0 878131604 225972224 27262 33554432000 4194304 4356188 140736603107328 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4616/statm: 55169 27262 164 40 0 53713 0
[pid=4616/tid=4622] ppid=4610 vsize=220676 CPUtime=492.06 cores=4-7
/proc/4616/task/4622/stat : 4622 (plingeling) R 4610 4610 4580 0 -1 4202560 28650 1246 0 3 49202 4 0 0 25 0 5 0 878131626 225972224 27262 33554432000 4194304 4356188 140736603107328 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4616/tid=4623] ppid=4610 vsize=220676 CPUtime=492.07 cores=4-7
/proc/4616/task/4623/stat : 4623 (plingeling) R 4610 4610 4580 0 -1 4202560 28211 1246 0 3 49204 3 0 0 25 0 5 0 878131626 225972224 27262 33554432000 4194304 4356188 140736603107328 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4616/tid=4624] ppid=4610 vsize=220676 CPUtime=492.07 cores=4-7
/proc/4616/task/4624/stat : 4624 (plingeling) R 4610 4610 4580 0 -1 4202560 31845 1246 0 3 49203 4 0 0 25 0 5 0 878131626 225972224 27262 33554432000 4194304 4356188 140736603107328 18446744073709551615 4279789 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4616/tid=4625] ppid=4610 vsize=220676 CPUtime=489.39 cores=4-7
/proc/4616/task/4625/stat : 4625 (plingeling) R 4610 4610 4580 0 -1 4202560 11343 1246 0 3 48938 1 0 0 25 0 5 0 878131626 225972224 27262 33554432000 4194304 4356188 140736603107328 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3934.76
Current children cumulated vsize (KiB) 3051400

[startup+492.501 s]
/proc/loadavg: 8.09 6.86 4.40 9/177 4638
/proc/meminfo: memFree=32116184/32951124 swapFree=67060628/67111528
[pid=4610] ppid=4608 vsize=18324 CPUtime=0 cores=0-7
/proc/4610/stat : 4610 (ppfolio) S 4608 4610 4580 0 -1 4202496 521 0 2 0 0 0 0 0 15 0 1 0 878131603 18763776 390 33554432000 4194304 4287625 140736711386368 18446744073709551615 253640879631 0 0 4096 65536 4320817643297701887 0 0 17 4 0 0 0
/proc/4610/statm: 4581 390 341 23 0 91 0
[pid=4612] ppid=4610 vsize=2165688 CPUtime=492.5 cores=0
/proc/4612/stat : 4612 (cryptominisat) R 4610 4610 4580 0 -1 4202496 75085 0 0 0 49229 21 0 0 25 0 1 0 878131604 2217664512 26000 33554432000 4194304 4587354 140737483041584 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4612/statm: 541422 26000 337 96 0 537984 0
[pid=4613] ppid=4610 vsize=91724 CPUtime=492.5 cores=1
/proc/4613/stat : 4613 (clasp) R 4610 4610 4580 0 -1 4202496 20557 0 0 0 49244 6 0 0 25 0 1 0 878131604 93925376 19512 33554432000 4194304 4785740 140735468022512 18446744073709551615 4553396 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4613/statm: 22931 19512 340 145 0 19976 0
[pid=4614] ppid=4610 vsize=461372 CPUtime=492.34 cores=2
/proc/4614/stat : 4614 (TNM) R 4610 4610 4580 0 -1 4202496 2955 0 11 0 49234 0 0 0 25 0 1 0 878131604 472444928 2862 33554432000 134512640 134534564 4293114080 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 2 0 0 10
/proc/4614/statm: 115343 2862 95 6 0 114009 0
[pid=4615] ppid=4610 vsize=93616 CPUtime=492.5 cores=3
/proc/4615/stat : 4615 (march_hi) R 4610 4610 4580 0 -1 4202496 36493 0 0 0 49242 8 0 0 25 0 1 0 878131604 95862784 15655 33554432000 4194304 4331988 140734872348256 18446744073709551615 4237398 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4615/statm: 23404 15655 175 34 0 21846 0
[pid=4616] ppid=4610 vsize=220676 CPUtime=1966.52 cores=4-7
/proc/4616/stat : 4616 (plingeling) S 4610 4610 4580 0 -1 4202496 104515 1246 0 3 196637 15 0 0 18 0 5 0 878131604 225972224 27262 33554432000 4194304 4356188 140736603107328 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4616/statm: 55169 27262 164 40 0 53713 0
[pid=4616/tid=4622] ppid=4610 vsize=220676 CPUtime=492.26 cores=4-7
/proc/4616/task/4622/stat : 4622 (plingeling) R 4610 4610 4580 0 -1 4202560 28650 1246 0 3 49222 4 0 0 25 0 5 0 878131626 225972224 27262 33554432000 4194304 4356188 140736603107328 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4616/tid=4623] ppid=4610 vsize=220676 CPUtime=492.27 cores=4-7
/proc/4616/task/4623/stat : 4623 (plingeling) R 4610 4610 4580 0 -1 4202560 28211 1246 0 3 49224 3 0 0 25 0 5 0 878131626 225972224 27262 33554432000 4194304 4356188 140736603107328 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4616/tid=4624] ppid=4610 vsize=220676 CPUtime=492.27 cores=4-7
/proc/4616/task/4624/stat : 4624 (plingeling) R 4610 4610 4580 0 -1 4202560 31845 1246 0 3 49223 4 0 0 25 0 5 0 878131626 225972224 27262 33554432000 4194304 4356188 140736603107328 18446744073709551615 4331045 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4616/tid=4625] ppid=4610 vsize=220676 CPUtime=489.59 cores=4-7
/proc/4616/task/4625/stat : 4625 (plingeling) R 4610 4610 4580 0 -1 4202560 11343 1246 0 3 48958 1 0 0 25 0 5 0 878131626 225972224 27262 33554432000 4194304 4356188 140736603107328 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3936.36
Current children cumulated vsize (KiB) 3051400

Child status: 0
Real time (s): 492.533
CPU time (s): 3936.64
CPU user time (s): 3936.08
CPU system time (s): 0.559914
CPU usage (%): 799.263
Max. virtual memory (cumulated for all children) (KiB): 5086532

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3936.08
system time used= 0.559914
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 241408
page faults= 16
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 589
involuntary context switches= 13587

runsolver used 0.732888 second user time and 1.9557 second system time

The end

Launcher Data 

Begin job on node106 at 2011-06-10 02:21:52
IDJOB=3310318
IDBENCH=83125
IDSOLVER=1638
FILE ID=node106/3310318-1307665312
RUNJOBID= node106-1307665312-4594
PBS_JOBID= 13549439
Free space on /tmp= 74124 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom14.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310318-1307665312/watcher-3310318-1307665312 -o /tmp/evaluation-result-3310318-1307665312/solver-3310318-1307665312 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310318-1307665312.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 7af4cc1b94644f101ccf5f2373fdbfea
RANDOM SEED=669620520

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      32477660 kB
Buffers:         69444 kB
Cached:         230968 kB
SwapCached:      12404 kB
Active:          91732 kB
Inactive:       226160 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      32477660 kB
SwapTotal:    67111528 kB
SwapFree:     67060628 kB
Dirty:           11380 kB
Writeback:           0 kB
AnonPages:       15992 kB
Mapped:           9528 kB
Slab:            90380 kB
PageTables:       3696 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   159436 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74116 MiB
End job on node106 at 2011-06-10 02:30:05