Trace number 3222075

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 258.471 32.5865

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v50-c4450-S324945930-048.UNKNOWN.cnf
MD5SUM25ed0c8de63814e6d33af77a8f91b72b
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark32.602
Satisfiable
(Un)Satisfiability was proved
Number of variables50
Number of clauses4450
Sum of the clauses size31150
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 54450

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7
257.75/32.58	s UNSATISFIABLE
257.75/32.58	solver [4] march_hi 2009 answered
257.75/32.58	Done

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3222075-1304163586/watcher-3222075-1304163586 -o /tmp/evaluation-result-3222075-1304163586/solver-3222075-1304163586 -C 40000 -W 5000 -M 31000 ppfolio HOME/instance-3222075-1304163586.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.22 8.10 8.02 1/168 15930
/proc/meminfo: memFree=30844844/32951132 swapFree=67080200/67111528
[pid=15930] ppid=15928 vsize=18324 CPUtime=0 cores=0-7
/proc/15930/stat : 15930 (ppfolio) S 15928 15930 15470 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 527958218 18763776 389 33554432000 4194304 4287625 140734279431088 18446744073709551615 210647166479 0 0 4096 65536 3804107788821463039 0 0 17 6 0 0 0
/proc/15930/statm: 4581 389 341 23 0 91 0

[startup+0.145083 s]
/proc/loadavg: 8.22 8.10 8.02 1/168 15930
/proc/meminfo: memFree=30844844/32951132 swapFree=67080200/67111528
[pid=15930] ppid=15928 vsize=18324 CPUtime=0 cores=0-7
/proc/15930/stat : 15930 (ppfolio) S 15928 15930 15470 0 -1 4202496 521 0 0 0 0 0 0 0 24 0 1 0 527958218 18763776 389 33554432000 4194304 4287625 140734279431088 18446744073709551615 210647166479 0 0 4096 65536 3804107788821463039 0 0 17 6 0 0 0
/proc/15930/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.201074 s]
/proc/loadavg: 8.22 8.10 8.02 1/168 15930
/proc/meminfo: memFree=30844844/32951132 swapFree=67080200/67111528
[pid=15930] ppid=15928 vsize=18324 CPUtime=0 cores=0-7
/proc/15930/stat : 15930 (ppfolio) S 15928 15930 15470 0 -1 4202496 521 0 0 0 0 0 0 0 24 0 1 0 527958218 18763776 389 33554432000 4194304 4287625 140734279431088 18446744073709551615 210647166479 0 0 4096 65536 3804107788821463039 0 0 17 6 0 0 0
/proc/15930/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.301058 s]
/proc/loadavg: 8.22 8.10 8.02 1/168 15930
/proc/meminfo: memFree=30844844/32951132 swapFree=67080200/67111528
[pid=15930] ppid=15928 vsize=18324 CPUtime=0 cores=0-7
/proc/15930/stat : 15930 (ppfolio) R 15928 15930 15470 0 -1 4202496 521 0 0 0 0 0 0 0 23 0 1 0 527958218 18763776 389 33554432000 4194304 4287625 140734279431088 18446744073709551615 210647166479 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/15930/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.70099 s]
/proc/loadavg: 8.22 8.10 8.02 1/168 15930
/proc/meminfo: memFree=30844844/32951132 swapFree=67080200/67111528
[pid=15930] ppid=15928 vsize=18324 CPUtime=0 cores=0-7
/proc/15930/stat : 15930 (ppfolio) R 15928 15930 15470 0 -1 4202496 521 0 0 0 0 0 0 0 21 0 1 0 527958218 18763776 389 33554432000 4194304 4287625 140734279431088 18446744073709551615 210647166479 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/15930/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50086 s]
/proc/loadavg: 8.22 8.10 8.02 9/178 15945
/proc/meminfo: memFree=30823056/32951132 swapFree=67080200/67111528
[pid=15930] ppid=15928 vsize=18324 CPUtime=0 cores=0-7
/proc/15930/stat : 15930 (ppfolio) S 15928 15930 15470 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527958218 18763776 389 33554432000 4194304 4287625 140734279431088 18446744073709551615 210647166479 0 0 4096 65536 3804107788821463039 0 0 17 6 0 0 0
/proc/15930/statm: 4581 389 341 23 0 91 0
[pid=15931] ppid=15930 vsize=1828200 CPUtime=1.49 cores=0
/proc/15931/stat : 15931 (cryptominisat) R 15930 15930 15470 0 -1 4202496 3540 0 0 0 149 0 0 0 20 0 1 0 527958218 1872076800 2288 33554432000 4194304 4587354 140734649207376 18446744073709551615 4365152 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15931/statm: 457050 2288 336 96 0 453612 0
[pid=15932] ppid=15930 vsize=14232 CPUtime=1.49 cores=1
/proc/15932/stat : 15932 (clasp) R 15930 15930 15470 0 -1 4202496 1003 0 0 0 149 0 0 0 20 0 1 0 527958218 14573568 895 33554432000 4194304 4785740 140733244781424 18446744073709551615 4277475 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/15932/statm: 3558 895 340 145 0 603 0
[pid=15933] ppid=15930 vsize=456220 CPUtime=1.49 cores=2
/proc/15933/stat : 15933 (TNM) R 15930 15930 15470 0 -1 4202496 440 0 0 0 149 0 0 0 20 0 1 0 527958218 467169280 337 33554432000 134512640 134534564 4291404928 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/15933/statm: 114055 337 95 6 0 112721 0
[pid=15934] ppid=15930 vsize=7760 CPUtime=1.49 cores=3
/proc/15934/stat : 15934 (march_hi) R 15930 15930 15470 0 -1 4202496 911 0 0 0 149 0 0 0 20 0 1 0 527958218 7946240 469 33554432000 4194304 4331988 140736975384208 18446744073709551615 4226304 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/15934/statm: 1940 469 174 34 0 382 0
[pid=15935] ppid=15930 vsize=60348 CPUtime=5.92 cores=4-7
/proc/15935/stat : 15935 (plingeling) S 15930 15930 15470 0 -1 4202496 4668 1257 0 0 592 0 0 0 18 0 5 0 527958218 61796352 3542 33554432000 4194304 4356188 140733990770336 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/15935/statm: 15087 3542 161 40 0 13631 0
[pid=15935/tid=15942] ppid=15930 vsize=60348 CPUtime=1.48 cores=4-7
/proc/15935/task/15942/stat : 15942 (plingeling) R 15930 15930 15470 0 -1 4202560 806 1257 0 0 148 0 0 0 20 0 5 0 527958220 61796352 3542 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331264 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15935/tid=15943] ppid=15930 vsize=60348 CPUtime=1.47 cores=4-7
/proc/15935/task/15943/stat : 15943 (plingeling) R 15930 15930 15470 0 -1 4202560 990 1257 0 0 147 0 0 0 23 0 5 0 527958220 61796352 3542 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331352 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15935/tid=15944] ppid=15930 vsize=60348 CPUtime=1.48 cores=4-7
/proc/15935/task/15944/stat : 15944 (plingeling) R 15930 15930 15470 0 -1 4202560 976 1257 0 0 148 0 0 0 23 0 5 0 527958220 61796352 3542 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331276 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15935/tid=15945] ppid=15930 vsize=60348 CPUtime=1.48 cores=4-7
/proc/15935/task/15945/stat : 15945 (plingeling) R 15930 15930 15470 0 -1 4202560 1019 1257 0 0 148 0 0 0 23 0 5 0 527958220 61796352 3542 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331268 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.88
Current children cumulated vsize (KiB) 2385084

[startup+3.10059 s]
/proc/loadavg: 8.21 8.10 8.02 9/178 15945
/proc/meminfo: memFree=30816484/32951132 swapFree=67080200/67111528
[pid=15930] ppid=15928 vsize=18324 CPUtime=0 cores=0-7
/proc/15930/stat : 15930 (ppfolio) S 15928 15930 15470 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527958218 18763776 389 33554432000 4194304 4287625 140734279431088 18446744073709551615 210647166479 0 0 4096 65536 3804107788821463039 0 0 17 6 0 0 0
/proc/15930/statm: 4581 389 341 23 0 91 0
[pid=15931] ppid=15930 vsize=799404 CPUtime=3.09 cores=0
/proc/15931/stat : 15931 (cryptominisat) R 15930 15930 15470 0 -1 4202496 4329 0 0 0 309 0 0 0 25 0 1 0 527958218 818589696 2339 33554432000 4194304 4587354 140734649207376 18446744073709551615 4238752 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15931/statm: 199851 2339 336 96 0 196413 0
[pid=15932] ppid=15930 vsize=14824 CPUtime=3.09 cores=1
/proc/15932/stat : 15932 (clasp) R 15930 15930 15470 0 -1 4202496 1143 0 0 0 309 0 0 0 25 0 1 0 527958218 15179776 1035 33554432000 4194304 4785740 140733244781424 18446744073709551615 4286973 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/15932/statm: 3706 1035 340 145 0 751 0
[pid=15933] ppid=15930 vsize=456220 CPUtime=3.09 cores=2
/proc/15933/stat : 15933 (TNM) R 15930 15930 15470 0 -1 4202496 440 0 0 0 309 0 0 0 25 0 1 0 527958218 467169280 337 33554432000 134512640 134534564 4291404928 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/15933/statm: 114055 337 95 6 0 112721 0
[pid=15934] ppid=15930 vsize=7760 CPUtime=3.09 cores=3
/proc/15934/stat : 15934 (march_hi) R 15930 15930 15470 0 -1 4202496 911 0 0 0 309 0 0 0 25 0 1 0 527958218 7946240 469 33554432000 4194304 4331988 140736975384208 18446744073709551615 4210528 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/15934/statm: 1940 469 174 34 0 382 0
[pid=15935] ppid=15930 vsize=61312 CPUtime=12.32 cores=4-7
/proc/15935/stat : 15935 (plingeling) S 15930 15930 15470 0 -1 4202496 5901 1257 0 0 1232 0 0 0 18 0 5 0 527958218 62783488 3751 33554432000 4194304 4356188 140733990770336 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/15935/statm: 15328 3751 161 40 0 13872 0
[pid=15935/tid=15942] ppid=15930 vsize=61312 CPUtime=3.08 cores=4-7
/proc/15935/task/15942/stat : 15942 (plingeling) R 15930 15930 15470 0 -1 4202560 1191 1257 0 0 308 0 0 0 25 0 5 0 527958220 62783488 3751 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331203 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15935/tid=15943] ppid=15930 vsize=61312 CPUtime=3.06 cores=4-7
/proc/15935/task/15943/stat : 15943 (plingeling) R 15930 15930 15470 0 -1 4202560 1294 1257 0 0 306 0 0 0 25 0 5 0 527958220 62783488 3751 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331345 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15935/tid=15944] ppid=15930 vsize=61312 CPUtime=3.08 cores=4-7
/proc/15935/task/15944/stat : 15944 (plingeling) R 15930 15930 15470 0 -1 4202560 1264 1257 0 0 308 0 0 0 25 0 5 0 527958220 62783488 3751 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15935/tid=15945] ppid=15930 vsize=61312 CPUtime=3.08 cores=4-7
/proc/15935/task/15945/stat : 15945 (plingeling) R 15930 15930 15470 0 -1 4202560 1275 1257 0 0 308 0 0 0 25 0 5 0 527958220 62783488 3751 33554432000 4194304 4356188 140733990770336 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.68
Current children cumulated vsize (KiB) 1357844

[startup+6.30105 s]
/proc/loadavg: 8.21 8.10 8.02 9/178 15945
/proc/meminfo: memFree=30814128/32951132 swapFree=67080200/67111528
[pid=15930] ppid=15928 vsize=18324 CPUtime=0 cores=0-7
/proc/15930/stat : 15930 (ppfolio) S 15928 15930 15470 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527958218 18763776 389 33554432000 4194304 4287625 140734279431088 18446744073709551615 210647166479 0 0 4096 65536 3804107788821463039 0 0 17 6 0 0 0
/proc/15930/statm: 4581 389 341 23 0 91 0
[pid=15931] ppid=15930 vsize=32652 CPUtime=6.29 cores=0
/proc/15931/stat : 15931 (cryptominisat) R 15930 15930 15470 0 -1 4202496 5891 0 0 0 629 0 0 0 25 0 1 0 527958218 33435648 2581 33554432000 4194304 4587354 140734649207376 18446744073709551615 4238755 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15931/statm: 8163 2581 336 96 0 4725 0
[pid=15932] ppid=15930 vsize=15580 CPUtime=6.29 cores=1
/proc/15932/stat : 15932 (clasp) R 15930 15930 15470 0 -1 4202496 1334 0 0 0 629 0 0 0 25 0 1 0 527958218 15953920 1226 33554432000 4194304 4785740 140733244781424 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/15932/statm: 3895 1226 340 145 0 940 0
[pid=15933] ppid=15930 vsize=456220 CPUtime=6.29 cores=2
/proc/15933/stat : 15933 (TNM) R 15930 15930 15470 0 -1 4202496 440 0 0 0 629 0 0 0 25 0 1 0 527958218 467169280 337 33554432000 134512640 134534564 4291404928 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/15933/statm: 114055 337 95 6 0 112721 0
[pid=15934] ppid=15930 vsize=7760 CPUtime=6.29 cores=3
/proc/15934/stat : 15934 (march_hi) R 15930 15930 15470 0 -1 4202496 911 0 0 0 629 0 0 0 25 0 1 0 527958218 7946240 469 33554432000 4194304 4331988 140736975384208 18446744073709551615 4210448 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/15934/statm: 1940 469 174 34 0 382 0
[pid=15935] ppid=15930 vsize=62388 CPUtime=23.86 cores=4-7
/proc/15935/stat : 15935 (plingeling) S 15930 15930 15470 0 -1 4202496 8082 1257 0 0 2376 10 0 0 18 0 5 0 527958218 63885312 4044 33554432000 4194304 4356188 140733990770336 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/15935/statm: 15597 4044 161 40 0 14141 0
[pid=15935/tid=15942] ppid=15930 vsize=62388 CPUtime=6.28 cores=4-7
/proc/15935/task/15942/stat : 15942 (plingeling) R 15930 15930 15470 0 -1 4202560 1831 1257 0 0 626 2 0 0 25 0 5 0 527958220 63885312 4044 33554432000 4194304 4356188 140733990770336 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15935/tid=15943] ppid=15930 vsize=62388 CPUtime=6.24 cores=4-7
/proc/15935/task/15943/stat : 15943 (plingeling) R 15930 15930 15470 0 -1 4202560 1890 1257 0 0 623 1 0 0 25 0 5 0 527958220 63885312 4044 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331170 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15935/tid=15944] ppid=15930 vsize=62388 CPUtime=5.03 cores=4-7
/proc/15935/task/15944/stat : 15944 (plingeling) R 15930 15930 15470 0 -1 4202560 1521 1257 0 0 499 4 0 0 25 0 5 0 527958220 63885312 4044 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15935/tid=15945] ppid=15930 vsize=62388 CPUtime=6.27 cores=4-7
/proc/15935/task/15945/stat : 15945 (plingeling) R 15930 15930 15470 0 -1 4202560 1963 1257 0 0 626 1 0 0 25 0 5 0 527958220 63885312 4044 33554432000 4194304 4356188 140733990770336 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 49.02
Current children cumulated vsize (KiB) 592924

[startup+12.701 s]
/proc/loadavg: 8.32 8.13 8.03 9/178 15945
/proc/meminfo: memFree=30798404/32951132 swapFree=67080200/67111528
[pid=15930] ppid=15928 vsize=18324 CPUtime=0 cores=0-7
/proc/15930/stat : 15930 (ppfolio) S 15928 15930 15470 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527958218 18763776 389 33554432000 4194304 4287625 140734279431088 18446744073709551615 210647166479 0 0 4096 65536 3804107788821463039 0 0 17 7 0 0 0
/proc/15930/statm: 4581 389 341 23 0 91 0
[pid=15931] ppid=15930 vsize=1835468 CPUtime=12.68 cores=0
/proc/15931/stat : 15931 (cryptominisat) R 15930 15930 15470 0 -1 4202496 9744 0 0 0 1268 0 0 0 25 0 1 0 527958218 1879519232 4197 33554432000 4194304 4587354 140734649207376 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15931/statm: 458867 4197 336 96 0 455429 0
[pid=15932] ppid=15930 vsize=16656 CPUtime=12.69 cores=1
/proc/15932/stat : 15932 (clasp) R 15930 15930 15470 0 -1 4202496 1569 0 0 0 1269 0 0 0 25 0 1 0 527958218 17055744 1461 33554432000 4194304 4785740 140733244781424 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/15932/statm: 4164 1461 340 145 0 1209 0
[pid=15933] ppid=15930 vsize=456220 CPUtime=12.68 cores=2
/proc/15933/stat : 15933 (TNM) R 15930 15930 15470 0 -1 4202496 440 0 0 0 1268 0 0 0 25 0 1 0 527958218 467169280 337 33554432000 134512640 134534564 4291404928 18446744073709551615 134530652 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/15933/statm: 114055 337 95 6 0 112721 0
[pid=15934] ppid=15930 vsize=7760 CPUtime=12.69 cores=3
/proc/15934/stat : 15934 (march_hi) R 15930 15930 15470 0 -1 4202496 911 0 0 0 1269 0 0 0 25 0 1 0 527958218 7946240 469 33554432000 4194304 4331988 140736975384208 18446744073709551615 4246245 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/15934/statm: 1940 469 174 34 0 382 0
[pid=15935] ppid=15930 vsize=71872 CPUtime=48.74 cores=4-7
/proc/15935/stat : 15935 (plingeling) S 15930 15930 15470 0 -1 4202496 14709 1257 0 0 4848 26 0 0 18 0 5 0 527958218 73596928 6415 33554432000 4194304 4356188 140733990770336 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/15935/statm: 17968 6415 161 40 0 16512 0
[pid=15935/tid=15942] ppid=15930 vsize=71872 CPUtime=12.67 cores=4-7
/proc/15935/task/15942/stat : 15942 (plingeling) R 15930 15930 15470 0 -1 4202560 3496 1257 0 0 1264 3 0 0 25 0 5 0 527958220 73596928 6415 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15935/tid=15943] ppid=15930 vsize=71872 CPUtime=12.59 cores=4-7
/proc/15935/task/15943/stat : 15943 (plingeling) R 15930 15930 15470 0 -1 4202560 3619 1257 0 0 1256 3 0 0 25 0 5 0 527958220 73596928 6415 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331019 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15935/tid=15944] ppid=15930 vsize=71872 CPUtime=10.76 cores=4-7
/proc/15935/task/15944/stat : 15944 (plingeling) R 15930 15930 15470 0 -1 4202560 3025 1257 0 0 1064 12 0 0 25 0 5 0 527958220 73596928 6415 33554432000 4194304 4356188 140733990770336 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15935/tid=15945] ppid=15930 vsize=71872 CPUtime=12.67 cores=4-7
/proc/15935/task/15945/stat : 15945 (plingeling) R 15930 15930 15470 0 -1 4202560 3692 1257 0 0 1261 6 0 0 25 0 5 0 527958220 73596928 6415 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331086 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 99.48
Current children cumulated vsize (KiB) 2406300

[startup+25.5008 s]
/proc/loadavg: 8.27 8.13 8.03 9/178 15946
/proc/meminfo: memFree=30788428/32951132 swapFree=67080200/67111528
[pid=15930] ppid=15928 vsize=18324 CPUtime=0 cores=0-7
/proc/15930/stat : 15930 (ppfolio) S 15928 15930 15470 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527958218 18763776 389 33554432000 4194304 4287625 140734279431088 18446744073709551615 210647166479 0 0 4096 65536 3804107788821463039 0 0 17 3 0 0 0
/proc/15930/statm: 4581 389 341 23 0 91 0
[pid=15931] ppid=15930 vsize=1840852 CPUtime=25.49 cores=0
/proc/15931/stat : 15931 (cryptominisat) R 15930 15930 15470 0 -1 4202496 14026 0 0 0 2548 1 0 0 25 0 1 0 527958218 1885032448 5710 33554432000 4194304 4587354 140734649207376 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=15935/tid=15942] ppid=15930 vsize=75980 CPUtime=28.77 cores=4-7
/proc/15935/task/15942/stat : 15942 (plingeling) R 15930 15930 15470 0 -1 4202560 6377 1257 0 0 2873 4 0 0 25 0 5 0 527958220 77803520 7450 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331165 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15935/tid=15943] ppid=15930 vsize=75980 CPUtime=28.62 cores=4-7
/proc/15935/task/15943/stat : 15943 (plingeling) R 15930 15930 15470 0 -1 4202560 6372 1257 0 0 2859 3 0 0 25 0 5 0 527958220 77803520 7450 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331984 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15935/tid=15944] ppid=15930 vsize=75980 CPUtime=26.85 cores=4-7
/proc/15935/task/15944/stat : 15944 (plingeling) R 15930 15930 15470 0 -1 4202560 5940 1257 0 0 2668 17 0 0 25 0 5 0 527958220 77803520 7450 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331964 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15935/tid=15945] ppid=15930 vsize=75980 CPUtime=28.77 cores=4-7
/proc/15935/task/15945/stat : 15945 (plingeling) R 15930 15930 15470 0 -1 4202560 6254 1257 0 0 2871 6 0 0 25 0 5 0 527958220 77803520 7450 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 228.18
Current children cumulated vsize (KiB) 2417500

[startup+30.401 s]
/proc/loadavg: 8.25 8.12 8.03 9/178 15946
/proc/meminfo: memFree=30788092/32951132 swapFree=67080200/67111528
[pid=15930] ppid=15928 vsize=18324 CPUtime=0 cores=0-7
/proc/15930/stat : 15930 (ppfolio) S 15928 15930 15470 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527958218 18763776 389 33554432000 4194304 4287625 140734279431088 18446744073709551615 210647166479 0 0 4096 65536 3804107788821463039 0 0 17 3 0 0 0
/proc/15930/statm: 4581 389 341 23 0 91 0
[pid=15931] ppid=15930 vsize=1840948 CPUtime=30.39 cores=0
/proc/15931/stat : 15931 (cryptominisat) R 15930 15930 15470 0 -1 4202496 15627 0 0 0 3038 1 0 0 25 0 1 0 527958218 1885130752 5712 33554432000 4194304 4587354 140734649207376 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15931/statm: 460237 5712 336 96 0 456799 0
[pid=15932] ppid=15930 vsize=18576 CPUtime=30.38 cores=1
/proc/15932/stat : 15932 (clasp) R 15930 15930 15470 0 -1 4202496 2002 0 0 0 3038 0 0 0 25 0 1 0 527958218 19021824 1894 33554432000 4194304 4785740 140733244781424 18446744073709551615 4546224 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/15932/statm: 4644 1894 341 145 0 1689 0
[pid=15933] ppid=15930 vsize=456220 CPUtime=30.37 cores=2
/proc/15933/stat : 15933 (TNM) R 15930 15930 15470 0 -1 4202496 440 0 0 0 3037 0 0 0 25 0 1 0 527958218 467169280 337 33554432000 134512640 134534564 4291404928 18446744073709551615 134530568 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/15933/statm: 114055 337 95 6 0 112721 0
[pid=15934] ppid=15930 vsize=7760 CPUtime=30.39 cores=3
/proc/15934/stat : 15934 (march_hi) R 15930 15930 15470 0 -1 4202496 911 0 0 0 3039 0 0 0 25 0 1 0 527958218 7946240 469 33554432000 4194304 4331988 140736975384208 18446744073709551615 4239610 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/15934/statm: 1940 469 174 34 0 382 0
[pid=15935] ppid=15930 vsize=74700 CPUtime=119.44 cores=4-7
/proc/15935/stat : 15935 (plingeling) S 15930 15930 15470 0 -1 4202496 26492 1257 0 0 11912 32 0 0 18 0 5 0 527958218 76492800 7130 33554432000 4194304 4356188 140733990770336 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/15935/statm: 18675 7130 161 40 0 17219 0
[pid=15935/tid=15942] ppid=15930 vsize=74700 CPUtime=30.37 cores=4-7
/proc/15935/task/15942/stat : 15942 (plingeling) R 15930 15930 15470 0 -1 4202560 6537 1257 0 0 3033 4 0 0 25 0 5 0 527958220 76492800 7130 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331992 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15935/tid=15943] ppid=15930 vsize=74700 CPUtime=30.21 cores=4-7
/proc/15935/task/15943/stat : 15943 (plingeling) R 15930 15930 15470 0 -1 4202560 6532 1257 0 0 3018 3 0 0 25 0 5 0 527958220 76492800 7130 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331971 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15935/tid=15944] ppid=15930 vsize=74700 CPUtime=28.45 cores=4-7
/proc/15935/task/15944/stat : 15944 (plingeling) R 15930 15930 15470 0 -1 4202560 6100 1257 0 0 2828 17 0 0 25 0 5 0 527958220 76492800 7130 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15935/tid=15945] ppid=15930 vsize=74700 CPUtime=30.37 cores=4-7
/proc/15935/task/15945/stat : 15945 (plingeling) R 15930 15930 15470 0 -1 4202560 6446 1257 0 0 3031 6 0 0 25 0 5 0 527958220 76492800 7130 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331340 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 240.97
Current children cumulated vsize (KiB) 2416528

[startup+31.2009 s]
/proc/loadavg: 8.25 8.12 8.03 9/178 15946
/proc/meminfo: memFree=30787472/32951132 swapFree=67080200/67111528
[pid=15930] ppid=15928 vsize=18324 CPUtime=0 cores=0-7
/proc/15930/stat : 15930 (ppfolio) S 15928 15930 15470 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527958218 18763776 389 33554432000 4194304 4287625 140734279431088 18446744073709551615 210647166479 0 0 4096 65536 3804107788821463039 0 0 17 3 0 0 0
/proc/15930/statm: 4581 389 341 23 0 91 0
[pid=15931] ppid=15930 vsize=1841008 CPUtime=31.19 cores=0
/proc/15931/stat : 15931 (cryptominisat) R 15930 15930 15470 0 -1 4202496 16106 0 0 0 3118 1 0 0 25 0 1 0 527958218 1885192192 5389 33554432000 4194304 4587354 140734649207376 18446744073709551615 4414931 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15931/statm: 460252 5389 336 96 0 456814 0
[pid=15932] ppid=15930 vsize=18744 CPUtime=31.18 cores=1
/proc/15932/stat : 15932 (clasp) R 15930 15930 15470 0 -1 4202496 2037 0 0 0 3118 0 0 0 25 0 1 0 527958218 19193856 1929 33554432000 4194304 4785740 140733244781424 18446744073709551615 4553437 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/15932/statm: 4686 1929 341 145 0 1731 0
[pid=15933] ppid=15930 vsize=456220 CPUtime=31.16 cores=2
/proc/15933/stat : 15933 (TNM) R 15930 15930 15470 0 -1 4202496 440 0 0 0 3116 0 0 0 25 0 1 0 527958218 467169280 337 33554432000 134512640 134534564 4291404928 18446744073709551615 134530701 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/15933/statm: 114055 337 95 6 0 112721 0
[pid=15934] ppid=15930 vsize=7760 CPUtime=31.19 cores=3
/proc/15934/stat : 15934 (march_hi) R 15930 15930 15470 0 -1 4202496 911 0 0 0 3119 0 0 0 25 0 1 0 527958218 7946240 469 33554432000 4194304 4331988 140736975384208 18446744073709551615 4210459 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/15934/statm: 1940 469 174 34 0 382 0
[pid=15935] ppid=15930 vsize=76236 CPUtime=122.64 cores=4-7
/proc/15935/stat : 15935 (plingeling) S 15930 15930 15470 0 -1 4202496 27100 1257 0 0 12231 33 0 0 18 0 5 0 527958218 78065664 7514 33554432000 4194304 4356188 140733990770336 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/15935/statm: 19059 7514 161 40 0 17603 0
[pid=15935/tid=15942] ppid=15930 vsize=76236 CPUtime=31.17 cores=4-7
/proc/15935/task/15942/stat : 15942 (plingeling) R 15930 15930 15470 0 -1 4202560 6633 1257 0 0 3113 4 0 0 25 0 5 0 527958220 78065664 7514 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331035 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15935/tid=15943] ppid=15930 vsize=76236 CPUtime=31 cores=4-7
/proc/15935/task/15943/stat : 15943 (plingeling) R 15930 15930 15470 0 -1 4202560 6724 1257 0 0 3097 3 0 0 25 0 5 0 527958220 78065664 7514 33554432000 4194304 4356188 140733990770336 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15935/tid=15944] ppid=15930 vsize=76236 CPUtime=29.25 cores=4-7
/proc/15935/task/15944/stat : 15944 (plingeling) R 15930 15930 15470 0 -1 4202560 6324 1257 0 0 2908 17 0 0 25 0 5 0 527958220 78065664 7514 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331106 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15935/tid=15945] ppid=15930 vsize=76236 CPUtime=31.18 cores=4-7
/proc/15935/task/15945/stat : 15945 (plingeling) R 15930 15930 15470 0 -1 4202560 6542 1257 0 0 3111 7 0 0 25 0 5 0 527958220 78065664 7514 33554432000 4194304 4356188 140733990770336 18446744073709551615 4332165 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 247.36
Current children cumulated vsize (KiB) 2418292

[startup+32.0067 s]
/proc/loadavg: 8.23 8.12 8.03 9/178 15946
/proc/meminfo: memFree=30787844/32951132 swapFree=67080200/67111528
[pid=15930] ppid=15928 vsize=18324 CPUtime=0 cores=0-7
/proc/15930/stat : 15930 (ppfolio) S 15928 15930 15470 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527958218 18763776 389 33554432000 4194304 4287625 140734279431088 18446744073709551615 210647166479 0 0 4096 65536 3804107788821463039 0 0 17 3 0 0 0
/proc/15930/statm: 4581 389 341 23 0 91 0
[pid=15931] ppid=15930 vsize=1841008 CPUtime=31.99 cores=0
/proc/15931/stat : 15931 (cryptominisat) R 15930 15930 15470 0 -1 4202496 16274 0 0 0 3198 1 0 0 25 0 1 0 527958218 1885192192 5548 33554432000 4194304 4587354 140734649207376 18446744073709551615 4238608 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15931/statm: 460252 5548 336 96 0 456814 0
[pid=15932] ppid=15930 vsize=18744 CPUtime=31.99 cores=1
/proc/15932/stat : 15932 (clasp) R 15930 15930 15470 0 -1 4202496 2037 0 0 0 3199 0 0 0 25 0 1 0 527958218 19193856 1929 33554432000 4194304 4785740 140733244781424 18446744073709551615 4550305 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/15932/statm: 4686 1929 341 145 0 1731 0
[pid=15933] ppid=15930 vsize=456220 CPUtime=31.97 cores=2
/proc/15933/stat : 15933 (TNM) R 15930 15930 15470 0 -1 4202496 440 0 0 0 3197 0 0 0 25 0 1 0 527958218 467169280 337 33554432000 134512640 134534564 4291404928 18446744073709551615 134530158 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/15933/statm: 114055 337 95 6 0 112721 0
[pid=15934] ppid=15930 vsize=7760 CPUtime=31.99 cores=3
/proc/15934/stat : 15934 (march_hi) R 15930 15930 15470 0 -1 4202496 911 0 0 0 3199 0 0 0 25 0 1 0 527958218 7946240 469 33554432000 4194304 4331988 140736975384208 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/15934/statm: 1940 469 174 34 0 382 0
[pid=15935] ppid=15930 vsize=75596 CPUtime=125.86 cores=4-7
/proc/15935/stat : 15935 (plingeling) S 15930 15930 15470 0 -1 4202496 27612 1257 0 0 12553 33 0 0 18 0 5 0 527958218 77410304 7354 33554432000 4194304 4356188 140733990770336 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/15935/statm: 18899 7354 161 40 0 17443 0
[pid=15935/tid=15942] ppid=15930 vsize=75596 CPUtime=31.98 cores=4-7
/proc/15935/task/15942/stat : 15942 (plingeling) R 15930 15930 15470 0 -1 4202560 6793 1257 0 0 3194 4 0 0 25 0 5 0 527958220 77410304 7354 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331050 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15935/tid=15943] ppid=15930 vsize=75596 CPUtime=31.81 cores=4-7
/proc/15935/task/15943/stat : 15943 (plingeling) R 15930 15930 15470 0 -1 4202560 6788 1257 0 0 3178 3 0 0 25 0 5 0 527958220 77410304 7354 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15935/tid=15944] ppid=15930 vsize=75596 CPUtime=30.05 cores=4-7
/proc/15935/task/15944/stat : 15944 (plingeling) R 15930 15930 15470 0 -1 4202560 6452 1257 0 0 2988 17 0 0 25 0 5 0 527958220 77410304 7354 33554432000 4194304 4356188 140733990770336 18446744073709551615 4332041 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15935/tid=15945] ppid=15930 vsize=75596 CPUtime=31.98 cores=4-7
/proc/15935/task/15945/stat : 15945 (plingeling) R 15930 15930 15470 0 -1 4202560 6702 1257 0 0 3191 7 0 0 25 0 5 0 527958220 77410304 7354 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 253.8
Current children cumulated vsize (KiB) 2417652

[startup+32.4007 s]
/proc/loadavg: 8.23 8.12 8.03 9/178 15946
/proc/meminfo: memFree=30787844/32951132 swapFree=67080200/67111528
[pid=15930] ppid=15928 vsize=18324 CPUtime=0 cores=0-7
/proc/15930/stat : 15930 (ppfolio) S 15928 15930 15470 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527958218 18763776 389 33554432000 4194304 4287625 140734279431088 18446744073709551615 210647166479 0 0 4096 65536 3804107788821463039 0 0 17 3 0 0 0
/proc/15930/statm: 4581 389 341 23 0 91 0
[pid=15931] ppid=15930 vsize=1841008 CPUtime=32.38 cores=0
/proc/15931/stat : 15931 (cryptominisat) R 15930 15930 15470 0 -1 4202496 16339 0 0 0 3237 1 0 0 25 0 1 0 527958218 1885192192 5612 33554432000 4194304 4587354 140734649207376 18446744073709551615 4238421 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15931/statm: 460252 5612 336 96 0 456814 0
[pid=15932] ppid=15930 vsize=18744 CPUtime=32.38 cores=1
/proc/15932/stat : 15932 (clasp) R 15930 15930 15470 0 -1 4202496 2037 0 0 0 3238 0 0 0 25 0 1 0 527958218 19193856 1929 33554432000 4194304 4785740 140733244781424 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/15932/statm: 4686 1929 341 145 0 1731 0
[pid=15933] ppid=15930 vsize=456220 CPUtime=32.36 cores=2
/proc/15933/stat : 15933 (TNM) R 15930 15930 15470 0 -1 4202496 440 0 0 0 3236 0 0 0 25 0 1 0 527958218 467169280 337 33554432000 134512640 134534564 4291404928 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/15933/statm: 114055 337 95 6 0 112721 0
[pid=15934] ppid=15930 vsize=7760 CPUtime=32.39 cores=3
/proc/15934/stat : 15934 (march_hi) R 15930 15930 15470 0 -1 4202496 911 0 0 0 3239 0 0 0 25 0 1 0 527958218 7946240 469 33554432000 4194304 4331988 140736975384208 18446744073709551615 4226645 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/15934/statm: 1940 469 174 34 0 382 0
[pid=15935] ppid=15930 vsize=75084 CPUtime=127.44 cores=4-7
/proc/15935/stat : 15935 (plingeling) S 15930 15930 15470 0 -1 4202496 27708 1257 0 0 12711 33 0 0 18 0 5 0 527958218 76886016 7226 33554432000 4194304 4356188 140733990770336 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/15935/statm: 18771 7226 161 40 0 17315 0
[pid=15935/tid=15942] ppid=15930 vsize=75084 CPUtime=32.37 cores=4-7
/proc/15935/task/15942/stat : 15942 (plingeling) R 15930 15930 15470 0 -1 4202560 6793 1257 0 0 3233 4 0 0 25 0 5 0 527958220 76886016 7226 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15935/tid=15943] ppid=15930 vsize=75084 CPUtime=32.2 cores=4-7
/proc/15935/task/15943/stat : 15943 (plingeling) R 15930 15930 15470 0 -1 4202560 6788 1257 0 0 3217 3 0 0 25 0 5 0 527958220 76886016 7226 33554432000 4194304 4356188 140733990770336 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15935/tid=15944] ppid=15930 vsize=75084 CPUtime=30.45 cores=4-7
/proc/15935/task/15944/stat : 15944 (plingeling) R 15930 15930 15470 0 -1 4202560 6548 1257 0 0 3028 17 0 0 25 0 5 0 527958220 76886016 7226 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331332 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15935/tid=15945] ppid=15930 vsize=75084 CPUtime=32.38 cores=4-7
/proc/15935/task/15945/stat : 15945 (plingeling) R 15930 15930 15470 0 -1 4202560 6702 1257 0 0 3231 7 0 0 25 0 5 0 527958220 76886016 7226 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331964 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 256.95
Current children cumulated vsize (KiB) 2417140

[startup+32.5006 s]
/proc/loadavg: 8.23 8.12 8.03 9/178 15946
/proc/meminfo: memFree=30787844/32951132 swapFree=67080200/67111528
[pid=15930] ppid=15928 vsize=18324 CPUtime=0 cores=0-7
/proc/15930/stat : 15930 (ppfolio) S 15928 15930 15470 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527958218 18763776 389 33554432000 4194304 4287625 140734279431088 18446744073709551615 210647166479 0 0 4096 65536 3804107788821463039 0 0 17 3 0 0 0
/proc/15930/statm: 4581 389 341 23 0 91 0
[pid=15931] ppid=15930 vsize=1841008 CPUtime=32.48 cores=0
/proc/15931/stat : 15931 (cryptominisat) R 15930 15930 15470 0 -1 4202496 16354 0 0 0 3247 1 0 0 25 0 1 0 527958218 1885192192 5627 33554432000 4194304 4587354 140734649207376 18446744073709551615 4238616 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15931/statm: 460252 5627 336 96 0 456814 0
[pid=15932] ppid=15930 vsize=18744 CPUtime=32.48 cores=1
/proc/15932/stat : 15932 (clasp) R 15930 15930 15470 0 -1 4202496 2039 0 0 0 3248 0 0 0 25 0 1 0 527958218 19193856 1931 33554432000 4194304 4785740 140733244781424 18446744073709551615 4287058 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/15932/statm: 4686 1931 341 145 0 1731 0
[pid=15933] ppid=15930 vsize=456220 CPUtime=32.46 cores=2
/proc/15933/stat : 15933 (TNM) R 15930 15930 15470 0 -1 4202496 440 0 0 0 3246 0 0 0 25 0 1 0 527958218 467169280 337 33554432000 134512640 134534564 4291404928 18446744073709551615 134528824 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/15933/statm: 114055 337 95 6 0 112721 0
[pid=15934] ppid=15930 vsize=7760 CPUtime=32.49 cores=3
/proc/15934/stat : 15934 (march_hi) R 15930 15930 15470 0 -1 4202496 911 0 0 0 3249 0 0 0 25 0 1 0 527958218 7946240 469 33554432000 4194304 4331988 140736975384208 18446744073709551615 4210448 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/15934/statm: 1940 469 174 34 0 382 0
[pid=15935] ppid=15930 vsize=75340 CPUtime=127.84 cores=4-7
/proc/15935/stat : 15935 (plingeling) S 15930 15930 15470 0 -1 4202496 27772 1257 0 0 12751 33 0 0 18 0 5 0 527958218 77148160 7290 33554432000 4194304 4356188 140733990770336 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/15935/statm: 18835 7290 161 40 0 17379 0
[pid=15935/tid=15942] ppid=15930 vsize=75340 CPUtime=32.47 cores=4-7
/proc/15935/task/15942/stat : 15942 (plingeling) R 15930 15930 15470 0 -1 4202560 6793 1257 0 0 3243 4 0 0 25 0 5 0 527958220 77148160 7290 33554432000 4194304 4356188 140733990770336 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15935/tid=15943] ppid=15930 vsize=75340 CPUtime=32.3 cores=4-7
/proc/15935/task/15943/stat : 15943 (plingeling) R 15930 15930 15470 0 -1 4202560 6852 1257 0 0 3227 3 0 0 25 0 5 0 527958220 77148160 7290 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15935/tid=15944] ppid=15930 vsize=75340 CPUtime=30.55 cores=4-7
/proc/15935/task/15944/stat : 15944 (plingeling) R 15930 15930 15470 0 -1 4202560 6548 1257 0 0 3038 17 0 0 25 0 5 0 527958220 77148160 7290 33554432000 4194304 4356188 140733990770336 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=15935/tid=15945] ppid=15930 vsize=75340 CPUtime=32.48 cores=4-7
/proc/15935/task/15945/stat : 15945 (plingeling) R 15930 15930 15470 0 -1 4202560 6702 1257 0 0 3241 7 0 0 25 0 5 0 527958220 77148160 7290 33554432000 4194304 4356188 140733990770336 18446744073709551615 4331086 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 257.75
Current children cumulated vsize (KiB) 2417396

Child status: 0
Real time (s): 32.5865
CPU time (s): 258.471
CPU user time (s): 258.097
CPU system time (s): 0.373943
CPU usage (%): 793.184
Max. virtual memory (cumulated for all children) (KiB): 2419444

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 258.097
system time used= 0.373943
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 49459
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1393
involuntary context switches= 1808

runsolver used 0.049992 second user time and 0.107983 second system time

The end

Launcher Data 

Begin job on node129 at 2011-04-30 13:39:46
IDJOB=3222075
IDBENCH=83029
IDSOLVER=1638
FILE ID=node129/3222075-1304163586
RUNJOBID= node129-1304158550-15484
PBS_JOBID= 13170917
Free space on /tmp= 67252 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k7-r89-v50-c4450-S324945930-048.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3222075-1304163586/watcher-3222075-1304163586 -o /tmp/evaluation-result-3222075-1304163586/solver-3222075-1304163586 -C 40000 -W 5000 -M 31000  ppfolio HOME/instance-3222075-1304163586.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 25ed0c8de63814e6d33af77a8f91b72b
RANDOM SEED=1745909026

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      30845248 kB
Buffers:        278596 kB
Cached:        1447468 kB
SwapCached:       5024 kB
Active:         139260 kB
Inactive:      1624508 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      30845248 kB
SwapTotal:    67111528 kB
SwapFree:     67080200 kB
Dirty:           10248 kB
Writeback:           8 kB
AnonPages:       35104 kB
Mapped:          12340 kB
Slab:           276348 kB
PageTables:       4216 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   184688 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 67240 MiB
End job on node129 at 2011-04-30 13:40:19