Trace number 3275696

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 1594.35 199.442

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-3-5_528.cnf
MD5SUM7c7070bd15b57ddd9a06dd3709baef54
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark157.252
Satisfiable
(Un)Satisfiability was proved
Number of variables527
Number of clauses12692
Sum of the clauses size38748
Maximum clause length5
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 312356
Number of clauses of size 40
Number of clauses of size 5336
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7
1594.00/199.43	s UNSATISFIABLE
1594.00/199.44	solver [2] clasp 1.3.6 answered
1594.00/199.44	Done

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3275696-1304169290/watcher-3275696-1304169290 -o /tmp/evaluation-result-3275696-1304169290/solver-3275696-1304169290 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3275696-1304169290.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.41 7.90 7.96 1/170 12660
/proc/meminfo: memFree=30086264/32950928 swapFree=67054472/67111528
[pid=12660] ppid=12658 vsize=18324 CPUtime=0 cores=0-7
/proc/12660/stat : 12660 (ppfolio) S 12658 12660 12634 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 607159664 18763776 390 33554432000 4194304 4287625 140735477357856 18446744073709551615 260905414159 0 0 4096 65536 4607859859696648191 0 0 17 4 0 0 0
/proc/12660/statm: 4581 390 341 23 0 91 0

[startup+0.126281 s]
/proc/loadavg: 7.41 7.90 7.96 1/170 12660
/proc/meminfo: memFree=30086264/32950928 swapFree=67054472/67111528
[pid=12660] ppid=12658 vsize=18324 CPUtime=0 cores=0-7
/proc/12660/stat : 12660 (ppfolio) R 12658 12660 12634 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 607159664 18763776 390 33554432000 4194304 4287625 140735477357856 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/12660/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.226261 s]
/proc/loadavg: 7.41 7.90 7.96 1/170 12660
/proc/meminfo: memFree=30086264/32950928 swapFree=67054472/67111528
[pid=12660] ppid=12658 vsize=18324 CPUtime=0 cores=0-7
/proc/12660/stat : 12660 (ppfolio) R 12658 12660 12634 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 607159664 18763776 390 33554432000 4194304 4287625 140735477357856 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/12660/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.326244 s]
/proc/loadavg: 7.41 7.90 7.96 1/170 12660
/proc/meminfo: memFree=30086264/32950928 swapFree=67054472/67111528
[pid=12660] ppid=12658 vsize=18324 CPUtime=0 cores=0-7
/proc/12660/stat : 12660 (ppfolio) R 12658 12660 12634 0 -1 4202496 520 0 0 0 0 0 0 0 24 0 1 0 607159664 18763776 390 33554432000 4194304 4287625 140735477357856 18446744073709551615 260905414159 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/12660/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700176 s]
/proc/loadavg: 7.41 7.90 7.96 1/170 12660
/proc/meminfo: memFree=30086264/32950928 swapFree=67054472/67111528
[pid=12660] ppid=12658 vsize=18324 CPUtime=0 cores=0-7
/proc/12660/stat : 12660 (ppfolio) S 12658 12660 12634 0 -1 4202496 520 0 0 0 0 0 0 0 22 0 1 0 607159664 18763776 390 33554432000 4194304 4287625 140735477357856 18446744073709551615 260905414159 0 0 4096 65536 4607859859696648191 0 0 17 4 0 0 0
/proc/12660/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50103 s]
/proc/loadavg: 7.41 7.90 7.96 9/180 12675
/proc/meminfo: memFree=30058160/32950928 swapFree=67054472/67111528
[pid=12660] ppid=12658 vsize=18324 CPUtime=0 cores=0-7
/proc/12660/stat : 12660 (ppfolio) S 12658 12660 12634 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 607159664 18763776 390 33554432000 4194304 4287625 140735477357856 18446744073709551615 260905414159 0 0 4096 65536 4607859859696648191 0 0 17 4 0 0 0
/proc/12660/statm: 4581 390 341 23 0 91 0
[pid=12661] ppid=12660 vsize=1532936 CPUtime=1.49 cores=0
/proc/12661/stat : 12661 (cryptominisat) R 12660 12660 12634 0 -1 4202496 4364 0 0 0 149 0 0 0 25 0 1 0 607159664 1569726464 2698 33554432000 4194304 4587354 140736594242496 18446744073709551615 4238392 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12661/statm: 383234 2698 338 96 0 379796 0
[pid=12662] ppid=12660 vsize=15952 CPUtime=1.49 cores=1
/proc/12662/stat : 12662 (clasp) R 12660 12660 12634 0 -1 4202496 1474 0 0 0 149 0 0 0 20 0 1 0 607159664 16334848 1341 33554432000 4194304 4785740 140733298293136 18446744073709551615 4287129 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12662/statm: 3988 1341 340 145 0 1033 0
[pid=12663] ppid=12660 vsize=456748 CPUtime=1.49 cores=2
/proc/12663/stat : 12663 (TNM) R 12660 12660 12634 0 -1 4202496 656 0 0 0 149 0 0 0 20 0 1 0 607159664 467709952 553 33554432000 134512640 134534564 4292264464 18446744073709551615 134528918 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12663/statm: 114187 553 95 6 0 112853 0
[pid=12664] ppid=12660 vsize=9568 CPUtime=1.49 cores=3
/proc/12664/stat : 12664 (march_hi) R 12660 12660 12634 0 -1 4202496 1048 0 0 0 149 0 0 0 25 0 1 0 607159664 9797632 772 33554432000 4194304 4331988 140734398164464 18446744073709551615 4287447 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12664/statm: 2392 772 175 34 0 834 0
[pid=12665] ppid=12660 vsize=127788 CPUtime=5.91 cores=4-7
/proc/12665/stat : 12665 (plingeling) S 12660 12660 12634 0 -1 4202496 5110 1259 0 0 591 0 0 0 19 0 5 0 607159664 130854912 4133 33554432000 4194304 4356188 140735357439840 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12665/statm: 31947 4133 164 40 0 30491 0
[pid=12665/tid=12672] ppid=12660 vsize=127788 CPUtime=1.47 cores=4-7
/proc/12665/task/12672/stat : 12672 (plingeling) R 12660 12660 12634 0 -1 4202560 1074 1259 0 0 147 0 0 0 20 0 5 0 607159666 130854912 4133 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331002 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12665/tid=12673] ppid=12660 vsize=127788 CPUtime=1.47 cores=4-7
/proc/12665/task/12673/stat : 12673 (plingeling) R 12660 12660 12634 0 -1 4202560 933 1259 0 0 147 0 0 0 23 0 5 0 607159666 130854912 4133 33554432000 4194304 4356188 140735357439840 18446744073709551615 4211859 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12665/tid=12674] ppid=12660 vsize=127788 CPUtime=1.47 cores=4-7
/proc/12665/task/12674/stat : 12674 (plingeling) R 12660 12660 12634 0 -1 4202560 656 1259 0 0 147 0 0 0 25 0 5 0 607159666 130854912 4133 33554432000 4194304 4356188 140735357439840 18446744073709551615 4212176 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12665/tid=12675] ppid=12660 vsize=127788 CPUtime=1.47 cores=4-7
/proc/12665/task/12675/stat : 12675 (plingeling) R 12660 12660 12634 0 -1 4202560 1021 1259 0 0 147 0 0 0 25 0 5 0 607159666 130854912 4133 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331176 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.87
Current children cumulated vsize (KiB) 2161316

[startup+3.10074 s]
/proc/loadavg: 7.41 7.90 7.96 9/180 12675
/proc/meminfo: memFree=30050596/32950928 swapFree=67054472/67111528
[pid=12660] ppid=12658 vsize=18324 CPUtime=0 cores=0-7
/proc/12660/stat : 12660 (ppfolio) S 12658 12660 12634 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 607159664 18763776 390 33554432000 4194304 4287625 140735477357856 18446744073709551615 260905414159 0 0 4096 65536 4607859859696648191 0 0 17 4 0 0 0
/proc/12660/statm: 4581 390 341 23 0 91 0
[pid=12661] ppid=12660 vsize=1537676 CPUtime=3.08 cores=0
/proc/12661/stat : 12661 (cryptominisat) R 12660 12660 12634 0 -1 4202496 6133 0 0 0 308 0 0 0 25 0 1 0 607159664 1574580224 3082 33554432000 4194304 4587354 140736594242496 18446744073709551615 4238104 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12661/statm: 384419 3082 338 96 0 380981 0
[pid=12662] ppid=12660 vsize=17116 CPUtime=3.09 cores=1
/proc/12662/stat : 12662 (clasp) R 12660 12660 12634 0 -1 4202496 1738 0 0 0 309 0 0 0 25 0 1 0 607159664 17526784 1605 33554432000 4194304 4785740 140733298293136 18446744073709551615 4286927 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12662/statm: 4279 1605 340 145 0 1324 0
[pid=12663] ppid=12660 vsize=456748 CPUtime=3.09 cores=2
/proc/12663/stat : 12663 (TNM) R 12660 12660 12634 0 -1 4202496 656 0 0 0 309 0 0 0 25 0 1 0 607159664 467709952 553 33554432000 134512640 134534564 4292264464 18446744073709551615 134530619 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12663/statm: 114187 553 95 6 0 112853 0
[pid=12664] ppid=12660 vsize=9704 CPUtime=3.09 cores=3
/proc/12664/stat : 12664 (march_hi) R 12660 12660 12634 0 -1 4202496 1055 0 0 0 309 0 0 0 25 0 1 0 607159664 9936896 779 33554432000 4194304 4331988 140734398164464 18446744073709551615 4226560 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12664/statm: 2426 779 175 34 0 868 0
[pid=12665] ppid=12660 vsize=130608 CPUtime=12.31 cores=4-7
/proc/12665/stat : 12665 (plingeling) S 12660 12660 12634 0 -1 4202496 5796 1259 0 0 1230 1 0 0 19 0 5 0 607159664 133742592 4819 33554432000 4194304 4356188 140735357439840 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12665/statm: 32652 4819 164 40 0 31196 0
[pid=12665/tid=12672] ppid=12660 vsize=130608 CPUtime=3.07 cores=4-7
/proc/12665/task/12672/stat : 12672 (plingeling) R 12660 12660 12634 0 -1 4202560 1363 1259 0 0 307 0 0 0 25 0 5 0 607159666 133742592 4819 33554432000 4194304 4356188 140735357439840 18446744073709551615 4281608 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12665/tid=12673] ppid=12660 vsize=130608 CPUtime=3.07 cores=4-7
/proc/12665/task/12673/stat : 12673 (plingeling) R 12660 12660 12634 0 -1 4202560 993 1259 0 0 307 0 0 0 25 0 5 0 607159666 133742592 4819 33554432000 4194304 4356188 140735357439840 18446744073709551615 4330896 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12665/tid=12674] ppid=12660 vsize=130608 CPUtime=3.07 cores=4-7
/proc/12665/task/12674/stat : 12674 (plingeling) R 12660 12660 12634 0 -1 4202560 720 1259 0 0 307 0 0 0 25 0 5 0 607159666 133742592 4819 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12665/tid=12675] ppid=12660 vsize=130608 CPUtime=3.06 cores=4-7
/proc/12665/task/12675/stat : 12675 (plingeling) R 12660 12660 12634 0 -1 4202560 1294 1259 0 0 306 0 0 0 25 0 5 0 607159666 133742592 4819 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331264 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.66
Current children cumulated vsize (KiB) 2170176

[startup+6.30115 s]
/proc/loadavg: 7.45 7.90 7.96 9/180 12675
/proc/meminfo: memFree=30037840/32950928 swapFree=67054472/67111528
[pid=12660] ppid=12658 vsize=18324 CPUtime=0 cores=0-7
/proc/12660/stat : 12660 (ppfolio) S 12658 12660 12634 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 607159664 18763776 390 33554432000 4194304 4287625 140735477357856 18446744073709551615 260905414159 0 0 4096 65536 4607859859696648191 0 0 17 4 0 0 0
/proc/12660/statm: 4581 390 341 23 0 91 0
[pid=12661] ppid=12660 vsize=1534976 CPUtime=6.29 cores=0
/proc/12661/stat : 12661 (cryptominisat) R 12660 12660 12634 0 -1 4202496 8416 0 0 0 628 1 0 0 25 0 1 0 607159664 1571815424 3175 33554432000 4194304 4587354 140736594242496 18446744073709551615 4238455 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12661/statm: 383744 3175 338 96 0 380306 0
[pid=12662] ppid=12660 vsize=18616 CPUtime=6.29 cores=1
/proc/12662/stat : 12662 (clasp) R 12660 12660 12634 0 -1 4202496 2057 0 0 0 629 0 0 0 25 0 1 0 607159664 19062784 1924 33554432000 4194304 4785740 140733298293136 18446744073709551615 4553015 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12662/statm: 4654 1924 340 145 0 1699 0
[pid=12663] ppid=12660 vsize=456748 CPUtime=6.29 cores=2
/proc/12663/stat : 12663 (TNM) R 12660 12660 12634 0 -1 4202496 656 0 0 0 629 0 0 0 25 0 1 0 607159664 467709952 553 33554432000 134512640 134534564 4292264464 18446744073709551615 134528880 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12663/statm: 114187 553 95 6 0 112853 0
[pid=12664] ppid=12660 vsize=9704 CPUtime=6.29 cores=3
/proc/12664/stat : 12664 (march_hi) R 12660 12660 12634 0 -1 4202496 1067 0 0 0 629 0 0 0 25 0 1 0 607159664 9936896 791 33554432000 4194304 4331988 140734398164464 18446744073709551615 4237171 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12664/statm: 2426 791 175 34 0 868 0
[pid=12665] ppid=12660 vsize=141116 CPUtime=25.09 cores=4-7
/proc/12665/stat : 12665 (plingeling) S 12660 12660 12634 0 -1 4202496 8935 1259 0 0 2508 1 0 0 19 0 5 0 607159664 144502784 7446 33554432000 4194304 4356188 140735357439840 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12665/statm: 35279 7446 164 40 0 33823 0
[pid=12665/tid=12672] ppid=12660 vsize=141116 CPUtime=6.27 cores=4-7
/proc/12665/task/12672/stat : 12672 (plingeling) R 12660 12660 12634 0 -1 4202560 1921 1259 0 0 627 0 0 0 25 0 5 0 607159666 144502784 7446 33554432000 4194304 4356188 140735357439840 18446744073709551615 4330973 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12665/tid=12673] ppid=12660 vsize=141116 CPUtime=6.27 cores=4-7
/proc/12665/task/12673/stat : 12673 (plingeling) R 12660 12660 12634 0 -1 4202560 1716 1259 0 0 627 0 0 0 25 0 5 0 607159666 144502784 7446 33554432000 4194304 4356188 140735357439840 18446744073709551615 4237401 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12665/tid=12674] ppid=12660 vsize=141116 CPUtime=6.27 cores=4-7
/proc/12665/task/12674/stat : 12674 (plingeling) R 12660 12660 12634 0 -1 4202560 1232 1259 0 0 627 0 0 0 25 0 5 0 607159666 144502784 7446 33554432000 4194304 4356188 140735357439840 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12665/tid=12675] ppid=12660 vsize=141116 CPUtime=6.24 cores=4-7
/proc/12665/task/12675/stat : 12675 (plingeling) R 12660 12660 12634 0 -1 4202560 2640 1259 0 0 624 0 0 0 25 0 5 0 607159666 144502784 7446 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.25
Current children cumulated vsize (KiB) 2179484

[startup+12.701 s]
/proc/loadavg: 7.50 7.90 7.96 9/180 12676
/proc/meminfo: memFree=30026420/32950928 swapFree=67054472/67111528
[pid=12660] ppid=12658 vsize=18324 CPUtime=0 cores=0-7
/proc/12660/stat : 12660 (ppfolio) S 12658 12660 12634 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 607159664 18763776 390 33554432000 4194304 4287625 140735477357856 18446744073709551615 260905414159 0 0 4096 65536 4607859859696648191 0 0 17 4 0 0 0
/proc/12660/statm: 4581 390 341 23 0 91 0
[pid=12661] ppid=12660 vsize=1537260 CPUtime=12.69 cores=0
/proc/12661/stat : 12661 (cryptominisat) R 12660 12660 12634 0 -1 4202496 12532 0 0 0 1267 2 0 0 25 0 1 0 607159664 1574154240 3814 33554432000 4194304 4587354 140736594242496 18446744073709551615 4237695 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12661/statm: 384315 3814 338 96 0 380877 0
[pid=12662] ppid=12660 vsize=20408 CPUtime=12.69 cores=1
/proc/12662/stat : 12662 (clasp) R 12660 12660 12634 0 -1 4202496 2481 0 0 0 1269 0 0 0 25 0 1 0 607159664 20897792 2348 33554432000 4194304 4785740 140733298293136 18446744073709551615 4286919 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12662/statm: 5102 2348 340 145 0 2147 0
[pid=12663] ppid=12660 vsize=456748 CPUtime=12.69 cores=2
/proc/12663/stat : 12663 (TNM) R 12660 12660 12634 0 -1 4202496 656 0 0 0 1269 0 0 0 25 0 1 0 607159664 467709952 553 33554432000 134512640 134534564 4292264464 18446744073709551615 134528864 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12663/statm: 114187 553 95 6 0 112853 0
[pid=12664] ppid=12660 vsize=9892 CPUtime=12.69 cores=3
/proc/12664/stat : 12664 (march_hi) R 12660 12660 12634 0 -1 4202496 1094 0 0 0 1269 0 0 0 25 0 1 0 607159664 10129408 818 33554432000 4194304 4331988 140734398164464 18446744073709551615 4292747 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12664/statm: 2473 818 175 34 0 915 0
[pid=12665] ppid=12660 vsize=146224 CPUtime=50.65 cores=4-7
/proc/12665/stat : 12665 (plingeling) S 12660 12660 12634 0 -1 4202496 12684 1259 0 0 5063 2 0 0 19 0 5 0 607159664 149733376 8755 33554432000 4194304 4356188 140735357439840 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12665/statm: 36556 8755 164 40 0 35100 0
[pid=12665/tid=12672] ppid=12660 vsize=146224 CPUtime=12.67 cores=4-7
/proc/12665/task/12672/stat : 12672 (plingeling) R 12660 12660 12634 0 -1 4202560 2739 1259 0 0 1267 0 0 0 25 0 5 0 607159666 149733376 8755 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331047 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12665/tid=12673] ppid=12660 vsize=146224 CPUtime=12.67 cores=4-7
/proc/12665/task/12673/stat : 12673 (plingeling) R 12660 12660 12634 0 -1 4202560 2705 1259 0 0 1267 0 0 0 25 0 5 0 607159666 149733376 8755 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12665/tid=12674] ppid=12660 vsize=146224 CPUtime=12.67 cores=4-7
/proc/12665/task/12674/stat : 12674 (plingeling) R 12660 12660 12634 0 -1 4202560 2215 1259 0 0 1267 0 0 0 25 0 5 0 607159666 149733376 8755 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331456 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12665/tid=12675] ppid=12660 vsize=146224 CPUtime=12.6 cores=4-7
/proc/12665/task/12675/stat : 12675 (plingeling) R 12660 12660 12634 0 -1 4202560 3599 1259 0 0 1260 0 0 0 25 0 5 0 607159666 149733376 8755 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331984 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.41
Current children cumulated vsize (KiB) 2188856

[startup+25.5006 s]
/proc/loadavg: 7.61 7.90 7.96 9/180 12676
/proc/meminfo: memFree=30009108/32950928 swapFree=67054472/67111528
[pid=12660] ppid=12658 vsize=18324 CPUtime=0 cores=0-7
/proc/12660/stat : 12660 (ppfolio) S 12658 12660 12634 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 607159664 18763776 390 33554432000 4194304 4287625 140735477357856 18446744073709551615 260905414159 0 0 4096 65536 4607859859696648191 0 0 17 4 0 0 0
/proc/12660/statm: 4581 390 341 23 0 91 0
[pid=12661] ppid=12660 vsize=1533284 CPUtime=25.49 cores=0
/proc/12661/stat : 12661 (cryptominisat) R 12660 12660 12634 0 -1 4202496 18997 0 0 0 2546 3 0 0 25 0 1 0 607159664 1570082816 3223 33554432000 4194304 4587354 140736594242496 18446744073709551615 4238739 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=12665/tid=12672] ppid=12660 vsize=218492 CPUtime=191.98 cores=4-7
/proc/12665/task/12672/stat : 12672 (plingeling) R 12660 12660 12634 0 -1 4202560 26663 1259 0 0 19194 4 0 0 25 0 5 0 607159666 223735808 26852 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331803 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12665/tid=12673] ppid=12660 vsize=218492 CPUtime=191.95 cores=4-7
/proc/12665/task/12673/stat : 12673 (plingeling) R 12660 12660 12634 0 -1 4202560 24086 1259 0 0 19192 3 0 0 25 0 5 0 607159666 223735808 26852 33554432000 4194304 4356188 140735357439840 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12665/tid=12674] ppid=12660 vsize=218492 CPUtime=191.97 cores=4-7
/proc/12665/task/12674/stat : 12674 (plingeling) R 12660 12660 12634 0 -1 4202560 28650 1259 0 0 19192 5 0 0 25 0 5 0 607159666 223735808 26852 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331328 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12665/tid=12675] ppid=12660 vsize=218492 CPUtime=190.93 cores=4-7
/proc/12665/task/12675/stat : 12675 (plingeling) R 12660 12660 12634 0 -1 4202560 26678 1259 0 0 19091 2 0 0 25 0 5 0 607159666 223735808 26852 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1534.83
Current children cumulated vsize (KiB) 2289784

[startup+195.201 s]
/proc/loadavg: 8.10 7.99 7.98 9/180 12681
/proc/meminfo: memFree=29929920/32950928 swapFree=67054472/67111528
[pid=12660] ppid=12658 vsize=18324 CPUtime=0 cores=0-7
/proc/12660/stat : 12660 (ppfolio) S 12658 12660 12634 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 607159664 18763776 390 33554432000 4194304 4287625 140735477357856 18446744073709551615 260905414159 0 0 4096 65536 4607859859696648191 0 0 17 4 0 0 0
/proc/12660/statm: 4581 390 341 23 0 91 0
[pid=12661] ppid=12660 vsize=1552388 CPUtime=195.19 cores=0
/proc/12661/stat : 12661 (cryptominisat) R 12660 12660 12634 0 -1 4202496 63510 0 0 0 19502 17 0 0 25 0 1 0 607159664 1589645312 8240 33554432000 4194304 4587354 140736594242496 18446744073709551615 4231923 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12661/statm: 388097 8240 340 96 0 384659 0
[pid=12662] ppid=12660 vsize=31692 CPUtime=195.19 cores=1
/proc/12662/stat : 12662 (clasp) R 12660 12660 12634 0 -1 4202496 5073 0 0 0 19519 0 0 0 25 0 1 0 607159664 32452608 4940 33554432000 4194304 4785740 140733298293136 18446744073709551615 4416773 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12662/statm: 7923 4940 340 145 0 4968 0
[pid=12663] ppid=12660 vsize=456748 CPUtime=195.19 cores=2
/proc/12663/stat : 12663 (TNM) R 12660 12660 12634 0 -1 4202496 656 0 0 0 19519 0 0 0 25 0 1 0 607159664 467709952 553 33554432000 134512640 134534564 4292264464 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12663/statm: 114187 553 95 6 0 112853 0
[pid=12664] ppid=12660 vsize=12904 CPUtime=195.19 cores=3
/proc/12664/stat : 12664 (march_hi) R 12660 12660 12634 0 -1 4202496 1654 0 0 0 19519 0 0 0 25 0 1 0 607159664 13213696 1378 33554432000 4194304 4331988 140734398164464 18446744073709551615 4210459 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12664/statm: 3226 1378 175 34 0 1668 0
[pid=12665] ppid=12660 vsize=213372 CPUtime=779.66 cores=4-7
/proc/12665/stat : 12665 (plingeling) S 12660 12660 12634 0 -1 4202496 108911 1259 0 0 77949 17 0 0 19 0 5 0 607159664 218492928 25572 33554432000 4194304 4356188 140735357439840 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12665/statm: 53343 25572 164 40 0 51887 0
[pid=12665/tid=12672] ppid=12660 vsize=213372 CPUtime=195.17 cores=4-7
/proc/12665/task/12672/stat : 12672 (plingeling) R 12660 12660 12634 0 -1 4202560 27175 1259 0 0 19513 4 0 0 25 0 5 0 607159666 218492928 25572 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12665/tid=12673] ppid=12660 vsize=213372 CPUtime=195.15 cores=4-7
/proc/12665/task/12673/stat : 12673 (plingeling) R 12660 12660 12634 0 -1 4202560 24598 1259 0 0 19512 3 0 0 25 0 5 0 607159666 218492928 25572 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12665/tid=12674] ppid=12660 vsize=213372 CPUtime=195.17 cores=4-7
/proc/12665/task/12674/stat : 12674 (plingeling) R 12660 12660 12634 0 -1 4202560 28906 1259 0 0 19512 5 0 0 25 0 5 0 607159666 218492928 25572 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12665/tid=12675] ppid=12660 vsize=213372 CPUtime=194.11 cores=4-7
/proc/12665/task/12675/stat : 12675 (plingeling) R 12660 12660 12634 0 -1 4202560 26806 1259 0 0 19409 2 0 0 25 0 5 0 607159666 218492928 25572 33554432000 4194304 4356188 140735357439840 18446744073709551615 4332145 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1560.42
Current children cumulated vsize (KiB) 2285428

[startup+196.801 s]
/proc/loadavg: 8.10 7.99 7.98 9/180 12681
/proc/meminfo: memFree=29934756/32950928 swapFree=67054472/67111528
[pid=12660] ppid=12658 vsize=18324 CPUtime=0 cores=0-7
/proc/12660/stat : 12660 (ppfolio) S 12658 12660 12634 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 607159664 18763776 390 33554432000 4194304 4287625 140735477357856 18446744073709551615 260905414159 0 0 4096 65536 4607859859696648191 0 0 17 4 0 0 0
/proc/12660/statm: 4581 390 341 23 0 91 0
[pid=12661] ppid=12660 vsize=1551948 CPUtime=196.8 cores=0
/proc/12661/stat : 12661 (cryptominisat) R 12660 12660 12634 0 -1 4202496 64486 0 0 0 19662 18 0 0 25 0 1 0 607159664 1589194752 7433 33554432000 4194304 4587354 140736594242496 18446744073709551615 4238593 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12661/statm: 387987 7433 340 96 0 384549 0
[pid=12662] ppid=12660 vsize=31692 CPUtime=196.79 cores=1
/proc/12662/stat : 12662 (clasp) R 12660 12660 12634 0 -1 4202496 5075 0 0 0 19679 0 0 0 25 0 1 0 607159664 32452608 4942 33554432000 4194304 4785740 140733298293136 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12662/statm: 7923 4942 340 145 0 4968 0
[pid=12663] ppid=12660 vsize=456748 CPUtime=196.79 cores=2
/proc/12663/stat : 12663 (TNM) R 12660 12660 12634 0 -1 4202496 656 0 0 0 19679 0 0 0 25 0 1 0 607159664 467709952 553 33554432000 134512640 134534564 4292264464 18446744073709551615 134528864 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12663/statm: 114187 553 95 6 0 112853 0
[pid=12664] ppid=12660 vsize=12904 CPUtime=196.79 cores=3
/proc/12664/stat : 12664 (march_hi) R 12660 12660 12634 0 -1 4202496 1658 0 0 0 19679 0 0 0 25 0 1 0 607159664 13213696 1382 33554432000 4194304 4331988 140734398164464 18446744073709551615 4210406 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12664/statm: 3226 1382 175 34 0 1668 0
[pid=12665] ppid=12660 vsize=203132 CPUtime=786.05 cores=4-7
/proc/12665/stat : 12665 (plingeling) S 12660 12660 12634 0 -1 4202496 109039 1259 0 0 78588 17 0 0 19 0 5 0 607159664 208007168 23012 33554432000 4194304 4356188 140735357439840 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12665/statm: 50783 23012 164 40 0 49327 0
[pid=12665/tid=12672] ppid=12660 vsize=203132 CPUtime=196.78 cores=4-7
/proc/12665/task/12672/stat : 12672 (plingeling) R 12660 12660 12634 0 -1 4202560 27175 1259 0 0 19674 4 0 0 25 0 5 0 607159666 208007168 23012 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12665/tid=12673] ppid=12660 vsize=203132 CPUtime=196.75 cores=4-7
/proc/12665/task/12673/stat : 12673 (plingeling) R 12660 12660 12634 0 -1 4202560 24598 1259 0 0 19672 3 0 0 25 0 5 0 607159666 208007168 23012 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12665/tid=12674] ppid=12660 vsize=203132 CPUtime=196.77 cores=4-7
/proc/12665/task/12674/stat : 12674 (plingeling) R 12660 12660 12634 0 -1 4202560 28906 1259 0 0 19672 5 0 0 25 0 5 0 607159666 208007168 23012 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12665/tid=12675] ppid=12660 vsize=203132 CPUtime=195.71 cores=4-7
/proc/12665/task/12675/stat : 12675 (plingeling) R 12660 12660 12634 0 -1 4202560 26934 1259 0 0 19568 3 0 0 25 0 5 0 607159666 208007168 23012 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1573.22
Current children cumulated vsize (KiB) 2274748

[startup+198.401 s]
/proc/loadavg: 8.10 7.99 7.98 9/180 12681
/proc/meminfo: memFree=29941324/32950928 swapFree=67054472/67111528
[pid=12660] ppid=12658 vsize=18324 CPUtime=0 cores=0-7
/proc/12660/stat : 12660 (ppfolio) S 12658 12660 12634 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 607159664 18763776 390 33554432000 4194304 4287625 140735477357856 18446744073709551615 260905414159 0 0 4096 65536 4607859859696648191 0 0 17 4 0 0 0
/proc/12660/statm: 4581 390 341 23 0 91 0
[pid=12661] ppid=12660 vsize=1551948 CPUtime=198.4 cores=0
/proc/12661/stat : 12661 (cryptominisat) R 12660 12660 12634 0 -1 4202496 64700 0 0 0 19822 18 0 0 25 0 1 0 607159664 1589194752 7637 33554432000 4194304 4587354 140736594242496 18446744073709551615 4248764 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12661/statm: 387987 7637 340 96 0 384549 0
[pid=12662] ppid=12660 vsize=31308 CPUtime=198.39 cores=1
/proc/12662/stat : 12662 (clasp) R 12660 12660 12634 0 -1 4202496 5076 0 0 0 19839 0 0 0 25 0 1 0 607159664 32059392 4871 33554432000 4194304 4785740 140733298293136 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12662/statm: 7827 4871 340 145 0 4872 0
[pid=12663] ppid=12660 vsize=456748 CPUtime=198.39 cores=2
/proc/12663/stat : 12663 (TNM) R 12660 12660 12634 0 -1 4202496 656 0 0 0 19839 0 0 0 25 0 1 0 607159664 467709952 553 33554432000 134512640 134534564 4292264464 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12663/statm: 114187 553 95 6 0 112853 0
[pid=12664] ppid=12660 vsize=12904 CPUtime=198.39 cores=3
/proc/12664/stat : 12664 (march_hi) R 12660 12660 12634 0 -1 4202496 1665 0 0 0 19839 0 0 0 25 0 1 0 607159664 13213696 1389 33554432000 4194304 4331988 140734398164464 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12664/statm: 3226 1389 175 34 0 1668 0
[pid=12665] ppid=12660 vsize=203644 CPUtime=792.44 cores=4-7
/proc/12665/stat : 12665 (plingeling) S 12660 12660 12634 0 -1 4202496 109167 1259 0 0 79227 17 0 0 19 0 5 0 607159664 208531456 23140 33554432000 4194304 4356188 140735357439840 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12665/statm: 50911 23140 164 40 0 49455 0
[pid=12665/tid=12672] ppid=12660 vsize=203644 CPUtime=198.37 cores=4-7
/proc/12665/task/12672/stat : 12672 (plingeling) R 12660 12660 12634 0 -1 4202560 27175 1259 0 0 19833 4 0 0 25 0 5 0 607159666 208531456 23140 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12665/tid=12673] ppid=12660 vsize=203644 CPUtime=198.35 cores=4-7
/proc/12665/task/12673/stat : 12673 (plingeling) R 12660 12660 12634 0 -1 4202560 24598 1259 0 0 19832 3 0 0 25 0 5 0 607159666 208531456 23140 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331296 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12665/tid=12674] ppid=12660 vsize=203644 CPUtime=198.37 cores=4-7
/proc/12665/task/12674/stat : 12674 (plingeling) R 12660 12660 12634 0 -1 4202560 29034 1259 0 0 19832 5 0 0 25 0 5 0 607159666 208531456 23140 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331151 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12665/tid=12675] ppid=12660 vsize=203644 CPUtime=197.3 cores=4-7
/proc/12665/task/12675/stat : 12675 (plingeling) R 12660 12660 12634 0 -1 4202560 26934 1259 0 0 19727 3 0 0 25 0 5 0 607159666 208531456 23140 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1586.01
Current children cumulated vsize (KiB) 2274876

[startup+199.207 s]
/proc/loadavg: 8.10 7.99 7.98 9/180 12681
/proc/meminfo: memFree=29948392/32950928 swapFree=67054472/67111528
[pid=12660] ppid=12658 vsize=18324 CPUtime=0 cores=0-7
/proc/12660/stat : 12660 (ppfolio) S 12658 12660 12634 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 607159664 18763776 390 33554432000 4194304 4287625 140735477357856 18446744073709551615 260905414159 0 0 4096 65536 4607859859696648191 0 0 17 4 0 0 0
/proc/12660/statm: 4581 390 341 23 0 91 0
[pid=12661] ppid=12660 vsize=1551948 CPUtime=199.2 cores=0
/proc/12661/stat : 12661 (cryptominisat) R 12660 12660 12634 0 -1 4202496 64796 0 0 0 19902 18 0 0 25 0 1 0 607159664 1589194752 7729 33554432000 4194304 4587354 140736594242496 18446744073709551615 4238449 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12661/statm: 387987 7729 340 96 0 384549 0
[pid=12662] ppid=12660 vsize=31308 CPUtime=199.19 cores=1
/proc/12662/stat : 12662 (clasp) R 12660 12660 12634 0 -1 4202496 5076 0 0 0 19919 0 0 0 25 0 1 0 607159664 32059392 4871 33554432000 4194304 4785740 140733298293136 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12662/statm: 7827 4871 340 145 0 4872 0
[pid=12663] ppid=12660 vsize=456748 CPUtime=199.2 cores=2
/proc/12663/stat : 12663 (TNM) R 12660 12660 12634 0 -1 4202496 656 0 0 0 19920 0 0 0 25 0 1 0 607159664 467709952 553 33554432000 134512640 134534564 4292264464 18446744073709551615 134530268 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12663/statm: 114187 553 95 6 0 112853 0
[pid=12664] ppid=12660 vsize=12904 CPUtime=199.2 cores=3
/proc/12664/stat : 12664 (march_hi) R 12660 12660 12634 0 -1 4202496 1672 0 0 0 19920 0 0 0 25 0 1 0 607159664 13213696 1396 33554432000 4194304 4331988 140734398164464 18446744073709551615 4228210 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12664/statm: 3226 1396 175 34 0 1668 0
[pid=12665] ppid=12660 vsize=196476 CPUtime=795.65 cores=4-7
/proc/12665/stat : 12665 (plingeling) S 12660 12660 12634 0 -1 4202496 109423 1259 0 0 79548 17 0 0 19 0 5 0 607159664 201191424 21348 33554432000 4194304 4356188 140735357439840 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12665/statm: 49119 21348 164 40 0 47663 0
[pid=12665/tid=12672] ppid=12660 vsize=196476 CPUtime=199.18 cores=4-7
/proc/12665/task/12672/stat : 12672 (plingeling) R 12660 12660 12634 0 -1 4202560 27175 1259 0 0 19914 4 0 0 25 0 5 0 607159666 201191424 21348 33554432000 4194304 4356188 140735357439840 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12665/tid=12673] ppid=12660 vsize=196476 CPUtime=199.16 cores=4-7
/proc/12665/task/12673/stat : 12673 (plingeling) R 12660 12660 12634 0 -1 4202560 24598 1259 0 0 19913 3 0 0 25 0 5 0 607159666 201191424 21348 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12665/tid=12674] ppid=12660 vsize=196476 CPUtime=199.17 cores=4-7
/proc/12665/task/12674/stat : 12674 (plingeling) R 12660 12660 12634 0 -1 4202560 29290 1259 0 0 19912 5 0 0 25 0 5 0 607159666 201191424 21348 33554432000 4194304 4356188 140735357439840 18446744073709551615 4336036 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12665/tid=12675] ppid=12660 vsize=196476 CPUtime=198.1 cores=4-7
/proc/12665/task/12675/stat : 12675 (plingeling) R 12660 12660 12634 0 -1 4202560 26934 1259 0 0 19807 3 0 0 25 0 5 0 607159666 201191424 21348 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1592.44
Current children cumulated vsize (KiB) 2267708

[startup+199.401 s]
/proc/loadavg: 8.10 7.99 7.98 9/180 12681
/proc/meminfo: memFree=29948392/32950928 swapFree=67054472/67111528
[pid=12660] ppid=12658 vsize=18324 CPUtime=0 cores=0-7
/proc/12660/stat : 12660 (ppfolio) S 12658 12660 12634 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 607159664 18763776 390 33554432000 4194304 4287625 140735477357856 18446744073709551615 260905414159 0 0 4096 65536 4607859859696648191 0 0 17 4 0 0 0
/proc/12660/statm: 4581 390 341 23 0 91 0
[pid=12661] ppid=12660 vsize=1551948 CPUtime=199.4 cores=0
/proc/12661/stat : 12661 (cryptominisat) R 12660 12660 12634 0 -1 4202496 64818 0 0 0 19922 18 0 0 25 0 1 0 607159664 1589194752 7748 33554432000 4194304 4587354 140736594242496 18446744073709551615 4237665 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12661/statm: 387987 7748 340 96 0 384549 0
[pid=12662] ppid=12660 vsize=30924 CPUtime=199.39 cores=1
/proc/12662/stat : 12662 (clasp) R 12660 12660 12634 0 -1 4202496 5076 0 0 0 19939 0 0 0 25 0 1 0 607159664 31666176 4798 33554432000 4194304 4785740 140733298293136 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12662/statm: 7731 4798 340 145 0 4776 0
[pid=12663] ppid=12660 vsize=456748 CPUtime=199.39 cores=2
/proc/12663/stat : 12663 (TNM) R 12660 12660 12634 0 -1 4202496 656 0 0 0 19939 0 0 0 25 0 1 0 607159664 467709952 553 33554432000 134512640 134534564 4292264464 18446744073709551615 134528913 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12663/statm: 114187 553 95 6 0 112853 0
[pid=12664] ppid=12660 vsize=12904 CPUtime=199.39 cores=3
/proc/12664/stat : 12664 (march_hi) R 12660 12660 12634 0 -1 4202496 1672 0 0 0 19939 0 0 0 25 0 1 0 607159664 13213696 1396 33554432000 4194304 4331988 140734398164464 18446744073709551615 4292076 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12664/statm: 3226 1396 175 34 0 1668 0
[pid=12665] ppid=12660 vsize=194428 CPUtime=796.43 cores=4-7
/proc/12665/stat : 12665 (plingeling) S 12660 12660 12634 0 -1 4202496 109423 1259 0 0 79626 17 0 0 19 0 5 0 607159664 199094272 20804 33554432000 4194304 4356188 140735357439840 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12665/statm: 48607 20804 164 40 0 47151 0
[pid=12665/tid=12672] ppid=12660 vsize=194428 CPUtime=199.37 cores=4-7
/proc/12665/task/12672/stat : 12672 (plingeling) R 12660 12660 12634 0 -1 4202560 27175 1259 0 0 19933 4 0 0 25 0 5 0 607159666 199094272 20804 33554432000 4194304 4356188 140735357439840 18446744073709551615 4330999 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12665/tid=12673] ppid=12660 vsize=194428 CPUtime=199.35 cores=4-7
/proc/12665/task/12673/stat : 12673 (plingeling) R 12660 12660 12634 0 -1 4202560 24598 1259 0 0 19932 3 0 0 25 0 5 0 607159666 199094272 20804 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12665/tid=12674] ppid=12660 vsize=194428 CPUtime=199.36 cores=4-7
/proc/12665/task/12674/stat : 12674 (plingeling) R 12660 12660 12634 0 -1 4202560 29290 1259 0 0 19931 5 0 0 25 0 5 0 607159666 199094272 20804 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12665/tid=12675] ppid=12660 vsize=194428 CPUtime=198.29 cores=4-7
/proc/12665/task/12675/stat : 12675 (plingeling) R 12660 12660 12634 0 -1 4202560 26934 1259 0 0 19826 3 0 0 25 0 5 0 607159666 199094272 20804 33554432000 4194304 4356188 140735357439840 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1594
Current children cumulated vsize (KiB) 2265276

Child status: 0
Real time (s): 199.442
CPU time (s): 1594.35
CPU user time (s): 1593.96
CPU system time (s): 0.394939
CPU usage (%): 799.406
Max. virtual memory (cumulated for all children) (KiB): 3729912

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1593.96
system time used= 0.394939
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 183465
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1216
involuntary context switches= 7779

runsolver used 0.318951 second user time and 0.773882 second system time

The end

Launcher Data 

Begin job on node116 at 2011-04-30 15:14:50
IDJOB=3275696
IDBENCH=83256
IDSOLVER=1638
FILE ID=node116/3275696-1304169290
RUNJOBID= node116-1304169290-12648
PBS_JOBID= 13170958
Free space on /tmp= 73288 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-3-5_528.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3275696-1304169290/watcher-3275696-1304169290 -o /tmp/evaluation-result-3275696-1304169290/solver-3275696-1304169290 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3275696-1304169290.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 7c7070bd15b57ddd9a06dd3709baef54
RANDOM SEED=976650333

node116.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30086668 kB
Buffers:       1018348 kB
Cached:        1487188 kB
SwapCached:       9656 kB
Active:         172924 kB
Inactive:      2350372 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30086668 kB
SwapTotal:    67111528 kB
SwapFree:     67054472 kB
Dirty:           10120 kB
Writeback:           0 kB
AnonPages:       16196 kB
Mapped:          12420 kB
Slab:           275776 kB
PageTables:       4648 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   188896 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73276 MiB
End job on node116 at 2011-04-30 15:18:09