Trace number 3310362

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.5 5003.82

General information on the benchmark

NameSAT03/industrial/li/li-test4/
li-test4-100.shuffled-as.sat03-370.cnf
MD5SUM5e5606ae7367b9272c60adc115594912
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables36809
Number of clauses142491
Sum of the clauses size559708
Maximum clause length172
Minimum clause length1
Number of clauses of size 114
Number of clauses of size 224558
Number of clauses of size 367458
Number of clauses of size 449000
Number of clauses of size 51
Number of clauses of size over 51460

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310362-1304016778/watcher-3310362-1304016778 -o /tmp/evaluation-result-3310362-1304016778/solver-3310362-1304016778 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310362-1304016778.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.47 6.90 6.96 4/170 30878
/proc/meminfo: memFree=20046860/32950904 swapFree=67082284/67111528
[pid=30878] ppid=30876 vsize=18324 CPUtime=0 cores=0-7
/proc/30878/stat : 30878 (ppfolio) S 30876 30878 30662 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 513277589 18763776 389 33554432000 4194304 4287625 140736981193264 18446744073709551615 237278899727 0 0 4096 65536 4427556995171614719 0 0 17 4 0 0 0
/proc/30878/statm: 4581 389 341 23 0 91 0

[startup+0.103122 s]
/proc/loadavg: 6.47 6.90 6.96 4/170 30878
/proc/meminfo: memFree=20046860/32950904 swapFree=67082284/67111528
[pid=30878] ppid=30876 vsize=18324 CPUtime=0 cores=0-7
/proc/30878/stat : 30878 (ppfolio) S 30876 30878 30662 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 513277589 18763776 389 33554432000 4194304 4287625 140736981193264 18446744073709551615 237278899727 0 0 4096 65536 4427556995171614719 0 0 17 4 0 0 0
/proc/30878/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.201102 s]
/proc/loadavg: 6.47 6.90 6.96 4/170 30878
/proc/meminfo: memFree=20046860/32950904 swapFree=67082284/67111528
[pid=30878] ppid=30876 vsize=18324 CPUtime=0 cores=0-7
/proc/30878/stat : 30878 (ppfolio) S 30876 30878 30662 0 -1 4202496 520 0 0 0 0 0 0 0 18 0 1 0 513277589 18763776 389 33554432000 4194304 4287625 140736981193264 18446744073709551615 237278899727 0 0 4096 65536 4427556995171614719 0 0 17 4 0 0 0
/proc/30878/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.301086 s]
/proc/loadavg: 6.47 6.90 6.96 4/170 30878
/proc/meminfo: memFree=20046860/32950904 swapFree=67082284/67111528
[pid=30878] ppid=30876 vsize=18324 CPUtime=0 cores=0-7
/proc/30878/stat : 30878 (ppfolio) S 30876 30878 30662 0 -1 4202496 520 0 0 0 0 0 0 0 18 0 1 0 513277589 18763776 389 33554432000 4194304 4287625 140736981193264 18446744073709551615 237278899727 0 0 4096 65536 4427556995171614719 0 0 17 4 0 0 0
/proc/30878/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.24986 s]
/proc/loadavg: 6.47 6.90 6.96 4/170 30878
/proc/meminfo: memFree=20046860/32950904 swapFree=67082284/67111528
[pid=30878] ppid=30876 vsize=18324 CPUtime=0 cores=0-7
/proc/30878/stat : 30878 (ppfolio) S 30876 30878 30662 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 513277589 18763776 389 33554432000 4194304 4287625 140736981193264 18446744073709551615 237278899727 0 0 4096 65536 4427556995171614719 0 0 17 4 0 0 0
/proc/30878/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50082 s]
/proc/loadavg: 6.47 6.90 6.96 4/170 30878
/proc/meminfo: memFree=20046860/32950904 swapFree=67082284/67111528
[pid=30878] ppid=30876 vsize=18324 CPUtime=0 cores=0-7
/proc/30878/stat : 30878 (ppfolio) S 30876 30878 30662 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 513277589 18763776 389 33554432000 4194304 4287625 140736981193264 18446744073709551615 237278899727 0 0 4096 65536 4427556995171614719 0 0 17 4 0 0 0
/proc/30878/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+3.10053 s]
/proc/loadavg: 6.47 6.90 6.96 9/180 30893
/proc/meminfo: memFree=19886216/32950904 swapFree=67082284/67111528
[pid=30878] ppid=30876 vsize=18324 CPUtime=0 cores=0-7
/proc/30878/stat : 30878 (ppfolio) S 30876 30878 30662 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 513277589 18763776 389 33554432000 4194304 4287625 140736981193264 18446744073709551615 237278899727 0 0 4096 65536 4427556995171614719 0 0 17 4 0 0 0
/proc/30878/statm: 4581 389 341 23 0 91 0
[pid=30879] ppid=30878 vsize=58288 CPUtime=3.08 cores=0
/proc/30879/stat : 30879 (cryptominisat) R 30878 30878 30662 0 -1 4202496 13345 0 0 0 307 1 0 0 25 0 1 0 513277589 59686912 9817 33554432000 4194304 4587354 140735707187200 18446744073709551615 4249135 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30879/statm: 14572 9817 331 96 0 11134 0
[pid=30880] ppid=30878 vsize=38240 CPUtime=3.09 cores=1
/proc/30880/stat : 30880 (clasp) R 30878 30878 30662 0 -1 4202496 8680 0 0 0 308 1 0 0 25 0 1 0 513277589 39157760 6731 33554432000 4194304 4785740 140735204576384 18446744073709551615 4319229 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30880/statm: 9560 6731 340 145 0 6605 0
[pid=30881] ppid=30878 vsize=463744 CPUtime=3.09 cores=2
/proc/30881/stat : 30881 (TNM) R 30878 30878 30662 0 -1 4202496 3959 0 0 0 308 1 0 0 25 0 1 0 513277589 474873856 3856 33554432000 134512640 134534564 4290300640 18446744073709551615 134524568 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30881/statm: 115936 3856 91 6 0 114602 0
[pid=30882] ppid=30878 vsize=37332 CPUtime=3.08 cores=3
/proc/30882/stat : 30882 (march_hi) R 30878 30878 30662 0 -1 4202496 28704 0 0 0 304 4 0 0 25 0 1 0 513277589 38227968 6422 33554432000 4194304 4331988 140736145129504 18446744073709551615 4217998 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30882/statm: 9333 6422 161 34 0 7775 0
[pid=30883] ppid=30878 vsize=101600 CPUtime=11.04 cores=4-7
/proc/30883/stat : 30883 (plingeling) S 30878 30878 30662 0 -1 4202496 25602 1251 0 0 1101 3 0 0 25 0 5 0 513277589 104038400 13844 33554432000 4194304 4356188 140736991311424 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/30883/statm: 25400 13844 164 40 0 23944 0
[pid=30883/tid=30890] ppid=30878 vsize=101600 CPUtime=2.65 cores=4-7
/proc/30883/task/30890/stat : 30890 (plingeling) R 30878 30878 30662 0 -1 4202560 2596 1251 0 0 265 0 0 0 23 0 5 0 513277633 104038400 13844 33554432000 4194304 4356188 140736991311424 18446744073709551615 4300674 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30883/tid=30891] ppid=30878 vsize=101600 CPUtime=2.65 cores=4-7
/proc/30883/task/30891/stat : 30891 (plingeling) R 30878 30878 30662 0 -1 4202560 2772 1251 0 0 265 0 0 0 23 0 5 0 513277633 104038400 13844 33554432000 4194304 4356188 140736991311424 18446744073709551615 4231350 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30883/tid=30892] ppid=30878 vsize=101600 CPUtime=2.65 cores=4-7
/proc/30883/task/30892/stat : 30892 (plingeling) R 30878 30878 30662 0 -1 4202560 3050 1251 0 0 265 0 0 0 23 0 5 0 513277633 104038400 13844 33554432000 4194304 4356188 140736991311424 18446744073709551615 4231408 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30883/tid=30893] ppid=30878 vsize=101600 CPUtime=2.64 cores=4-7
/proc/30883/task/30893/stat : 30893 (plingeling) R 30878 30878 30662 0 -1 4202560 2523 1251 0 0 264 0 0 0 23 0 5 0 513277633 104038400 13844 33554432000 4194304 4356188 140736991311424 18446744073709551615 4334543 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 23.38
Current children cumulated vsize (KiB) 717528

[startup+6.30696 s]
/proc/loadavg: 6.60 6.91 6.97 9/180 30893
/proc/meminfo: memFree=19862656/32950904 swapFree=67082284/67111528
[pid=30878] ppid=30876 vsize=18324 CPUtime=0 cores=0-7
/proc/30878/stat : 30878 (ppfolio) S 30876 30878 30662 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 513277589 18763776 389 33554432000 4194304 4287625 140736981193264 18446744073709551615 237278899727 0 0 4096 65536 4427556995171614719 0 0 17 4 0 0 0
/proc/30878/statm: 4581 389 341 23 0 91 0
[pid=30879] ppid=30878 vsize=58288 CPUtime=6.29 cores=0
/proc/30879/stat : 30879 (cryptominisat) R 30878 30878 30662 0 -1 4202496 13394 0 0 0 628 1 0 0 25 0 1 0 513277589 59686912 9859 33554432000 4194304 4587354 140735707187200 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30879/statm: 14572 9859 331 96 0 11134 0
[pid=30880] ppid=30878 vsize=38240 CPUtime=6.29 cores=1
/proc/30880/stat : 30880 (clasp) R 30878 30878 30662 0 -1 4202496 8683 0 0 0 628 1 0 0 25 0 1 0 513277589 39157760 6734 33554432000 4194304 4785740 140735204576384 18446744073709551615 4319257 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30880/statm: 9560 6734 340 145 0 6605 0
[pid=30881] ppid=30878 vsize=477232 CPUtime=6.29 cores=2
/proc/30881/stat : 30881 (TNM) R 30878 30878 30662 0 -1 4202496 8772 0 0 0 628 1 0 0 25 0 1 0 513277589 488685568 8669 33554432000 134512640 134534564 4290300640 18446744073709551615 134530124 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30881/statm: 119308 8669 95 6 0 117974 0
[pid=30882] ppid=30878 vsize=41924 CPUtime=6.3 cores=3
/proc/30882/stat : 30882 (march_hi) R 30878 30878 30662 0 -1 4202496 30729 0 0 0 625 5 0 0 25 0 1 0 513277589 42930176 7437 33554432000 4194304 4331988 140736145129504 18446744073709551615 4217696 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30882/statm: 10481 7437 166 34 0 8923 0
[pid=30883] ppid=30878 vsize=101760 CPUtime=23.85 cores=4-7
/proc/30883/stat : 30883 (plingeling) S 30878 30878 30662 0 -1 4202496 25642 1251 0 0 2382 3 0 0 25 0 5 0 513277589 104202240 13884 33554432000 4194304 4356188 140736991311424 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/30883/statm: 25440 13884 164 40 0 23984 0
[pid=30883/tid=30890] ppid=30878 vsize=101760 CPUtime=5.86 cores=4-7
/proc/30883/task/30890/stat : 30890 (plingeling) R 30878 30878 30662 0 -1 4202560 2596 1251 0 0 586 0 0 0 25 0 5 0 513277633 104202240 13884 33554432000 4194304 4356188 140736991311424 18446744073709551615 4302306 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30883/tid=30891] ppid=30878 vsize=101760 CPUtime=5.86 cores=4-7
/proc/30883/task/30891/stat : 30891 (plingeling) R 30878 30878 30662 0 -1 4202560 2780 1251 0 0 586 0 0 0 25 0 5 0 513277633 104202240 13884 33554432000 4194304 4356188 140736991311424 18446744073709551615 4231367 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30883/tid=30892] ppid=30878 vsize=101760 CPUtime=5.86 cores=4-7
/proc/30883/task/30892/stat : 30892 (plingeling) R 30878 30878 30662 0 -1 4202560 3050 1251 0 0 586 0 0 0 25 0 5 0 513277633 104202240 13884 33554432000 4194304 4356188 140736991311424 18446744073709551615 4210587 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30883/tid=30893] ppid=30878 vsize=101760 CPUtime=5.82 cores=4-7
/proc/30883/task/30893/stat : 30893 (plingeling) R 30878 30878 30662 0 -1 4202560 2555 1251 0 0 582 0 0 0 25 0 5 0 513277633 104202240 13884 33554432000 4194304 4356188 140736991311424 18446744073709551615 4334474 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.02
Current children cumulated vsize (KiB) 735768

[startup+12.7008 s]
/proc/loadavg: 6.71 6.93 6.97 9/180 30893
/proc/meminfo: memFree=19843392/32950904 swapFree=67082284/67111528
[pid=30878] ppid=30876 vsize=18324 CPUtime=0 cores=0-7
/proc/30878/stat : 30878 (ppfolio) S 30876 30878 30662 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 513277589 18763776 389 33554432000 4194304 4287625 140736981193264 18446744073709551615 237278899727 0 0 4096 65536 4427556995171614719 0 0 17 4 0 0 0
/proc/30878/statm: 4581 389 341 23 0 91 0
[pid=30879] ppid=30878 vsize=58288 CPUtime=12.68 cores=0
/proc/30879/stat : 30879 (cryptominisat) R 30878 30878 30662 0 -1 4202496 13454 0 0 0 1267 1 0 0 25 0 1 0 513277589 59686912 9909 33554432000 4194304 4587354 140735707187200 18446744073709551615 4237740 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30879/statm: 14572 9909 331 96 0 11134 0
[pid=30880] ppid=30878 vsize=38240 CPUtime=12.69 cores=1
/proc/30880/stat : 30880 (clasp) R 30878 30878 30662 0 -1 4202496 8686 0 0 0 1268 1 0 0 25 0 1 0 513277589 39157760 6737 33554432000 4194304 4785740 140735204576384 18446744073709551615 4553035 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30880/statm: 9560 6737 340 145 0 6605 0
[pid=30881] ppid=30878 vsize=477232 CPUtime=12.68 cores=2
/proc/30881/stat : 30881 (TNM) R 30878 30878 30662 0 -1 4202496 8772 0 0 0 1267 1 0 0 25 0 1 0 513277589 488685568 8669 33554432000 134512640 134534564 4290300640 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30881/statm: 119308 8669 95 6 0 117974 0
[pid=30882] ppid=30878 vsize=90460 CPUtime=12.69 cores=3
/proc/30882/stat : 30882 (march_hi) R 30878 30878 30662 0 -1 4202496 40769 0 0 0 1263 6 0 0 25 0 1 0 513277589 92631040 12271 33554432000 4194304 4331988 140736145129504 18446744073709551615 4228459 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30882/statm: 22615 12271 187 34 0 21057 0
[pid=30883] ppid=30878 vsize=103164 CPUtime=49.4 cores=4-7
/proc/30883/stat : 30883 (plingeling) S 30878 30878 30662 0 -1 4202496 26001 1251 0 0 4937 3 0 0 25 0 5 0 513277589 105639936 14235 33554432000 4194304 4356188 140736991311424 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/30883/statm: 25791 14235 164 40 0 24335 0
[pid=30883/tid=30890] ppid=30878 vsize=103164 CPUtime=12.25 cores=4-7
/proc/30883/task/30890/stat : 30890 (plingeling) R 30878 30878 30662 0 -1 4202560 2596 1251 0 0 1225 0 0 0 25 0 5 0 513277633 105639936 14235 33554432000 4194304 4356188 140736991311424 18446744073709551615 4331416 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30883/tid=30891] ppid=30878 vsize=103164 CPUtime=12.25 cores=4-7
/proc/30883/task/30891/stat : 30891 (plingeling) R 30878 30878 30662 0 -1 4202560 2812 1251 0 0 1225 0 0 0 25 0 5 0 513277633 105639936 14235 33554432000 4194304 4356188 140736991311424 18446744073709551615 4241608 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30883/tid=30892] ppid=30878 vsize=103164 CPUtime=12.25 cores=4-7
/proc/30883/task/30892/stat : 30892 (plingeling) R 30878 30878 30662 0 -1 4202560 3377 1251 0 0 1225 0 0 0 25 0 5 0 513277633 105639936 14235 33554432000 4194304 4356188 140736991311424 18446744073709551615 4334501 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30883/tid=30893] ppid=30878 vsize=103164 CPUtime=12.19 cores=4-7
/proc/30883/task/30893/stat : 30893 (plingeling) R 30878 30878 30662 0 -1 4202560 2555 1251 0 0 1219 0 0 0 25 0 5 0 513277633 105639936 14235 33554432000 4194304 4356188 140736991311424 18446744073709551615 4334231 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 100.14
Current children cumulated vsize (KiB) 785708

[startup+25.5006 s]
/proc/loadavg: 6.99 6.98 6.99 9/180 30894
/proc/meminfo: memFree=19845580/32950904 swapFree=67082284/67111528
[pid=30878] ppid=30876 vsize=18324 CPUtime=0 cores=0-7
/proc/30878/stat : 30878 (ppfolio) S 30876 30878 30662 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 513277589 18763776 389 33554432000 4194304 4287625 140736981193264 18446744073709551615 237278899727 0 0 4096 65536 4427556995171614719 0 0 17 4 0 0 0
/proc/30878/statm: 4581 389 341 23 0 91 0
[pid=30879] ppid=30878 vsize=61632 CPUtime=25.49 cores=0
/proc/30879/stat : 30879 (cryptominisat) R 30878 30878 30662 0 -1 4202496 15404 0 0 0 2547 2 0 0 25 0 1 0 513277589 63111168 10231 33554432000 4194304 4587354 140735707187200 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30879/statm: 15408 10231 334 96 0 11970 0
[pid=30880] ppid=30878 vsize=38240 CPUtime=25.49 cores=1
/proc/30880/stat : 30880 (clasp) R 30878 30878 30662 0 -1 4202496 8689 0 0 0 2548 1 0 0 25 0 1 0 513277589 39157760 6740 33554432000 4194304 4785740 140735204576384 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30880/statm: 9560 6740 340 145 0 6605 0
[pid=30881] ppid=30878 vsize=477232 CPUtime=25.48 cores=2
/proc/30881/stat : 30881 (TNM) R 30878 30878 30662 0 -1 4202496 8772 0 0 0 2547 1 0 0 25 0 1 0 513277589 488685568 8669 33554432000 134512640 134534564 4290300640 18446744073709551615 134525873 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30881/statm: 119308 8669 95 6 0 117974 0
[pid=30882] ppid=30878 vsize=91156 CPUtime=25.49 cores=3
/proc/30882/stat : 30882 (march_hi) R 30878 30878 30662 0 -1 4202496 40851 0 0 0 2543 6 0 0 25 0 1 0 513277589 93343744 12353 33554432000 4194304 4331988 140736145129504 18446744073709551615 4228534 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30882/statm: 22789 12353 187 34 0 21231 0
[pid=30883] ppid=30878 vsize=103164 CPUtime=100.53 cores=4-7
/proc/30883/stat : 30883 (plingeling) S 30878 30878 30662 0 -1 4202496 26001 1251 0 0 10050 3 0 0 25 0 5 0 513277589 105639936 14235 33554432000 4194304 4356188 140736991311424 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/30883/statm: 25791 14235 164 40 0 24335 0
[pid=30883/tid=30890] ppid=30878 vsize=103164 CPUtime=25.05 cores=4-7
/proc/30883/task/30890/stat : 30890 (plingeling) R 30878 30878 30662 0 -1 4202560 2596 1251 0 0 2505 0 0 0 25 0 5 0 513277633 105639936 14235 33554432000 4194304 4356188 140736991311424 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30883/tid=30891] ppid=30878 vsize=103164 CPUtime=25.05 cores=4-7
/proc/30883/task/30891/stat : 30891 (plingeling) R 30878 30878 30662 0 -1 4202560 2812 1251 0 0 2505 0 0 0 25 0 5 0 513277633 105639936 14235 33554432000 4194304 4356188 140736991311424 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30883/tid=30892] ppid=30878 vsize=103164 CPUtime=25.05 cores=4-7
/proc/30883/task/30892/stat : 30892 (plingeling) R 30878 30878 30662 0 -1 4202560 3377 1251 0 0 2505 0 0 0 25 0 5 0 513277633 105639936 14235 33554432000 4194304 4356188 140736991311424 18446744073709551615 4334584 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30883/tid=30893] ppid=30878 vsize=103164 CPUtime=24.92 cores=4-7
/proc/30883/task/30893/stat : 30893 (plingeling) R 30878 30878 30662 0 -1 4202560 2555 1251 0 0 2492 0 0 0 25 0 5 0 513277633 105639936 14235 33554432000 4194304 4356188 140736991311424 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 202.48
Current children cumulated vsize (KiB) 789748

################
# More data... #
################

[pid=30881] ppid=30878 vsize=477236 CPUtime=4780.99 cores=2
/proc/30881/stat : 30881 (TNM) R 30878 30878 30662 0 -1 4202496 8781 0 0 0 478095 4 0 0 25 0 1 0 513277589 488689664 8678 33554432000 134512640 134534564 4290300640 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30881/statm: 119309 8678 103 6 0 117975 0
[pid=30882] ppid=30878 vsize=139836 CPUtime=4782.4 cores=3
/proc/30882/stat : 30882 (march_hi) R 30878 30878 30662 0 -1 4202496 52218 0 0 0 478226 14 0 0 25 0 1 0 513277589 143192064 23691 33554432000 4194304 4331988 140736145129504 18446744073709551615 4263258 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30882/statm: 34959 23691 215 34 0 33401 0
[pid=30883] ppid=30878 vsize=276996 CPUtime=19101.6 cores=4-7
/proc/30883/stat : 30883 (plingeling) S 30878 30878 30662 0 -1 4202496 352034 1251 0 0 1910108 53 0 0 25 0 5 0 513277589 283643904 57693 33554432000 4194304 4356188 140736991311424 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/30883/statm: 69249 57693 164 40 0 67793 0
[pid=30883/tid=30890] ppid=30878 vsize=276996 CPUtime=4781.98 cores=4-7
/proc/30883/task/30890/stat : 30890 (plingeling) R 30878 30878 30662 0 -1 4202560 88652 1251 0 0 478186 12 0 0 25 0 5 0 513277633 283643904 57693 33554432000 4194304 4356188 140736991311424 18446744073709551615 4330992 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30883/tid=30891] ppid=30878 vsize=276996 CPUtime=4781.31 cores=4-7
/proc/30883/task/30891/stat : 30891 (plingeling) R 30878 30878 30662 0 -1 4202560 79769 1251 0 0 478119 12 0 0 25 0 5 0 513277633 283643904 57693 33554432000 4194304 4356188 140736991311424 18446744073709551615 4281681 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30883/tid=30892] ppid=30878 vsize=276996 CPUtime=4781.97 cores=4-7
/proc/30883/task/30892/stat : 30892 (plingeling) R 30878 30878 30662 0 -1 4202560 99636 1251 0 0 478182 15 0 0 25 0 5 0 513277633 283643904 57693 33554432000 4194304 4356188 140736991311424 18446744073709551615 4283920 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30883/tid=30893] ppid=30878 vsize=276996 CPUtime=4755.9 cores=4-7
/proc/30883/task/30893/stat : 30893 (plingeling) R 30878 30878 30662 0 -1 4202560 69316 1251 0 0 475579 11 0 0 25 0 5 0 513277633 283643904 57693 33554432000 4194304 4356188 140736991311424 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38229.6
Current children cumulated vsize (KiB) 2650440

[startup+4842.3 s]
/proc/loadavg: 8.00 8.03 8.01 9/180 31046
/proc/meminfo: memFree=18244488/32950904 swapFree=67082284/67111528
[pid=30878] ppid=30876 vsize=18324 CPUtime=0 cores=0-7
/proc/30878/stat : 30878 (ppfolio) S 30876 30878 30662 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 513277589 18763776 389 33554432000 4194304 4287625 140736981193264 18446744073709551615 237278899727 0 0 4096 65536 4427556995171614719 0 0 17 4 0 0 0
/proc/30878/statm: 4581 389 341 23 0 91 0
[pid=30879] ppid=30878 vsize=653688 CPUtime=4842.4 cores=0
/proc/30879/stat : 30879 (cryptominisat) R 30878 30878 30662 0 -1 4202496 3516816 0 0 0 483126 1114 0 0 25 0 1 0 513277589 669376512 85988 33554432000 4194304 4587354 140735707187200 18446744073709551615 4237740 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30879/statm: 163422 85988 337 96 0 159984 0
[pid=30880] ppid=30878 vsize=1086380 CPUtime=4842.24 cores=1
/proc/30880/stat : 30880 (clasp) R 30878 30878 30662 0 -1 4202496 269013 0 0 0 484130 94 0 0 25 0 1 0 513277589 1112453120 267064 33554432000 4194304 4785740 140735204576384 18446744073709551615 4278070 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30880/statm: 271595 267064 340 145 0 268640 0
[pid=30881] ppid=30878 vsize=477236 CPUtime=4840.99 cores=2
/proc/30881/stat : 30881 (TNM) R 30878 30878 30662 0 -1 4202496 8781 0 0 0 484095 4 0 0 25 0 1 0 513277589 488689664 8678 33554432000 134512640 134534564 4290300640 18446744073709551615 134529675 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30881/statm: 119309 8678 103 6 0 117975 0
[pid=30882] ppid=30878 vsize=139836 CPUtime=4842.4 cores=3
/proc/30882/stat : 30882 (march_hi) R 30878 30878 30662 0 -1 4202496 52338 0 0 0 484226 14 0 0 25 0 1 0 513277589 143192064 23811 33554432000 4194304 4331988 140736145129504 18446744073709551615 4228459 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30882/statm: 34959 23811 215 34 0 33401 0
[pid=30883] ppid=30878 vsize=310788 CPUtime=19341.3 cores=4-7
/proc/30883/stat : 30883 (plingeling) S 30878 30878 30662 0 -1 4202496 360482 1251 0 0 1934075 54 0 0 25 0 5 0 513277589 318246912 66141 33554432000 4194304 4356188 140736991311424 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/30883/statm: 77697 66141 164 40 0 76241 0
[pid=30883/tid=30890] ppid=30878 vsize=310788 CPUtime=4841.98 cores=4-7
/proc/30883/task/30890/stat : 30890 (plingeling) R 30878 30878 30662 0 -1 4202560 89676 1251 0 0 484186 12 0 0 25 0 5 0 513277633 318246912 66141 33554432000 4194304 4356188 140736991311424 18446744073709551615 4281627 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30883/tid=30891] ppid=30878 vsize=310788 CPUtime=4841.31 cores=4-7
/proc/30883/task/30891/stat : 30891 (plingeling) R 30878 30878 30662 0 -1 4202560 79769 1251 0 0 484119 12 0 0 25 0 5 0 513277633 318246912 66141 33554432000 4194304 4356188 140736991311424 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30883/tid=30892] ppid=30878 vsize=310788 CPUtime=4841.97 cores=4-7
/proc/30883/task/30892/stat : 30892 (plingeling) R 30878 30878 30662 0 -1 4202560 106804 1251 0 0 484181 16 0 0 25 0 5 0 513277633 318246912 66141 33554432000 4194304 4356188 140736991311424 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30883/tid=30893] ppid=30878 vsize=310788 CPUtime=4815.57 cores=4-7
/proc/30883/task/30893/stat : 30893 (plingeling) R 30878 30878 30662 0 -1 4202560 69572 1251 0 0 481546 11 0 0 25 0 5 0 513277633 318246912 66141 33554432000 4194304 4356188 140736991311424 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38709.3
Current children cumulated vsize (KiB) 2686252

[startup+4902.3 s]
/proc/loadavg: 8.00 8.03 8.00 9/180 31048
/proc/meminfo: memFree=18113416/32950904 swapFree=67082284/67111528
[pid=30878] ppid=30876 vsize=18324 CPUtime=0 cores=0-7
/proc/30878/stat : 30878 (ppfolio) S 30876 30878 30662 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 513277589 18763776 389 33554432000 4194304 4287625 140736981193264 18446744073709551615 237278899727 0 0 4096 65536 4427556995171614719 0 0 17 4 0 0 0
/proc/30878/statm: 4581 389 341 23 0 91 0
[pid=30879] ppid=30878 vsize=653688 CPUtime=4902.4 cores=0
/proc/30879/stat : 30879 (cryptominisat) R 30878 30878 30662 0 -1 4202496 3550689 0 0 0 489113 1127 0 0 25 0 1 0 513277589 669376512 119830 33554432000 4194304 4587354 140735707187200 18446744073709551615 4238606 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30879/statm: 163422 119830 337 96 0 159984 0
[pid=30880] ppid=30878 vsize=1086380 CPUtime=4902.25 cores=1
/proc/30880/stat : 30880 (clasp) R 30878 30878 30662 0 -1 4202496 269023 0 0 0 490131 94 0 0 25 0 1 0 513277589 1112453120 267074 33554432000 4194304 4785740 140735204576384 18446744073709551615 4278556 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30880/statm: 271595 267074 340 145 0 268640 0
[pid=30881] ppid=30878 vsize=477236 CPUtime=4900.99 cores=2
/proc/30881/stat : 30881 (TNM) R 30878 30878 30662 0 -1 4202496 8781 0 0 0 490095 4 0 0 25 0 1 0 513277589 488689664 8678 33554432000 134512640 134534564 4290300640 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30881/statm: 119309 8678 103 6 0 117975 0
[pid=30882] ppid=30878 vsize=159480 CPUtime=4902.4 cores=3
/proc/30882/stat : 30882 (march_hi) R 30878 30878 30662 0 -1 4202496 52464 0 0 0 490226 14 0 0 25 0 1 0 513277589 163307520 23937 33554432000 4194304 4331988 140736145129504 18446744073709551615 4263238 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30882/statm: 39870 23937 215 34 0 38312 0
[pid=30883] ppid=30878 vsize=303624 CPUtime=19581 cores=4-7
/proc/30883/stat : 30883 (plingeling) S 30878 30878 30662 0 -1 4202496 370467 1251 0 0 1958042 56 0 0 25 0 5 0 513277589 310910976 64350 33554432000 4194304 4356188 140736991311424 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/30883/statm: 75906 64350 164 40 0 74450 0
[pid=30883/tid=30890] ppid=30878 vsize=303624 CPUtime=4901.98 cores=4-7
/proc/30883/task/30890/stat : 30890 (plingeling) R 30878 30878 30662 0 -1 4202560 98125 1251 0 0 490185 13 0 0 25 0 5 0 513277633 310910976 64350 33554432000 4194304 4356188 140736991311424 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30883/tid=30891] ppid=30878 vsize=303624 CPUtime=4901.32 cores=4-7
/proc/30883/task/30891/stat : 30891 (plingeling) R 30878 30878 30662 0 -1 4202560 79769 1251 0 0 490120 12 0 0 25 0 5 0 513277633 310910976 64350 33554432000 4194304 4356188 140736991311424 18446744073709551615 4284144 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30883/tid=30892] ppid=30878 vsize=303624 CPUtime=4901.98 cores=4-7
/proc/30883/task/30892/stat : 30892 (plingeling) R 30878 30878 30662 0 -1 4202560 106804 1251 0 0 490182 16 0 0 25 0 5 0 513277633 310910976 64350 33554432000 4194304 4356188 140736991311424 18446744073709551615 4281624 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30883/tid=30893] ppid=30878 vsize=303624 CPUtime=4875.25 cores=4-7
/proc/30883/task/30893/stat : 30893 (plingeling) R 30878 30878 30662 0 -1 4202560 71108 1251 0 0 487514 11 0 0 25 0 5 0 513277633 310910976 64350 33554432000 4194304 4356188 140736991311424 18446744073709551615 4330909 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39189
Current children cumulated vsize (KiB) 2698732

[startup+4962.3 s]
/proc/loadavg: 8.00 8.02 8.00 9/180 31049
/proc/meminfo: memFree=18002052/32950904 swapFree=67082284/67111528
[pid=30878] ppid=30876 vsize=18324 CPUtime=0 cores=0-7
/proc/30878/stat : 30878 (ppfolio) S 30876 30878 30662 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 513277589 18763776 389 33554432000 4194304 4287625 140736981193264 18446744073709551615 237278899727 0 0 4096 65536 4427556995171614719 0 0 17 4 0 0 0
/proc/30878/statm: 4581 389 341 23 0 91 0
[pid=30879] ppid=30878 vsize=653688 CPUtime=4962.39 cores=0
/proc/30879/stat : 30879 (cryptominisat) R 30878 30878 30662 0 -1 4202496 3580462 0 0 0 495101 1138 0 0 25 0 1 0 513277589 669376512 149571 33554432000 4194304 4587354 140735707187200 18446744073709551615 4238568 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30879/statm: 163422 149571 337 96 0 159984 0
[pid=30880] ppid=30878 vsize=1086380 CPUtime=4962.24 cores=1
/proc/30880/stat : 30880 (clasp) R 30878 30878 30662 0 -1 4202496 269053 0 0 0 496130 94 0 0 25 0 1 0 513277589 1112453120 267104 33554432000 4194304 4785740 140735204576384 18446744073709551615 4286953 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30880/statm: 271595 267104 340 145 0 268640 0
[pid=30881] ppid=30878 vsize=477236 CPUtime=4960.97 cores=2
/proc/30881/stat : 30881 (TNM) R 30878 30878 30662 0 -1 4202496 8781 0 0 0 496093 4 0 0 25 0 1 0 513277589 488689664 8678 33554432000 134512640 134534564 4290300640 18446744073709551615 134528600 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30881/statm: 119309 8678 103 6 0 117975 0
[pid=30882] ppid=30878 vsize=159480 CPUtime=4962.4 cores=3
/proc/30882/stat : 30882 (march_hi) R 30878 30878 30662 0 -1 4202496 52587 0 0 0 496226 14 0 0 25 0 1 0 513277589 163307520 24060 33554432000 4194304 4331988 140736145129504 18446744073709551615 4228520 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30882/statm: 39870 24060 215 34 0 38312 0
[pid=30883] ppid=30878 vsize=295000 CPUtime=19820.7 cores=4-7
/proc/30883/stat : 30883 (plingeling) S 30878 30878 30662 0 -1 4202496 370467 1251 0 0 1982009 56 0 0 25 0 5 0 513277589 302080000 62194 33554432000 4194304 4356188 140736991311424 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/30883/statm: 73750 62194 164 40 0 72294 0
[pid=30883/tid=30890] ppid=30878 vsize=295000 CPUtime=4961.98 cores=4-7
/proc/30883/task/30890/stat : 30890 (plingeling) R 30878 30878 30662 0 -1 4202560 98125 1251 0 0 496185 13 0 0 25 0 5 0 513277633 302080000 62194 33554432000 4194304 4356188 140736991311424 18446744073709551615 4210544 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30883/tid=30891] ppid=30878 vsize=295000 CPUtime=4961.31 cores=4-7
/proc/30883/task/30891/stat : 30891 (plingeling) R 30878 30878 30662 0 -1 4202560 79769 1251 0 0 496119 12 0 0 25 0 5 0 513277633 302080000 62194 33554432000 4194304 4356188 140736991311424 18446744073709551615 4331337 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30883/tid=30892] ppid=30878 vsize=295000 CPUtime=4961.97 cores=4-7
/proc/30883/task/30892/stat : 30892 (plingeling) R 30878 30878 30662 0 -1 4202560 106804 1251 0 0 496181 16 0 0 25 0 5 0 513277633 302080000 62194 33554432000 4194304 4356188 140736991311424 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30883/tid=30893] ppid=30878 vsize=295000 CPUtime=4934.92 cores=4-7
/proc/30883/task/30893/stat : 30893 (plingeling) R 30878 30878 30662 0 -1 4202560 71108 1251 0 0 493481 11 0 0 25 0 5 0 513277633 302080000 62194 33554432000 4194304 4356188 140736991311424 18446744073709551615 4281672 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39668.6
Current children cumulated vsize (KiB) 2690108



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.8 s]
/proc/loadavg: 8.00 8.02 8.00 9/180 31051
/proc/meminfo: memFree=17935820/32950904 swapFree=67082284/67111528
[pid=30878] ppid=30876 vsize=18324 CPUtime=0 cores=0-7
/proc/30878/stat : 30878 (ppfolio) S 30876 30878 30662 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 513277589 18763776 389 33554432000 4194304 4287625 140736981193264 18446744073709551615 237278899727 0 0 4096 65536 4427556995171614719 0 0 17 4 0 0 0
/proc/30878/statm: 4581 389 341 23 0 91 0
[pid=30879] ppid=30878 vsize=915836 CPUtime=5003.9 cores=0
/proc/30879/stat : 30879 (cryptominisat) R 30878 30878 30662 0 -1 4202496 3598791 0 0 0 499245 1145 0 0 25 0 1 0 513277589 937816064 167881 33554432000 4194304 4587354 140735707187200 18446744073709551615 4236583 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30879/statm: 228959 167881 337 96 0 225521 0
[pid=30880] ppid=30878 vsize=1086380 CPUtime=5003.75 cores=1
/proc/30880/stat : 30880 (clasp) R 30878 30878 30662 0 -1 4202496 269100 0 0 0 500281 94 0 0 25 0 1 0 513277589 1112453120 267151 33554432000 4194304 4785740 140735204576384 18446744073709551615 4549593 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30880/statm: 271595 267151 340 145 0 268640 0
[pid=30881] ppid=30878 vsize=477236 CPUtime=5002.48 cores=2
/proc/30881/stat : 30881 (TNM) R 30878 30878 30662 0 -1 4202496 8781 0 0 0 500244 4 0 0 25 0 1 0 513277589 488689664 8678 33554432000 134512640 134534564 4290300640 18446744073709551615 134528523 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30881/statm: 119309 8678 103 6 0 117975 0
[pid=30882] ppid=30878 vsize=159496 CPUtime=5003.9 cores=3
/proc/30882/stat : 30882 (march_hi) R 30878 30878 30662 0 -1 4202496 52679 0 0 0 500376 14 0 0 25 0 1 0 513277589 163323904 24152 33554432000 4194304 4331988 140736145129504 18446744073709551615 4228457 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30882/statm: 39874 24152 215 34 0 38316 0
[pid=30883] ppid=30878 vsize=286812 CPUtime=19986.4 cores=4-7
/proc/30883/stat : 30883 (plingeling) S 30878 30878 30662 0 -1 4202496 377124 1251 0 0 1998586 57 0 0 25 0 5 0 513277589 293695488 60147 33554432000 4194304 4356188 140736991311424 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/30883/statm: 71703 60147 164 40 0 70247 0
[pid=30883/tid=30890] ppid=30878 vsize=286812 CPUtime=5003.48 cores=4-7
/proc/30883/task/30890/stat : 30890 (plingeling) R 30878 30878 30662 0 -1 4202560 104270 1251 0 0 500334 14 0 0 25 0 5 0 513277633 293695488 60147 33554432000 4194304 4356188 140736991311424 18446744073709551615 4331076 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30883/tid=30891] ppid=30878 vsize=286812 CPUtime=5002.82 cores=4-7
/proc/30883/task/30891/stat : 30891 (plingeling) R 30878 30878 30662 0 -1 4202560 79769 1251 0 0 500270 12 0 0 25 0 5 0 513277633 293695488 60147 33554432000 4194304 4356188 140736991311424 18446744073709551615 4330982 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30883/tid=30892] ppid=30878 vsize=286812 CPUtime=5003.48 cores=4-7
/proc/30883/task/30892/stat : 30892 (plingeling) R 30878 30878 30662 0 -1 4202560 106804 1251 0 0 500332 16 0 0 25 0 5 0 513277633 293695488 60147 33554432000 4194304 4356188 140736991311424 18446744073709551615 4281639 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30883/tid=30893] ppid=30878 vsize=286812 CPUtime=4976.19 cores=4-7
/proc/30883/task/30893/stat : 30893 (plingeling) R 30878 30878 30662 0 -1 4202560 71620 1251 0 0 497608 11 0 0 25 0 5 0 513277633 293695488 60147 33554432000 4194304 4356188 140736991311424 18446744073709551615 4332293 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 2944084

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 30878 and gives
#  childrusage.ru_utime.tv_sec=10006
#  childrusage.ru_utime.tv_usec=216823
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=206968
# CPU time returned by wait4() is 10006.4
# while last known CPU time is 40000.5
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.82
CPU time (s): 40000.5
CPU user time (s): 39987.3
CPU system time (s): 13.14
CPU usage (%): 799.399
Max. virtual memory (cumulated for all children) (KiB): 5325420

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 10006.2
system time used= 0.206968
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 61981
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 545
involuntary context switches= 72086

runsolver used 7.83181 second user time and 19.469 second system time

The end

Launcher Data 

Begin job on node121 at 2011-04-28 20:52:58
IDJOB=3310362
IDBENCH=84227
IDSOLVER=1638
FILE ID=node121/3310362-1304016778
RUNJOBID= node121-1304011676-30676
PBS_JOBID= 13168857
Free space on /tmp= 72652 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT03/industrial/li/li-test4/li-test4-100.shuffled-as.sat03-370.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310362-1304016778/watcher-3310362-1304016778 -o /tmp/evaluation-result-3310362-1304016778/solver-3310362-1304016778 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310362-1304016778.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 5e5606ae7367b9272c60adc115594912
RANDOM SEED=1843044684

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      20047264 kB
Buffers:       2176696 kB
Cached:       10168036 kB
SwapCached:       2776 kB
Active:        9091324 kB
Inactive:      3291592 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      20047264 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:           13828 kB
Writeback:           0 kB
AnonPages:       35928 kB
Mapped:          13524 kB
Slab:           454852 kB
PageTables:       4404 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:   187064 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72640 MiB
End job on node121 at 2011-04-28 22:16:24