Trace number 3275661

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.2 5003.52

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-4-5_4231.cnf
MD5SUMa52d60bf6e72caa628ad712a5fe0fb7a
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables4229
Number of clauses100397
Sum of the clauses size411595
Maximum clause length5
Minimum clause length4
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 490390
Number of clauses of size 510007
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3275661-1304168339/watcher-3275661-1304168339 -o /tmp/evaluation-result-3275661-1304168339/solver-3275661-1304168339 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3275661-1304168339.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.07 8.05 8.00 1/170 345
/proc/meminfo: memFree=29707604/32950928 swapFree=67111364/67111528
[pid=345] ppid=343 vsize=18240 CPUtime=0 cores=0-7
/proc/345/stat : 345 (ppfolio) R 343 345 32245 0 -1 4194304 248 0 0 0 0 0 0 0 25 0 1 0 607064555 18677760 197 33554432000 4194304 4287625 140735135991968 18446744073709551615 256410469808 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/345/statm: 4560 197 171 23 0 57 0

[startup+0.088988 s]
/proc/loadavg: 8.07 8.05 8.00 1/170 345
/proc/meminfo: memFree=29707604/32950928 swapFree=67111364/67111528
[pid=345] ppid=343 vsize=18324 CPUtime=0 cores=0-7
/proc/345/stat : 345 (ppfolio) S 343 345 32245 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 607064555 18763776 390 33554432000 4194304 4287625 140735135991968 18446744073709551615 256415411727 0 0 4096 65536 4604685157310398463 0 0 17 6 0 0 0
/proc/345/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.10099 s]
/proc/loadavg: 8.07 8.05 8.00 1/170 345
/proc/meminfo: memFree=29707604/32950928 swapFree=67111364/67111528
[pid=345] ppid=343 vsize=18324 CPUtime=0 cores=0-7
/proc/345/stat : 345 (ppfolio) S 343 345 32245 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 607064555 18763776 390 33554432000 4194304 4287625 140735135991968 18446744073709551615 256415411727 0 0 4096 65536 4604685157310398463 0 0 17 6 0 0 0
/proc/345/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300892 s]
/proc/loadavg: 8.07 8.05 8.00 1/170 345
/proc/meminfo: memFree=29707604/32950928 swapFree=67111364/67111528
[pid=345] ppid=343 vsize=18324 CPUtime=0 cores=0-7
/proc/345/stat : 345 (ppfolio) S 343 345 32245 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 607064555 18763776 390 33554432000 4194304 4287625 140735135991968 18446744073709551615 256415411727 0 0 4096 65536 4604685157310398463 0 0 17 6 0 0 0
/proc/345/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700816 s]
/proc/loadavg: 8.07 8.05 8.00 1/170 345
/proc/meminfo: memFree=29707604/32950928 swapFree=67111364/67111528
[pid=345] ppid=343 vsize=18324 CPUtime=0 cores=0-7
/proc/345/stat : 345 (ppfolio) S 343 345 32245 0 -1 4202496 523 0 0 0 0 0 0 0 19 0 1 0 607064555 18763776 390 33554432000 4194304 4287625 140735135991968 18446744073709551615 256415411727 0 0 4096 65536 4604685157310398463 0 0 17 6 0 0 0
/proc/345/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50066 s]
/proc/loadavg: 8.07 8.05 8.00 9/180 360
/proc/meminfo: memFree=29593320/32950928 swapFree=67111364/67111528
[pid=345] ppid=343 vsize=18324 CPUtime=0 cores=0-7
/proc/345/stat : 345 (ppfolio) S 343 345 32245 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 607064555 18763776 390 33554432000 4194304 4287625 140735135991968 18446744073709551615 256415411727 0 0 4096 65536 4604685157310398463 0 0 17 6 0 0 0
/proc/345/statm: 4581 390 341 23 0 91 0
[pid=346] ppid=345 vsize=46812 CPUtime=1.49 cores=0
/proc/346/stat : 346 (cryptominisat) R 345 345 32245 0 -1 4202496 8677 0 0 0 148 1 0 0 20 0 1 0 607064555 47935488 7438 33554432000 4194304 4587354 140736950823344 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/346/statm: 11703 7438 327 96 0 8265 0
[pid=347] ppid=345 vsize=31992 CPUtime=1.49 cores=1
/proc/347/stat : 347 (clasp) R 345 345 32245 0 -1 4202496 6090 0 0 0 148 1 0 0 20 0 1 0 607064555 32759808 5272 33554432000 4194304 4785740 140735478542480 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/347/statm: 7998 5272 340 145 0 5043 0
[pid=348] ppid=345 vsize=467708 CPUtime=1.49 cores=2
/proc/348/stat : 348 (TNM) R 345 345 32245 0 -1 4202496 4257 0 0 0 149 0 0 0 20 0 1 0 607064555 478932992 4154 33554432000 134512640 134534564 4292269488 18446744073709551615 134528934 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/348/statm: 116927 4154 95 6 0 115593 0
[pid=349] ppid=345 vsize=35600 CPUtime=1.49 cores=3
/proc/349/stat : 349 (march_hi) R 345 345 32245 0 -1 4202496 17871 0 0 0 147 2 0 0 20 0 1 0 607064555 36454400 5035 33554432000 4194304 4331988 140733890478896 18446744073709551615 4299854 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/349/statm: 8900 5035 175 34 0 7342 0
[pid=350] ppid=345 vsize=162504 CPUtime=5.5 cores=4-7
/proc/350/stat : 350 (plingeling) S 345 345 32245 0 -1 4202496 13614 1250 0 0 548 2 0 0 18 0 5 0 607064555 166404096 12700 33554432000 4194304 4356188 140735139155568 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/350/statm: 40626 12700 163 40 0 39170 0
[pid=350/tid=357] ppid=345 vsize=162504 CPUtime=1.34 cores=4-7
/proc/350/task/357/stat : 357 (plingeling) R 345 345 32245 0 -1 4202560 1705 1250 0 0 134 0 0 0 25 0 5 0 607064570 166404096 12700 33554432000 4194304 4356188 140735139155568 18446744073709551615 4331086 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=350/tid=358] ppid=345 vsize=162504 CPUtime=1.34 cores=4-7
/proc/350/task/358/stat : 358 (plingeling) R 345 345 32245 0 -1 4202560 1779 1250 0 0 134 0 0 0 25 0 5 0 607064570 166404096 12700 33554432000 4194304 4356188 140735139155568 18446744073709551615 4330856 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=350/tid=359] ppid=345 vsize=162504 CPUtime=1.32 cores=4-7
/proc/350/task/359/stat : 359 (plingeling) R 345 345 32245 0 -1 4202560 1778 1250 0 0 132 0 0 0 25 0 5 0 607064570 166404096 12700 33554432000 4194304 4356188 140735139155568 18446744073709551615 4331352 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=350/tid=360] ppid=345 vsize=162504 CPUtime=1.33 cores=4-7
/proc/350/task/360/stat : 360 (plingeling) R 345 345 32245 0 -1 4202560 1354 1250 0 0 133 0 0 0 22 0 5 0 607064570 166404096 12700 33554432000 4194304 4356188 140735139155568 18446744073709551615 4281627 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.46
Current children cumulated vsize (KiB) 762940

[startup+3.10136 s]
/proc/loadavg: 8.07 8.05 8.00 9/180 360
/proc/meminfo: memFree=29569264/32950928 swapFree=67111364/67111528
[pid=345] ppid=343 vsize=18324 CPUtime=0 cores=0-7
/proc/345/stat : 345 (ppfolio) S 343 345 32245 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 607064555 18763776 390 33554432000 4194304 4287625 140735135991968 18446744073709551615 256415411727 0 0 4096 65536 4604685157310398463 0 0 17 6 0 0 0
/proc/345/statm: 4581 390 341 23 0 91 0
[pid=346] ppid=345 vsize=271936 CPUtime=3.08 cores=0
/proc/346/stat : 346 (cryptominisat) R 345 345 32245 0 -1 4202496 13699 0 0 0 307 1 0 0 25 0 1 0 607064555 278462464 9941 33554432000 4194304 4587354 140736950823344 18446744073709551615 4245181 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/346/statm: 67984 9941 335 96 0 64546 0
[pid=347] ppid=345 vsize=40792 CPUtime=3.08 cores=1
/proc/347/stat : 347 (clasp) R 345 345 32245 0 -1 4202496 8274 0 0 0 307 1 0 0 25 0 1 0 607064555 41771008 7456 33554432000 4194304 4785740 140735478542480 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/347/statm: 10198 7456 340 145 0 7243 0
[pid=348] ppid=345 vsize=467708 CPUtime=3.09 cores=2
/proc/348/stat : 348 (TNM) R 345 345 32245 0 -1 4202496 4257 0 0 0 309 0 0 0 25 0 1 0 607064555 478932992 4154 33554432000 134512640 134534564 4292269488 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/348/statm: 116927 4154 95 6 0 115593 0
[pid=349] ppid=345 vsize=35600 CPUtime=3.09 cores=3
/proc/349/stat : 349 (march_hi) R 345 345 32245 0 -1 4202496 17944 0 0 0 307 2 0 0 25 0 1 0 607064555 36454400 5108 33554432000 4194304 4331988 140733890478896 18446744073709551615 4265452 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/349/statm: 8900 5108 175 34 0 7342 0
[pid=350] ppid=345 vsize=161108 CPUtime=11.89 cores=4-7
/proc/350/stat : 350 (plingeling) S 345 345 32245 0 -1 4202496 14922 1250 0 0 1187 2 0 0 18 0 5 0 607064555 164974592 12319 33554432000 4194304 4356188 140735139155568 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/350/statm: 40277 12319 163 40 0 38821 0
[pid=350/tid=357] ppid=345 vsize=161108 CPUtime=2.94 cores=4-7
/proc/350/task/357/stat : 357 (plingeling) R 345 345 32245 0 -1 4202560 2028 1250 0 0 294 0 0 0 25 0 5 0 607064570 164974592 12319 33554432000 4194304 4356188 140735139155568 18446744073709551615 4331086 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=350/tid=358] ppid=345 vsize=161108 CPUtime=2.93 cores=4-7
/proc/350/task/358/stat : 358 (plingeling) R 345 345 32245 0 -1 4202560 2215 1250 0 0 293 0 0 0 25 0 5 0 607064570 164974592 12319 33554432000 4194304 4356188 140735139155568 18446744073709551615 4279456 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=350/tid=359] ppid=345 vsize=161108 CPUtime=2.91 cores=4-7
/proc/350/task/359/stat : 359 (plingeling) R 345 345 32245 0 -1 4202560 2002 1250 0 0 291 0 0 0 25 0 5 0 607064570 164974592 12319 33554432000 4194304 4356188 140735139155568 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=350/tid=360] ppid=345 vsize=161108 CPUtime=2.93 cores=4-7
/proc/350/task/360/stat : 360 (plingeling) R 345 345 32245 0 -1 4202560 1679 1250 0 0 293 0 0 0 25 0 5 0 607064570 164974592 12319 33554432000 4194304 4356188 140735139155568 18446744073709551615 4279717 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.23
Current children cumulated vsize (KiB) 995468

[startup+6.30076 s]
/proc/loadavg: 8.06 8.05 8.00 9/180 360
/proc/meminfo: memFree=29551036/32950928 swapFree=67111364/67111528
[pid=345] ppid=343 vsize=18324 CPUtime=0 cores=0-7
/proc/345/stat : 345 (ppfolio) S 343 345 32245 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 607064555 18763776 390 33554432000 4194304 4287625 140735135991968 18446744073709551615 256415411727 0 0 4096 65536 4604685157310398463 0 0 17 6 0 0 0
/proc/345/statm: 4581 390 341 23 0 91 0
[pid=346] ppid=345 vsize=275580 CPUtime=6.28 cores=0
/proc/346/stat : 346 (cryptominisat) R 345 345 32245 0 -1 4202496 17032 0 0 0 626 2 0 0 25 0 1 0 607064555 282193920 10269 33554432000 4194304 4587354 140736950823344 18446744073709551615 4239225 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/346/statm: 68895 10269 335 96 0 65457 0
[pid=347] ppid=345 vsize=43144 CPUtime=6.28 cores=1
/proc/347/stat : 347 (clasp) R 345 345 32245 0 -1 4202496 8849 0 0 0 627 1 0 0 25 0 1 0 607064555 44179456 8031 33554432000 4194304 4785740 140735478542480 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/347/statm: 10786 8031 340 145 0 7831 0
[pid=348] ppid=345 vsize=467708 CPUtime=6.28 cores=2
/proc/348/stat : 348 (TNM) R 345 345 32245 0 -1 4202496 4257 0 0 0 628 0 0 0 25 0 1 0 607064555 478932992 4154 33554432000 134512640 134534564 4292269488 18446744073709551615 134530652 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/348/statm: 116927 4154 95 6 0 115593 0
[pid=349] ppid=345 vsize=35600 CPUtime=6.29 cores=3
/proc/349/stat : 349 (march_hi) R 345 345 32245 0 -1 4202496 17945 0 0 0 627 2 0 0 25 0 1 0 607064555 36454400 5109 33554432000 4194304 4331988 140733890478896 18446744073709551615 4299129 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/349/statm: 8900 5109 175 34 0 7342 0
[pid=350] ppid=345 vsize=162384 CPUtime=24.66 cores=4-7
/proc/350/stat : 350 (plingeling) S 345 345 32245 0 -1 4202496 15529 1250 0 0 2464 2 0 0 18 0 5 0 607064555 166281216 12638 33554432000 4194304 4356188 140735139155568 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/350/statm: 40596 12638 163 40 0 39140 0
[pid=350/tid=357] ppid=345 vsize=162384 CPUtime=6.14 cores=4-7
/proc/350/task/357/stat : 357 (plingeling) R 345 345 32245 0 -1 4202560 2124 1250 0 0 614 0 0 0 25 0 5 0 607064570 166281216 12638 33554432000 4194304 4356188 140735139155568 18446744073709551615 4234276 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=350/tid=358] ppid=345 vsize=162384 CPUtime=6.13 cores=4-7
/proc/350/task/358/stat : 358 (plingeling) R 345 345 32245 0 -1 4202560 2373 1250 0 0 613 0 0 0 25 0 5 0 607064570 166281216 12638 33554432000 4194304 4356188 140735139155568 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=350/tid=359] ppid=345 vsize=162384 CPUtime=6.09 cores=4-7
/proc/350/task/359/stat : 359 (plingeling) R 345 345 32245 0 -1 4202560 2161 1250 0 0 609 0 0 0 25 0 5 0 607064570 166281216 12638 33554432000 4194304 4356188 140735139155568 18446744073709551615 4225618 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=350/tid=360] ppid=345 vsize=162384 CPUtime=6.13 cores=4-7
/proc/350/task/360/stat : 360 (plingeling) R 345 345 32245 0 -1 4202560 1873 1250 0 0 613 0 0 0 25 0 5 0 607064570 166281216 12638 33554432000 4194304 4356188 140735139155568 18446744073709551615 4279567 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 49.79
Current children cumulated vsize (KiB) 1002740

[startup+12.7006 s]
/proc/loadavg: 8.06 8.05 8.00 9/180 360
/proc/meminfo: memFree=29529716/32950928 swapFree=67111364/67111528
[pid=345] ppid=343 vsize=18324 CPUtime=0 cores=0-7
/proc/345/stat : 345 (ppfolio) S 343 345 32245 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 607064555 18763776 390 33554432000 4194304 4287625 140735135991968 18446744073709551615 256415411727 0 0 4096 65536 4604685157310398463 0 0 17 6 0 0 0
/proc/345/statm: 4581 390 341 23 0 91 0
[pid=346] ppid=345 vsize=283236 CPUtime=12.69 cores=0
/proc/346/stat : 346 (cryptominisat) R 345 345 32245 0 -1 4202496 19986 0 0 0 1265 4 0 0 25 0 1 0 607064555 290033664 13192 33554432000 4194304 4587354 140736950823344 18446744073709551615 4238568 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/346/statm: 70809 13192 335 96 0 67371 0
[pid=347] ppid=345 vsize=53012 CPUtime=12.69 cores=1
/proc/347/stat : 347 (clasp) R 345 345 32245 0 -1 4202496 11247 0 0 0 1267 2 0 0 25 0 1 0 607064555 54284288 10429 33554432000 4194304 4785740 140735478542480 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/347/statm: 13253 10429 340 145 0 10298 0
[pid=348] ppid=345 vsize=467708 CPUtime=12.68 cores=2
/proc/348/stat : 348 (TNM) R 345 345 32245 0 -1 4202496 4257 0 0 0 1268 0 0 0 25 0 1 0 607064555 478932992 4154 33554432000 134512640 134534564 4292269488 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/348/statm: 116927 4154 95 6 0 115593 0
[pid=349] ppid=345 vsize=35600 CPUtime=12.69 cores=3
/proc/349/stat : 349 (march_hi) R 345 345 32245 0 -1 4202496 17946 0 0 0 1267 2 0 0 25 0 1 0 607064555 36454400 5110 33554432000 4194304 4331988 140733890478896 18446744073709551615 4239530 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/349/statm: 8900 5110 175 34 0 7342 0
[pid=350] ppid=345 vsize=164180 CPUtime=50.23 cores=4-7
/proc/350/stat : 350 (plingeling) S 345 345 32245 0 -1 4202496 16781 1250 0 0 5021 2 0 0 18 0 5 0 607064555 168120320 13086 33554432000 4194304 4356188 140735139155568 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/350/statm: 41045 13086 163 40 0 39589 0
[pid=350/tid=357] ppid=345 vsize=164180 CPUtime=12.54 cores=4-7
/proc/350/task/357/stat : 357 (plingeling) R 345 345 32245 0 -1 4202560 2478 1250 0 0 1254 0 0 0 25 0 5 0 607064570 168120320 13086 33554432000 4194304 4356188 140735139155568 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=350/tid=358] ppid=345 vsize=164180 CPUtime=12.53 cores=4-7
/proc/350/task/358/stat : 358 (plingeling) R 345 345 32245 0 -1 4202560 2727 1250 0 0 1253 0 0 0 25 0 5 0 607064570 168120320 13086 33554432000 4194304 4356188 140735139155568 18446744073709551615 4331039 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=350/tid=359] ppid=345 vsize=164180 CPUtime=12.46 cores=4-7
/proc/350/task/359/stat : 359 (plingeling) R 345 345 32245 0 -1 4202560 2321 1250 0 0 1246 0 0 0 25 0 5 0 607064570 168120320 13086 33554432000 4194304 4356188 140735139155568 18446744073709551615 4332239 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=350/tid=360] ppid=345 vsize=164180 CPUtime=12.53 cores=4-7
/proc/350/task/360/stat : 360 (plingeling) R 345 345 32245 0 -1 4202560 2257 1250 0 0 1253 0 0 0 25 0 5 0 607064570 168120320 13086 33554432000 4194304 4356188 140735139155568 18446744073709551615 4282357 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 100.98
Current children cumulated vsize (KiB) 1022060

[startup+25.5011 s]
/proc/loadavg: 8.04 8.05 8.00 9/180 360
/proc/meminfo: memFree=29530588/32950928 swapFree=67111364/67111528
[pid=345] ppid=343 vsize=18324 CPUtime=0 cores=0-7
/proc/345/stat : 345 (ppfolio) S 343 345 32245 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 607064555 18763776 390 33554432000 4194304 4287625 140735135991968 18446744073709551615 256415411727 0 0 4096 65536 4604685157310398463 0 0 17 6 0 0 0
/proc/345/statm: 4581 390 341 23 0 91 0
[pid=346] ppid=345 vsize=258600 CPUtime=25.49 cores=0
/proc/346/stat : 346 (cryptominisat) R 345 345 32245 0 -1 4202496 24035 0 0 0 2544 5 0 0 25 0 1 0 607064555 264806400 8891 33554432000 4194304 4587354 140736950823344 18446744073709551615 256415088326 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=348] ppid=345 vsize=467708 CPUtime=4842.45 cores=2
/proc/348/stat : 348 (TNM) R 345 345 32245 0 -1 4202496 4257 0 0 0 484243 2 0 0 25 0 1 0 607064555 478932992 4154 33554432000 134512640 134534564 4292269488 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/348/statm: 116927 4154 95 6 0 115593 0
[pid=349] ppid=345 vsize=350928 CPUtime=4842.45 cores=3
/proc/349/stat : 349 (march_hi) R 345 345 32245 0 -1 4202496 82057 0 0 0 484196 49 0 0 25 0 1 0 607064555 359350272 69221 33554432000 4194304 4331988 140733890478896 18446744073709551615 4212344 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/349/statm: 87732 69221 175 34 0 86174 0
[pid=350] ppid=345 vsize=310380 CPUtime=19341.6 cores=4-7
/proc/350/stat : 350 (plingeling) S 345 345 32245 0 -1 4202496 1008173 1250 0 0 1934017 143 0 0 18 0 5 0 607064555 317829120 49667 33554432000 4194304 4356188 140735139155568 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/350/statm: 77595 49667 163 40 0 76139 0
[pid=350/tid=357] ppid=345 vsize=310380 CPUtime=4842.17 cores=4-7
/proc/350/task/357/stat : 357 (plingeling) R 345 345 32245 0 -1 4202560 274491 1250 0 0 484180 37 0 0 25 0 5 0 607064570 317829120 49667 33554432000 4194304 4356188 140735139155568 18446744073709551615 4279565 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=350/tid=358] ppid=345 vsize=310380 CPUtime=4841.06 cores=4-7
/proc/350/task/358/stat : 358 (plingeling) R 345 345 32245 0 -1 4202560 217107 1250 0 0 484074 32 0 0 25 0 5 0 607064570 317829120 49667 33554432000 4194304 4356188 140735139155568 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=350/tid=359] ppid=345 vsize=310380 CPUtime=4815.89 cores=4-7
/proc/350/task/359/stat : 359 (plingeling) R 345 345 32245 0 -1 4202560 276446 1250 0 0 481552 37 0 0 25 0 5 0 607064570 317829120 49667 33554432000 4194304 4356188 140735139155568 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=350/tid=360] ppid=345 vsize=310380 CPUtime=4842.29 cores=4-7
/proc/350/task/360/stat : 360 (plingeling) R 345 345 32245 0 -1 4202560 233131 1250 0 0 484195 34 0 0 25 0 5 0 607064570 317829120 49667 33554432000 4194304 4356188 140735139155568 18446744073709551615 4331960 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38711.4
Current children cumulated vsize (KiB) 2028420

[startup+4902.3 s]
/proc/loadavg: 8.03 8.01 8.00 9/180 522
/proc/meminfo: memFree=28501700/32950928 swapFree=67111364/67111528
[pid=345] ppid=343 vsize=18324 CPUtime=0 cores=0-7
/proc/345/stat : 345 (ppfolio) S 343 345 32245 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 607064555 18763776 390 33554432000 4194304 4287625 140735135991968 18446744073709551615 256415411727 0 0 4096 65536 4604685157310398463 0 0 17 6 0 0 0
/proc/345/statm: 4581 390 341 23 0 91 0
[pid=346] ppid=345 vsize=473856 CPUtime=4902.45 cores=0
/proc/346/stat : 346 (cryptominisat) R 345 345 32245 0 -1 4202496 1561602 0 0 0 489594 651 0 0 25 0 1 0 607064555 485228544 84586 33554432000 4194304 4587354 140736950823344 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/346/statm: 118464 84586 335 96 0 115026 0
[pid=347] ppid=345 vsize=410772 CPUtime=4902.44 cores=1
/proc/347/stat : 347 (clasp) R 345 345 32245 0 -1 4202496 95105 0 0 0 490217 27 0 0 25 0 1 0 607064555 420630528 94287 33554432000 4194304 4785740 140735478542480 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/347/statm: 102693 94287 340 145 0 99738 0
[pid=348] ppid=345 vsize=467708 CPUtime=4902.46 cores=2
/proc/348/stat : 348 (TNM) R 345 345 32245 0 -1 4202496 4257 0 0 0 490244 2 0 0 25 0 1 0 607064555 478932992 4154 33554432000 134512640 134534564 4292269488 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/348/statm: 116927 4154 95 6 0 115593 0
[pid=349] ppid=345 vsize=350928 CPUtime=4902.45 cores=3
/proc/349/stat : 349 (march_hi) R 345 345 32245 0 -1 4202496 82856 0 0 0 490195 50 0 0 25 0 1 0 607064555 359350272 70020 33554432000 4194304 4331988 140733890478896 18446744073709551615 4228270 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/349/statm: 87732 70020 175 34 0 86174 0
[pid=350] ppid=345 vsize=307564 CPUtime=19581.3 cores=4-7
/proc/350/stat : 350 (plingeling) S 345 345 32245 0 -1 4202496 1016781 1250 0 0 1957984 144 0 0 18 0 5 0 607064555 314945536 48963 33554432000 4194304 4356188 140735139155568 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/350/statm: 76891 48963 163 40 0 75435 0
[pid=350/tid=357] ppid=345 vsize=307564 CPUtime=4902.18 cores=4-7
/proc/350/task/357/stat : 357 (plingeling) R 345 345 32245 0 -1 4202560 276923 1250 0 0 490180 38 0 0 25 0 5 0 607064570 314945536 48963 33554432000 4194304 4356188 140735139155568 18446744073709551615 4331007 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=350/tid=358] ppid=345 vsize=307564 CPUtime=4901.06 cores=4-7
/proc/350/task/358/stat : 358 (plingeling) R 345 345 32245 0 -1 4202560 221587 1250 0 0 490073 33 0 0 25 0 5 0 607064570 314945536 48963 33554432000 4194304 4356188 140735139155568 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=350/tid=359] ppid=345 vsize=307564 CPUtime=4875.57 cores=4-7
/proc/350/task/359/stat : 359 (plingeling) R 345 345 32245 0 -1 4202560 276478 1250 0 0 487520 37 0 0 25 0 5 0 607064570 314945536 48963 33554432000 4194304 4356188 140735139155568 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=350/tid=360] ppid=345 vsize=307564 CPUtime=4902.29 cores=4-7
/proc/350/task/360/stat : 360 (plingeling) R 345 345 32245 0 -1 4202560 234795 1250 0 0 490195 34 0 0 25 0 5 0 607064570 314945536 48963 33554432000 4194304 4356188 140735139155568 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39191.1
Current children cumulated vsize (KiB) 2029152

[startup+4962.3 s]
/proc/loadavg: 8.04 8.02 8.00 9/180 523
/proc/meminfo: memFree=28537236/32950928 swapFree=67111364/67111528
[pid=345] ppid=343 vsize=18324 CPUtime=0 cores=0-7
/proc/345/stat : 345 (ppfolio) S 343 345 32245 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 607064555 18763776 390 33554432000 4194304 4287625 140735135991968 18446744073709551615 256415411727 0 0 4096 65536 4604685157310398463 0 0 17 6 0 0 0
/proc/345/statm: 4581 390 341 23 0 91 0
[pid=346] ppid=345 vsize=480220 CPUtime=4962.45 cores=0
/proc/346/stat : 346 (cryptominisat) R 345 345 32245 0 -1 4202496 1593262 0 0 0 495583 662 0 0 25 0 1 0 607064555 491745280 78113 33554432000 4194304 4587354 140736950823344 18446744073709551615 4238608 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/346/statm: 120055 78113 335 96 0 116617 0
[pid=347] ppid=345 vsize=411836 CPUtime=4962.44 cores=1
/proc/347/stat : 347 (clasp) R 345 345 32245 0 -1 4202496 95357 0 0 0 496217 27 0 0 25 0 1 0 607064555 421720064 94539 33554432000 4194304 4785740 140735478542480 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/347/statm: 102959 94539 340 145 0 100004 0
[pid=348] ppid=345 vsize=467708 CPUtime=4962.46 cores=2
/proc/348/stat : 348 (TNM) R 345 345 32245 0 -1 4202496 4257 0 0 0 496244 2 0 0 25 0 1 0 607064555 478932992 4154 33554432000 134512640 134534564 4292269488 18446744073709551615 134528708 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/348/statm: 116927 4154 95 6 0 115593 0
[pid=349] ppid=345 vsize=350928 CPUtime=4962.45 cores=3
/proc/349/stat : 349 (march_hi) R 345 345 32245 0 -1 4202496 83668 0 0 0 496195 50 0 0 25 0 1 0 607064555 359350272 70832 33554432000 4194304 4331988 140733890478896 18446744073709551615 4299872 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/349/statm: 87732 70832 175 34 0 86174 0
[pid=350] ppid=345 vsize=293740 CPUtime=19820.9 cores=4-7
/proc/350/stat : 350 (plingeling) S 345 345 32245 0 -1 4202496 1019373 1250 0 0 1981950 144 0 0 18 0 5 0 607064555 300789760 45507 33554432000 4194304 4356188 140735139155568 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/350/statm: 73435 45507 163 40 0 71979 0
[pid=350/tid=357] ppid=345 vsize=293740 CPUtime=4962.18 cores=4-7
/proc/350/task/357/stat : 357 (plingeling) R 345 345 32245 0 -1 4202560 277563 1250 0 0 496180 38 0 0 25 0 5 0 607064570 300789760 45507 33554432000 4194304 4356188 140735139155568 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=350/tid=358] ppid=345 vsize=293740 CPUtime=4961.05 cores=4-7
/proc/350/task/358/stat : 358 (plingeling) R 345 345 32245 0 -1 4202560 223155 1250 0 0 496072 33 0 0 25 0 5 0 607064570 300789760 45507 33554432000 4194304 4356188 140735139155568 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=350/tid=359] ppid=345 vsize=293740 CPUtime=4935.24 cores=4-7
/proc/350/task/359/stat : 359 (plingeling) R 345 345 32245 0 -1 4202560 276478 1250 0 0 493487 37 0 0 25 0 5 0 607064570 300789760 45507 33554432000 4194304 4356188 140735139155568 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=350/tid=360] ppid=345 vsize=293740 CPUtime=4962.29 cores=4-7
/proc/350/task/360/stat : 360 (plingeling) R 345 345 32245 0 -1 4202560 235179 1250 0 0 496195 34 0 0 25 0 5 0 607064570 300789760 45507 33554432000 4194304 4356188 140735139155568 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39670.7
Current children cumulated vsize (KiB) 2022756



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.5 s]
/proc/loadavg: 8.02 8.02 8.00 9/180 524
/proc/meminfo: memFree=28614212/32950928 swapFree=67111364/67111528
[pid=345] ppid=343 vsize=18324 CPUtime=0 cores=0-7
/proc/345/stat : 345 (ppfolio) S 343 345 32245 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 607064555 18763776 390 33554432000 4194304 4287625 140735135991968 18446744073709551615 256415411727 0 0 4096 65536 4604685157310398463 0 0 17 6 0 0 0
/proc/345/statm: 4581 390 341 23 0 91 0
[pid=346] ppid=345 vsize=466896 CPUtime=5003.66 cores=0
/proc/346/stat : 346 (cryptominisat) R 345 345 32245 0 -1 4202496 1614234 0 0 0 499694 672 0 0 25 0 1 0 607064555 478101504 58810 33554432000 4194304 4587354 140736950823344 18446744073709551615 256415088273 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/346/statm: 116724 58810 335 96 0 113286 0
[pid=347] ppid=345 vsize=414824 CPUtime=5003.64 cores=1
/proc/347/stat : 347 (clasp) R 345 345 32245 0 -1 4202496 96055 0 0 0 500337 27 0 0 25 0 1 0 607064555 424779776 95237 33554432000 4194304 4785740 140735478542480 18446744073709551615 4552556 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/347/statm: 103706 95237 340 145 0 100751 0
[pid=348] ppid=345 vsize=467708 CPUtime=5003.66 cores=2
/proc/348/stat : 348 (TNM) R 345 345 32245 0 -1 4202496 4257 0 0 0 500364 2 0 0 25 0 1 0 607064555 478932992 4154 33554432000 134512640 134534564 4292269488 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/348/statm: 116927 4154 95 6 0 115593 0
[pid=349] ppid=345 vsize=350928 CPUtime=5003.66 cores=3
/proc/349/stat : 349 (march_hi) R 345 345 32245 0 -1 4202496 84189 0 0 0 500316 50 0 0 25 0 1 0 607064555 359350272 71353 33554432000 4194304 4331988 140733890478896 18446744073709551615 4299840 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/349/statm: 87732 71353 175 34 0 86174 0
[pid=350] ppid=345 vsize=288108 CPUtime=19985.5 cores=4-7
/proc/350/stat : 350 (plingeling) S 345 345 32245 0 -1 4202496 1025165 1250 0 0 1998408 145 0 0 18 0 5 0 607064555 295022592 44099 33554432000 4194304 4356188 140735139155568 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/350/statm: 72027 44099 163 40 0 70571 0
[pid=350/tid=357] ppid=345 vsize=288108 CPUtime=5003.39 cores=4-7
/proc/350/task/357/stat : 357 (plingeling) R 345 345 32245 0 -1 4202560 277595 1250 0 0 500301 38 0 0 25 0 5 0 607064570 295022592 44099 33554432000 4194304 4356188 140735139155568 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=350/tid=358] ppid=345 vsize=288108 CPUtime=5002.25 cores=4-7
/proc/350/task/358/stat : 358 (plingeling) R 345 345 32245 0 -1 4202560 223155 1250 0 0 500192 33 0 0 25 0 5 0 607064570 295022592 44099 33554432000 4194304 4356188 140735139155568 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=350/tid=359] ppid=345 vsize=288108 CPUtime=4976.22 cores=4-7
/proc/350/task/359/stat : 359 (plingeling) R 345 345 32245 0 -1 4202560 276478 1250 0 0 497585 37 0 0 25 0 5 0 607064570 295022592 44099 33554432000 4194304 4356188 140735139155568 18446744073709551615 4234276 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=350/tid=360] ppid=345 vsize=288108 CPUtime=5003.51 cores=4-7
/proc/350/task/360/stat : 360 (plingeling) R 345 345 32245 0 -1 4202560 240939 1250 0 0 500316 35 0 0 25 0 5 0 607064570 295022592 44099 33554432000 4194304 4356188 140735139155568 18446744073709551615 4332162 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 2006788

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5003.5 s]
/proc/loadavg: 8.02 8.02 8.00 9/180 524
/proc/meminfo: memFree=28614212/32950928 swapFree=67111364/67111528
[pid=345] ppid=343 vsize=18324 CPUtime=0 cores=0-7
/proc/345/stat : 345 (ppfolio) S 343 345 32245 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 607064555 18763776 390 33554432000 4194304 4287625 140735135991968 18446744073709551615 256415411727 0 0 4096 65536 4604685157310398463 0 0 17 6 0 0 0
/proc/345/statm: 4581 390 341 23 0 91 0
[pid=346] ppid=345 vsize=466896 CPUtime=5003.66 cores=0
/proc/346/stat : 346 (cryptominisat) R 345 345 32245 0 -1 4202496 1614234 0 0 0 499694 672 0 0 25 0 1 0 607064555 478101504 58810 33554432000 4194304 4587354 140736950823344 18446744073709551615 256415088273 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/346/statm: 116724 58810 335 96 0 113286 0
[pid=347] ppid=345 vsize=414824 CPUtime=5003.64 cores=1
/proc/347/stat : 347 (clasp) R 345 345 32245 0 -1 4202496 96055 0 0 0 500337 27 0 0 25 0 1 0 607064555 424779776 95237 33554432000 4194304 4785740 140735478542480 18446744073709551615 4552556 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/347/statm: 103706 95237 340 145 0 100751 0
[pid=348] ppid=345 vsize=467708 CPUtime=5003.66 cores=2
/proc/348/stat : 348 (TNM) R 345 345 32245 0 -1 4202496 4257 0 0 0 500364 2 0 0 25 0 1 0 607064555 478932992 4154 33554432000 134512640 134534564 4292269488 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/348/statm: 116927 4154 95 6 0 115593 0
[pid=349] ppid=345 vsize=350928 CPUtime=5003.66 cores=3
/proc/349/stat : 349 (march_hi) R 345 345 32245 0 -1 4202496 84189 0 0 0 500316 50 0 0 25 0 1 0 607064555 359350272 71353 33554432000 4194304 4331988 140733890478896 18446744073709551615 4299840 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/349/statm: 87732 71353 175 34 0 86174 0
[pid=350] ppid=345 vsize=288108 CPUtime=19985.5 cores=4-7
/proc/350/stat : 350 (plingeling) S 345 345 32245 0 -1 4202496 1025165 1250 0 0 1998408 145 0 0 18 0 5 0 607064555 295022592 44099 33554432000 4194304 4356188 140735139155568 18446744073709551615 256427194341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/350/statm: 72027 44099 163 40 0 70571 0
[pid=350/tid=357] ppid=345 vsize=288108 CPUtime=5003.39 cores=4-7
/proc/350/task/357/stat : 357 (plingeling) R 345 345 32245 0 -1 4202560 277595 1250 0 0 500301 38 0 0 25 0 5 0 607064570 295022592 44099 33554432000 4194304 4356188 140735139155568 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=350/tid=358] ppid=345 vsize=288108 CPUtime=5002.25 cores=4-7
/proc/350/task/358/stat : 358 (plingeling) R 345 345 32245 0 -1 4202560 223155 1250 0 0 500192 33 0 0 25 0 5 0 607064570 295022592 44099 33554432000 4194304 4356188 140735139155568 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=350/tid=359] ppid=345 vsize=288108 CPUtime=4976.22 cores=4-7
/proc/350/task/359/stat : 359 (plingeling) R 345 345 32245 0 -1 4202560 276478 1250 0 0 497585 37 0 0 25 0 5 0 607064570 295022592 44099 33554432000 4194304 4356188 140735139155568 18446744073709551615 4234276 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=350/tid=360] ppid=345 vsize=288108 CPUtime=5003.51 cores=4-7
/proc/350/task/360/stat : 360 (plingeling) R 345 345 32245 0 -1 4202560 240939 1250 0 0 500316 35 0 0 25 0 5 0 607064570 295022592 44099 33554432000 4194304 4356188 140735139155568 18446744073709551615 4332162 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 2006788

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 345 and gives
#  childrusage.ru_utime.tv_sec=5003
#  childrusage.ru_utime.tv_usec=653329
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=31995
# CPU time returned by wait4() is 5003.69
# while last known CPU time is 40000.2
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.52
CPU time (s): 40000.2
CPU user time (s): 39991.2
CPU system time (s): 8.96
CPU usage (%): 799.441
Max. virtual memory (cumulated for all children) (KiB): 2361416

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5003.65
system time used= 0.031995
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4782
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 288
involuntary context switches= 14071

runsolver used 7.9008 second user time and 19.3971 second system time

The end

Launcher Data 

Begin job on node115 at 2011-04-30 14:58:59
IDJOB=3275661
IDBENCH=83248
IDSOLVER=1638
FILE ID=node115/3275661-1304168339
RUNJOBID= node115-1304162845-32259
PBS_JOBID= 13170941
Free space on /tmp= 72876 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-4-5_4231.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3275661-1304168339/watcher-3275661-1304168339 -o /tmp/evaluation-result-3275661-1304168339/solver-3275661-1304168339 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3275661-1304168339.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= a52d60bf6e72caa628ad712a5fe0fb7a
RANDOM SEED=1294750292

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      29707760 kB
Buffers:        844680 kB
Cached:        1908144 kB
SwapCached:          0 kB
Active:         232112 kB
Inactive:      2584264 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      29707760 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           12060 kB
Writeback:          28 kB
AnonPages:       63444 kB
Mapped:          14524 kB
Slab:           361520 kB
PageTables:       4268 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   185616 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72868 MiB
End job on node115 at 2011-04-30 16:22:24