Trace number 3371889

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Lingeling 587f (fixed)UNSAT 1060.62 1060.59

General information on the benchmark

NameSAT-Race-2010-CNF/hardware-verification/
velev/1dlx_c_iq57_a.cnf
MD5SUM953b9cb99bfd26cff0e1ac65be1241f6
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark630.301
Satisfiable
(Un)Satisfiability was proved
Number of variables569795
Number of clauses8562505
Sum of the clauses size24843745
Maximum clause length186
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 27567948
Number of clauses of size 3724416
Number of clauses of size 49898
Number of clauses of size 560873
Number of clauses of size over 5199369

Solver Data 

1060.51/1060.57	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371889-1305436074/watcher-3371889-1305436074 -o /tmp/evaluation-result-3371889-1305436074/solver-3371889-1305436074 -C 2400 -W 1300 -M 7680 lingeling HOME/instance-3371889-1305436074.cnf 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.00 4.07 4.96 4/371 17039
/proc/meminfo: memFree=28733792/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=7580 CPUtime=0 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 476 0 0 0 0 0 0 0 22 0 1 0 636024113 7761920 419 33554432000 4194304 4409284 140733729159056 18446744073709551615 4198816 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 1895 419 112 53 0 318 0

[startup+0.039343 s]
/proc/loadavg: 4.00 4.07 4.96 4/371 17039
/proc/meminfo: memFree=28733792/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=10320 CPUtime=0.03 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 1215 0 0 0 3 0 0 0 22 0 1 0 636024113 10567680 1104 33554432000 4194304 4409284 140733729159056 18446744073709551615 212039655168 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 2580 1104 112 53 0 1003 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 10320

[startup+0.100296 s]
/proc/loadavg: 4.00 4.07 4.96 4/371 17039
/proc/meminfo: memFree=28733792/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=14036 CPUtime=0.09 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 2144 0 0 0 9 0 0 0 22 0 1 0 636024113 14372864 2033 33554432000 4194304 4409284 140733729159056 18446744073709551615 212039655168 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 3509 2033 112 53 0 1932 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 14036

[startup+0.300287 s]
/proc/loadavg: 4.00 4.07 4.96 4/371 17039
/proc/meminfo: memFree=28733792/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=31752 CPUtime=0.29 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 6593 0 0 0 28 1 0 0 23 0 1 0 636024113 32514048 6462 33554432000 4194304 4409284 140733729159056 18446744073709551615 212039655168 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 7938 6462 112 53 0 6361 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 31752

[startup+0.70019 s]
/proc/loadavg: 4.00 4.07 4.96 4/371 17039
/proc/meminfo: memFree=28733792/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=65736 CPUtime=0.69 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 15014 0 0 0 66 3 0 0 25 0 1 0 636024113 67313664 14866 33554432000 4194304 4409284 140733729159056 18446744073709551615 212039349341 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 16434 14887 112 53 0 14857 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 65736

[startup+1.86399 s]
/proc/loadavg: 4.00 4.07 4.96 4/371 17039
/proc/meminfo: memFree=28733792/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=125896 CPUtime=1.85 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 30146 0 0 0 178 7 0 0 25 0 1 0 636024113 128917504 29998 33554432000 4194304 4409284 140733729159056 18446744073709551615 212039655168 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 31474 29998 112 53 0 29897 0
Current children cumulated CPU time (s) 1.85
Current children cumulated vsize (KiB) 125896

[startup+3.10076 s]
/proc/loadavg: 4.32 4.14 4.98 6/377 17047
/proc/meminfo: memFree=28302636/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=207816 CPUtime=3.1 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 50626 0 0 0 300 10 0 0 25 0 1 0 636024113 212803584 50478 33554432000 4194304 4409284 140733729159056 18446744073709551615 212039655168 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 51954 50478 112 53 0 50377 0
Current children cumulated CPU time (s) 3.1
Current children cumulated vsize (KiB) 207816

[startup+6.3002 s]
/proc/loadavg: 4.32 4.14 4.98 6/377 17047
/proc/meminfo: memFree=28113048/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=247852 CPUtime=6.28 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 75757 0 0 0 614 14 0 0 25 0 1 0 636024113 253800448 60440 33554432000 4194304 4409284 140733729159056 18446744073709551615 4284470 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 61963 60440 128 53 0 60386 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 247852

[startup+12.7011 s]
/proc/loadavg: 4.42 4.16 4.98 6/377 17047
/proc/meminfo: memFree=27977648/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=255572 CPUtime=12.69 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 159063 0 0 0 1245 24 0 0 25 0 1 0 636024113 261705728 62406 33554432000 4194304 4409284 140733729159056 18446744073709551615 4296704 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 63893 62406 133 53 0 62316 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 255572

[startup+25.5008 s]
/proc/loadavg: 4.36 4.16 4.96 6/377 17047
/proc/meminfo: memFree=27890364/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=430628 CPUtime=25.48 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 202897 0 0 0 2520 28 0 0 25 0 1 0 636024113 440963072 106183 33554432000 4194304 4409284 140733729159056 18446744073709551615 4360264 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 107657 106183 140 53 0 106080 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 430628

[startup+51.1002 s]
/proc/loadavg: 4.23 4.14 4.94 6/377 17048
/proc/meminfo: memFree=27882452/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=430628 CPUtime=51.09 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 202898 0 0 0 5080 29 0 0 25 0 1 0 636024113 440963072 106184 33554432000 4194304 4409284 140733729159056 18446744073709551615 4230570 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 107657 106184 141 53 0 106080 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 430628

[startup+102.301 s]
/proc/loadavg: 4.09 4.12 4.88 5/377 17076
/proc/meminfo: memFree=27896772/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=430628 CPUtime=102.29 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 202898 0 0 0 10199 30 0 0 25 0 1 0 636024113 440963072 106184 33554432000 4194304 4409284 140733729159056 18446744073709551615 4230803 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 107657 106184 141 53 0 106080 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 430628

[startup+162.3 s]
/proc/loadavg: 4.03 4.09 4.82 5/377 17078
/proc/meminfo: memFree=27874168/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=428092 CPUtime=162.29 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 297398 0 0 0 16189 40 0 0 25 0 1 0 636024113 438366208 105550 33554432000 4194304 4409284 140733729159056 18446744073709551615 4285141 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 107023 105550 141 53 0 105446 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 428092

[startup+222.301 s]
/proc/loadavg: 4.01 4.07 4.77 5/377 17079
/proc/meminfo: memFree=27824872/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=409908 CPUtime=222.29 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 300406 0 0 0 22188 41 0 0 25 0 1 0 636024113 419745792 101004 33554432000 4194304 4409284 140733729159056 18446744073709551615 4358371 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 102477 101004 141 53 0 100900 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 409908

[startup+282.301 s]
/proc/loadavg: 3.32 3.90 4.66 3/365 17116
/proc/meminfo: memFree=28329320/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=409756 CPUtime=282.29 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 333612 0 0 0 28181 48 0 0 25 0 1 0 636024113 419590144 100966 33554432000 4194304 4409284 140733729159056 18446744073709551615 4259235 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 102439 100966 141 53 0 100862 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 409756

[startup+342.3 s]
/proc/loadavg: 2.56 3.56 4.50 3/365 17118
/proc/meminfo: memFree=28436168/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=303016 CPUtime=342.29 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 350389 0 0 0 34176 53 0 0 25 0 1 0 636024113 310288384 74313 33554432000 4194304 4409284 140733729159056 18446744073709551615 4230570 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 75754 74313 141 53 0 74177 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 303016

[startup+402.3 s]
/proc/loadavg: 2.29 3.33 4.36 3/365 17119
/proc/meminfo: memFree=28421976/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=318140 CPUtime=402.29 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 404294 0 0 0 40167 62 0 0 25 0 1 0 636024113 325775360 78062 33554432000 4194304 4409284 140733729159056 18446744073709551615 4358342 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 79535 78062 141 53 0 77958 0
Current children cumulated CPU time (s) 402.29
Current children cumulated vsize (KiB) 318140

[startup+462.301 s]
/proc/loadavg: 2.13 3.08 4.21 3/365 17121
/proc/meminfo: memFree=28421672/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=319268 CPUtime=462.3 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 404577 0 0 0 46164 66 0 0 25 0 1 0 636024113 326930432 78344 33554432000 4194304 4409284 140733729159056 18446744073709551615 4242957 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 79817 78344 141 53 0 78240 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 319268

[startup+522.301 s]
/proc/loadavg: 2.04 2.88 4.07 3/365 17122
/proc/meminfo: memFree=28412920/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=327488 CPUtime=522.31 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 423329 0 0 0 52160 71 0 0 25 0 1 0 636024113 335347712 80399 33554432000 4194304 4409284 140733729159056 18446744073709551615 4358519 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 81872 80399 141 53 0 80295 0
Current children cumulated CPU time (s) 522.31
Current children cumulated vsize (KiB) 327488

[startup+582.3 s]
/proc/loadavg: 2.01 2.72 3.93 3/365 17124
/proc/meminfo: memFree=28416356/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=323896 CPUtime=582.31 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 423329 0 0 0 58154 77 0 0 25 0 1 0 636024113 331669504 79501 33554432000 4194304 4409284 140733729159056 18446744073709551615 4226300 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 80974 79501 141 53 0 79397 0
Current children cumulated CPU time (s) 582.31
Current children cumulated vsize (KiB) 323896

[startup+642.314 s]
/proc/loadavg: 2.00 2.58 3.81 3/365 17126
/proc/meminfo: memFree=28409728/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=329700 CPUtime=642.32 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 441457 0 0 0 64150 82 0 0 25 0 1 0 636024113 337612800 80952 33554432000 4194304 4409284 140733729159056 18446744073709551615 212039679895 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 82425 80952 141 53 0 80848 0
Current children cumulated CPU time (s) 642.32
Current children cumulated vsize (KiB) 329700

[startup+702.301 s]
/proc/loadavg: 2.00 2.47 3.69 3/365 17127
/proc/meminfo: memFree=28428536/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=329700 CPUtime=702.3 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 441457 0 0 0 70143 87 0 0 25 0 1 0 636024113 337612800 80952 33554432000 4194304 4409284 140733729159056 18446744073709551615 4230778 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 82425 80952 141 53 0 80848 0
Current children cumulated CPU time (s) 702.3
Current children cumulated vsize (KiB) 329700

[startup+762.301 s]
/proc/loadavg: 2.00 2.39 3.58 3/365 17129
/proc/meminfo: memFree=28424148/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=337744 CPUtime=762.31 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 460385 0 0 0 76137 94 0 0 25 0 1 0 636024113 345849856 82963 33554432000 4194304 4409284 140733729159056 18446744073709551615 4259291 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 84436 82963 141 53 0 82859 0
Current children cumulated CPU time (s) 762.31
Current children cumulated vsize (KiB) 337744

[startup+822.3 s]
/proc/loadavg: 2.00 2.31 3.48 3/365 17130
/proc/meminfo: memFree=28291552/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=337712 CPUtime=822.31 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 460385 0 0 0 82132 99 0 0 25 0 1 0 636024113 345817088 82955 33554432000 4194304 4409284 140733729159056 18446744073709551615 4230570 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 84428 82955 141 53 0 82851 0
Current children cumulated CPU time (s) 822.31
Current children cumulated vsize (KiB) 337712

[startup+882.301 s]
/proc/loadavg: 2.00 2.25 3.39 3/365 17132
/proc/meminfo: memFree=28357064/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=337712 CPUtime=882.31 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 460597 0 0 0 88124 107 0 0 25 0 1 0 636024113 345817088 82955 33554432000 4194304 4409284 140733729159056 18446744073709551615 4269684 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 84428 82955 141 53 0 82851 0
Current children cumulated CPU time (s) 882.31
Current children cumulated vsize (KiB) 337712

[startup+942.301 s]
/proc/loadavg: 2.17 2.26 3.32 3/365 17134
/proc/meminfo: memFree=28333712/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=361308 CPUtime=942.32 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 483170 0 0 0 94120 112 0 0 25 0 1 0 636024113 369979392 88854 33554432000 4194304 4409284 140733729159056 18446744073709551615 4324307 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 90327 88854 141 53 0 88750 0
Current children cumulated CPU time (s) 942.32
Current children cumulated vsize (KiB) 361308

[startup+1002.3 s]
/proc/loadavg: 2.10 2.23 3.24 3/365 17135
/proc/meminfo: memFree=28485936/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=364012 CPUtime=1002.31 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 483852 0 0 0 100115 116 0 0 25 0 1 0 636024113 372748288 89530 33554432000 4194304 4409284 140733729159056 18446744073709551615 4230514 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 91003 89530 141 53 0 89426 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 364012

Solver just ended. Dumping a history of the last processes samples

[startup+1024.9 s]
/proc/loadavg: 2.07 2.21 3.21 4/366 17139
/proc/meminfo: memFree=28465068/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=364012 CPUtime=1024.91 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 483852 0 0 0 102373 118 0 0 25 0 1 0 636024113 372748288 89530 33554432000 4194304 4409284 140733729159056 18446744073709551615 4358234 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 91003 89530 141 53 0 89426 0
Current children cumulated CPU time (s) 1024.91
Current children cumulated vsize (KiB) 364012

[startup+1037.7 s]
/proc/loadavg: 2.06 2.20 3.19 3/365 17139
/proc/meminfo: memFree=28480528/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=368692 CPUtime=1037.72 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 485043 0 0 0 103651 121 0 0 25 0 1 0 636024113 377540608 90700 33554432000 4194304 4409284 140733729159056 18446744073709551615 4259189 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 92173 90700 141 53 0 90596 0
Current children cumulated CPU time (s) 1037.72
Current children cumulated vsize (KiB) 368692

[startup+1050.5 s]
/proc/loadavg: 2.05 2.19 3.18 3/365 17139
/proc/meminfo: memFree=28472584/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=376884 CPUtime=1050.51 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 487091 0 0 0 104929 122 0 0 25 0 1 0 636024113 385929216 92748 33554432000 4194304 4409284 140733729159056 18446744073709551615 4359330 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 94221 92748 141 53 0 92644 0
Current children cumulated CPU time (s) 1050.51
Current children cumulated vsize (KiB) 376884

[startup+1056.9 s]
/proc/loadavg: 2.04 2.19 3.16 3/365 17140
/proc/meminfo: memFree=28472544/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=376884 CPUtime=1056.93 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 487091 0 0 0 105570 123 0 0 25 0 1 0 636024113 385929216 92748 33554432000 4194304 4409284 140733729159056 18446744073709551615 212039679895 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 94221 92748 141 53 0 92644 0
Current children cumulated CPU time (s) 1056.93
Current children cumulated vsize (KiB) 376884

[startup+1058.5 s]
/proc/loadavg: 2.04 2.19 3.16 3/365 17140
/proc/meminfo: memFree=28457664/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=391732 CPUtime=1058.52 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 490803 0 0 0 105728 124 0 0 25 0 1 0 636024113 401133568 96460 33554432000 4194304 4409284 140733729159056 18446744073709551615 4358673 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 97933 96460 141 53 0 96356 0
Current children cumulated CPU time (s) 1058.52
Current children cumulated vsize (KiB) 391732

[startup+1059.3 s]
/proc/loadavg: 2.04 2.19 3.16 3/365 17140
/proc/meminfo: memFree=28457664/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=391732 CPUtime=1059.32 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 490803 0 0 0 105808 124 0 0 25 0 1 0 636024113 401133568 96460 33554432000 4194304 4409284 140733729159056 18446744073709551615 4226446 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 97933 96460 141 53 0 96356 0
Current children cumulated CPU time (s) 1059.32
Current children cumulated vsize (KiB) 391732

[startup+1060.1 s]
/proc/loadavg: 2.04 2.19 3.16 3/365 17140
/proc/meminfo: memFree=28457664/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=391732 CPUtime=1060.12 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 490803 0 0 0 105888 124 0 0 25 0 1 0 636024113 401133568 96460 33554432000 4194304 4409284 140733729159056 18446744073709551615 4347328 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 97933 96460 141 53 0 96356 0
Current children cumulated CPU time (s) 1060.12
Current children cumulated vsize (KiB) 391732

[startup+1060.5 s]
/proc/loadavg: 2.04 2.19 3.16 3/365 17140
/proc/meminfo: memFree=28457540/32951124 swapFree=51873460/67111528
[pid=17039] ppid=17037 vsize=391732 CPUtime=1060.51 cores=4,6
/proc/17039/stat : 17039 (lingeling) R 17037 17039 16781 0 -1 4202496 490803 0 0 0 105927 124 0 0 25 0 1 0 636024113 401133568 96460 33554432000 4194304 4409284 140733729159056 18446744073709551615 212039679895 0 0 4096 17506 0 0 0 17 4 0 0 0
/proc/17039/statm: 97933 96460 141 53 0 96356 0
Current children cumulated CPU time (s) 1060.51
Current children cumulated vsize (KiB) 391732

Child status: 20
Real time (s): 1060.59
CPU time (s): 1060.62
CPU user time (s): 1059.36
CPU system time (s): 1.26181
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 561696

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1059.36
system time used= 1.26181
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 490806
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4
involuntary context switches= 1547

runsolver used 4.02939 second user time and 8.46871 second system time

The end

Launcher Data 

Begin job on node146 at 2011-05-15 07:07:59
IDJOB=3371889
IDBENCH=88159
IDSOLVER=1849
FILE ID=node146/3371889-1305436074
RUNJOBID= node146-1305434772-16800
PBS_JOBID= 13324698
Free space on /tmp= 72804 MiB

SOLVER NAME= Lingeling 587f (fixed)
BENCH NAME= SAT-Race-2010-CNF/hardware-verification/velev/1dlx_c_iq57_a.cnf
COMMAND LINE= lingeling BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371889-1305436074/watcher-3371889-1305436074 -o /tmp/evaluation-result-3371889-1305436074/solver-3371889-1305436074 -C 2400 -W 1300 -M 7680  lingeling HOME/instance-3371889-1305436074.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 953b9cb99bfd26cff0e1ac65be1241f6
RANDOM SEED=1651592057

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28733816 kB
Buffers:        107172 kB
Cached:        1294048 kB
SwapCached:      56148 kB
Active:        1600068 kB
Inactive:      2368624 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28733816 kB
SwapTotal:    67111528 kB
SwapFree:     51873460 kB
Dirty:          429144 kB
Writeback:           0 kB
AnonPages:     2517688 kB
Mapped:          17744 kB
Slab:           122812 kB
PageTables:      60064 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 82120772 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72928 MiB
End job on node146 at 2011-05-15 07:25:39