Trace number 3362427

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20? (TO) 4800.41 1212.44

General information on the benchmark

NameSAT-Race-2010-CNF/hardware-verification/
velev/1dlx_c_iq60_a.cnf
MD5SUM1e60a63f1ba68b9b3c423ca413b4fa2b
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark802.03
Satisfiable
(Un)Satisfiability was proved
Number of variables651875
Number of clauses9927770
Sum of the clauses size28821360
Maximum clause length195
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 28783867
Number of clauses of size 3839934
Number of clauses of size 410777
Number of clauses of size 570916
Number of clauses of size over 5222275

Solver Data 

0.00/0.00	c Parsing...
0.00/0.00	c num clause = 9927770, num vars = 651875
0.00/0.00	c Exiting...too many clauses

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3362427-1305302589/watcher-3362427-1305302589 -o /tmp/evaluation-result-3362427-1305302589/solver-3362427-1305302589 -C 4800 -W 1300 -M 15500 manysat.sh HOME/instance-3362427-1305302589.cnf aimd 1 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.82 7.36 7.80 5/368 31921
/proc/meminfo: memFree=10425808/32951124 swapFree=65155552/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0

[startup+0.0168731 s]
/proc/loadavg: 5.82 7.36 7.80 5/368 31921
/proc/meminfo: memFree=10425808/32951124 swapFree=65155552/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100876 s]
/proc/loadavg: 5.82 7.36 7.80 5/368 31921
/proc/meminfo: memFree=10425808/32951124 swapFree=65155552/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300819 s]
/proc/loadavg: 5.82 7.36 7.80 5/368 31921
/proc/meminfo: memFree=10425808/32951124 swapFree=65155552/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.89553 s]
/proc/loadavg: 5.82 7.36 7.80 5/368 31921
/proc/meminfo: memFree=10425808/32951124 swapFree=65155552/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.90053 s]
/proc/loadavg: 5.82 7.36 7.80 5/368 31921
/proc/meminfo: memFree=10425808/32951124 swapFree=65155552/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+3.10032 s]
/proc/loadavg: 5.82 7.36 7.80 6/370 31924
/proc/meminfo: memFree=9882040/32951124 swapFree=65155552/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
[pid=31923] ppid=31921 vsize=723328 CPUtime=3.09 cores=0,2,4,6
/proc/31923/stat : 31923 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202496 174100 0 0 0 288 21 0 0 25 0 1 0 622676251 740687872 174055 33554432000 134512640 135305190 4287913968 18446744073709551615 134840070 0 0 4096 3 0 0 0 17 4 0 0 0
/proc/31923/statm: 180832 174060 71 194 0 180636 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 732028

[startup+6.30074 s]
/proc/loadavg: 5.75 7.32 7.78 6/370 31924
/proc/meminfo: memFree=9149664/32951124 swapFree=65155552/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
[pid=31923] ppid=31921 vsize=1474360 CPUtime=6.29 cores=0,2,4,6
/proc/31923/stat : 31923 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202496 351710 0 0 0 583 46 0 0 25 0 1 0 622676251 1509744640 351665 33554432000 134512640 135305190 4287913968 18446744073709551615 134839991 0 0 4096 3 0 0 0 17 4 0 0 0
/proc/31923/statm: 368590 351666 71 194 0 368394 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1483060

[startup+12.7006 s]
/proc/loadavg: 5.69 7.28 7.77 9/373 31927
/proc/meminfo: memFree=8155592/32951124 swapFree=65155552/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
[pid=31923] ppid=31921 vsize=2355156 CPUtime=17.07 cores=0,2,4,6
/proc/31923/stat : 31923 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202496 566162 0 0 0 1610 97 0 0 18 0 4 0 622676251 2411679744 566113 33554432000 134512640 135305190 4287913968 18446744073709551615 134551651 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/31923/statm: 588789 566113 83 194 0 588593 0
[pid=31923/tid=31925] ppid=31921 vsize=2355156 CPUtime=1.46 cores=0,2,4,6
/proc/31923/task/31925/stat : 31925 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 4335 0 0 0 139 7 0 0 19 0 4 0 622677367 2411679744 566113 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31923/tid=31926] ppid=31921 vsize=2355156 CPUtime=1.45 cores=0,2,4,6
/proc/31923/task/31926/stat : 31926 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 3058 0 0 0 139 6 0 0 18 0 4 0 622677367 2411679744 566113 33554432000 134512640 135305190 4287913968 18446744073709551615 134857151 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=31923/tid=31927] ppid=31921 vsize=2355156 CPUtime=1.49 cores=0,2,4,6
/proc/31923/task/31927/stat : 31927 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 4667 0 0 0 146 3 0 0 18 0 4 0 622677367 2411679744 566113 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 17.07
Current children cumulated vsize (KiB) 2363856

[startup+25.5003 s]
/proc/loadavg: 5.83 7.23 7.74 6/370 31956
/proc/meminfo: memFree=7851304/32951124 swapFree=65155552/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
[pid=31923] ppid=31921 vsize=2367004 CPUtime=68.15 cores=0,2,4,6
/proc/31923/stat : 31923 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202496 569334 0 0 0 6715 100 0 0 25 0 4 0 622676251 2423812096 569285 33554432000 134512640 135305190 4287913968 18446744073709551615 134528229 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/31923/statm: 591751 569285 83 194 0 591555 0
[pid=31923/tid=31925] ppid=31921 vsize=2367004 CPUtime=14.26 cores=0,2,4,6
/proc/31923/task/31925/stat : 31925 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 5522 0 0 0 1418 8 0 0 25 0 4 0 622677367 2423812096 569285 33554432000 134512640 135305190 4287913968 18446744073709551615 134528571 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31923/tid=31926] ppid=31921 vsize=2367004 CPUtime=14.1 cores=0,2,4,6
/proc/31923/task/31926/stat : 31926 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 3742 0 0 0 1403 7 0 0 25 0 4 0 622677367 2423812096 569285 33554432000 134512640 135305190 4287913968 18446744073709551615 134528252 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=31923/tid=31927] ppid=31921 vsize=2367004 CPUtime=14.3 cores=0,2,4,6
/proc/31923/task/31927/stat : 31927 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 5328 0 0 0 1426 4 0 0 25 0 4 0 622677367 2423812096 569285 33554432000 134512640 135305190 4287913968 18446744073709551615 134529062 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 68.15
Current children cumulated vsize (KiB) 2375704

[startup+51.1007 s]
/proc/loadavg: 6.06 7.17 7.70 9/373 31960
/proc/meminfo: memFree=7105876/32951124 swapFree=65155552/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
[pid=31923] ppid=31921 vsize=2376160 CPUtime=170.19 cores=0,2,4,6
/proc/31923/stat : 31923 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202496 571547 0 0 0 16917 102 0 0 25 0 4 0 622676251 2433187840 571498 33554432000 134512640 135305190 4287913968 18446744073709551615 134528310 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/31923/statm: 594040 571498 83 194 0 593844 0
[pid=31923/tid=31925] ppid=31921 vsize=2376160 CPUtime=39.86 cores=0,2,4,6
/proc/31923/task/31925/stat : 31925 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 6016 0 0 0 3977 9 0 0 25 0 4 0 622677367 2433187840 571498 33554432000 134512640 135305190 4287913968 18446744073709551615 134530561 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31923/tid=31926] ppid=31921 vsize=2376160 CPUtime=39.39 cores=0,2,4,6
/proc/31923/task/31926/stat : 31926 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 4309 0 0 0 3932 7 0 0 25 0 4 0 622677367 2433187840 571498 33554432000 134512640 135305190 4287913968 18446744073709551615 134528237 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=31923/tid=31927] ppid=31921 vsize=2376160 CPUtime=39.88 cores=0,2,4,6
/proc/31923/task/31927/stat : 31927 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 5897 0 0 0 3984 4 0 0 25 0 4 0 622677367 2433187840 571498 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 170.19
Current children cumulated vsize (KiB) 2384860

[startup+102.301 s]
/proc/loadavg: 7.22 7.31 7.72 9/373 31962
/proc/meminfo: memFree=6740032/32951124 swapFree=65155552/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
[pid=31923] ppid=31921 vsize=2396196 CPUtime=374.37 cores=0,2,4,6
/proc/31923/stat : 31923 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202496 576718 0 0 0 37331 106 0 0 25 0 4 0 622676251 2453704704 576669 33554432000 134512640 135305190 4287913968 18446744073709551615 134528229 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/31923/statm: 599049 576669 83 194 0 598853 0
[pid=31923/tid=31925] ppid=31921 vsize=2396196 CPUtime=91.05 cores=0,2,4,6
/proc/31923/task/31925/stat : 31925 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 7092 0 0 0 9096 9 0 0 25 0 4 0 622677367 2453704704 576669 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31923/tid=31926] ppid=31921 vsize=2396196 CPUtime=89.99 cores=0,2,4,6
/proc/31923/task/31926/stat : 31926 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 6390 0 0 0 8990 9 0 0 25 0 4 0 622677367 2453704704 576669 33554432000 134512640 135305190 4287913968 18446744073709551615 134528536 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=31923/tid=31927] ppid=31921 vsize=2396196 CPUtime=91.06 cores=0,2,4,6
/proc/31923/task/31927/stat : 31927 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 6746 0 0 0 9101 5 0 0 25 0 4 0 622677367 2453704704 576669 33554432000 134512640 135305190 4287913968 18446744073709551615 134528252 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 374.37
Current children cumulated vsize (KiB) 2404896

[startup+162.301 s]
/proc/loadavg: 7.81 7.46 7.75 9/373 31963
/proc/meminfo: memFree=6380128/32951124 swapFree=65155552/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
[pid=31923] ppid=31921 vsize=2442476 CPUtime=613.42 cores=0,2,4,6
/proc/31923/stat : 31923 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202496 588083 0 0 0 61226 116 0 0 25 0 4 0 622676251 2501095424 588034 33554432000 134512640 135305190 4287913968 18446744073709551615 134528229 0 0 4096 3 18446744073709551615 0 0 17 6 0 0 0
/proc/31923/statm: 610619 588034 83 194 0 610423 0
[pid=31923/tid=31925] ppid=31921 vsize=2442476 CPUtime=150.97 cores=0,2,4,6
/proc/31923/task/31925/stat : 31925 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 8478 0 0 0 15086 11 0 0 25 0 4 0 622677367 2501095424 588034 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31923/tid=31926] ppid=31921 vsize=2442476 CPUtime=149.61 cores=0,2,4,6
/proc/31923/task/31926/stat : 31926 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 14193 0 0 0 14946 15 0 0 25 0 4 0 622677367 2501095424 588034 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 0 0 0 0
[pid=31923/tid=31927] ppid=31921 vsize=2442476 CPUtime=151 cores=0,2,4,6
/proc/31923/task/31927/stat : 31927 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 7829 0 0 0 15094 6 0 0 25 0 4 0 622677367 2501095424 588034 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 613.42
Current children cumulated vsize (KiB) 2451176

[startup+222.301 s]
/proc/loadavg: 8.02 7.59 7.77 9/373 31965
/proc/meminfo: memFree=6037516/32951124 swapFree=65155552/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
[pid=31923] ppid=31921 vsize=2528380 CPUtime=852.73 cores=0,2,4,6
/proc/31923/stat : 31923 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202496 609219 0 0 0 85145 128 0 0 25 0 4 0 622676251 2589061120 609170 33554432000 134512640 135305190 4287913968 18446744073709551615 134551651 0 0 4096 3 18446744073709551615 0 0 17 6 0 0 0
/proc/31923/statm: 632095 609170 83 194 0 631899 0
[pid=31923/tid=31925] ppid=31921 vsize=2528380 CPUtime=210.97 cores=0,2,4,6
/proc/31923/task/31925/stat : 31925 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 10083 0 0 0 21085 12 0 0 25 0 4 0 622677367 2589061120 609170 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31923/tid=31926] ppid=31921 vsize=2528380 CPUtime=209.62 cores=0,2,4,6
/proc/31923/task/31926/stat : 31926 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 31492 0 0 0 20937 25 0 0 25 0 4 0 622677367 2589061120 609170 33554432000 134512640 135305190 4287913968 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 0 0 0 0

################
# More data... #
################

/proc/31923/task/31927/stat : 31927 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 11138 0 0 0 75077 9 0 0 25 0 4 0 622677367 3278614528 777528 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3005.71
Current children cumulated vsize (KiB) 3210472

[startup+822.301 s]
/proc/loadavg: 8.19 8.05 7.92 9/373 31981
/proc/meminfo: memFree=3077932/32951124 swapFree=65155552/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
[pid=31923] ppid=31921 vsize=3240036 CPUtime=3244.98 cores=0,2,4,6
/proc/31923/stat : 31923 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202496 787027 0 0 0 324271 227 0 0 25 0 4 0 622676251 3317796864 786978 33554432000 134512640 135305190 4287913968 18446744073709551615 134528406 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/31923/statm: 810009 786978 83 194 0 809813 0
[pid=31923/tid=31925] ppid=31921 vsize=3240036 CPUtime=807.34 cores=0,2,4,6
/proc/31923/task/31925/stat : 31925 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 18761 0 0 0 80715 19 0 0 25 0 4 0 622677367 3317796864 786978 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=31923/tid=31926] ppid=31921 vsize=3240036 CPUtime=805.8 cores=0,2,4,6
/proc/31923/task/31926/stat : 31926 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 187234 0 0 0 80477 103 0 0 25 0 4 0 622677367 3317796864 786978 33554432000 134512640 135305190 4287913968 18446744073709551615 134530636 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31923/tid=31927] ppid=31921 vsize=3240036 CPUtime=810.86 cores=0,2,4,6
/proc/31923/task/31927/stat : 31927 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 11305 0 0 0 81077 9 0 0 25 0 4 0 622677367 3317796864 786978 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3244.98
Current children cumulated vsize (KiB) 3248736

[startup+882.301 s]
/proc/loadavg: 7.99 8.06 7.93 5/364 32002
/proc/meminfo: memFree=8685468/32951124 swapFree=65051360/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
[pid=31923] ppid=31921 vsize=3260028 CPUtime=3484.05 cores=0,2,4,6
/proc/31923/stat : 31923 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202496 792084 0 0 0 348128 277 0 0 25 0 4 0 622676251 3338268672 792035 33554432000 134512640 135305190 4287913968 18446744073709551615 134530649 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/31923/statm: 815007 792035 83 194 0 814811 0
[pid=31923/tid=31925] ppid=31921 vsize=3260028 CPUtime=867.06 cores=0,2,4,6
/proc/31923/task/31925/stat : 31925 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 19700 0 0 0 86685 21 0 0 25 0 4 0 622677367 3338268672 792035 33554432000 134512640 135305190 4287913968 18446744073709551615 134528252 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31923/tid=31926] ppid=31921 vsize=3260028 CPUtime=865.16 cores=0,2,4,6
/proc/31923/task/31926/stat : 31926 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 190036 0 0 0 86409 107 0 0 25 0 4 0 622677367 3338268672 792035 33554432000 134512640 135305190 4287913968 18446744073709551615 134528252 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=31923/tid=31927] ppid=31921 vsize=3260028 CPUtime=870.87 cores=0,2,4,6
/proc/31923/task/31927/stat : 31927 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 11459 0 0 0 87035 52 0 0 25 0 4 0 622677367 3338268672 792035 33554432000 134512640 135305190 4287913968 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3484.05
Current children cumulated vsize (KiB) 3268728

[startup+942.3 s]
/proc/loadavg: 5.47 7.32 7.68 5/363 32003
/proc/meminfo: memFree=8666468/32951124 swapFree=65051360/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
[pid=31923] ppid=31921 vsize=3287420 CPUtime=3723.34 cores=0,2,4,6
/proc/31923/stat : 31923 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202496 798840 0 0 0 372050 284 0 0 25 0 4 0 622676251 3366318080 798791 33554432000 134512640 135305190 4287913968 18446744073709551615 134530561 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/31923/statm: 821855 798791 83 194 0 821659 0
[pid=31923/tid=31925] ppid=31921 vsize=3287420 CPUtime=927.05 cores=0,2,4,6
/proc/31923/task/31925/stat : 31925 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 20472 0 0 0 92683 22 0 0 25 0 4 0 622677367 3366318080 798791 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31923/tid=31926] ppid=31921 vsize=3287420 CPUtime=924.44 cores=0,2,4,6
/proc/31923/task/31926/stat : 31926 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 194849 0 0 0 92332 112 0 0 25 0 4 0 622677367 3366318080 798791 33554432000 134512640 135305190 4287913968 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=31923/tid=31927] ppid=31921 vsize=3287420 CPUtime=930.86 cores=0,2,4,6
/proc/31923/task/31927/stat : 31927 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 11584 0 0 0 93034 52 0 0 25 0 4 0 622677367 3366318080 798791 33554432000 134512640 135305190 4287913968 18446744073709551615 134528310 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3723.34
Current children cumulated vsize (KiB) 3296120

[startup+1002.3 s]
/proc/loadavg: 4.60 6.73 7.45 5/363 32005
/proc/meminfo: memFree=8636440/32951124 swapFree=65051360/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
[pid=31923] ppid=31921 vsize=3317520 CPUtime=3962.6 cores=0,2,4,6
/proc/31923/stat : 31923 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202496 806277 0 0 0 395965 295 0 0 25 0 4 0 622676251 3397140480 806228 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/31923/statm: 829380 806228 83 194 0 829184 0
[pid=31923/tid=31925] ppid=31921 vsize=3317520 CPUtime=987.02 cores=0,2,4,6
/proc/31923/task/31925/stat : 31925 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 21637 0 0 0 98677 25 0 0 25 0 4 0 622677367 3397140480 806228 33554432000 134512640 135305190 4287913968 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31923/tid=31926] ppid=31921 vsize=3317520 CPUtime=983.75 cores=0,2,4,6
/proc/31923/task/31926/stat : 31926 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 199422 0 0 0 98255 120 0 0 25 0 4 0 622677367 3397140480 806228 33554432000 134512640 135305190 4287913968 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=31923/tid=31927] ppid=31921 vsize=3317520 CPUtime=990.87 cores=0,2,4,6
/proc/31923/task/31927/stat : 31927 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 11796 0 0 0 99035 52 0 0 25 0 4 0 622677367 3397140480 806228 33554432000 134512640 135305190 4287913968 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3962.6
Current children cumulated vsize (KiB) 3326220

[startup+1062.3 s]
/proc/loadavg: 4.22 6.23 7.23 5/363 32006
/proc/meminfo: memFree=8592028/32951124 swapFree=65051360/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
[pid=31923] ppid=31921 vsize=3362732 CPUtime=4201.86 cores=0,2,4,6
/proc/31923/stat : 31923 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202496 817480 0 0 0 419873 313 0 0 25 0 4 0 622676251 3443437568 817431 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/31923/statm: 840683 817431 83 194 0 840487 0
[pid=31923/tid=31925] ppid=31921 vsize=3362732 CPUtime=1047 cores=0,2,4,6
/proc/31923/task/31925/stat : 31925 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 23080 0 0 0 104673 27 0 0 25 0 4 0 622677367 3443437568 817431 33554432000 134512640 135305190 4287913968 18446744073709551615 134541741 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31923/tid=31926] ppid=31921 vsize=3362732 CPUtime=1043.03 cores=0,2,4,6
/proc/31923/task/31926/stat : 31926 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 207330 0 0 0 104170 133 0 0 25 0 4 0 622677367 3443437568 817431 33554432000 134512640 135305190 4287913968 18446744073709551615 134530615 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=31923/tid=31927] ppid=31921 vsize=3362732 CPUtime=1050.87 cores=0,2,4,6
/proc/31923/task/31927/stat : 31927 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 11964 0 0 0 105034 53 0 0 25 0 4 0 622677367 3443437568 817431 33554432000 134512640 135305190 4287913968 18446744073709551615 134528539 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4201.86
Current children cumulated vsize (KiB) 3371432

[startup+1122.31 s]
/proc/loadavg: 4.13 5.84 7.03 5/363 32008
/proc/meminfo: memFree=8565232/32951124 swapFree=65051360/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
[pid=31923] ppid=31921 vsize=3390028 CPUtime=4441.04 cores=0,2,4,6
/proc/31923/stat : 31923 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202496 824074 0 0 0 443778 326 0 0 25 0 4 0 622676251 3471388672 824025 33554432000 134512640 135305190 4287913968 18446744073709551615 134528189 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/31923/statm: 847507 824025 83 194 0 847311 0
[pid=31923/tid=31925] ppid=31921 vsize=3390028 CPUtime=1106.95 cores=0,2,4,6
/proc/31923/task/31925/stat : 31925 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 23838 0 0 0 110666 29 0 0 25 0 4 0 622677367 3471388672 824025 33554432000 134512640 135305190 4287913968 18446744073709551615 134528626 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31923/tid=31926] ppid=31921 vsize=3390028 CPUtime=1102.33 cores=0,2,4,6
/proc/31923/task/31926/stat : 31926 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 212261 0 0 0 110091 142 0 0 25 0 4 0 622677367 3471388672 824025 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=31923/tid=31927] ppid=31921 vsize=3390028 CPUtime=1110.85 cores=0,2,4,6
/proc/31923/task/31927/stat : 31927 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 12110 0 0 0 111032 53 0 0 25 0 4 0 622677367 3471388672 824025 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4441.04
Current children cumulated vsize (KiB) 3398728

[startup+1182.3 s]
/proc/loadavg: 4.05 5.50 6.84 5/363 32010
/proc/meminfo: memFree=8539168/32951124 swapFree=65051360/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
[pid=31923] ppid=31921 vsize=3417812 CPUtime=4680.28 cores=0,2,4,6
/proc/31923/stat : 31923 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202496 830683 0 0 0 467695 333 0 0 25 0 4 0 622676251 3499839488 830634 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/31923/statm: 854453 830634 83 194 0 854257 0
[pid=31923/tid=31925] ppid=31921 vsize=3417812 CPUtime=1166.95 cores=0,2,4,6
/proc/31923/task/31925/stat : 31925 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 24607 0 0 0 116665 30 0 0 25 0 4 0 622677367 3499839488 830634 33554432000 134512640 135305190 4287913968 18446744073709551615 134528480 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31923/tid=31926] ppid=31921 vsize=3417812 CPUtime=1161.62 cores=0,2,4,6
/proc/31923/task/31926/stat : 31926 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 217598 0 0 0 116013 149 0 0 25 0 4 0 622677367 3499839488 830634 33554432000 134512640 135305190 4287913968 18446744073709551615 134551712 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=31923/tid=31927] ppid=31921 vsize=3417812 CPUtime=1170.83 cores=0,2,4,6
/proc/31923/task/31927/stat : 31927 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 12230 0 0 0 117030 53 0 0 25 0 4 0 622677367 3499839488 830634 33554432000 134512640 135305190 4287913968 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4680.28
Current children cumulated vsize (KiB) 3426512



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1212.4 s]
/proc/loadavg: 4.10 5.37 6.75 6/363 32010
/proc/meminfo: memFree=8514236/32951124 swapFree=65051360/67111528
[pid=31921] ppid=31919 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/31921/stat : 31921 (manysat.sh) S 31919 31921 31066 0 -1 4202496 354 107 0 0 0 0 0 0 22 0 1 0 622676250 8908800 251 33554432000 4194304 4922060 140737073351568 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/31921/statm: 2175 251 209 178 0 68 0
[pid=31923] ppid=31921 vsize=3442332 CPUtime=4800.41 cores=0,2,4,6
/proc/31923/stat : 31923 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202496 836693 0 0 0 479701 340 0 0 25 0 4 0 622676251 3524947968 836644 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 0 0 0 0
/proc/31923/statm: 860583 836644 83 194 0 860387 0
[pid=31923/tid=31925] ppid=31921 vsize=3442332 CPUtime=1197.07 cores=0,2,4,6
/proc/31923/task/31925/stat : 31925 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 25748 0 0 0 119676 31 0 0 25 0 4 0 622677367 3524947968 836644 33554432000 134512640 135305190 4287913968 18446744073709551615 134529138 0 0 4096 3 0 0 0 -1 4 0 0 0
[pid=31923/tid=31926] ppid=31921 vsize=3442332 CPUtime=1191.37 cores=0,2,4,6
/proc/31923/task/31926/stat : 31926 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 222006 0 0 0 118983 154 0 0 25 0 4 0 622677367 3524947968 836644 33554432000 134512640 135305190 4287913968 18446744073709551615 134551668 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=31923/tid=31927] ppid=31921 vsize=3442332 CPUtime=1200.96 cores=0,2,4,6
/proc/31923/task/31927/stat : 31927 (manysat1.1_stat) R 31921 31921 31066 0 -1 4202560 12401 0 0 0 120042 54 0 0 25 0 4 0 622677367 3524947968 836644 33554432000 134512640 135305190 4287913968 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.41
Current children cumulated vsize (KiB) 3451032

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31921 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 4800.41
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1212.44
CPU time (s): 4800.41
CPU user time (s): 4797.01
CPU system time (s): 3.4
CPU usage (%): 395.93
Max. virtual memory (cumulated for all children) (KiB): 3451032

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.000999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 461
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 5

runsolver used 4.19936 second user time and 10.1395 second system time

The end

Launcher Data 

Begin job on node146 at 2011-05-13 18:03:20
IDJOB=3362427
IDBENCH=88158
IDSOLVER=1838
FILE ID=node146/3362427-1305302589
RUNJOBID= node146-1305296390-31085
PBS_JOBID= 13321407
Free space on /tmp= 41184 MiB

SOLVER NAME= ManySAT 1.1 aimd 1/2009-03-20 (4 threads)
BENCH NAME= SAT-Race-2010-CNF/hardware-verification/velev/1dlx_c_iq60_a.cnf
COMMAND LINE= manysat.sh BENCHNAME aimd 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3362427-1305302589/watcher-3362427-1305302589 -o /tmp/evaluation-result-3362427-1305302589/solver-3362427-1305302589 -C 4800 -W 1300 -M 15500  manysat.sh HOME/instance-3362427-1305302589.cnf aimd 1

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1e60a63f1ba68b9b3c423ca413b4fa2b
RANDOM SEED=1134672052

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      10426088 kB
Buffers:        222080 kB
Cached:        6326148 kB
SwapCached:       9684 kB
Active:       11813852 kB
Inactive:     10360720 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      10426088 kB
SwapTotal:    67111528 kB
SwapFree:     65155552 kB
Dirty:          240204 kB
Writeback:           0 kB
AnonPages:    15623960 kB
Mapped:          22884 kB
Slab:           226044 kB
PageTables:      59264 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 81950680 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 41192 MiB
End job on node146 at 2011-05-13 18:23:34