Trace number 3362162

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SAT09 reference solver: ManySAT 1.1 aimd 1/2009-03-20? (TO) 20395.4 5100.02

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf
MD5SUMee159af2e208d290f7f3fefd15c344f2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark630.529
Satisfiable
(Un)Satisfiability was proved
Number of variables44692
Number of clauses129620
Sum of the clauses size302444
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 286412
Number of clauses of size 343206
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Parsing...
0.00/0.06	c ==============================================================================
0.00/0.06	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.06	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.06	c ==============================================================================
0.00/0.06	c |         0 |  129618   302442 |   38885       0        0     nan |  0.000 % |
0.00/0.43	c |         0 |   68921   217805 |      --       0       --      -- |     --   | -60695/-84632
0.00/0.43	c ==============================================================================
0.00/0.43	c Result  :   #vars: 13945   #clauses: 68921   #literals: 217805
0.00/0.43	c CPU time:   0.420936 s
0.00/0.43	c ==============================================================================

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3362162-1305300181/watcher-3362162-1305300181 -o /tmp/evaluation-result-3362162-1305300181/solver-3362162-1305300181 -C 40000 -W 5100 -M 31000 manysat.sh HOME/instance-3362162-1305300181.cnf aimd 1 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.99 3.83 3.75 1/329 25094
/proc/meminfo: memFree=8476760/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 329 0 0 0 0 0 0 0 21 0 1 0 641619066 8908800 250 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 250 209 178 0 68 0

[startup+0.0953421 s]
/proc/loadavg: 3.99 3.83 3.75 1/329 25094
/proc/meminfo: memFree=8476760/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 329 0 0 0 0 0 0 0 21 0 1 0 641619066 8908800 250 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.10034 s]
/proc/loadavg: 3.99 3.83 3.75 1/329 25094
/proc/meminfo: memFree=8476760/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 329 0 0 0 0 0 0 0 21 0 1 0 641619066 8908800 250 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300325 s]
/proc/loadavg: 3.99 3.83 3.75 1/329 25094
/proc/meminfo: memFree=8476760/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 329 0 0 0 0 0 0 0 21 0 1 0 641619066 8908800 250 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700197 s]
/proc/loadavg: 3.99 3.83 3.75 1/329 25094
/proc/meminfo: memFree=8476760/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
Current children cumulated CPU time (s) 0.47
Current children cumulated vsize (KiB) 8700

[startup+1.50105 s]
/proc/loadavg: 3.99 3.83 3.75 5/334 25100
/proc/meminfo: memFree=8445720/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
[pid=25097] ppid=25094 vsize=65060 CPUtime=3.67 cores=0-7
/proc/25097/stat : 25097 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202496 7776 0 0 0 359 8 0 0 18 0 4 0 641619115 66621440 7731 33554432000 134512640 135305190 4293885344 18446744073709551615 134846358 0 0 4096 3 18446744073709551615 0 0 17 7 0 0 0
/proc/25097/statm: 16265 7731 84 194 0 16069 0
[pid=25097/tid=25098] ppid=25094 vsize=65060 CPUtime=0.87 cores=0-7
/proc/25097/task/25098/stat : 25098 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 547 0 0 0 87 0 0 0 18 0 4 0 641619124 66621440 7731 33554432000 134512640 135305190 4293885344 18446744073709551615 134557821 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=25097/tid=25099] ppid=25094 vsize=65060 CPUtime=0.88 cores=0-7
/proc/25097/task/25099/stat : 25099 (manysat1.1_stat) S 25094 25094 24661 0 -1 4202560 836 0 0 0 86 2 0 0 18 0 4 0 641619124 66621440 7731 33554432000 134512640 135305190 4293885344 18446744073709551615 134694990 0 0 4096 3 18446604469090390208 0 0 -1 5 0 0 0
[pid=25097/tid=25100] ppid=25094 vsize=65060 CPUtime=0.9 cores=0-7
/proc/25097/task/25100/stat : 25100 (manysat1.1_stat) S 25094 25094 24661 0 -1 4202560 551 0 0 0 88 2 0 0 17 0 4 0 641619124 66621440 7731 33554432000 134512640 135305190 4293885344 18446744073709551615 134694990 0 0 4096 3 18446604469090390208 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.14
Current children cumulated vsize (KiB) 73760

[startup+3.10077 s]
/proc/loadavg: 3.99 3.83 3.75 5/334 25100
/proc/meminfo: memFree=8436668/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
[pid=25097] ppid=25094 vsize=77836 CPUtime=10.03 cores=0-7
/proc/25097/stat : 25097 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202496 10820 0 0 0 993 10 0 0 18 0 4 0 641619115 79704064 10775 33554432000 134512640 135305190 4293885344 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 7 0 0 0
/proc/25097/statm: 19459 10775 84 194 0 19263 0
[pid=25097/tid=25098] ppid=25094 vsize=77836 CPUtime=2.47 cores=0-7
/proc/25097/task/25098/stat : 25098 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 982 0 0 0 246 1 0 0 18 0 4 0 641619124 79704064 10775 33554432000 134512640 135305190 4293885344 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=25097/tid=25099] ppid=25094 vsize=77836 CPUtime=2.48 cores=0-7
/proc/25097/task/25099/stat : 25099 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 1878 0 0 0 246 2 0 0 18 0 4 0 641619124 79704064 10775 33554432000 134512640 135305190 4293885344 18446744073709551615 134528289 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=25097/tid=25100] ppid=25094 vsize=77836 CPUtime=2.49 cores=0-7
/proc/25097/task/25100/stat : 25100 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 1307 0 0 0 246 3 0 0 19 0 4 0 641619124 79704064 10775 33554432000 134512640 135305190 4293885344 18446744073709551615 134528480 0 0 4096 3 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 10.5
Current children cumulated vsize (KiB) 86536

[startup+6.30124 s]
/proc/loadavg: 3.99 3.83 3.75 5/334 25100
/proc/meminfo: memFree=8419556/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
[pid=25097] ppid=25094 vsize=91636 CPUtime=22.78 cores=0-7
/proc/25097/stat : 25097 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202496 14237 0 0 0 2265 13 0 0 18 0 4 0 641619115 93835264 14192 33554432000 134512640 135305190 4293885344 18446744073709551615 134528399 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/25097/statm: 22909 14192 84 194 0 22713 0
[pid=25097/tid=25098] ppid=25094 vsize=91636 CPUtime=5.66 cores=0-7
/proc/25097/task/25098/stat : 25098 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 1551 0 0 0 564 2 0 0 18 0 4 0 641619124 93835264 14192 33554432000 134512640 135305190 4293885344 18446744073709551615 134695249 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=25097/tid=25099] ppid=25094 vsize=91636 CPUtime=5.68 cores=0-7
/proc/25097/task/25099/stat : 25099 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 2950 0 0 0 565 3 0 0 18 0 4 0 641619124 93835264 14192 33554432000 134512640 135305190 4293885344 18446744073709551615 134528157 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=25097/tid=25100] ppid=25094 vsize=91636 CPUtime=5.69 cores=0-7
/proc/25097/task/25100/stat : 25100 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 2083 0 0 0 566 3 0 0 25 0 4 0 641619124 93835264 14192 33554432000 134512640 135305190 4293885344 18446744073709551615 134695249 0 0 4096 3 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 23.25
Current children cumulated vsize (KiB) 100336

[startup+12.7011 s]
/proc/loadavg: 3.99 3.84 3.75 5/334 25100
/proc/meminfo: memFree=8401084/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
[pid=25097] ppid=25094 vsize=111468 CPUtime=48.37 cores=0-7
/proc/25097/stat : 25097 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202496 19132 0 0 0 4820 17 0 0 18 0 4 0 641619115 114143232 19087 33554432000 134512640 135305190 4293885344 18446744073709551615 134528252 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/25097/statm: 27867 19087 84 194 0 27671 0
[pid=25097/tid=25098] ppid=25094 vsize=111468 CPUtime=12.05 cores=0-7
/proc/25097/task/25098/stat : 25098 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 2254 0 0 0 1202 3 0 0 18 0 4 0 641619124 114143232 19087 33554432000 134512640 135305190 4293885344 18446744073709551615 134558374 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=25097/tid=25099] ppid=25094 vsize=111468 CPUtime=12.07 cores=0-7
/proc/25097/task/25099/stat : 25099 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 4722 0 0 0 1203 4 0 0 18 0 4 0 641619124 114143232 19087 33554432000 134512640 135305190 4293885344 18446744073709551615 134551978 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=25097/tid=25100] ppid=25094 vsize=111468 CPUtime=12.08 cores=0-7
/proc/25097/task/25100/stat : 25100 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 3245 0 0 0 1204 4 0 0 25 0 4 0 641619124 114143232 19087 33554432000 134512640 135305190 4293885344 18446744073709551615 134528747 0 0 4096 3 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 48.84
Current children cumulated vsize (KiB) 120168

[startup+25.5008 s]
/proc/loadavg: 3.99 3.84 3.76 5/334 25101
/proc/meminfo: memFree=8377580/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
[pid=25097] ppid=25094 vsize=130240 CPUtime=99.53 cores=0-7
/proc/25097/stat : 25097 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202496 24153 0 0 0 9932 21 0 0 18 0 4 0 641619115 133365760 24108 33554432000 134512640 135305190 4293885344 18446744073709551615 134528415 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/25097/statm: 32560 24108 84 194 0 32364 0
[pid=25097/tid=25098] ppid=25094 vsize=130240 CPUtime=24.84 cores=0-7
/proc/25097/task/25098/stat : 25098 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 3029 0 0 0 2480 4 0 0 19 0 4 0 641619124 133365760 24108 33554432000 134512640 135305190 4293885344 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=25097/tid=25099] ppid=25094 vsize=130240 CPUtime=24.86 cores=0-7
/proc/25097/task/25099/stat : 25099 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 6430 0 0 0 2481 5 0 0 18 0 4 0 641619124 133365760 24108 33554432000 134512640 135305190 4293885344 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=25097/tid=25100] ppid=25094 vsize=130240 CPUtime=24.88 cores=0-7
/proc/25097/task/25100/stat : 25100 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 4335 0 0 0 2483 5 0 0 25 0 4 0 641619124 133365760 24108 33554432000 134512640 135305190 4293885344 18446744073709551615 134556572 0 0 4096 3 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 100
Current children cumulated vsize (KiB) 138940

[startup+51.1003 s]
/proc/loadavg: 4.14 3.89 3.77 5/334 25101
/proc/meminfo: memFree=8339908/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
[pid=25097] ppid=25094 vsize=169020 CPUtime=201.86 cores=0-7
/proc/25097/stat : 25097 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202496 33606 0 0 0 20158 28 0 0 20 0 4 0 641619115 173076480 33561 33554432000 134512640 135305190 4293885344 18446744073709551615 134529134 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/25097/statm: 42255 33561 84 194 0 42059 0
[pid=25097/tid=25098] ppid=25094 vsize=169020 CPUtime=50.42 cores=0-7
/proc/25097/task/25098/stat : 25098 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 5089 0 0 0 5035 7 0 0 19 0 4 0 641619124 173076480 33561 33554432000 134512640 135305190 4293885344 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=25097/tid=25099] ppid=25094 vsize=169020 CPUtime=50.46 cores=0-7
/proc/25097/task/25099/stat : 25099 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 8986 0 0 0 5039 7 0 0 21 0 4 0 641619124 173076480 33561 33554432000 134512640 135305190 4293885344 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=25097/tid=25100] ppid=25094 vsize=169020 CPUtime=50.47 cores=0-7
/proc/25097/task/25100/stat : 25100 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 6727 0 0 0 5040 7 0 0 25 0 4 0 641619124 173076480 33561 33554432000 134512640 135305190 4293885344 18446744073709551615 134528548 0 0 4096 3 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 202.33
Current children cumulated vsize (KiB) 177720

[startup+102.312 s]
/proc/loadavg: 4.14 3.92 3.79 5/334 25103
/proc/meminfo: memFree=8297124/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
[pid=25097] ppid=25094 vsize=211492 CPUtime=406.62 cores=0-7
/proc/25097/stat : 25097 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202496 44166 0 0 0 40618 44 0 0 18 0 4 0 641619115 216567808 44121 33554432000 134512640 135305190 4293885344 18446744073709551615 134557821 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/25097/statm: 52873 44121 84 194 0 52677 0
[pid=25097/tid=25098] ppid=25094 vsize=211492 CPUtime=101.61 cores=0-7
/proc/25097/task/25098/stat : 25098 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 7367 0 0 0 10150 11 0 0 25 0 4 0 641619124 216567808 44121 33554432000 134512640 135305190 4293885344 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=25097/tid=25099] ppid=25094 vsize=211492 CPUtime=101.65 cores=0-7
/proc/25097/task/25099/stat : 25099 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 12138 0 0 0 10156 9 0 0 19 0 4 0 641619124 216567808 44121 33554432000 134512640 135305190 4293885344 18446744073709551615 134528559 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=25097/tid=25100] ppid=25094 vsize=211492 CPUtime=101.66 cores=0-7
/proc/25097/task/25100/stat : 25100 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 9493 0 0 0 10153 13 0 0 25 0 4 0 641619124 216567808 44121 33554432000 134512640 135305190 4293885344 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 407.09
Current children cumulated vsize (KiB) 220192

[startup+162.301 s]
/proc/loadavg: 4.05 3.93 3.80 5/334 25104
/proc/meminfo: memFree=8268460/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
[pid=25097] ppid=25094 vsize=242192 CPUtime=646.47 cores=0-7
/proc/25097/stat : 25097 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202496 51365 0 0 0 64593 54 0 0 18 0 4 0 641619115 248004608 51320 33554432000 134512640 135305190 4293885344 18446744073709551615 134557493 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/25097/statm: 60548 51320 84 194 0 60352 0
[pid=25097/tid=25098] ppid=25094 vsize=242192 CPUtime=161.58 cores=0-7

################
# More data... #
################

/proc/25097/task/25100/stat : 25100 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 56002 0 0 0 465998 109 0 0 25 0 4 0 641619124 1332248576 307333 33554432000 134512640 135305190 4293885344 18446744073709551615 134528252 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 18644.6
Current children cumulated vsize (KiB) 1309724

[startup+4722.31 s]
/proc/loadavg: 4.00 4.00 3.96 5/334 25238
/proc/meminfo: memFree=7240848/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
[pid=25097] ppid=25094 vsize=1302416 CPUtime=18884.2 cores=0-7
/proc/25097/stat : 25097 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202496 307591 0 0 0 1887952 466 0 0 20 0 4 0 641619115 1333673984 307524 33554432000 134512640 135305190 4293885344 18446744073709551615 134528571 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/25097/statm: 325604 307524 84 194 0 325408 0
[pid=25097/tid=25098] ppid=25094 vsize=1302416 CPUtime=4721.01 cores=0-7
/proc/25097/task/25098/stat : 25098 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 57747 0 0 0 471999 102 0 0 25 0 4 0 641619124 1333673984 307524 33554432000 134512640 135305190 4293885344 18446744073709551615 134528237 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=25097/tid=25099] ppid=25094 vsize=1302416 CPUtime=4720.83 cores=0-7
/proc/25097/task/25099/stat : 25099 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 121178 0 0 0 471928 155 0 0 18 0 4 0 641619124 1333673984 307524 33554432000 134512640 135305190 4293885344 18446744073709551615 134551697 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=25097/tid=25100] ppid=25094 vsize=1302416 CPUtime=4721.08 cores=0-7
/proc/25097/task/25100/stat : 25100 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 56002 0 0 0 471999 109 0 0 25 0 4 0 641619124 1333673984 307524 33554432000 134512640 135305190 4293885344 18446744073709551615 134528503 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 18884.7
Current children cumulated vsize (KiB) 1311116

[startup+4782.3 s]
/proc/loadavg: 4.00 4.00 3.96 5/334 25240
/proc/meminfo: memFree=7235496/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
[pid=25097] ppid=25094 vsize=1307152 CPUtime=19124.2 cores=0-7
/proc/25097/stat : 25097 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202496 308961 0 0 0 1911944 471 0 0 25 0 4 0 641619115 1338523648 308894 33554432000 134512640 135305190 4293885344 18446744073709551615 134528252 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/25097/statm: 326788 308894 84 194 0 326592 0
[pid=25097/tid=25098] ppid=25094 vsize=1307152 CPUtime=4781 cores=0-7
/proc/25097/task/25098/stat : 25098 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 57764 0 0 0 477998 102 0 0 25 0 4 0 641619124 1338523648 308894 33554432000 134512640 135305190 4293885344 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=25097/tid=25099] ppid=25094 vsize=1307152 CPUtime=4780.82 cores=0-7
/proc/25097/task/25099/stat : 25099 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 121781 0 0 0 477925 157 0 0 25 0 4 0 641619124 1338523648 308894 33554432000 134512640 135305190 4293885344 18446744073709551615 134553411 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=25097/tid=25100] ppid=25094 vsize=1307152 CPUtime=4781.07 cores=0-7
/proc/25097/task/25100/stat : 25100 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 56464 0 0 0 477996 111 0 0 25 0 4 0 641619124 1338523648 308894 33554432000 134512640 135305190 4293885344 18446744073709551615 134528872 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 19124.6
Current children cumulated vsize (KiB) 1315852

[startup+4842.3 s]
/proc/loadavg: 4.00 4.00 3.96 5/334 25241
/proc/meminfo: memFree=7230636/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
[pid=25097] ppid=25094 vsize=1311944 CPUtime=19364.1 cores=0-7
/proc/25097/stat : 25097 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202496 310118 0 0 0 1935940 474 0 0 25 0 4 0 641619115 1343430656 310051 33554432000 134512640 135305190 4293885344 18446744073709551615 134528256 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/25097/statm: 327986 310051 84 194 0 327790 0
[pid=25097/tid=25098] ppid=25094 vsize=1311944 CPUtime=4841 cores=0-7
/proc/25097/task/25098/stat : 25098 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 57876 0 0 0 483998 102 0 0 25 0 4 0 641619124 1343430656 310051 33554432000 134512640 135305190 4293885344 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=25097/tid=25099] ppid=25094 vsize=1311944 CPUtime=4840.81 cores=0-7
/proc/25097/task/25099/stat : 25099 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 122092 0 0 0 483923 158 0 0 25 0 4 0 641619124 1343430656 310051 33554432000 134512640 135305190 4293885344 18446744073709551615 134551959 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=25097/tid=25100] ppid=25094 vsize=1311944 CPUtime=4841.07 cores=0-7
/proc/25097/task/25100/stat : 25100 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 56872 0 0 0 483995 112 0 0 25 0 4 0 641619124 1343430656 310051 33554432000 134512640 135305190 4293885344 18446744073709551615 134528503 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 19364.6
Current children cumulated vsize (KiB) 1320644

[startup+4902.3 s]
/proc/loadavg: 4.00 4.00 3.96 5/334 25243
/proc/meminfo: memFree=7222804/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
[pid=25097] ppid=25094 vsize=1320624 CPUtime=19604.1 cores=0-7
/proc/25097/stat : 25097 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202496 312132 0 0 0 1959936 478 0 0 25 0 4 0 641619115 1352318976 312065 33554432000 134512640 135305190 4293885344 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/25097/statm: 330156 312065 84 194 0 329960 0
[pid=25097/tid=25098] ppid=25094 vsize=1320624 CPUtime=4901.01 cores=0-7
/proc/25097/task/25098/stat : 25098 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 57954 0 0 0 489998 103 0 0 25 0 4 0 641619124 1352318976 312065 33554432000 134512640 135305190 4293885344 18446744073709551615 134551651 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=25097/tid=25099] ppid=25094 vsize=1320624 CPUtime=4900.82 cores=0-7
/proc/25097/task/25099/stat : 25099 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 123373 0 0 0 489922 160 0 0 18 0 4 0 641619124 1352318976 312065 33554432000 134512640 135305190 4293885344 18446744073709551615 134538309 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=25097/tid=25100] ppid=25094 vsize=1320624 CPUtime=4901.07 cores=0-7
/proc/25097/task/25100/stat : 25100 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 57142 0 0 0 489995 112 0 0 25 0 4 0 641619124 1352318976 312065 33554432000 134512640 135305190 4293885344 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 19604.6
Current children cumulated vsize (KiB) 1329324

[startup+4962.3 s]
/proc/loadavg: 4.00 4.00 3.96 5/334 25244
/proc/meminfo: memFree=7216832/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
[pid=25097] ppid=25094 vsize=1326644 CPUtime=19844.1 cores=0-7
/proc/25097/stat : 25097 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202496 313621 0 0 0 1983930 483 0 0 25 0 4 0 641619115 1358483456 313554 33554432000 134512640 135305190 4293885344 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/25097/statm: 331661 313554 84 194 0 331465 0
[pid=25097/tid=25098] ppid=25094 vsize=1326644 CPUtime=4961 cores=0-7
/proc/25097/task/25098/stat : 25098 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 58192 0 0 0 495997 103 0 0 25 0 4 0 641619124 1358483456 313554 33554432000 134512640 135305190 4293885344 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=25097/tid=25099] ppid=25094 vsize=1326644 CPUtime=4960.81 cores=0-7
/proc/25097/task/25099/stat : 25099 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 123563 0 0 0 495920 161 0 0 25 0 4 0 641619124 1358483456 313554 33554432000 134512640 135305190 4293885344 18446744073709551615 134551668 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=25097/tid=25100] ppid=25094 vsize=1326644 CPUtime=4961.07 cores=0-7
/proc/25097/task/25100/stat : 25100 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 57952 0 0 0 495992 115 0 0 25 0 4 0 641619124 1358483456 313554 33554432000 134512640 135305190 4293885344 18446744073709551615 134528559 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 19844.6
Current children cumulated vsize (KiB) 1335344

[startup+5022.3 s]
/proc/loadavg: 4.00 4.00 3.96 5/334 25246
/proc/meminfo: memFree=7195716/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
[pid=25097] ppid=25094 vsize=1346088 CPUtime=20084.1 cores=0-7
/proc/25097/stat : 25097 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202496 318857 0 0 0 2007919 494 0 0 25 0 4 0 641619115 1378394112 318790 33554432000 134512640 135305190 4293885344 18446744073709551615 134528229 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/25097/statm: 336522 318790 84 194 0 336326 0
[pid=25097/tid=25098] ppid=25094 vsize=1346088 CPUtime=5021.01 cores=0-7
/proc/25097/task/25098/stat : 25098 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 58856 0 0 0 501996 105 0 0 25 0 4 0 641619124 1378394112 318790 33554432000 134512640 135305190 4293885344 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=25097/tid=25099] ppid=25094 vsize=1346088 CPUtime=5020.79 cores=0-7
/proc/25097/task/25099/stat : 25099 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 126643 0 0 0 501913 166 0 0 25 0 4 0 641619124 1378394112 318790 33554432000 134512640 135305190 4293885344 18446744073709551615 134528277 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=25097/tid=25100] ppid=25094 vsize=1346088 CPUtime=5021.07 cores=0-7
/proc/25097/task/25100/stat : 25100 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 58818 0 0 0 501989 118 0 0 25 0 4 0 641619124 1378394112 318790 33554432000 134512640 135305190 4293885344 18446744073709551615 134528229 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 20084.6
Current children cumulated vsize (KiB) 1354788

[startup+5082.3 s]
/proc/loadavg: 4.00 4.00 3.96 5/334 25248
/proc/meminfo: memFree=7174740/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
[pid=25097] ppid=25094 vsize=1368168 CPUtime=20324.1 cores=0-7
/proc/25097/stat : 25097 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202496 324160 0 0 0 2031909 505 0 0 25 0 4 0 641619115 1401004032 324093 33554432000 134512640 135305190 4293885344 18446744073709551615 134528768 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/25097/statm: 342042 324093 84 194 0 341846 0
[pid=25097/tid=25098] ppid=25094 vsize=1368168 CPUtime=5081.01 cores=0-7
/proc/25097/task/25098/stat : 25098 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 59172 0 0 0 507996 105 0 0 25 0 4 0 641619124 1401004032 324093 33554432000 134512640 135305190 4293885344 18446744073709551615 134528768 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=25097/tid=25099] ppid=25094 vsize=1368168 CPUtime=5080.8 cores=0-7
/proc/25097/task/25099/stat : 25099 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 130972 0 0 0 507905 175 0 0 25 0 4 0 641619124 1401004032 324093 33554432000 134512640 135305190 4293885344 18446744073709551615 134553513 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=25097/tid=25100] ppid=25094 vsize=1368168 CPUtime=5081.07 cores=0-7
/proc/25097/task/25100/stat : 25100 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 59203 0 0 0 507988 119 0 0 25 0 4 0 641619124 1401004032 324093 33554432000 134512640 135305190 4293885344 18446744073709551615 134528480 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 20324.6
Current children cumulated vsize (KiB) 1376868



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5100 s]
/proc/loadavg: 4.00 4.00 3.96 5/334 25248
/proc/meminfo: memFree=7167652/32951124 swapFree=67056804/67111528
[pid=25094] ppid=25092 vsize=8700 CPUtime=0.47 cores=0-7
/proc/25094/stat : 25094 (manysat.sh) S 25092 25094 24661 0 -1 4202496 356 5985 0 0 0 0 46 1 17 0 1 0 641619066 8908800 253 33554432000 4194304 4922060 140734973503952 18446744073709551615 270612929669 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/25094/statm: 2175 253 209 178 0 68 0
[pid=25097] ppid=25094 vsize=1376384 CPUtime=20395 cores=0-7
/proc/25097/stat : 25097 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202496 325883 0 0 0 2038988 509 0 0 25 0 4 0 641619115 1409417216 325816 33554432000 134512640 135305190 4293885344 18446744073709551615 134528298 0 0 4096 3 18446744073709551615 0 0 17 3 0 0 0
/proc/25097/statm: 344096 325816 84 194 0 343900 0
[pid=25097/tid=25098] ppid=25094 vsize=1376384 CPUtime=5098.72 cores=0-7
/proc/25097/task/25098/stat : 25098 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 59240 0 0 0 509767 105 0 0 25 0 4 0 641619124 1409417216 325816 33554432000 134512640 135305190 4293885344 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 6 0 0 0
[pid=25097/tid=25099] ppid=25094 vsize=1376384 CPUtime=5098.49 cores=0-7
/proc/25097/task/25099/stat : 25099 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 132459 0 0 0 509671 178 0 0 24 0 4 0 641619124 1409417216 325816 33554432000 134512640 135305190 4293885344 18446744073709551615 134528237 0 0 4096 3 0 0 0 -1 5 0 0 0
[pid=25097/tid=25100] ppid=25094 vsize=1376384 CPUtime=5098.78 cores=0-7
/proc/25097/task/25100/stat : 25100 (manysat1.1_stat) R 25094 25094 24661 0 -1 4202560 59210 0 0 0 509759 119 0 0 25 0 4 0 641619124 1409417216 325816 33554432000 134512640 135305190 4293885344 18446744073709551615 134528298 0 0 4096 3 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 20395.4
Current children cumulated vsize (KiB) 1385084

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 25094 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=464929
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=19996
# CPU time returned by wait4() is 0.484925
# while last known CPU time is 20395.4
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5100.02
CPU time (s): 20395.4
CPU user time (s): 20390.3
CPU system time (s): 5.1
CPU usage (%): 399.909
Max. virtual memory (cumulated for all children) (KiB): 1385084

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.464929
system time used= 0.019996
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6341
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 6

runsolver used 16.1825 second user time and 39.412 second system time

The end

Launcher Data 

Begin job on node108 at 2011-05-13 17:23:01
IDJOB=3362162
IDBENCH=82466
IDSOLVER=1839
FILE ID=node108/3362162-1305300181
RUNJOBID= node108-1305296396-24675
PBS_JOBID= 13321445
Free space on /tmp= 35588 MiB

SOLVER NAME= ManySAT 1.1 aimd 1/2009-03-20 (4 threads)
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf
COMMAND LINE= manysat.sh BENCHNAME aimd 1
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3362162-1305300181/watcher-3362162-1305300181 -o /tmp/evaluation-result-3362162-1305300181/solver-3362162-1305300181 -C 40000 -W 5100 -M 31000  manysat.sh HOME/instance-3362162-1305300181.cnf aimd 1

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ee159af2e208d290f7f3fefd15c344f2
RANDOM SEED=1818126929

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       8477032 kB
Buffers:        251640 kB
Cached:       13565548 kB
SwapCached:       8700 kB
Active:       13005424 kB
Inactive:     10917588 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       8477032 kB
SwapTotal:    67111528 kB
SwapFree:     67056804 kB
Dirty:            3384 kB
Writeback:           0 kB
AnonPages:    10103096 kB
Mapped:          26364 kB
Slab:           447236 kB
PageTables:      37944 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 52251812 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 35580 MiB
End job on node108 at 2011-05-13 18:48:03