Trace number 3287413

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.19 1201.84

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf
MD5SUMee159af2e208d290f7f3fefd15c344f2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark731.23
Satisfiable
(Un)Satisfiability was proved
Number of variables44692
Number of clauses129620
Sum of the clauses size302444
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 286412
Number of clauses of size 343206
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3287413-1304063035/watcher-3287413-1304063035 -o /tmp/evaluation-result-3287413-1304063035/solver-3287413-1304063035 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3287413-1304063035.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.10 7.85 7.38 5/185 31076
/proc/meminfo: memFree=30503808/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=10428 CPUtime=0 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) R 31074 31076 29944 0 -1 4202496 668 1250 0 0 0 0 0 0 25 0 1 0 517901418 10678272 597 33554432000 4194304 4417332 140734041459936 18446744073709551615 271550231533 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/31076/statm: 2607 597 147 55 0 493 0

[startup+0.00815095 s]
/proc/loadavg: 8.10 7.85 7.38 5/185 31076
/proc/meminfo: memFree=30503808/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=10692 CPUtime=0 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) R 31074 31076 29944 0 -1 4202496 766 1250 0 0 0 0 0 0 25 0 1 0 517901418 10948608 695 33554432000 4194304 4417332 140734041459936 18446744073709551615 271550537472 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/31076/statm: 2673 695 147 55 0 559 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 10692

[startup+0.101115 s]
/proc/loadavg: 8.10 7.85 7.38 5/185 31076
/proc/meminfo: memFree=30503808/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=27064 CPUtime=0.09 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) R 31074 31076 29944 0 -1 4202496 4879 1250 0 0 9 0 0 0 25 0 1 0 517901418 27713536 4789 33554432000 4194304 4417332 140734041459936 18446744073709551615 4264959 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/31076/statm: 6766 4789 148 55 0 4652 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 27064

[startup+0.301041 s]
/proc/loadavg: 8.10 7.85 7.38 5/185 31076
/proc/meminfo: memFree=30503808/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=155064 CPUtime=0.7 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 16359 1250 0 0 68 2 0 0 25 0 5 0 517901418 158785536 10511 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 38766 10511 172 55 0 36652 0
Current children cumulated CPU time (s) 0.7
Current children cumulated vsize (KiB) 155064

[startup+0.700967 s]
/proc/loadavg: 8.10 7.85 7.38 5/185 31076
/proc/meminfo: memFree=30503808/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=150620 CPUtime=2.31 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 22121 1250 0 0 228 3 0 0 25 0 5 0 517901418 154234880 10577 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 37655 10577 174 55 0 35541 0
Current children cumulated CPU time (s) 2.31
Current children cumulated vsize (KiB) 150620

[startup+1.50082 s]
/proc/loadavg: 8.10 7.85 7.38 9/190 31086
/proc/meminfo: memFree=30465212/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=147512 CPUtime=5.49 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 33906 1250 0 0 545 4 0 0 25 0 5 0 517901418 151052288 9818 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 36878 9818 175 55 0 34764 0
[pid=31076/tid=31083] ppid=31074 vsize=147512 CPUtime=1.33 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 7538 1250 0 0 132 1 0 0 25 0 5 0 517901434 151052288 9818 33554432000 4194304 4417332 140734041459936 18446744073709551615 4265360 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=147512 CPUtime=1.32 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 7232 1250 0 0 132 0 0 0 25 0 5 0 517901434 151052288 9818 33554432000 4194304 4417332 140734041459936 18446744073709551615 4275711 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=147512 CPUtime=1.32 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 8933 1250 0 0 132 0 0 0 25 0 5 0 517901434 151052288 9818 33554432000 4194304 4417332 140734041459936 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=147512 CPUtime=1.33 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 884 1250 0 0 133 0 0 0 25 0 5 0 517901434 151052288 9818 33554432000 4194304 4417332 140734041459936 18446744073709551615 4232801 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.49
Current children cumulated vsize (KiB) 147512

[startup+3.10053 s]
/proc/loadavg: 8.10 7.85 7.38 9/190 31086
/proc/meminfo: memFree=30562056/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=167724 CPUtime=11.89 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 43050 1250 0 0 1184 5 0 0 25 0 5 0 517901418 171749376 13379 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 41931 13379 180 55 0 39817 0
[pid=31076/tid=31083] ppid=31074 vsize=167724 CPUtime=2.93 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 10965 1250 0 0 292 1 0 0 25 0 5 0 517901434 171749376 13379 33554432000 4194304 4417332 140734041459936 18446744073709551615 4252144 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=167724 CPUtime=2.93 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 10816 1250 0 0 292 1 0 0 25 0 5 0 517901434 171749376 13379 33554432000 4194304 4417332 140734041459936 18446744073709551615 4239991 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=167724 CPUtime=2.92 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 10664 1250 0 0 292 0 0 0 25 0 5 0 517901434 171749376 13379 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=167724 CPUtime=2.92 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 1286 1250 0 0 292 0 0 0 25 0 5 0 517901434 171749376 13379 33554432000 4194304 4417332 140734041459936 18446744073709551615 4199451 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.89
Current children cumulated vsize (KiB) 167724

[startup+6.30095 s]
/proc/loadavg: 8.09 7.85 7.39 9/190 31086
/proc/meminfo: memFree=30559332/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=163508 CPUtime=24.67 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 44075 1250 0 0 2462 5 0 0 25 0 5 0 517901418 167432192 12326 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 40877 12326 181 55 0 38763 0
[pid=31076/tid=31083] ppid=31074 vsize=163508 CPUtime=6.13 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 11477 1250 0 0 612 1 0 0 25 0 5 0 517901434 167432192 12326 33554432000 4194304 4417332 140734041459936 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=163508 CPUtime=6.13 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 11329 1250 0 0 612 1 0 0 25 0 5 0 517901434 167432192 12326 33554432000 4194304 4417332 140734041459936 18446744073709551615 4275735 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=163508 CPUtime=6.12 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 10664 1250 0 0 612 0 0 0 25 0 5 0 517901434 167432192 12326 33554432000 4194304 4417332 140734041459936 18446744073709551615 4365065 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=163508 CPUtime=6.1 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 1286 1250 0 0 610 0 0 0 25 0 5 0 517901434 167432192 12326 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.67
Current children cumulated vsize (KiB) 163508

[startup+12.7008 s]
/proc/loadavg: 8.08 7.85 7.39 9/190 31086
/proc/meminfo: memFree=30484752/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=177448 CPUtime=50.24 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 47957 1250 0 0 5018 6 0 0 25 0 5 0 517901418 181706752 15811 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 44362 15811 181 55 0 42248 0
[pid=31076/tid=31083] ppid=31074 vsize=177448 CPUtime=12.53 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 12519 1250 0 0 1251 2 0 0 25 0 5 0 517901434 181706752 15811 33554432000 4194304 4417332 140734041459936 18446744073709551615 4232580 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=177448 CPUtime=12.53 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 11402 1250 0 0 1252 1 0 0 25 0 5 0 517901434 181706752 15811 33554432000 4194304 4417332 140734041459936 18446744073709551615 4261313 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=177448 CPUtime=12.53 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 12439 1250 0 0 1252 1 0 0 25 0 5 0 517901434 181706752 15811 33554432000 4194304 4417332 140734041459936 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=177448 CPUtime=12.47 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 2278 1250 0 0 1247 0 0 0 25 0 5 0 517901434 181706752 15811 33554432000 4194304 4417332 140734041459936 18446744073709551615 4232680 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.24
Current children cumulated vsize (KiB) 177448

[startup+25.5005 s]
/proc/loadavg: 8.06 7.86 7.40 9/190 31086
/proc/meminfo: memFree=30473572/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=184808 CPUtime=101.36 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 62035 1250 0 0 10129 7 0 0 25 0 5 0 517901418 189243392 17657 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 46202 17657 181 55 0 44088 0
[pid=31076/tid=31083] ppid=31074 vsize=184808 CPUtime=25.33 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 14464 1250 0 0 2531 2 0 0 25 0 5 0 517901434 189243392 17657 33554432000 4194304 4417332 140734041459936 18446744073709551615 4353461 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=184808 CPUtime=25.32 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 14828 1250 0 0 2531 1 0 0 25 0 5 0 517901434 189243392 17657 33554432000 4194304 4417332 140734041459936 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=184808 CPUtime=25.32 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 16181 1250 0 0 2531 1 0 0 25 0 5 0 517901434 189243392 17657 33554432000 4194304 4417332 140734041459936 18446744073709551615 4366424 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=184808 CPUtime=25.19 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 7243 1250 0 0 2519 0 0 0 25 0 5 0 517901434 189243392 17657 33554432000 4194304 4417332 140734041459936 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.36
Current children cumulated vsize (KiB) 184808

[startup+51.1008 s]
/proc/loadavg: 8.12 7.88 7.42 9/190 31087
/proc/meminfo: memFree=30424912/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=260196 CPUtime=203.62 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 128920 1250 0 0 20346 16 0 0 25 0 5 0 517901418 266440704 36504 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 65049 36504 181 55 0 62935 0
[pid=31076/tid=31083] ppid=31074 vsize=260196 CPUtime=50.93 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 42423 1250 0 0 5087 6 0 0 25 0 5 0 517901434 266440704 36504 33554432000 4194304 4417332 140734041459936 18446744073709551615 4365695 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=260196 CPUtime=50.93 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 35088 1250 0 0 5089 4 0 0 25 0 5 0 517901434 266440704 36504 33554432000 4194304 4417332 140734041459936 18446744073709551615 4320926 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=260196 CPUtime=50.93 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 24537 1250 0 0 5090 3 0 0 25 0 5 0 517901434 266440704 36504 33554432000 4194304 4417332 140734041459936 18446744073709551615 4355731 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=260196 CPUtime=50.65 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 17553 1250 0 0 5064 1 0 0 25 0 5 0 517901434 266440704 36504 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.62
Current children cumulated vsize (KiB) 260196

[startup+102.307 s]
/proc/loadavg: 8.05 7.90 7.45 9/190 31088
/proc/meminfo: memFree=30379396/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=276020 CPUtime=408.16 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 195230 1250 0 0 40792 24 0 0 25 0 5 0 517901418 282644480 39949 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 69005 39949 181 55 0 66891 0
[pid=31076/tid=31083] ppid=31074 vsize=276020 CPUtime=102.13 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 61812 1250 0 0 10205 8 0 0 25 0 5 0 517901434 282644480 39949 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364529 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=276020 CPUtime=102.13 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 62067 1250 0 0 10206 7 0 0 25 0 5 0 517901434 282644480 39949 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364349 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=276020 CPUtime=102.13 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 37497 1250 0 0 10209 4 0 0 25 0 5 0 517901434 282644480 39949 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=276020 CPUtime=101.58 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 24535 1250 0 0 10156 2 0 0 25 0 5 0 517901434 282644480 39949 33554432000 4194304 4417332 140734041459936 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 408.16
Current children cumulated vsize (KiB) 276020

[startup+162.301 s]
/proc/loadavg: 8.05 7.93 7.48 9/190 31090
/proc/meminfo: memFree=30233180/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=366996 CPUtime=647.82 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 266028 1250 0 0 64747 35 0 0 25 0 5 0 517901418 375803904 63204 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 91749 63204 181 55 0 89635 0
[pid=31076/tid=31083] ppid=31074 vsize=366996 CPUtime=162.12 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 87407 1250 0 0 16201 11 0 0 25 0 5 0 517901434 375803904 63204 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=366996 CPUtime=162.13 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 67292 1250 0 0 16205 8 0 0 25 0 5 0 517901434 375803904 63204 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=366996 CPUtime=162.13 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 65935 1250 0 0 16204 9 0 0 25 0 5 0 517901434 375803904 63204 33554432000 4194304 4417332 140734041459936 18446744073709551615 4251167 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=366996 CPUtime=161.25 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 36075 1250 0 0 16121 4 0 0 25 0 5 0 517901434 375803904 63204 33554432000 4194304 4417332 140734041459936 18446744073709551615 4357843 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 647.82
Current children cumulated vsize (KiB) 366996


################
# More data... #
################

[pid=31076/tid=31084] ppid=31074 vsize=612672 CPUtime=702.14 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 166874 1250 0 0 70193 21 0 0 25 0 5 0 517901434 627376128 124623 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=612672 CPUtime=702.15 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 194364 1250 0 0 70189 26 0 0 25 0 5 0 517901434 627376128 124623 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=612672 CPUtime=698.31 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 97364 1250 0 0 69819 12 0 0 25 0 5 0 517901434 627376128 124623 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2804.89
Current children cumulated vsize (KiB) 612672

[startup+762.307 s]
/proc/loadavg: 8.25 8.13 7.78 9/190 31106
/proc/meminfo: memFree=29779420/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=797972 CPUtime=3044.59 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 783293 1250 0 0 304354 105 0 0 25 0 5 0 517901418 817123328 170948 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 199493 170948 181 55 0 197379 0
[pid=31076/tid=31083] ppid=31074 vsize=797972 CPUtime=762.11 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 279622 1250 0 0 76172 39 0 0 25 0 5 0 517901434 817123328 170948 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364990 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=797972 CPUtime=762.14 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 166874 1250 0 0 76193 21 0 0 25 0 5 0 517901434 817123328 170948 33554432000 4194304 4417332 140734041459936 18446744073709551615 4250927 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=797972 CPUtime=762.15 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 205996 1250 0 0 76188 27 0 0 25 0 5 0 517901434 817123328 170948 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=797972 CPUtime=757.99 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 121482 1250 0 0 75784 15 0 0 25 0 5 0 517901434 817123328 170948 33554432000 4194304 4417332 140734041459936 18446744073709551615 4357164 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3044.59
Current children cumulated vsize (KiB) 797972

[startup+822.301 s]
/proc/loadavg: 8.18 8.13 7.80 9/190 31108
/proc/meminfo: memFree=29602440/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=726680 CPUtime=3284.24 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 855220 1250 0 0 328308 116 0 0 25 0 5 0 517901418 744120320 153125 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 181670 153125 181 55 0 179556 0
[pid=31076/tid=31083] ppid=31074 vsize=726680 CPUtime=822.11 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 284166 1250 0 0 82171 40 0 0 25 0 5 0 517901434 744120320 153125 33554432000 4194304 4417332 140734041459936 18446744073709551615 4355764 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=726680 CPUtime=822.14 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 198040 1250 0 0 82188 26 0 0 25 0 5 0 517901434 744120320 153125 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=726680 CPUtime=822.14 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 230273 1250 0 0 82184 30 0 0 25 0 5 0 517901434 744120320 153125 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=726680 CPUtime=817.66 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 133422 1250 0 0 81749 17 0 0 25 0 5 0 517901434 744120320 153125 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364788 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3284.24
Current children cumulated vsize (KiB) 726680

[startup+882.301 s]
/proc/loadavg: 8.35 8.20 7.84 9/190 31109
/proc/meminfo: memFree=29277772/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=841040 CPUtime=3523.91 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 902389 1250 0 0 352270 121 0 0 25 0 5 0 517901418 861224960 181715 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 210260 181715 181 55 0 208146 0
[pid=31076/tid=31083] ppid=31074 vsize=841040 CPUtime=882.11 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 296847 1250 0 0 88169 42 0 0 25 0 5 0 517901434 861224960 181715 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=841040 CPUtime=882.14 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 209938 1250 0 0 88187 27 0 0 25 0 5 0 517901434 861224960 181715 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=841040 CPUtime=882.14 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 238470 1250 0 0 88183 31 0 0 25 0 5 0 517901434 861224960 181715 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=841040 CPUtime=877.33 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 147815 1250 0 0 87715 18 0 0 25 0 5 0 517901434 861224960 181715 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3523.91
Current children cumulated vsize (KiB) 841040

[startup+942.301 s]
/proc/loadavg: 8.25 8.20 7.87 9/190 31111
/proc/meminfo: memFree=29699848/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=795132 CPUtime=3763.59 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 945316 1250 0 0 376232 127 0 0 25 0 5 0 517901418 814215168 170238 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 198783 170238 181 55 0 196669 0
[pid=31076/tid=31083] ppid=31074 vsize=795132 CPUtime=942.11 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 301939 1250 0 0 94168 43 0 0 25 0 5 0 517901434 814215168 170238 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=795132 CPUtime=942.14 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 221774 1250 0 0 94186 28 0 0 25 0 5 0 517901434 814215168 170238 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=795132 CPUtime=942.14 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 252256 1250 0 0 94181 33 0 0 25 0 5 0 517901434 814215168 170238 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=795132 CPUtime=937 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 160028 1250 0 0 93681 19 0 0 25 0 5 0 517901434 814215168 170238 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364529 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3763.59
Current children cumulated vsize (KiB) 795132

[startup+1002.3 s]
/proc/loadavg: 8.10 8.20 7.89 5/180 31130
/proc/meminfo: memFree=30256432/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=812332 CPUtime=4003.26 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 991568 1250 0 0 400192 134 0 0 25 0 5 0 517901418 831827968 174538 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 203083 174538 181 55 0 200969 0
[pid=31076/tid=31083] ppid=31074 vsize=812332 CPUtime=1002.1 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 313843 1250 0 0 100165 45 0 0 25 0 5 0 517901434 831827968 174538 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=812332 CPUtime=1002.14 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 233012 1250 0 0 100184 30 0 0 25 0 5 0 517901434 831827968 174538 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=812332 CPUtime=1002.15 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 257742 1250 0 0 100181 34 0 0 25 0 5 0 517901434 831827968 174538 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=812332 CPUtime=996.68 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 177652 1250 0 0 99646 22 0 0 25 0 5 0 517901434 831827968 174538 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4003.26
Current children cumulated vsize (KiB) 812332

[startup+1062.3 s]
/proc/loadavg: 5.66 7.48 7.66 5/180 31141
/proc/meminfo: memFree=30227580/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=841460 CPUtime=4242.93 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 1037845 1250 0 0 424151 142 0 0 25 0 5 0 517901418 861655040 181820 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 210365 181820 181 55 0 208251 0
[pid=31076/tid=31083] ppid=31074 vsize=841460 CPUtime=1062.09 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 317237 1250 0 0 106163 46 0 0 25 0 5 0 517901434 861655040 181820 33554432000 4194304 4417332 140734041459936 18446744073709551615 4263227 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=841460 CPUtime=1062.14 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 233012 1250 0 0 106184 30 0 0 25 0 5 0 517901434 861655040 181820 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=841460 CPUtime=1062.15 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 286088 1250 0 0 106176 39 0 0 25 0 5 0 517901434 861655040 181820 33554432000 4194304 4417332 140734041459936 18446744073709551615 4366303 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=841460 CPUtime=1056.36 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 192189 1250 0 0 105612 24 0 0 25 0 5 0 517901434 861655040 181820 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364734 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4242.93
Current children cumulated vsize (KiB) 841460

[startup+1122.3 s]
/proc/loadavg: 4.92 6.92 7.45 5/180 31143
/proc/meminfo: memFree=30190612/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=878336 CPUtime=4482.58 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 1083798 1250 0 0 448109 149 0 0 25 0 5 0 517901418 899416064 191039 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 219584 191039 181 55 0 217470 0
[pid=31076/tid=31083] ppid=31074 vsize=878336 CPUtime=1122.08 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 329354 1250 0 0 112160 48 0 0 25 0 5 0 517901434 899416064 191039 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=878336 CPUtime=1122.14 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 233012 1250 0 0 112184 30 0 0 25 0 5 0 517901434 899416064 191039 33554432000 4194304 4417332 140734041459936 18446744073709551615 4358072 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=878336 CPUtime=1122.15 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 294285 1250 0 0 112174 41 0 0 25 0 5 0 517901434 899416064 191039 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=878336 CPUtime=1116.02 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 217828 1250 0 0 111575 27 0 0 25 0 5 0 517901434 899416064 191039 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4482.58
Current children cumulated vsize (KiB) 878336

[startup+1182.3 s]
/proc/loadavg: 4.40 6.40 7.24 5/180 31144
/proc/meminfo: memFree=30386872/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=682364 CPUtime=4722.23 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 1117245 1250 0 0 472069 154 0 0 25 0 5 0 517901418 698740736 142078 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 170591 142078 181 55 0 168477 0
[pid=31076/tid=31083] ppid=31074 vsize=682364 CPUtime=1182.05 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 329354 1250 0 0 118156 49 0 0 25 0 5 0 517901434 698740736 142078 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=682364 CPUtime=1182.14 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 241204 1250 0 0 118183 31 0 0 25 0 5 0 517901434 698740736 142078 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=682364 CPUtime=1182.15 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 300092 1250 0 0 118173 42 0 0 25 0 5 0 517901434 698740736 142078 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=682364 CPUtime=1175.71 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 237276 1250 0 0 117541 30 0 0 25 0 5 0 517901434 698740736 142078 33554432000 4194304 4417332 140734041459936 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4722.23
Current children cumulated vsize (KiB) 682364



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 4.29 6.25 7.17 5/180 31145
/proc/meminfo: memFree=30409552/32951124 swapFree=67111344/67111528
[pid=31076] ppid=31074 vsize=659768 CPUtime=4800.14 cores=0,2,4,6
/proc/31076/stat : 31076 (plingeling) S 31074 31076 29944 0 -1 4202496 1119727 1250 0 0 479859 155 0 0 25 0 5 0 517901418 675602432 136429 33554432000 4194304 4417332 140734041459936 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31076/statm: 164942 136429 181 55 0 162828 0
[pid=31076/tid=31083] ppid=31074 vsize=659768 CPUtime=1201.54 cores=0,2,4,6
/proc/31076/task/31083/stat : 31083 (plingeling) R 31074 31076 29944 0 -1 4202560 329354 1250 0 0 120105 49 0 0 25 0 5 0 517901434 675602432 136429 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31076/tid=31084] ppid=31074 vsize=659768 CPUtime=1201.65 cores=0,2,4,6
/proc/31076/task/31084/stat : 31084 (plingeling) R 31074 31076 29944 0 -1 4202560 241204 1250 0 0 120134 31 0 0 25 0 5 0 517901434 675602432 136429 33554432000 4194304 4417332 140734041459936 18446744073709551615 4354001 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31076/tid=31085] ppid=31074 vsize=659768 CPUtime=1201.66 cores=0,2,4,6
/proc/31076/task/31085/stat : 31085 (plingeling) R 31074 31076 29944 0 -1 4202560 301166 1250 0 0 120124 42 0 0 25 0 5 0 517901434 675602432 136429 33554432000 4194304 4417332 140734041459936 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=31076/tid=31086] ppid=31074 vsize=659768 CPUtime=1195.1 cores=0,2,4,6
/proc/31076/task/31086/stat : 31086 (plingeling) R 31074 31076 29944 0 -1 4202560 238684 1250 0 0 119480 30 0 0 25 0 5 0 517901434 675602432 136429 33554432000 4194304 4417332 140734041459936 18446744073709551615 4357618 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.14
Current children cumulated vsize (KiB) 659768

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.84
CPU time (s): 4800.19
CPU user time (s): 4798.61
CPU system time (s): 1.58076
CPU usage (%): 399.404
Max. virtual memory (cumulated for all children) (KiB): 933432

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.61
system time used= 1.58076
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1120977
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 188
involuntary context switches= 79612

runsolver used 1.93771 second user time and 4.6263 second system time

The end

Launcher Data 

Begin job on node133 at 2011-04-29 09:43:55
IDJOB=3287413
IDBENCH=82466
IDSOLVER=1605
FILE ID=node133/3287413-1304063035
RUNJOBID= node133-1304062278-30558
PBS_JOBID= 13170442
Free space on /tmp= 71888 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3287413-1304063035/watcher-3287413-1304063035 -o /tmp/evaluation-result-3287413-1304063035/solver-3287413-1304063035 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3287413-1304063035.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ee159af2e208d290f7f3fefd15c344f2
RANDOM SEED=636279375

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30503964 kB
Buffers:        716816 kB
Cached:         860888 kB
SwapCached:        124 kB
Active:        1019288 kB
Inactive:      1069456 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30503964 kB
SwapTotal:    67111528 kB
SwapFree:     67111344 kB
Dirty:            2428 kB
Writeback:           0 kB
AnonPages:      510612 kB
Mapped:          15476 kB
Slab:           293936 kB
PageTables:       5528 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   703020 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71892 MiB
End job on node133 at 2011-04-29 10:03:59