Trace number 3370941

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.42 1205.1

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-17x30.cnf
MD5SUM3a506c7557d86d0d326e3b3cdee85b69
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2040
Number of clauses240210
Sum of the clauses size954720
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 23060
Number of clauses of size 30
Number of clauses of size 4237150
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3370941-1305425257/watcher-3370941-1305425257 -o /tmp/evaluation-result-3370941-1305425257/solver-3370941-1305425257 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3370941-1305425257.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.57 7.94 7.46 6/353 29284
/proc/meminfo: memFree=21518140/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=10408 CPUtime=0 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) R 29282 29284 27864 0 -1 4202496 662 1253 0 0 0 0 0 0 25 0 1 0 634941835 10657792 592 33554432000 4194304 4417452 140736552054224 18446744073709551615 255106768640 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/29284/statm: 2602 592 147 55 0 488 0

[startup+0.0193069 s]
/proc/loadavg: 7.57 7.94 7.46 6/353 29284
/proc/meminfo: memFree=21518140/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=12532 CPUtime=0.01 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) R 29282 29284 27864 0 -1 4202496 1242 1253 0 0 1 0 0 0 25 0 1 0 634941835 12832768 1156 33554432000 4194304 4417452 140736552054224 18446744073709551615 255106387434 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/29284/statm: 3133 1156 148 55 0 1019 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 12532

[startup+0.100274 s]
/proc/loadavg: 7.57 7.94 7.46 6/353 29284
/proc/meminfo: memFree=21518140/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=34124 CPUtime=0.08 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) R 29282 29284 27864 0 -1 4202496 6748 1253 0 0 8 0 0 0 25 0 1 0 634941835 34942976 6554 33554432000 4194304 4417452 140736552054224 18446744073709551615 255106768640 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/29284/statm: 8531 6554 148 55 0 6417 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 34124

[startup+0.3002 s]
/proc/loadavg: 7.57 7.94 7.46 6/353 29284
/proc/meminfo: memFree=21518140/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=101976 CPUtime=0.31 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 17059 1253 0 0 30 1 0 0 25 0 5 0 634941835 104423424 13297 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 25494 13297 168 55 0 23380 0
Current children cumulated CPU time (s) 0.31
Current children cumulated vsize (KiB) 101976

[startup+0.700131 s]
/proc/loadavg: 7.57 7.94 7.46 6/353 29284
/proc/meminfo: memFree=21518140/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=196620 CPUtime=1.92 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 24692 1253 0 0 189 3 0 0 25 0 5 0 634941835 201338880 20583 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 49155 20583 177 55 0 47041 0
Current children cumulated CPU time (s) 1.92
Current children cumulated vsize (KiB) 196620

[startup+1.50099 s]
/proc/loadavg: 7.57 7.94 7.46 9/358 29294
/proc/meminfo: memFree=21423000/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=203032 CPUtime=5.1 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 27843 1253 0 0 507 3 0 0 25 0 5 0 634941835 207904768 22188 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 50758 22188 179 55 0 48644 0
[pid=29284/tid=29291] ppid=29282 vsize=203032 CPUtime=1.2 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 2296 1253 0 0 120 0 0 0 25 0 5 0 634941863 207904768 22188 33554432000 4194304 4417452 140736552054224 18446744073709551615 4253440 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=203032 CPUtime=1.2 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 2309 1253 0 0 120 0 0 0 25 0 5 0 634941863 207904768 22188 33554432000 4194304 4417452 140736552054224 18446744073709551615 4254299 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=203032 CPUtime=1.19 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 3237 1253 0 0 119 0 0 0 25 0 5 0 634941863 207904768 22188 33554432000 4194304 4417452 140736552054224 18446744073709551615 4239395 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=203032 CPUtime=1.2 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 3001 1253 0 0 120 0 0 0 25 0 5 0 634941863 207904768 22188 33554432000 4194304 4417452 140736552054224 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.1
Current children cumulated vsize (KiB) 203032

[startup+3.10071 s]
/proc/loadavg: 7.57 7.94 7.46 9/358 29294
/proc/meminfo: memFree=21389004/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=242032 CPUtime=11.49 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 40274 1253 0 0 1143 6 0 0 25 0 5 0 634941835 247840768 31911 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 60508 31911 179 55 0 58394 0
[pid=29284/tid=29291] ppid=29282 vsize=242032 CPUtime=2.81 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 5770 1253 0 0 280 1 0 0 25 0 5 0 634941863 247840768 31911 33554432000 4194304 4417452 140736552054224 18446744073709551615 4236294 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=242032 CPUtime=2.8 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 5783 1253 0 0 279 1 0 0 25 0 5 0 634941863 247840768 31911 33554432000 4194304 4417452 140736552054224 18446744073709551615 4239411 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=242032 CPUtime=2.77 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 5553 1253 0 0 277 0 0 0 25 0 5 0 634941863 247840768 31911 33554432000 4194304 4417452 140736552054224 18446744073709551615 4249186 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=242032 CPUtime=2.8 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 6168 1253 0 0 279 1 0 0 25 0 5 0 634941863 247840768 31911 33554432000 4194304 4417452 140736552054224 18446744073709551615 4366646 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 11.49
Current children cumulated vsize (KiB) 242032

[startup+6.30114 s]
/proc/loadavg: 7.61 7.94 7.46 9/358 29294
/proc/meminfo: memFree=21323788/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=255952 CPUtime=24.25 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 51686 1253 0 0 2418 7 0 0 25 0 5 0 634941835 262094848 35423 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 63988 35423 179 55 0 61874 0
[pid=29284/tid=29291] ppid=29282 vsize=255952 CPUtime=6.01 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 5770 1253 0 0 600 1 0 0 25 0 5 0 634941863 262094848 35423 33554432000 4194304 4417452 140736552054224 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=255952 CPUtime=6 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 5783 1253 0 0 599 1 0 0 25 0 5 0 634941863 262094848 35423 33554432000 4194304 4417452 140736552054224 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=255952 CPUtime=5.94 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 5553 1253 0 0 594 0 0 0 25 0 5 0 634941863 262094848 35423 33554432000 4194304 4417452 140736552054224 18446744073709551615 4250003 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=255952 CPUtime=6 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 17580 1253 0 0 598 2 0 0 25 0 5 0 634941863 262094848 35423 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 24.25
Current children cumulated vsize (KiB) 255952

[startup+12.701 s]
/proc/loadavg: 7.64 7.94 7.46 9/358 29295
/proc/meminfo: memFree=21279324/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=259508 CPUtime=49.78 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 74564 1253 0 0 4968 10 0 0 25 0 5 0 634941835 265736192 36281 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 64877 36281 180 55 0 62763 0
[pid=29284/tid=29291] ppid=29282 vsize=259508 CPUtime=12.41 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 6679 1253 0 0 1240 1 0 0 25 0 5 0 634941863 265736192 36281 33554432000 4194304 4417452 140736552054224 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=259508 CPUtime=12.4 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 6694 1253 0 0 1239 1 0 0 25 0 5 0 634941863 265736192 36281 33554432000 4194304 4417452 140736552054224 18446744073709551615 4249181 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=259508 CPUtime=12.26 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 8329 1253 0 0 1226 0 0 0 25 0 5 0 634941863 265736192 36281 33554432000 4194304 4417452 140736552054224 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=259508 CPUtime=12.41 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 35862 1253 0 0 1236 5 0 0 25 0 5 0 634941863 265736192 36281 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 49.78
Current children cumulated vsize (KiB) 259508

[startup+25.5008 s]
/proc/loadavg: 7.72 7.95 7.47 9/358 29295
/proc/meminfo: memFree=21201584/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=312092 CPUtime=100.83 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 111889 1253 0 0 10069 14 0 0 25 0 5 0 634941835 319582208 49459 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 78023 49459 180 55 0 75909 0
[pid=29284/tid=29291] ppid=29282 vsize=312092 CPUtime=25.2 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 12316 1253 0 0 2519 1 0 0 25 0 5 0 634941863 319582208 49459 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=312092 CPUtime=25.2 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 12325 1253 0 0 2518 2 0 0 25 0 5 0 634941863 319582208 49459 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364466 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=312092 CPUtime=24.92 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 14307 1253 0 0 2491 1 0 0 25 0 5 0 634941863 319582208 49459 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=312092 CPUtime=25.2 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 55941 1253 0 0 2513 7 0 0 25 0 5 0 634941863 319582208 49459 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 100.83
Current children cumulated vsize (KiB) 312092

[startup+51.1003 s]
/proc/loadavg: 7.89 7.97 7.49 9/358 29296
/proc/meminfo: memFree=20971636/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=464032 CPUtime=202.95 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 204234 1253 0 0 20266 29 0 0 25 0 5 0 634941835 475168768 87444 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 116008 87444 180 55 0 113894 0
[pid=29284/tid=29291] ppid=29282 vsize=464032 CPUtime=50.79 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 33078 1253 0 0 5075 4 0 0 25 0 5 0 634941863 475168768 87444 33554432000 4194304 4417452 140736552054224 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=464032 CPUtime=50.79 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 24029 1253 0 0 5076 3 0 0 25 0 5 0 634941863 475168768 87444 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=464032 CPUtime=50.24 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 31944 1253 0 0 5021 3 0 0 25 0 5 0 634941863 475168768 87444 33554432000 4194304 4417452 140736552054224 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=464032 CPUtime=50.8 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 98183 1253 0 0 5065 15 0 0 25 0 5 0 634941863 475168768 87444 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 202.95
Current children cumulated vsize (KiB) 464032

[startup+102.313 s]
/proc/loadavg: 7.99 7.98 7.52 9/358 29297
/proc/meminfo: memFree=20735408/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=461460 CPUtime=407.23 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 367308 1253 0 0 40672 51 0 0 25 0 5 0 634941835 472535040 86801 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 115365 86801 180 55 0 113251 0
[pid=29284/tid=29291] ppid=29282 vsize=461460 CPUtime=102 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 94060 1253 0 0 10188 12 0 0 25 0 5 0 634941863 472535040 86801 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=461460 CPUtime=102.01 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 43379 1253 0 0 10195 6 0 0 25 0 5 0 634941863 472535040 86801 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364614 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=461460 CPUtime=100.9 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 68576 1253 0 0 10082 8 0 0 25 0 5 0 634941863 472535040 86801 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=461460 CPUtime=102.02 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 144293 1253 0 0 10180 22 0 0 25 0 5 0 634941863 472535040 86801 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 407.23
Current children cumulated vsize (KiB) 461460

[startup+162.301 s]
/proc/loadavg: 8.22 8.04 7.56 9/358 29299
/proc/meminfo: memFree=20232932/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=715024 CPUtime=646.53 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 565811 1253 0 0 64573 80 0 0 25 0 5 0 634941835 732184576 150192 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 178756 150192 180 55 0 176642 0
[pid=29284/tid=29291] ppid=29282 vsize=715024 CPUtime=161.98 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 151601 1253 0 0 16177 21 0 0 25 0 5 0 634941863 732184576 150192 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364380 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=715024 CPUtime=162 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 105883 1253 0 0 16187 13 0 0 25 0 5 0 634941863 732184576 150192 33554432000 4194304 4417452 140736552054224 18446744073709551615 4274781 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=715024 CPUtime=160.24 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 116614 1253 0 0 16008 16 0 0 25 0 5 0 634941863 732184576 150192 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=715024 CPUtime=162 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 174713 1253 0 0 16173 27 0 0 25 0 5 0 634941863 732184576 150192 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 646.53
Current children cumulated vsize (KiB) 715024


################
# More data... #
################

[pid=29284/tid=29292] ppid=29282 vsize=1422328 CPUtime=696.6 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 185283 1253 0 0 69636 24 0 0 25 0 5 0 634941863 1456463872 327018 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=1422328 CPUtime=699.74 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 426700 1253 0 0 69915 59 0 0 25 0 5 0 634941863 1456463872 327018 33554432000 4194304 4417452 140736552054224 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=1422328 CPUtime=702.01 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 402276 1253 0 0 70141 60 0 0 25 0 5 0 634941863 1456463872 327018 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2800.56
Current children cumulated vsize (KiB) 1422328

[startup+762.313 s]
/proc/loadavg: 8.08 8.11 7.82 9/358 29315
/proc/meminfo: memFree=18641388/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=1824032 CPUtime=3039.94 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 1553844 1253 0 0 303769 225 0 0 25 0 5 0 634941835 1867808768 427444 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 456008 427444 180 55 0 453894 0
[pid=29284/tid=29291] ppid=29282 vsize=1824032 CPUtime=761.89 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 406598 1253 0 0 76129 60 0 0 25 0 5 0 634941863 1867808768 427444 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=1824032 CPUtime=755.95 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 202980 1253 0 0 75569 26 0 0 25 0 5 0 634941863 1867808768 427444 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=1824032 CPUtime=759.76 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 472284 1253 0 0 75912 64 0 0 25 0 5 0 634941863 1867808768 427444 33554432000 4194304 4417452 140736552054224 18446744073709551615 4365042 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=1824032 CPUtime=762.03 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 454982 1253 0 0 76131 72 0 0 25 0 5 0 634941863 1867808768 427444 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3039.94
Current children cumulated vsize (KiB) 1824032

[startup+822.301 s]
/proc/loadavg: 8.11 8.12 7.83 9/358 29316
/proc/meminfo: memFree=18421900/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=1898556 CPUtime=3279.23 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 1655314 1253 0 0 327684 239 0 0 25 0 5 0 634941835 1944121344 446075 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 474639 446075 180 55 0 472525 0
[pid=29284/tid=29291] ppid=29282 vsize=1898556 CPUtime=821.87 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 469532 1253 0 0 82119 68 0 0 25 0 5 0 634941863 1944121344 446075 33554432000 4194304 4417452 140736552054224 18446744073709551615 4263224 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=1898556 CPUtime=815.29 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 227116 1253 0 0 81500 29 0 0 25 0 5 0 634941863 1944121344 446075 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=1898556 CPUtime=819.74 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 486684 1253 0 0 81908 66 0 0 25 0 5 0 634941863 1944121344 446075 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=1898556 CPUtime=822.02 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 454982 1253 0 0 82130 72 0 0 25 0 5 0 634941863 1944121344 446075 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3279.23
Current children cumulated vsize (KiB) 1898556

[startup+882.301 s]
/proc/loadavg: 8.35 8.17 7.87 10/366 29914
/proc/meminfo: memFree=18523668/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=1423776 CPUtime=3518.23 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 1771494 1253 0 0 351567 256 0 0 25 0 5 0 634941835 1457946624 327380 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 355944 327380 180 55 0 353830 0
[pid=29284/tid=29291] ppid=29282 vsize=1423776 CPUtime=881.85 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 485663 1253 0 0 88114 71 0 0 25 0 5 0 634941863 1457946624 327380 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=1423776 CPUtime=874.52 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 251637 1253 0 0 87419 33 0 0 25 0 5 0 634941863 1457946624 327380 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=1423776 CPUtime=879.71 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 513565 1253 0 0 87901 70 0 0 25 0 5 0 634941863 1457946624 327380 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=1423776 CPUtime=881.84 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 503629 1253 0 0 88105 79 0 0 25 0 5 0 634941863 1457946624 327380 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3518.23
Current children cumulated vsize (KiB) 1423776

[startup+942.301 s]
/proc/loadavg: 9.01 8.38 7.96 10/366 31625
/proc/meminfo: memFree=18302576/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=1654148 CPUtime=3756.58 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 1829087 1253 0 0 375393 265 0 0 25 0 5 0 634941835 1693847552 384973 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 413537 384973 180 55 0 411423 0
[pid=29284/tid=29291] ppid=29282 vsize=1654148 CPUtime=941.81 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 507191 1253 0 0 94107 74 0 0 25 0 5 0 634941863 1693847552 384973 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=1654148 CPUtime=933.73 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 251637 1253 0 0 93340 33 0 0 25 0 5 0 634941863 1693847552 384973 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=1654148 CPUtime=939.64 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 531582 1253 0 0 93890 74 0 0 25 0 5 0 634941863 1693847552 384973 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=1654148 CPUtime=941.09 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 521677 1253 0 0 94028 81 0 0 25 0 5 0 634941863 1693847552 384973 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3756.58
Current children cumulated vsize (KiB) 1654148

[startup+1002.3 s]
/proc/loadavg: 9.19 8.56 8.04 11/366 1033
/proc/meminfo: memFree=18252032/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=1687256 CPUtime=3994.92 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 1884525 1253 0 0 399219 273 0 0 25 0 5 0 634941835 1727750144 393250 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 421814 393250 180 55 0 419700 0
[pid=29284/tid=29291] ppid=29282 vsize=1687256 CPUtime=1001.7 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 524183 1253 0 0 100094 76 0 0 25 0 5 0 634941863 1727750144 393250 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=1687256 CPUtime=992.91 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 276429 1253 0 0 99255 36 0 0 25 0 5 0 634941863 1727750144 393250 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=1687256 CPUtime=999.53 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 545236 1253 0 0 99876 77 0 0 25 0 5 0 634941863 1727750144 393250 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364784 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=1687256 CPUtime=1000.47 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 521677 1253 0 0 99966 81 0 0 25 0 5 0 634941863 1727750144 393250 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3994.92
Current children cumulated vsize (KiB) 1687256

[startup+1062.3 s]
/proc/loadavg: 9.57 8.78 8.15 11/367 2728
/proc/meminfo: memFree=18200064/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=1852020 CPUtime=4233.33 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 1948643 1253 0 0 423053 280 0 0 25 0 5 0 634941835 1896468480 434441 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 463005 434441 180 55 0 460891 0
[pid=29284/tid=29291] ppid=29282 vsize=1852020 CPUtime=1061.6 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 524183 1253 0 0 106084 76 0 0 25 0 5 0 634941863 1896468480 434441 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=1852020 CPUtime=1052.16 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 295239 1253 0 0 105178 38 0 0 25 0 5 0 634941863 1896468480 434441 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=1852020 CPUtime=1059.46 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 590544 1253 0 0 105865 81 0 0 25 0 5 0 634941863 1896468480 434441 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=1852020 CPUtime=1059.8 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 521677 1253 0 0 105898 82 0 0 25 0 5 0 634941863 1896468480 434441 33554432000 4194304 4417452 140736552054224 18446744073709551615 4356867 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4233.33
Current children cumulated vsize (KiB) 1852020

[startup+1122.3 s]
/proc/loadavg: 9.51 8.89 8.23 11/364 4476
/proc/meminfo: memFree=18196072/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=2089320 CPUtime=4471.66 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 2028774 1253 0 0 446869 297 0 0 25 0 5 0 634941835 2139463680 493766 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 522330 493766 180 55 0 520216 0
[pid=29284/tid=29291] ppid=29282 vsize=2089320 CPUtime=1121.49 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 535895 1253 0 0 112071 78 0 0 25 0 5 0 634941863 2139463680 493766 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=2089320 CPUtime=1111.4 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 316801 1253 0 0 111099 41 0 0 25 0 5 0 634941863 2139463680 493766 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=2089320 CPUtime=1119.42 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 606928 1253 0 0 111857 85 0 0 25 0 5 0 634941863 2139463680 493766 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=2089320 CPUtime=1119.02 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 552150 1253 0 0 111813 89 0 0 25 0 5 0 634941863 2139463680 493766 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4471.66
Current children cumulated vsize (KiB) 2089320

[startup+1182.3 s]
/proc/loadavg: 9.30 8.94 8.28 10/366 6145
/proc/meminfo: memFree=18027008/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=2158544 CPUtime=4710.05 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 2238353 1253 0 0 470671 334 0 0 25 0 5 0 634941835 2210349056 511072 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 539636 511072 180 55 0 537522 0
[pid=29284/tid=29291] ppid=29282 vsize=2158544 CPUtime=1181.3 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 569879 1253 0 0 118044 86 0 0 25 0 5 0 634941863 2210349056 511072 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=2158544 CPUtime=1170.55 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 357969 1253 0 0 117008 47 0 0 25 0 5 0 634941863 2210349056 511072 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=2158544 CPUtime=1179.16 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 710520 1253 0 0 117813 103 0 0 25 0 5 0 634941863 2210349056 511072 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=2158544 CPUtime=1178.74 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 582985 1253 0 0 117778 96 0 0 25 0 5 0 634941863 2210349056 511072 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4710.05
Current children cumulated vsize (KiB) 2158544



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1205 s]
/proc/loadavg: 9.33 8.98 8.31 6/360 7278
/proc/meminfo: memFree=19450168/32951124 swapFree=67111348/67111528
[pid=29284] ppid=29282 vsize=2199748 CPUtime=4800.3 cores=0,2,4,6
/proc/29284/stat : 29284 (plingeling) S 29282 29284 27864 0 -1 4202496 2291966 1253 0 0 479688 342 0 0 25 0 5 0 634941835 2252541952 521373 33554432000 4194304 4417452 140736552054224 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29284/statm: 549937 521373 180 55 0 547823 0
[pid=29284/tid=29291] ppid=29282 vsize=2199748 CPUtime=1203.93 cores=0,2,4,6
/proc/29284/task/29291/stat : 29291 (plingeling) R 29282 29284 27864 0 -1 4202560 582936 1253 0 0 120306 87 0 0 25 0 5 0 634941863 2252541952 521373 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29284/tid=29292] ppid=29282 vsize=2199748 CPUtime=1192.93 cores=0,2,4,6
/proc/29284/task/29292/stat : 29292 (plingeling) R 29282 29284 27864 0 -1 4202560 391986 1253 0 0 119241 52 0 0 25 0 5 0 634941863 2252541952 521373 33554432000 4194304 4417452 140736552054224 18446744073709551615 4357227 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29284/tid=29293] ppid=29282 vsize=2199748 CPUtime=1201.82 cores=0,2,4,6
/proc/29284/task/29293/stat : 29293 (plingeling) R 29282 29284 27864 0 -1 4202560 717059 1253 0 0 120078 104 0 0 25 0 5 0 634941863 2252541952 521373 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29284/tid=29294] ppid=29282 vsize=2199748 CPUtime=1201.33 cores=0,2,4,6
/proc/29284/task/29294/stat : 29294 (plingeling) R 29282 29284 27864 0 -1 4202560 582985 1253 0 0 120037 96 0 0 25 0 5 0 634941863 2252541952 521373 33554432000 4194304 4417452 140736552054224 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 2199748

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1205.1
CPU time (s): 4800.42
CPU user time (s): 4796.91
CPU system time (s): 3.51047
CPU usage (%): 398.341
Max. virtual memory (cumulated for all children) (KiB): 2418088

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.91
system time used= 3.51047
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2293246
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 87
involuntary context switches= 36075

runsolver used 3.9244 second user time and 9.51555 second system time

The end

Launcher Data 

Begin job on node144 at 2011-05-15 04:07:37
IDJOB=3370941
IDBENCH=83172
IDSOLVER=1848
FILE ID=node144/3370941-1305425257
RUNJOBID= node144-1305424050-28559
PBS_JOBID= 13324583
Free space on /tmp= 73252 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-17x30.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3370941-1305425257/watcher-3370941-1305425257 -o /tmp/evaluation-result-3370941-1305425257/solver-3370941-1305425257 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3370941-1305425257.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3a506c7557d86d0d326e3b3cdee85b69
RANDOM SEED=903331494

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21520900 kB
Buffers:        293096 kB
Cached:        3634312 kB
SwapCached:          0 kB
Active:        8250644 kB
Inactive:      2834300 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21520900 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:            7448 kB
Writeback:         144 kB
AnonPages:     7156888 kB
Mapped:          27632 kB
Slab:           245196 kB
PageTables:      37620 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 82064272 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73252 MiB
End job on node144 at 2011-05-15 04:27:44