Trace number 3372728

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.6 5006.38

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom23.cnf
MD5SUMe560aa6505ddce6d3784f70d5b7aff66
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables57800
Number of clauses193923
Sum of the clauses size495331
Maximum clause length1803
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 298497
Number of clauses of size 394437
Number of clauses of size 4275
Number of clauses of size 521
Number of clauses of size over 5692

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372728-1305441688/watcher-3372728-1305441688 -o /tmp/evaluation-result-3372728-1305441688/solver-3372728-1305441688 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3372728-1305441688.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.76 7.98 7.93 1/272 30586
/proc/meminfo: memFree=24721164/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=18796 CPUtime=0 cores=0-7
/proc/30586/stat : 30586 (plingeling) R 30584 30586 30315 0 -1 4202496 2755 1250 0 0 0 0 0 0 25 0 1 0 636584189 19247104 2686 33554432000 4194304 4417452 140736039370432 18446744073709551615 254261616384 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/30586/statm: 4699 2686 144 55 0 2585 0

[startup+0.100925 s]
/proc/loadavg: 7.76 7.98 7.93 1/272 30586
/proc/meminfo: memFree=24721164/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=41472 CPUtime=0.09 cores=0-7
/proc/30586/stat : 30586 (plingeling) R 30584 30586 30315 0 -1 4202496 8477 1250 0 0 8 1 0 0 25 0 1 0 636584189 42467328 8392 33554432000 4194304 4417452 140736039370432 18446744073709551615 254261616384 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/30586/statm: 10368 8392 149 55 0 8254 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 41472

[startup+0.200904 s]
/proc/loadavg: 7.76 7.98 7.93 1/272 30586
/proc/meminfo: memFree=24721164/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=49664 CPUtime=0.19 cores=0-7
/proc/30586/stat : 30586 (plingeling) R 30584 30586 30315 0 -1 4202496 10525 1250 0 0 18 1 0 0 25 0 1 0 636584189 50855936 10440 33554432000 4194304 4417452 140736039370432 18446744073709551615 4227769 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/30586/statm: 12416 10440 149 55 0 10302 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 49664

[startup+0.300886 s]
/proc/loadavg: 7.76 7.98 7.93 1/272 30586
/proc/meminfo: memFree=24721164/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=81276 CPUtime=0.29 cores=0-7
/proc/30586/stat : 30586 (plingeling) R 30584 30586 30315 0 -1 4202496 18436 1250 0 0 27 2 0 0 25 0 1 0 636584189 83226624 18343 33554432000 4194304 4417452 140736039370432 18446744073709551615 254261616384 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/30586/statm: 20319 18343 149 55 0 18205 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 81276

[startup+1.27168 s]
/proc/loadavg: 7.76 7.98 7.93 1/272 30586
/proc/meminfo: memFree=24721164/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=250044 CPUtime=6.92 cores=0-7
/proc/30586/stat : 30586 (plingeling) S 30584 30586 30315 0 -1 4202496 33549 1250 0 0 688 4 0 0 18 0 9 0 636584189 256045056 23706 33554432000 4194304 4417452 140736039370432 18446744073709551615 254273419237 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/30586/statm: 62511 23706 175 55 0 60397 0
Current children cumulated CPU time (s) 6.92
Current children cumulated vsize (KiB) 250044

[startup+1.50064 s]
/proc/loadavg: 7.76 7.98 7.93 1/272 30586
/proc/meminfo: memFree=24721164/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=249340 CPUtime=8.74 cores=0-7
/proc/30586/stat : 30586 (plingeling) S 30584 30586 30315 0 -1 4202496 36773 1250 0 0 870 4 0 0 18 0 9 0 636584189 255324160 25030 33554432000 4194304 4417452 140736039370432 18446744073709551615 254273419237 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/30586/statm: 62335 25030 175 55 0 60221 0
Current children cumulated CPU time (s) 8.74
Current children cumulated vsize (KiB) 249340

[startup+3.10036 s]
/proc/loadavg: 7.76 7.98 7.93 9/281 30600
/proc/meminfo: memFree=24581912/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=281348 CPUtime=21.52 cores=0-7
/proc/30586/stat : 30586 (plingeling) S 30584 30586 30315 0 -1 4202496 59208 1250 0 0 2145 7 0 0 18 0 9 0 636584189 288100352 34153 33554432000 4194304 4417452 140736039370432 18446744073709551615 254273419237 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/30586/statm: 70337 34153 179 55 0 68223 0
[pid=30586/tid=30593] ppid=30584 vsize=281348 CPUtime=2.62 cores=0-7
/proc/30586/task/30593/stat : 30593 (plingeling) R 30584 30586 30315 0 -1 4202560 4411 1250 0 0 262 0 0 0 22 0 9 0 636584235 288100352 34153 33554432000 4194304 4417452 140736039370432 18446744073709551615 4346428 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30586/tid=30594] ppid=30584 vsize=281348 CPUtime=2.63 cores=0-7
/proc/30586/task/30594/stat : 30594 (plingeling) R 30584 30586 30315 0 -1 4202560 2558 1250 0 0 263 0 0 0 23 0 9 0 636584235 288100352 34153 33554432000 4194304 4417452 140736039370432 18446744073709551615 4346666 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30586/tid=30595] ppid=30584 vsize=281348 CPUtime=2.61 cores=0-7
/proc/30586/task/30595/stat : 30595 (plingeling) R 30584 30586 30315 0 -1 4202560 6934 1250 0 0 261 0 0 0 23 0 9 0 636584235 288100352 34153 33554432000 4194304 4417452 140736039370432 18446744073709551615 4284341 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30586/tid=30596] ppid=30584 vsize=281348 CPUtime=2.63 cores=0-7
/proc/30586/task/30596/stat : 30596 (plingeling) R 30584 30586 30315 0 -1 4202560 2404 1250 0 0 263 0 0 0 23 0 9 0 636584235 288100352 34153 33554432000 4194304 4417452 140736039370432 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30586/tid=30597] ppid=30584 vsize=281348 CPUtime=2.62 cores=0-7
/proc/30586/task/30597/stat : 30597 (plingeling) R 30584 30586 30315 0 -1 4202560 4981 1250 0 0 262 0 0 0 25 0 9 0 636584235 288100352 34153 33554432000 4194304 4417452 140736039370432 18446744073709551615 4346508 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30586/tid=30598] ppid=30584 vsize=281348 CPUtime=2.63 cores=0-7
/proc/30586/task/30598/stat : 30598 (plingeling) R 30584 30586 30315 0 -1 4202560 5551 1250 0 0 263 0 0 0 23 0 9 0 636584235 288100352 34153 33554432000 4194304 4417452 140736039370432 18446744073709551615 4302086 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30586/tid=30599] ppid=30584 vsize=281348 CPUtime=2.62 cores=0-7
/proc/30586/task/30599/stat : 30599 (plingeling) R 30584 30586 30315 0 -1 4202560 5860 1250 0 0 262 0 0 0 25 0 9 0 636584235 288100352 34153 33554432000 4194304 4417452 140736039370432 18446744073709551615 4330973 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30586/tid=30600] ppid=30584 vsize=281348 CPUtime=2.62 cores=0-7
/proc/30586/task/30600/stat : 30600 (plingeling) R 30584 30586 30315 0 -1 4202560 8057 1250 0 0 262 0 0 0 25 0 9 0 636584235 288100352 34153 33554432000 4194304 4417452 140736039370432 18446744073709551615 4346484 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 21.52
Current children cumulated vsize (KiB) 281348

[startup+6.31079 s]
/proc/loadavg: 7.78 7.98 7.93 9/281 30601
/proc/meminfo: memFree=24581816/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=280792 CPUtime=47.17 cores=0-7
/proc/30586/stat : 30586 (plingeling) S 30584 30586 30315 0 -1 4202496 67804 1250 0 0 4709 8 0 0 18 0 9 0 636584189 287531008 33474 33554432000 4194304 4417452 140736039370432 18446744073709551615 254273419237 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/30586/statm: 70198 33474 180 55 0 68084 0
[pid=30586/tid=30593] ppid=30584 vsize=280792 CPUtime=5.84 cores=0-7
/proc/30586/task/30593/stat : 30593 (plingeling) R 30584 30586 30315 0 -1 4202560 6664 1250 0 0 583 1 0 0 25 0 9 0 636584235 287531008 33474 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364440 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30586/tid=30594] ppid=30584 vsize=280792 CPUtime=5.84 cores=0-7
/proc/30586/task/30594/stat : 30594 (plingeling) R 30584 30586 30315 0 -1 4202560 4293 1250 0 0 584 0 0 0 25 0 9 0 636584235 287531008 33474 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30586/tid=30595] ppid=30584 vsize=280792 CPUtime=5.79 cores=0-7
/proc/30586/task/30595/stat : 30595 (plingeling) R 30584 30586 30315 0 -1 4202560 6959 1250 0 0 579 0 0 0 25 0 9 0 636584235 287531008 33474 33554432000 4194304 4417452 140736039370432 18446744073709551615 4365959 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30586/tid=30596] ppid=30584 vsize=280792 CPUtime=5.84 cores=0-7
/proc/30586/task/30596/stat : 30596 (plingeling) R 30584 30586 30315 0 -1 4202560 2818 1250 0 0 584 0 0 0 25 0 9 0 636584235 287531008 33474 33554432000 4194304 4417452 140736039370432 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30586/tid=30597] ppid=30584 vsize=280792 CPUtime=5.83 cores=0-7
/proc/30586/task/30597/stat : 30597 (plingeling) R 30584 30586 30315 0 -1 4202560 5656 1250 0 0 583 0 0 0 25 0 9 0 636584235 287531008 33474 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364885 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30586/tid=30598] ppid=30584 vsize=280792 CPUtime=5.83 cores=0-7
/proc/30586/task/30598/stat : 30598 (plingeling) R 30584 30586 30315 0 -1 4202560 7093 1250 0 0 583 0 0 0 25 0 9 0 636584235 287531008 33474 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30586/tid=30599] ppid=30584 vsize=280792 CPUtime=5.83 cores=0-7
/proc/30586/task/30599/stat : 30599 (plingeling) R 30584 30586 30315 0 -1 4202560 5884 1250 0 0 583 0 0 0 25 0 9 0 636584235 287531008 33474 33554432000 4194304 4417452 140736039370432 18446744073709551615 4232566 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30586/tid=30600] ppid=30584 vsize=280792 CPUtime=5.84 cores=0-7
/proc/30586/task/30600/stat : 30600 (plingeling) R 30584 30586 30315 0 -1 4202560 9985 1250 0 0 583 1 0 0 25 0 9 0 636584235 287531008 33474 33554432000 4194304 4417452 140736039370432 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 47.17
Current children cumulated vsize (KiB) 280792

[startup+12.7007 s]
/proc/loadavg: 7.80 7.98 7.93 9/281 30601
/proc/meminfo: memFree=24583328/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=280952 CPUtime=98.24 cores=0-7
/proc/30586/stat : 30586 (plingeling) S 30584 30586 30315 0 -1 4202496 67925 1250 0 0 9816 8 0 0 18 0 9 0 636584189 287694848 33514 33554432000 4194304 4417452 140736039370432 18446744073709551615 254273419237 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/30586/statm: 70238 33514 180 55 0 68124 0
[pid=30586/tid=30593] ppid=30584 vsize=280952 CPUtime=12.23 cores=0-7
/proc/30586/task/30593/stat : 30593 (plingeling) R 30584 30586 30315 0 -1 4202560 6679 1250 0 0 1222 1 0 0 25 0 9 0 636584235 287694848 33514 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364508 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30586/tid=30594] ppid=30584 vsize=280952 CPUtime=12.23 cores=0-7
/proc/30586/task/30594/stat : 30594 (plingeling) R 30584 30586 30315 0 -1 4202560 4309 1250 0 0 1223 0 0 0 25 0 9 0 636584235 287694848 33514 33554432000 4194304 4417452 140736039370432 18446744073709551615 4365936 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30586/tid=30595] ppid=30584 vsize=280952 CPUtime=12.13 cores=0-7
/proc/30586/task/30595/stat : 30595 (plingeling) R 30584 30586 30315 0 -1 4202560 6982 1250 0 0 1213 0 0 0 25 0 9 0 636584235 287694848 33514 33554432000 4194304 4417452 140736039370432 18446744073709551615 4301771 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30586/tid=30596] ppid=30584 vsize=280952 CPUtime=12.23 cores=0-7
/proc/30586/task/30596/stat : 30596 (plingeling) R 30584 30586 30315 0 -1 4202560 2818 1250 0 0 1223 0 0 0 25 0 9 0 636584235 287694848 33514 33554432000 4194304 4417452 140736039370432 18446744073709551615 4357003 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30586/tid=30597] ppid=30584 vsize=280952 CPUtime=12.23 cores=0-7
/proc/30586/task/30597/stat : 30597 (plingeling) R 30584 30586 30315 0 -1 4202560 5669 1250 0 0 1222 1 0 0 25 0 9 0 636584235 287694848 33514 33554432000 4194304 4417452 140736039370432 18446744073709551615 4321264 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30586/tid=30598] ppid=30584 vsize=280952 CPUtime=12.22 cores=0-7
/proc/30586/task/30598/stat : 30598 (plingeling) R 30584 30586 30315 0 -1 4202560 7109 1250 0 0 1222 0 0 0 25 0 9 0 636584235 287694848 33514 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364442 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30586/tid=30599] ppid=30584 vsize=280952 CPUtime=12.22 cores=0-7
/proc/30586/task/30599/stat : 30599 (plingeling) R 30584 30586 30315 0 -1 4202560 5907 1250 0 0 1222 0 0 0 25 0 9 0 636584235 287694848 33514 33554432000 4194304 4417452 140736039370432 18446744073709551615 4277628 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30586/tid=30600] ppid=30584 vsize=280952 CPUtime=12.23 cores=0-7
/proc/30586/task/30600/stat : 30600 (plingeling) R 30584 30586 30315 0 -1 4202560 10000 1250 0 0 1222 1 0 0 25 0 9 0 636584235 287694848 33514 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364607 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 98.24
Current children cumulated vsize (KiB) 280952

[startup+25.5004 s]
/proc/loadavg: 7.91 7.99 7.94 9/281 30601
/proc/meminfo: memFree=24542272/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=326156 CPUtime=200.53 cores=0-7
/proc/30586/stat : 30586 (plingeling) S 30584 30586 30315 0 -1 4202496 82119 1250 0 0 20043 10 0 0 18 0 9 0 636584189 333983744 44859 33554432000 4194304 4417452 140736039370432 18446744073709551615 254273419237 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/30586/statm: 81539 44859 180 55 0 79425 0
[pid=30586/tid=30593] ppid=30584 vsize=326156 CPUtime=25.02 cores=0-7
/proc/30586/task/30593/stat : 30593 (plingeling) R 30584 30586 30315 0 -1 4202560 9431 1250 0 0 2501 1 0 0 25 0 9 0 636584235 333983744 44859 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30586/tid=30594] ppid=30584 vsize=326156 CPUtime=25.03 cores=0-7
/proc/30586/task/30594/stat : 30594 (plingeling) R 30584 30586 30315 0 -1 4202560 5814 1250 0 0 2503 0 0 0 25 0 9 0 636584235 333983744 44859 33554432000 4194304 4417452 140736039370432 18446744073709551615 4366141 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30586/tid=30595] ppid=30584 vsize=326156 CPUtime=24.83 cores=0-7
/proc/30586/task/30595/stat : 30595 (plingeling) R 30584 30586 30315 0 -1 4202560 8758 1250 0 0 2482 1 0 0 25 0 9 0 636584235 333983744 44859 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30586/tid=30596] ppid=30584 vsize=326156 CPUtime=25.03 cores=0-7
/proc/30586/task/30596/stat : 30596 (plingeling) R 30584 30586 30315 0 -1 4202560 3986 1250 0 0 2503 0 0 0 25 0 9 0 636584235 333983744 44859 33554432000 4194304 4417452 140736039370432 18446744073709551615 4357094 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30586/tid=30597] ppid=30584 vsize=326156 CPUtime=25.03 cores=0-7
/proc/30586/task/30597/stat : 30597 (plingeling) R 30584 30586 30315 0 -1 4202560 6734 1250 0 0 2502 1 0 0 25 0 9 0 636584235 333983744 44859 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364500 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30586/tid=30598] ppid=30584 vsize=326156 CPUtime=25.02 cores=0-7
/proc/30586/task/30598/stat : 30598 (plingeling) R 30584 30586 30315 0 -1 4202560 8758 1250 0 0 2502 0 0 0 25 0 9 0 636584235 333983744 44859 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364752 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30586/tid=30599] ppid=30584 vsize=326156 CPUtime=25.02 cores=0-7
/proc/30586/task/30599/stat : 30599 (plingeling) R 30584 30586 30315 0 -1 4202560 7976 1250 0 0 2501 1 0 0 25 0 9 0 636584235 333983744 44859 33554432000 4194304 4417452 140736039370432 18446744073709551615 4237371 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30586/tid=30600] ppid=30584 vsize=326156 CPUtime=25.03 cores=0-7
/proc/30586/task/30600/stat : 30600 (plingeling) R 30584 30586 30315 0 -1 4202560 12210 1250 0 0 2502 1 0 0 25 0 9 0 636584235 333983744 44859 33554432000 4194304 4417452 140736039370432 18446744073709551615 4250633 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 200.53
Current children cumulated vsize (KiB) 326156

[startup+51.1008 s]
/proc/loadavg: 7.94 7.99 7.94 9/281 30602
/proc/meminfo: memFree=24494352/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=370692 CPUtime=405.11 cores=0-7
/proc/30586/stat : 30586 (plingeling) S 30584 30586 30315 0 -1 4202496 106520 1250 0 0 40497 14 0 0 18 0 9 0 636584189 379588608 57549 33554432000 4194304 4417452 140736039370432 18446744073709551615 254273419237 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/30586/statm: 92673 57549 180 55 0 90559 0
[pid=30586/tid=30593] ppid=30584 vsize=370692 CPUtime=50.63 cores=0-7
/proc/30586/task/30593/stat : 30593 (plingeling) R 30584 30586 30315 0 -1 4202560 10493 1250 0 0 5062 1 0 0 25 0 9 0 636584235 379588608 57549 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30586/tid=30594] ppid=30584 vsize=370692 CPUtime=50.63 cores=0-7
/proc/30586/task/30594/stat : 30594 (plingeling) R 30584 30586 30315 0 -1 4202560 8187 1250 0 0 5063 0 0 0 25 0 9 0 636584235 379588608 57549 33554432000 4194304 4417452 140736039370432 18446744073709551615 4236630 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30586/tid=30595] ppid=30584 vsize=370692 CPUtime=50.2 cores=0-7
/proc/30586/task/30595/stat : 30595 (plingeling) R 30584 30586 30315 0 -1 4202560 10078 1250 0 0 5019 1 0 0 25 0 9 0 636584235 379588608 57549 33554432000 4194304 4417452 140736039370432 18446744073709551615 4366074 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30586/tid=30596] ppid=30584 vsize=370692 CPUtime=50.63 cores=0-7
/proc/30586/task/30596/stat : 30596 (plingeling) R 30584 30586 30315 0 -1 4202560 9831 1250 0 0 5062 1 0 0 25 0 9 0 636584235 379588608 57549 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30586/tid=30597] ppid=30584 vsize=370692 CPUtime=50.63 cores=0-7
/proc/30586/task/30597/stat : 30597 (plingeling) R 30584 30586 30315 0 -1 4202560 8223 1250 0 0 5062 1 0 0 25 0 9 0 636584235 379588608 57549 33554432000 4194304 4417452 140736039370432 18446744073709551615 4310582 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30586/tid=30598] ppid=30584 vsize=370692 CPUtime=50.63 cores=0-7
/proc/30586/task/30598/stat : 30598 (plingeling) R 30584 30586 30315 0 -1 4202560 19373 1250 0 0 5061 2 0 0 25 0 9 0 636584235 379588608 57549 33554432000 4194304 4417452 140736039370432 18446744073709551615 4265514 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30586/tid=30599] ppid=30584 vsize=370692 CPUtime=50.62 cores=0-7
/proc/30586/task/30599/stat : 30599 (plingeling) R 30584 30586 30315 0 -1 4202560 9059 1250 0 0 5061 1 0 0 25 0 9 0 636584235 379588608 57549 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30586/tid=30600] ppid=30584 vsize=370692 CPUtime=50.63 cores=0-7
/proc/30586/task/30600/stat : 30600 (plingeling) R 30584 30586 30315 0 -1 4202560 12824 1250 0 0 5062 1 0 0 25 0 9 0 636584235 379588608 57549 33554432000 4194304 4417452 140736039370432 18446744073709551615 4353485 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 405.11
Current children cumulated vsize (KiB) 370692

[startup+102.301 s]
/proc/loadavg: 8.02 8.01 7.94 9/281 30603

################
# More data... #
################


[startup+4722.3 s]
/proc/loadavg: 8.02 8.06 8.02 9/281 30738
/proc/meminfo: memFree=22214616/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=2655896 CPUtime=37731.7 cores=0-7
/proc/30586/stat : 30586 (plingeling) S 30584 30586 30315 0 -1 4202496 3604045 1250 0 0 3772609 559 0 0 18 0 9 0 636584189 2719637504 625723 33554432000 4194304 4417452 140736039370432 18446744073709551615 254273419237 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/30586/statm: 663974 625723 180 55 0 661860 0
[pid=30586/tid=30593] ppid=30584 vsize=2655896 CPUtime=4721.78 cores=0-7
/proc/30586/task/30593/stat : 30593 (plingeling) R 30584 30586 30315 0 -1 4202560 351166 1250 0 0 472121 57 0 0 25 0 9 0 636584235 2719637504 625723 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364442 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30586/tid=30594] ppid=30584 vsize=2655896 CPUtime=4721.9 cores=0-7
/proc/30586/task/30594/stat : 30594 (plingeling) R 30584 30586 30315 0 -1 4202560 388294 1250 0 0 472132 58 0 0 25 0 9 0 636584235 2719637504 625723 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30586/tid=30595] ppid=30584 vsize=2655896 CPUtime=4688.16 cores=0-7
/proc/30586/task/30595/stat : 30595 (plingeling) R 30584 30586 30315 0 -1 4202560 365610 1250 0 0 468757 59 0 0 25 0 9 0 636584235 2719637504 625723 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30586/tid=30596] ppid=30584 vsize=2655896 CPUtime=4721.12 cores=0-7
/proc/30586/task/30596/stat : 30596 (plingeling) R 30584 30586 30315 0 -1 4202560 554164 1250 0 0 472021 91 0 0 25 0 9 0 636584235 2719637504 625723 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30586/tid=30597] ppid=30584 vsize=2655896 CPUtime=4721.92 cores=0-7
/proc/30586/task/30597/stat : 30597 (plingeling) R 30584 30586 30315 0 -1 4202560 450848 1250 0 0 472122 70 0 0 25 0 9 0 636584235 2719637504 625723 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30586/tid=30598] ppid=30584 vsize=2655896 CPUtime=4713.11 cores=0-7
/proc/30586/task/30598/stat : 30598 (plingeling) R 30584 30586 30315 0 -1 4202560 524026 1250 0 0 471231 80 0 0 25 0 9 0 636584235 2719637504 625723 33554432000 4194304 4417452 140736039370432 18446744073709551615 4346497 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30586/tid=30599] ppid=30584 vsize=2655896 CPUtime=4721.24 cores=0-7
/proc/30586/task/30599/stat : 30599 (plingeling) R 30584 30586 30315 0 -1 4202560 514095 1250 0 0 472044 80 0 0 25 0 9 0 636584235 2719637504 625723 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30586/tid=30600] ppid=30584 vsize=2655896 CPUtime=4721.93 cores=0-7
/proc/30586/task/30600/stat : 30600 (plingeling) R 30584 30586 30315 0 -1 4202560 437390 1250 0 0 472134 59 0 0 25 0 9 0 636584235 2719637504 625723 33554432000 4194304 4417452 140736039370432 18446744073709551615 4236906 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37731.7
Current children cumulated vsize (KiB) 2655896

[startup+4782.3 s]
/proc/loadavg: 8.08 8.06 8.02 9/281 30749
/proc/meminfo: memFree=21956556/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=2911988 CPUtime=38211.1 cores=0-7
/proc/30586/stat : 30586 (plingeling) S 30584 30586 30315 0 -1 4202496 3675136 1250 0 0 3820544 567 0 0 18 0 9 0 636584189 2981875712 689715 33554432000 4194304 4417452 140736039370432 18446744073709551615 254273419237 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/30586/statm: 727997 689715 180 55 0 725883 0
[pid=30586/tid=30593] ppid=30584 vsize=2911988 CPUtime=4781.77 cores=0-7
/proc/30586/task/30593/stat : 30593 (plingeling) R 30584 30586 30315 0 -1 4202560 359390 1250 0 0 478120 57 0 0 25 0 9 0 636584235 2981875712 689715 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30586/tid=30594] ppid=30584 vsize=2911988 CPUtime=4781.9 cores=0-7
/proc/30586/task/30594/stat : 30594 (plingeling) R 30584 30586 30315 0 -1 4202560 388307 1250 0 0 478132 58 0 0 25 0 9 0 636584235 2981875712 689715 33554432000 4194304 4417452 140736039370432 18446744073709551615 4356867 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30586/tid=30595] ppid=30584 vsize=2911988 CPUtime=4748.15 cores=0-7
/proc/30586/task/30595/stat : 30595 (plingeling) R 30584 30586 30315 0 -1 4202560 373817 1250 0 0 474756 59 0 0 25 0 9 0 636584235 2981875712 689715 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30586/tid=30596] ppid=30584 vsize=2911988 CPUtime=4781.12 cores=0-7
/proc/30586/task/30596/stat : 30596 (plingeling) R 30584 30586 30315 0 -1 4202560 554164 1250 0 0 478021 91 0 0 25 0 9 0 636584235 2981875712 689715 33554432000 4194304 4417452 140736039370432 18446744073709551615 4250786 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30586/tid=30597] ppid=30584 vsize=2911988 CPUtime=4781.9 cores=0-7
/proc/30586/task/30597/stat : 30597 (plingeling) R 30584 30586 30315 0 -1 4202560 465144 1250 0 0 478118 72 0 0 25 0 9 0 636584235 2981875712 689715 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30586/tid=30598] ppid=30584 vsize=2911988 CPUtime=4772.56 cores=0-7
/proc/30586/task/30598/stat : 30598 (plingeling) R 30584 30586 30315 0 -1 4202560 564377 1250 0 0 477172 84 0 0 25 0 9 0 636584235 2981875712 689715 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30586/tid=30599] ppid=30584 vsize=2911988 CPUtime=4781.24 cores=0-7
/proc/30586/task/30599/stat : 30599 (plingeling) R 30584 30586 30315 0 -1 4202560 514095 1250 0 0 478044 80 0 0 25 0 9 0 636584235 2981875712 689715 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30586/tid=30600] ppid=30584 vsize=2911988 CPUtime=4781.93 cores=0-7
/proc/30586/task/30600/stat : 30600 (plingeling) R 30584 30586 30315 0 -1 4202560 437390 1250 0 0 478134 59 0 0 25 0 9 0 636584235 2981875712 689715 33554432000 4194304 4417452 140736039370432 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38211.1
Current children cumulated vsize (KiB) 2911988

[startup+4842.3 s]
/proc/loadavg: 8.10 8.06 8.02 9/281 30750
/proc/meminfo: memFree=21632248/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=3237384 CPUtime=38690.6 cores=0-7
/proc/30586/stat : 30586 (plingeling) S 30584 30586 30315 0 -1 4202496 3788836 1250 0 0 3868473 582 0 0 18 0 9 0 636584189 3315081216 771077 33554432000 4194304 4417452 140736039370432 18446744073709551615 254273419237 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/30586/statm: 809346 771077 180 55 0 807232 0
[pid=30586/tid=30593] ppid=30584 vsize=3237384 CPUtime=4841.78 cores=0-7
/proc/30586/task/30593/stat : 30593 (plingeling) R 30584 30586 30315 0 -1 4202560 392451 1250 0 0 484116 62 0 0 25 0 9 0 636584235 3315081216 771077 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30586/tid=30594] ppid=30584 vsize=3237384 CPUtime=4841.9 cores=0-7
/proc/30586/task/30594/stat : 30594 (plingeling) R 30584 30586 30315 0 -1 4202560 388307 1250 0 0 484132 58 0 0 25 0 9 0 636584235 3315081216 771077 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30586/tid=30595] ppid=30584 vsize=3237384 CPUtime=4808.15 cores=0-7
/proc/30586/task/30595/stat : 30595 (plingeling) R 30584 30586 30315 0 -1 4202560 385082 1250 0 0 480754 61 0 0 25 0 9 0 636584235 3315081216 771077 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30586/tid=30596] ppid=30584 vsize=3237384 CPUtime=4841.13 cores=0-7
/proc/30586/task/30596/stat : 30596 (plingeling) R 30584 30586 30315 0 -1 4202560 572857 1250 0 0 484020 93 0 0 25 0 9 0 636584235 3315081216 771077 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364466 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30586/tid=30597] ppid=30584 vsize=3237384 CPUtime=4841.91 cores=0-7
/proc/30586/task/30597/stat : 30597 (plingeling) R 30584 30586 30315 0 -1 4202560 515811 1250 0 0 484111 80 0 0 25 0 9 0 636584235 3315081216 771077 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30586/tid=30598] ppid=30584 vsize=3237384 CPUtime=4832.01 cores=0-7
/proc/30586/task/30598/stat : 30598 (plingeling) R 30584 30586 30315 0 -1 4202560 564391 1250 0 0 483117 84 0 0 25 0 9 0 636584235 3315081216 771077 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30586/tid=30599] ppid=30584 vsize=3237384 CPUtime=4841.22 cores=0-7
/proc/30586/task/30599/stat : 30599 (plingeling) R 30584 30586 30315 0 -1 4202560 514095 1250 0 0 484042 80 0 0 25 0 9 0 636584235 3315081216 771077 33554432000 4194304 4417452 140736039370432 18446744073709551615 4366535 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30586/tid=30600] ppid=30584 vsize=3237384 CPUtime=4841.93 cores=0-7
/proc/30586/task/30600/stat : 30600 (plingeling) R 30584 30586 30315 0 -1 4202560 437390 1250 0 0 484134 59 0 0 25 0 9 0 636584235 3315081216 771077 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38690.6
Current children cumulated vsize (KiB) 3237384

[startup+4902.3 s]
/proc/loadavg: 8.10 8.07 8.02 9/281 30752
/proc/meminfo: memFree=21540460/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=3329304 CPUtime=39170.1 cores=0-7
/proc/30586/stat : 30586 (plingeling) S 30584 30586 30315 0 -1 4202496 3828792 1250 0 0 3916420 588 0 0 18 0 9 0 636584189 3409207296 794059 33554432000 4194304 4417452 140736039370432 18446744073709551615 254273419237 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/30586/statm: 832326 794059 180 55 0 830212 0
[pid=30586/tid=30593] ppid=30584 vsize=3329304 CPUtime=4901.79 cores=0-7
/proc/30586/task/30593/stat : 30593 (plingeling) R 30584 30586 30315 0 -1 4202560 392451 1250 0 0 490117 62 0 0 25 0 9 0 636584235 3409207296 794059 33554432000 4194304 4417452 140736039370432 18446744073709551615 4365973 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30586/tid=30594] ppid=30584 vsize=3329304 CPUtime=4901.92 cores=0-7
/proc/30586/task/30594/stat : 30594 (plingeling) R 30584 30586 30315 0 -1 4202560 388307 1250 0 0 490134 58 0 0 25 0 9 0 636584235 3409207296 794059 33554432000 4194304 4417452 140736039370432 18446744073709551615 4357797 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30586/tid=30595] ppid=30584 vsize=3329304 CPUtime=4868.17 cores=0-7
/proc/30586/task/30595/stat : 30595 (plingeling) R 30584 30586 30315 0 -1 4202560 405472 1250 0 0 486752 65 0 0 25 0 9 0 636584235 3409207296 794059 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30586/tid=30596] ppid=30584 vsize=3329304 CPUtime=4901.14 cores=0-7
/proc/30586/task/30596/stat : 30596 (plingeling) R 30584 30586 30315 0 -1 4202560 579685 1250 0 0 490020 94 0 0 25 0 9 0 636584235 3409207296 794059 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30586/tid=30597] ppid=30584 vsize=3329304 CPUtime=4901.92 cores=0-7
/proc/30586/task/30597/stat : 30597 (plingeling) R 30584 30586 30315 0 -1 4202560 515811 1250 0 0 490112 80 0 0 25 0 9 0 636584235 3409207296 794059 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30586/tid=30598] ppid=30584 vsize=3329304 CPUtime=4891.47 cores=0-7
/proc/30586/task/30598/stat : 30598 (plingeling) R 30584 30586 30315 0 -1 4202560 564391 1250 0 0 489063 84 0 0 25 0 9 0 636584235 3409207296 794059 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30586/tid=30599] ppid=30584 vsize=3329304 CPUtime=4901.23 cores=0-7
/proc/30586/task/30599/stat : 30599 (plingeling) R 30584 30586 30315 0 -1 4202560 526833 1250 0 0 490041 82 0 0 25 0 9 0 636584235 3409207296 794059 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30586/tid=30600] ppid=30584 vsize=3329304 CPUtime=4901.94 cores=0-7
/proc/30586/task/30600/stat : 30600 (plingeling) R 30584 30586 30315 0 -1 4202560 437390 1250 0 0 490135 59 0 0 25 0 9 0 636584235 3409207296 794059 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39170.1
Current children cumulated vsize (KiB) 3329304

[startup+4962.3 s]
/proc/loadavg: 8.10 8.07 8.02 9/281 30754
/proc/meminfo: memFree=21221876/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=3648248 CPUtime=39649.5 cores=0-7
/proc/30586/stat : 30586 (plingeling) S 30584 30586 30315 0 -1 4202496 3939029 1250 0 0 3964337 611 0 0 18 0 9 0 636584189 3735805952 873795 33554432000 4194304 4417452 140736039370432 18446744073709551615 254273419237 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/30586/statm: 912062 873795 180 55 0 909948 0
[pid=30586/tid=30593] ppid=30584 vsize=3648248 CPUtime=4961.78 cores=0-7
/proc/30586/task/30593/stat : 30593 (plingeling) R 30584 30586 30315 0 -1 4202560 392451 1250 0 0 496116 62 0 0 25 0 9 0 636584235 3735805952 873795 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30586/tid=30594] ppid=30584 vsize=3648248 CPUtime=4961.91 cores=0-7
/proc/30586/task/30594/stat : 30594 (plingeling) R 30584 30586 30315 0 -1 4202560 404691 1250 0 0 496128 63 0 0 25 0 9 0 636584235 3735805952 873795 33554432000 4194304 4417452 140736039370432 18446744073709551615 4366806 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30586/tid=30595] ppid=30584 vsize=3648248 CPUtime=4928.16 cores=0-7
/proc/30586/task/30595/stat : 30595 (plingeling) R 30584 30586 30315 0 -1 4202560 405472 1250 0 0 492751 65 0 0 25 0 9 0 636584235 3735805952 873795 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30586/tid=30596] ppid=30584 vsize=3648248 CPUtime=4961.13 cores=0-7
/proc/30586/task/30596/stat : 30596 (plingeling) R 30584 30586 30315 0 -1 4202560 584065 1250 0 0 496018 95 0 0 25 0 9 0 636584235 3735805952 873795 33554432000 4194304 4417452 140736039370432 18446744073709551615 4236603 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30586/tid=30597] ppid=30584 vsize=3648248 CPUtime=4961.91 cores=0-7
/proc/30586/task/30597/stat : 30597 (plingeling) R 30584 30586 30315 0 -1 4202560 515824 1250 0 0 496111 80 0 0 25 0 9 0 636584235 3735805952 873795 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30586/tid=30598] ppid=30584 vsize=3648248 CPUtime=4950.93 cores=0-7
/proc/30586/task/30598/stat : 30598 (plingeling) R 30584 30586 30315 0 -1 4202560 580775 1250 0 0 495004 89 0 0 25 0 9 0 636584235 3735805952 873795 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30586/tid=30599] ppid=30584 vsize=3648248 CPUtime=4961.21 cores=0-7
/proc/30586/task/30599/stat : 30599 (plingeling) R 30584 30586 30315 0 -1 4202560 531598 1250 0 0 496038 83 0 0 25 0 9 0 636584235 3735805952 873795 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30586/tid=30600] ppid=30584 vsize=3648248 CPUtime=4961.93 cores=0-7
/proc/30586/task/30600/stat : 30600 (plingeling) R 30584 30586 30315 0 -1 4202560 505701 1250 0 0 496124 69 0 0 25 0 9 0 636584235 3735805952 873795 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39649.5
Current children cumulated vsize (KiB) 3648248



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5006.2 s]
/proc/loadavg: 8.12 8.07 8.02 9/281 30755
/proc/meminfo: memFree=21029656/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=3844924 CPUtime=40000.4 cores=0-7
/proc/30586/stat : 30586 (plingeling) S 30584 30586 30315 0 -1 4202496 4005108 1250 0 0 3999410 625 0 0 18 0 9 0 636584189 3937202176 922964 33554432000 4194304 4417452 140736039370432 18446744073709551615 254273419237 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/30586/statm: 961231 922964 180 55 0 959117 0
[pid=30586/tid=30593] ppid=30584 vsize=3844924 CPUtime=5005.69 cores=0-7
/proc/30586/task/30593/stat : 30593 (plingeling) R 30584 30586 30315 0 -1 4202560 392451 1250 0 0 500507 62 0 0 25 0 9 0 636584235 3937202176 922964 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30586/tid=30594] ppid=30584 vsize=3844924 CPUtime=5005.82 cores=0-7
/proc/30586/task/30594/stat : 30594 (plingeling) R 30584 30586 30315 0 -1 4202560 404691 1250 0 0 500519 63 0 0 25 0 9 0 636584235 3937202176 922964 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30586/tid=30595] ppid=30584 vsize=3844924 CPUtime=4972.07 cores=0-7
/proc/30586/task/30595/stat : 30595 (plingeling) R 30584 30586 30315 0 -1 4202560 405472 1250 0 0 497142 65 0 0 25 0 9 0 636584235 3937202176 922964 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30586/tid=30596] ppid=30584 vsize=3844924 CPUtime=5005.04 cores=0-7
/proc/30586/task/30596/stat : 30596 (plingeling) R 30584 30586 30315 0 -1 4202560 588613 1250 0 0 500409 95 0 0 25 0 9 0 636584235 3937202176 922964 33554432000 4194304 4417452 140736039370432 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30586/tid=30597] ppid=30584 vsize=3844924 CPUtime=5005.82 cores=0-7
/proc/30586/task/30597/stat : 30597 (plingeling) R 30584 30586 30315 0 -1 4202560 532208 1250 0 0 500498 84 0 0 25 0 9 0 636584235 3937202176 922964 33554432000 4194304 4417452 140736039370432 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30586/tid=30598] ppid=30584 vsize=3844924 CPUtime=4994.43 cores=0-7
/proc/30586/task/30598/stat : 30598 (plingeling) R 30584 30586 30315 0 -1 4202560 580775 1250 0 0 499354 89 0 0 25 0 9 0 636584235 3937202176 922964 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30586/tid=30599] ppid=30584 vsize=3844924 CPUtime=5005.13 cores=0-7
/proc/30586/task/30599/stat : 30599 (plingeling) R 30584 30586 30315 0 -1 4202560 576745 1250 0 0 500420 93 0 0 25 0 9 0 636584235 3937202176 922964 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30586/tid=30600] ppid=30584 vsize=3844924 CPUtime=5005.85 cores=0-7
/proc/30586/task/30600/stat : 30600 (plingeling) R 30584 30586 30315 0 -1 4202560 505701 1250 0 0 500516 69 0 0 25 0 9 0 636584235 3937202176 922964 33554432000 4194304 4417452 140736039370432 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 3844924

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5006.32 s]
/proc/loadavg: 8.12 8.07 8.02 9/281 30755
/proc/meminfo: memFree=21029656/32951124 swapFree=67057896/67111528
[pid=30586] ppid=30584 vsize=0 CPUtime=40000.5 cores=0-7
/proc/30586/stat : 30586 (plingeling) Z 30584 30586 30315 0 -1 4203548 4005108 1250 0 0 3999414 635 0 0 18 0 2 0 636584189 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/30586/statm: 0 0 0 0 0 0 0
[pid=30586/tid=30598] ppid=30584 vsize=0 CPUtime=4994.53 cores=0-7
/proc/30586/task/30598/stat : 30598 (plingeling) R 30584 30586 30315 0 -1 4203588 580775 1250 0 0 499354 99 0 0 25 0 2 0 636584235 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5006.38
CPU time (s): 40000.6
CPU user time (s): 39994.2
CPU system time (s): 6.41502
CPU usage (%): 798.992
Max. virtual memory (cumulated for all children) (KiB): 3844924

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39994.2
system time used= 6.41502
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4006358
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 606
involuntary context switches= 193782

runsolver used 13.257 second user time and 31.8942 second system time

The end

Launcher Data 

Begin job on node140 at 2011-05-15 08:41:29
IDJOB=3372728
IDBENCH=83137
IDSOLVER=1851
FILE ID=node140/3372728-1305441688
RUNJOBID= node140-1305437514-30329
PBS_JOBID= 13324780
Free space on /tmp= 73508 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom23.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372728-1305441688/watcher-3372728-1305441688 -o /tmp/evaluation-result-3372728-1305441688/solver-3372728-1305441688 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3372728-1305441688.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= e560aa6505ddce6d3784f70d5b7aff66
RANDOM SEED=763110529

node140.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24721568 kB
Buffers:        310384 kB
Cached:        4079332 kB
SwapCached:       8056 kB
Active:        4914600 kB
Inactive:      3004092 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24721568 kB
SwapTotal:    67111528 kB
SwapFree:     67057896 kB
Dirty:            3528 kB
Writeback:           0 kB
AnonPages:     3527136 kB
Mapped:          22980 kB
Slab:           223768 kB
PageTables:      21804 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 45562780 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73504 MiB
End job on node140 at 2011-05-15 10:04:57