Trace number 3285573

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.36 1202.63

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf
MD5SUM4ab53801f3b1a3f7169c9fb38cba4184
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables171676
Number of clauses870241
Sum of the clauses size2069671
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2859140
Number of clauses of size 32700
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 58190

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3285573-1304059943/watcher-3285573-1304059943 -o /tmp/evaluation-result-3285573-1304059943/solver-3285573-1304059943 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3285573-1304059943.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.88 7.98 7.98 5/181 31374
/proc/meminfo: memFree=14276844/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=11360 CPUtime=0 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) R 31372 31374 31098 0 -1 4202496 901 1257 0 0 0 0 0 0 23 0 1 0 517594039 11632640 830 33554432000 4194304 4417332 140735646185632 18446744073709551615 4231657 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/31374/statm: 2840 830 143 55 0 726 0

[startup+0.014931 s]
/proc/loadavg: 7.88 7.98 7.98 5/181 31374
/proc/meminfo: memFree=14276844/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=12384 CPUtime=0.01 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) R 31372 31374 31098 0 -1 4202496 1188 1257 0 0 1 0 0 0 23 0 1 0 517594039 12681216 1117 33554432000 4194304 4417332 140735646185632 18446744073709551615 4231629 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/31374/statm: 3096 1117 146 55 0 982 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 12384

[startup+0.100919 s]
/proc/loadavg: 7.88 7.98 7.98 5/181 31374
/proc/meminfo: memFree=14276844/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=24012 CPUtime=0.09 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) R 31372 31374 31098 0 -1 4202496 4097 1257 0 0 9 0 0 0 24 0 1 0 517594039 24588288 4026 33554432000 4194304 4417332 140735646185632 18446744073709551615 274473967360 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/31374/statm: 6003 4026 148 55 0 3889 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 24012

[startup+0.300884 s]
/proc/loadavg: 7.88 7.98 7.98 5/181 31374
/proc/meminfo: memFree=14276844/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=60396 CPUtime=0.29 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) R 31372 31374 31098 0 -1 4202496 13193 1257 0 0 28 1 0 0 25 0 1 0 517594039 61845504 13122 33554432000 4194304 4417332 140735646185632 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/31374/statm: 15099 13122 148 55 0 12985 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 60396

[startup+0.700814 s]
/proc/loadavg: 7.88 7.98 7.98 5/181 31374
/proc/meminfo: memFree=14276844/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=125428 CPUtime=0.69 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) R 31372 31374 31098 0 -1 4202496 29451 1257 0 0 66 3 0 0 25 0 1 0 517594039 128438272 29380 33554432000 4194304 4417332 140735646185632 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/31374/statm: 31357 29380 148 55 0 29243 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 125428

[startup+1.50067 s]
/proc/loadavg: 7.88 7.98 7.98 9/186 31384
/proc/meminfo: memFree=14160004/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=219360 CPUtime=3.57 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 51629 1257 0 0 351 6 0 0 25 0 5 0 517594039 224624640 29599 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 54840 29599 174 55 0 52726 0
[pid=31374/tid=31381] ppid=31372 vsize=219360 CPUtime=0.68 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 5884 1257 0 0 68 0 0 0 25 0 5 0 517594120 224624640 29599 33554432000 4194304 4417332 140735646185632 18446744073709551615 4310334 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=219360 CPUtime=0.68 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 5849 1257 0 0 68 0 0 0 25 0 5 0 517594120 224624640 29599 33554432000 4194304 4417332 140735646185632 18446744073709551615 4309991 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=219360 CPUtime=0.68 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 7519 1257 0 0 67 1 0 0 25 0 5 0 517594120 224624640 29599 33554432000 4194304 4417332 140735646185632 18446744073709551615 4309899 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=219360 CPUtime=0.69 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 2914 1257 0 0 69 0 0 0 25 0 5 0 517594120 224624640 29599 33554432000 4194304 4417332 140735646185632 18446744073709551615 4236634 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3.57
Current children cumulated vsize (KiB) 219360

[startup+3.10039 s]
/proc/loadavg: 7.88 7.98 7.98 9/186 31384
/proc/meminfo: memFree=14145744/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=229832 CPUtime=9.96 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 65158 1257 0 0 988 8 0 0 25 0 5 0 517594039 235347968 35343 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 57458 35343 177 55 0 55344 0
[pid=31374/tid=31381] ppid=31372 vsize=229832 CPUtime=2.29 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 9887 1257 0 0 228 1 0 0 25 0 5 0 517594120 235347968 35343 33554432000 4194304 4417332 140735646185632 18446744073709551615 4275475 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=229832 CPUtime=2.29 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 12086 1257 0 0 228 1 0 0 25 0 5 0 517594120 235347968 35343 33554432000 4194304 4417332 140735646185632 18446744073709551615 4255595 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=229832 CPUtime=2.27 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 10807 1257 0 0 226 1 0 0 25 0 5 0 517594120 235347968 35343 33554432000 4194304 4417332 140735646185632 18446744073709551615 4346377 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=229832 CPUtime=2.29 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 2915 1257 0 0 229 0 0 0 25 0 5 0 517594120 235347968 35343 33554432000 4194304 4417332 140735646185632 18446744073709551615 4236830 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 9.96
Current children cumulated vsize (KiB) 229832

[startup+6.30083 s]
/proc/loadavg: 7.89 7.98 7.98 9/186 31384
/proc/meminfo: memFree=14068040/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=287312 CPUtime=22.74 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 88467 1257 0 0 2263 11 0 0 25 0 5 0 517594039 294207488 47073 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 71828 47073 181 55 0 69714 0
[pid=31374/tid=31381] ppid=31372 vsize=287312 CPUtime=5.49 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 15939 1257 0 0 547 2 0 0 25 0 5 0 517594120 294207488 47073 33554432000 4194304 4417332 140735646185632 18446744073709551615 4235968 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=287312 CPUtime=5.49 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 19027 1257 0 0 547 2 0 0 25 0 5 0 517594120 294207488 47073 33554432000 4194304 4417332 140735646185632 18446744073709551615 4259186 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=287312 CPUtime=5.46 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 15012 1257 0 0 544 2 0 0 25 0 5 0 517594120 294207488 47073 33554432000 4194304 4417332 140735646185632 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=287312 CPUtime=5.48 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 9026 1257 0 0 548 0 0 0 25 0 5 0 517594120 294207488 47073 33554432000 4194304 4417332 140735646185632 18446744073709551615 4320992 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 22.74
Current children cumulated vsize (KiB) 287312

[startup+12.7007 s]
/proc/loadavg: 7.90 7.98 7.98 9/186 31384
/proc/meminfo: memFree=14042544/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=301088 CPUtime=48.3 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 95625 1257 0 0 4818 12 0 0 25 0 5 0 517594039 308314112 50825 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 75272 50825 181 55 0 73158 0
[pid=31374/tid=31381] ppid=31372 vsize=301088 CPUtime=11.89 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 15939 1257 0 0 1187 2 0 0 25 0 5 0 517594120 308314112 50825 33554432000 4194304 4417332 140735646185632 18446744073709551615 4364695 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=301088 CPUtime=11.88 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 20963 1257 0 0 1186 2 0 0 25 0 5 0 517594120 308314112 50825 33554432000 4194304 4417332 140735646185632 18446744073709551615 4264940 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=301088 CPUtime=11.82 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 15012 1257 0 0 1180 2 0 0 25 0 5 0 517594120 308314112 50825 33554432000 4194304 4417332 140735646185632 18446744073709551615 4264768 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=301088 CPUtime=11.88 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 14248 1257 0 0 1187 1 0 0 25 0 5 0 517594120 308314112 50825 33554432000 4194304 4417332 140735646185632 18446744073709551615 4237148 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 48.3
Current children cumulated vsize (KiB) 301088

[startup+25.5005 s]
/proc/loadavg: 7.92 7.98 7.98 9/186 31384
/proc/meminfo: memFree=13869428/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=323176 CPUtime=99.43 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 117984 1257 0 0 9927 16 0 0 25 0 5 0 517594039 330932224 61951 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 80794 61951 181 55 0 78680 0
[pid=31374/tid=31381] ppid=31372 vsize=323176 CPUtime=24.69 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 18065 1257 0 0 2467 2 0 0 25 0 5 0 517594120 330932224 61951 33554432000 4194304 4417332 140735646185632 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=323176 CPUtime=24.69 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 35601 1257 0 0 2464 5 0 0 25 0 5 0 517594120 330932224 61951 33554432000 4194304 4417332 140735646185632 18446744073709551615 4357265 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=323176 CPUtime=24.55 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 15883 1257 0 0 2453 2 0 0 25 0 5 0 517594120 330932224 61951 33554432000 4194304 4417332 140735646185632 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=323176 CPUtime=24.68 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 18972 1257 0 0 2466 2 0 0 25 0 5 0 517594120 330932224 61951 33554432000 4194304 4417332 140735646185632 18446744073709551615 4364531 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 99.43
Current children cumulated vsize (KiB) 323176

[startup+51.1009 s]
/proc/loadavg: 7.95 7.98 7.98 9/186 31385
/proc/meminfo: memFree=13605216/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=438080 CPUtime=201.69 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 175629 1257 0 0 20146 23 0 0 25 0 5 0 517594039 448593920 91564 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 109520 91564 181 55 0 107406 0
[pid=31374/tid=31381] ppid=31372 vsize=438080 CPUtime=50.28 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 22917 1257 0 0 5026 2 0 0 25 0 5 0 517594120 448593920 91564 33554432000 4194304 4417332 140735646185632 18446744073709551615 4232801 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=438080 CPUtime=50.29 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 51524 1257 0 0 5022 7 0 0 25 0 5 0 517594120 448593920 91564 33554432000 4194304 4417332 140735646185632 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=438080 CPUtime=50 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 19703 1257 0 0 4998 2 0 0 25 0 5 0 517594120 448593920 91564 33554432000 4194304 4417332 140735646185632 18446744073709551615 4357195 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=438080 CPUtime=50.28 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 52022 1257 0 0 5022 6 0 0 25 0 5 0 517594120 448593920 91564 33554432000 4194304 4417332 140735646185632 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 201.69
Current children cumulated vsize (KiB) 438080

[startup+102.307 s]
/proc/loadavg: 7.98 7.98 7.98 9/186 31387
/proc/meminfo: memFree=13895992/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=538040 CPUtime=406.23 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 341924 1257 0 0 40577 46 0 0 25 0 5 0 517594039 550952960 121677 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 134510 121677 181 55 0 132396 0
[pid=31374/tid=31381] ppid=31372 vsize=538040 CPUtime=101.49 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 29191 1257 0 0 10146 3 0 0 25 0 5 0 517594120 550952960 121677 33554432000 4194304 4417332 140735646185632 18446744073709551615 4356899 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=538040 CPUtime=101.49 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 87835 1257 0 0 10138 11 0 0 25 0 5 0 517594120 550952960 121677 33554432000 4194304 4417332 140735646185632 18446744073709551615 4353447 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=538040 CPUtime=100.93 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 26609 1257 0 0 10090 3 0 0 25 0 5 0 517594120 550952960 121677 33554432000 4194304 4417332 140735646185632 18446744073709551615 4232656 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=538040 CPUtime=101.49 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 168826 1257 0 0 10125 24 0 0 25 0 5 0 517594120 550952960 121677 33554432000 4194304 4417332 140735646185632 18446744073709551615 4320867 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 406.23
Current children cumulated vsize (KiB) 538040

[startup+162.3 s]
/proc/loadavg: 7.99 7.98 7.98 9/186 31388
/proc/meminfo: memFree=13563152/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=660008 CPUtime=645.88 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 453211 1257 0 0 64527 61 0 0 25 0 5 0 517594039 675848192 147392 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 165002 147392 181 55 0 162888 0
[pid=31374/tid=31381] ppid=31372 vsize=660008 CPUtime=161.48 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 39376 1257 0 0 16144 4 0 0 25 0 5 0 517594120 675848192 147392 33554432000 4194304 4417332 140735646185632 18446744073709551615 4355739 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=660008 CPUtime=161.49 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 98517 1257 0 0 16136 13 0 0 25 0 5 0 517594120 675848192 147392 33554432000 4194304 4417332 140735646185632 18446744073709551615 4309907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=660008 CPUtime=160.6 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 30455 1257 0 0 16056 4 0 0 25 0 5 0 517594120 675848192 147392 33554432000 4194304 4417332 140735646185632 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=660008 CPUtime=161.48 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 255400 1257 0 0 16113 35 0 0 25 0 5 0 517594120 675848192 147392 33554432000 4194304 4417332 140735646185632 18446744073709551615 4250744 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 645.88
Current children cumulated vsize (KiB) 660008


################
# More data... #
################

/proc/meminfo: memFree=13634016/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=1167692 CPUtime=3041.81 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 1989580 1257 0 0 303910 271 0 0 25 0 5 0 517594039 1195716608 278940 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 291923 278940 181 55 0 289809 0
[pid=31374/tid=31381] ppid=31372 vsize=1167692 CPUtime=761.32 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 248517 1257 0 0 76099 33 0 0 25 0 5 0 517594120 1195716608 278940 33554432000 4194304 4417332 140735646185632 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=1167692 CPUtime=760.82 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 325544 1257 0 0 76040 42 0 0 25 0 5 0 517594120 1195716608 278940 33554432000 4194304 4417332 140735646185632 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=1167692 CPUtime=757.34 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 235438 1257 0 0 75706 28 0 0 25 0 5 0 517594120 1195716608 278940 33554432000 4194304 4417332 140735646185632 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=1167692 CPUtime=761.48 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 1150618 1257 0 0 75986 162 0 0 25 0 5 0 517594120 1195716608 278940 33554432000 4194304 4417332 140735646185632 18446744073709551615 4320823 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3041.81
Current children cumulated vsize (KiB) 1167692

[startup+822.3 s]
/proc/loadavg: 8.21 8.15 8.05 9/186 31455
/proc/meminfo: memFree=13514564/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=1260392 CPUtime=3281.45 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 2179235 1257 0 0 327850 295 0 0 25 0 5 0 517594039 1290641408 302115 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 315098 302115 181 55 0 312984 0
[pid=31374/tid=31381] ppid=31372 vsize=1260392 CPUtime=821.32 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 301167 1257 0 0 82093 39 0 0 25 0 5 0 517594120 1290641408 302115 33554432000 4194304 4417332 140735646185632 18446744073709551615 4357811 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=1260392 CPUtime=820.82 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 325544 1257 0 0 82040 42 0 0 25 0 5 0 517594120 1290641408 302115 33554432000 4194304 4417332 140735646185632 18446744073709551615 4354410 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=1260392 CPUtime=817.01 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 261943 1257 0 0 81669 32 0 0 25 0 5 0 517594120 1290641408 302115 33554432000 4194304 4417332 140735646185632 18446744073709551615 4364734 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=1260392 CPUtime=821.47 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 1261118 1257 0 0 81971 176 0 0 25 0 5 0 517594120 1290641408 302115 33554432000 4194304 4417332 140735646185632 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3281.45
Current children cumulated vsize (KiB) 1260392

[startup+882.301 s]
/proc/loadavg: 8.12 8.14 8.05 9/186 31456
/proc/meminfo: memFree=13342428/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=1357592 CPUtime=3521.13 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 2355566 1257 0 0 351792 321 0 0 25 0 5 0 517594039 1390174208 326415 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 339398 326415 181 55 0 337284 0
[pid=31374/tid=31381] ppid=31372 vsize=1357592 CPUtime=881.31 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 342163 1257 0 0 88087 44 0 0 25 0 5 0 517594120 1390174208 326415 33554432000 4194304 4417332 140735646185632 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=1357592 CPUtime=880.82 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 325544 1257 0 0 88040 42 0 0 25 0 5 0 517594120 1390174208 326415 33554432000 4194304 4417332 140735646185632 18446744073709551615 4357458 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=1357592 CPUtime=876.68 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 280197 1257 0 0 87632 36 0 0 25 0 5 0 517594120 1390174208 326415 33554432000 4194304 4417332 140735646185632 18446744073709551615 4265443 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=1357592 CPUtime=881.48 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 1378199 1257 0 0 87955 193 0 0 25 0 5 0 517594120 1390174208 326415 33554432000 4194304 4417332 140735646185632 18446744073709551615 4357243 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3521.13
Current children cumulated vsize (KiB) 1357592

[startup+942.301 s]
/proc/loadavg: 8.13 8.14 8.05 9/186 31458
/proc/meminfo: memFree=13138048/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=1543684 CPUtime=3760.81 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 2510171 1257 0 0 375737 344 0 0 25 0 5 0 517594039 1580732416 372938 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 385921 372938 181 55 0 383807 0
[pid=31374/tid=31381] ppid=31372 vsize=1543684 CPUtime=941.31 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 362150 1257 0 0 94084 47 0 0 25 0 5 0 517594120 1580732416 372938 33554432000 4194304 4417332 140735646185632 18446744073709551615 4250936 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=1543684 CPUtime=940.82 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 329681 1257 0 0 94039 43 0 0 25 0 5 0 517594120 1580732416 372938 33554432000 4194304 4417332 140735646185632 18446744073709551615 4358641 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=1543684 CPUtime=936.35 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 356974 1257 0 0 93588 47 0 0 25 0 5 0 517594120 1580732416 372938 33554432000 4194304 4417332 140735646185632 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=1543684 CPUtime=941.48 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 1431903 1257 0 0 93947 201 0 0 25 0 5 0 517594120 1580732416 372938 33554432000 4194304 4417332 140735646185632 18446744073709551615 4353461 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3760.81
Current children cumulated vsize (KiB) 1543684

[startup+1002.3 s]
/proc/loadavg: 8.08 8.13 8.05 9/186 31460
/proc/meminfo: memFree=13007080/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=1654872 CPUtime=4000.47 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 2709595 1257 0 0 399674 373 0 0 25 0 5 0 517594039 1694588928 400735 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 413718 400735 181 55 0 411604 0
[pid=31374/tid=31381] ppid=31372 vsize=1654872 CPUtime=1001.32 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 376826 1257 0 0 100082 50 0 0 25 0 5 0 517594120 1694588928 400735 33554432000 4194304 4417332 140735646185632 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=1654872 CPUtime=1000.83 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 402687 1257 0 0 100029 54 0 0 25 0 5 0 517594120 1694588928 400735 33554432000 4194304 4417332 140735646185632 18446744073709551615 4237189 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=1654872 CPUtime=996.02 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 396650 1257 0 0 99548 54 0 0 25 0 5 0 517594120 1694588928 400735 33554432000 4194304 4417332 140735646185632 18446744073709551615 4256265 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=1654872 CPUtime=1001.47 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 1503969 1257 0 0 99937 210 0 0 25 0 5 0 517594120 1694588928 400735 33554432000 4194304 4417332 140735646185632 18446744073709551615 4358010 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4000.47
Current children cumulated vsize (KiB) 1654872

[startup+1062.3 s]
/proc/loadavg: 8.03 8.10 8.05 9/186 31461
/proc/meminfo: memFree=13082696/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=1532288 CPUtime=4240.14 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 3096638 1257 0 0 423583 431 0 0 25 0 5 0 517594039 1569062912 370120 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 383072 370120 181 55 0 380958 0
[pid=31374/tid=31381] ppid=31372 vsize=1532288 CPUtime=1061.31 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 389650 1257 0 0 106079 52 0 0 25 0 5 0 517594120 1569062912 370120 33554432000 4194304 4417332 140735646185632 18446744073709551615 4354401 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=1532288 CPUtime=1060.82 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 419862 1257 0 0 106026 56 0 0 25 0 5 0 517594120 1569062912 370120 33554432000 4194304 4417332 140735646185632 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=1532288 CPUtime=1055.7 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 565632 1257 0 0 105493 77 0 0 25 0 5 0 517594120 1569062912 370120 33554432000 4194304 4417332 140735646185632 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=1532288 CPUtime=1061.47 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 1692031 1257 0 0 105907 240 0 0 25 0 5 0 517594120 1569062912 370120 33554432000 4194304 4417332 140735646185632 18446744073709551615 4357164 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4240.14
Current children cumulated vsize (KiB) 1532288

[startup+1122.3 s]
/proc/loadavg: 8.01 8.08 8.04 9/186 31463
/proc/meminfo: memFree=11891156/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=2653292 CPUtime=4479.81 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 3497495 1257 0 0 447490 491 0 0 25 0 5 0 517594039 2716971008 650371 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 663323 650371 181 55 0 661209 0
[pid=31374/tid=31381] ppid=31372 vsize=2653292 CPUtime=1121.3 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 526850 1257 0 0 112061 69 0 0 25 0 5 0 517594120 2716971008 650371 33554432000 4194304 4417332 140735646185632 18446744073709551615 4364899 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=2653292 CPUtime=1120.82 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 436991 1257 0 0 112023 59 0 0 25 0 5 0 517594120 2716971008 650371 33554432000 4194304 4417332 140735646185632 18446744073709551615 4358010 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=2653292 CPUtime=1115.38 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 614746 1257 0 0 111454 84 0 0 25 0 5 0 517594120 2716971008 650371 33554432000 4194304 4417332 140735646185632 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=2653292 CPUtime=1121.48 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 1889445 1257 0 0 111874 274 0 0 25 0 5 0 517594120 2716971008 650371 33554432000 4194304 4417332 140735646185632 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4479.81
Current children cumulated vsize (KiB) 2653292

[startup+1182.3 s]
/proc/loadavg: 8.00 8.06 8.04 9/186 31464
/proc/meminfo: memFree=11791928/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=2708424 CPUtime=4719.5 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 3777560 1257 0 0 471418 532 0 0 25 0 5 0 517594039 2773426176 664155 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 677106 664155 181 55 0 674992 0
[pid=31374/tid=31381] ppid=31372 vsize=2708424 CPUtime=1181.3 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 613555 1257 0 0 118050 80 0 0 25 0 5 0 517594120 2773426176 664155 33554432000 4194304 4417332 140735646185632 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=2708424 CPUtime=1180.83 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 477526 1257 0 0 118018 65 0 0 25 0 5 0 517594120 2773426176 664155 33554432000 4194304 4417332 140735646185632 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=2708424 CPUtime=1175.07 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 666638 1257 0 0 117414 93 0 0 25 0 5 0 517594120 2773426176 664155 33554432000 4194304 4417332 140735646185632 18446744073709551615 4232617 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=2708424 CPUtime=1181.48 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 1990378 1257 0 0 117858 290 0 0 25 0 5 0 517594120 2773426176 664155 33554432000 4194304 4417332 140735646185632 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4719.5
Current children cumulated vsize (KiB) 2708424



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.5 s]
/proc/loadavg: 8.00 8.06 8.03 9/186 31465
/proc/meminfo: memFree=11482168/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=3030444 CPUtime=4800.2 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) S 31372 31374 31098 0 -1 4202496 3858211 1257 0 0 479474 546 0 0 25 0 5 0 517594039 3103174656 744660 33554432000 4194304 4417332 140735646185632 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 757611 744660 181 55 0 755497 0
[pid=31374/tid=31381] ppid=31372 vsize=3030444 CPUtime=1201.51 cores=0,2,4,6
/proc/31374/task/31381/stat : 31381 (plingeling) R 31372 31374 31098 0 -1 4202560 625255 1257 0 0 120070 81 0 0 25 0 5 0 517594120 3103174656 744660 33554432000 4194304 4417332 140735646185632 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=31374/tid=31382] ppid=31372 vsize=3030444 CPUtime=1201.03 cores=0,2,4,6
/proc/31374/task/31382/stat : 31382 (plingeling) R 31372 31374 31098 0 -1 4202560 489136 1257 0 0 120037 66 0 0 25 0 5 0 517594120 3103174656 744660 33554432000 4194304 4417332 140735646185632 18446744073709551615 4354352 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=3030444 CPUtime=1195.16 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4202560 673396 1257 0 0 119423 93 0 0 25 0 5 0 517594120 3103174656 744660 33554432000 4194304 4417332 140735646185632 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=31374/tid=31384] ppid=31372 vsize=3030444 CPUtime=1201.68 cores=0,2,4,6
/proc/31374/task/31384/stat : 31384 (plingeling) R 31372 31374 31098 0 -1 4202560 2040961 1257 0 0 119867 301 0 0 25 0 5 0 517594120 3103174656 744660 33554432000 4194304 4417332 140735646185632 18446744073709551615 4357458 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.2
Current children cumulated vsize (KiB) 3030444

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.61 s]
/proc/loadavg: 8.00 8.06 8.03 9/186 31465
/proc/meminfo: memFree=11482168/32950928 swapFree=67111528/67111528
[pid=31374] ppid=31372 vsize=0 CPUtime=4800.33 cores=0,2,4,6
/proc/31374/stat : 31374 (plingeling) Z 31372 31374 31098 0 -1 4203548 3858212 1257 0 0 479477 556 0 0 18 0 2 0 517594039 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/31374/statm: 0 0 0 0 0 0 0
[pid=31374/tid=31383] ppid=31372 vsize=0 CPUtime=1195.26 cores=0,2,4,6
/proc/31374/task/31383/stat : 31383 (plingeling) R 31372 31374 31098 0 -1 4203588 673396 1257 0 0 119423 103 0 0 25 0 2 0 517594120 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.33
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.63
CPU time (s): 4800.36
CPU user time (s): 4794.77
CPU system time (s): 5.58315
CPU usage (%): 399.156
Max. virtual memory (cumulated for all children) (KiB): 3212648

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4794.77
system time used= 5.58315
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3859469
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 203
involuntary context switches= 25985

runsolver used 1.9547 second user time and 4.46832 second system time

The end

Launcher Data 

Begin job on node125 at 2011-04-29 08:52:24
IDJOB=3285573
IDBENCH=82389
IDSOLVER=1605
FILE ID=node125/3285573-1304059943
RUNJOBID= node125-1304058205-31116
PBS_JOBID= 13170441
Free space on /tmp= 72724 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.045-NOTKNOWN.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3285573-1304059943/watcher-3285573-1304059943 -o /tmp/evaluation-result-3285573-1304059943/solver-3285573-1304059943 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3285573-1304059943.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4ab53801f3b1a3f7169c9fb38cba4184
RANDOM SEED=1232749260

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      14277008 kB
Buffers:       2218956 kB
Cached:       15022404 kB
SwapCached:          0 kB
Active:        9993112 kB
Inactive:      8146944 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      14277008 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           16016 kB
Writeback:           0 kB
AnonPages:      898168 kB
Mapped:          15384 kB
Slab:           469116 kB
PageTables:       6508 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  1095648 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72700 MiB
End job on node125 at 2011-04-29 09:12:28