Trace number 3249360

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.42 1202.4

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-21x40.cnf
MD5SUM65a5698edfd6f3a12089595d81c196e3
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables3360
Number of clauses661080
Sum of the clauses size2634240
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 25040
Number of clauses of size 30
Number of clauses of size 4656040
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3249360-1304086677/watcher-3249360-1304086677 -o /tmp/evaluation-result-3249360-1304086677/solver-3249360-1304086677 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3249360-1304086677.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.53 7.97 7.98 6/181 879
/proc/meminfo: memFree=29374780/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=8728 CPUtime=0 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 216 0 0 0 0 0 0 0 21 0 1 0 598898403 8937472 146 33554432000 4194304 4417332 140733731243536 18446744073709551615 251367546624 0 0 4096 0 18446744071562362840 0 0 17 1 0 0 0
/proc/879/statm: 2182 146 122 55 0 68 0

[startup+0.0516271 s]
/proc/loadavg: 7.53 7.97 7.98 6/181 879
/proc/meminfo: memFree=29374780/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=22520 CPUtime=0.04 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) R 877 879 384 0 -1 4202496 3819 1252 0 0 4 0 0 0 21 0 1 0 598898403 23060480 3652 33554432000 4194304 4417332 140733731243536 18446744073709551615 251367546624 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/879/statm: 5630 3652 147 55 0 3516 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 22520

[startup+0.100613 s]
/proc/loadavg: 7.53 7.97 7.98 6/181 879
/proc/meminfo: memFree=29374780/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=26616 CPUtime=0.08 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) R 877 879 384 0 -1 4202496 4843 1252 0 0 8 0 0 0 21 0 1 0 598898403 27254784 4676 33554432000 4194304 4417332 140733731243536 18446744073709551615 4231392 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/879/statm: 6654 4676 147 55 0 4540 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 26616

[startup+0.300594 s]
/proc/loadavg: 7.53 7.97 7.98 6/181 879
/proc/meminfo: memFree=29374780/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=75768 CPUtime=0.29 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) R 877 879 384 0 -1 4202496 17131 1252 0 0 27 2 0 0 22 0 1 0 598898403 77586432 16964 33554432000 4194304 4417332 140733731243536 18446744073709551615 251367546624 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/879/statm: 18942 16964 147 55 0 16828 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 75768

[startup+0.700514 s]
/proc/loadavg: 7.53 7.97 7.98 6/181 879
/proc/meminfo: memFree=29374780/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=141304 CPUtime=0.69 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) R 877 879 384 0 -1 4202496 33515 1252 0 0 65 4 0 0 24 0 1 0 598898403 144695296 33348 33554432000 4194304 4417332 140733731243536 18446744073709551615 251367546624 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/879/statm: 35326 33348 147 55 0 33212 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 141304

[startup+1.5003 s]
/proc/loadavg: 7.53 7.97 7.98 9/186 890
/proc/meminfo: memFree=29227428/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=222720 CPUtime=3.6 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 48295 1252 0 0 353 7 0 0 25 0 5 0 598898403 228065280 43493 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 55680 43493 174 55 0 53566 0
[pid=879/tid=887] ppid=877 vsize=222720 CPUtime=0.69 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 4774 1252 0 0 69 0 0 0 25 0 5 0 598898482 228065280 43493 33554432000 4194304 4417332 140733731243536 18446744073709551615 4278518 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=222720 CPUtime=0.69 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 4143 1252 0 0 69 0 0 0 25 0 5 0 598898482 228065280 43493 33554432000 4194304 4417332 140733731243536 18446744073709551615 4295498 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=222720 CPUtime=0.68 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 4137 1252 0 0 68 0 0 0 25 0 5 0 598898482 228065280 43493 33554432000 4194304 4417332 140733731243536 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=222720 CPUtime=0.7 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 1714 1252 0 0 70 0 0 0 25 0 5 0 598898482 228065280 43493 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3.6
Current children cumulated vsize (KiB) 222720

[startup+3.101 s]
/proc/loadavg: 7.53 7.97 7.98 9/186 890
/proc/meminfo: memFree=29184896/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=250924 CPUtime=9.99 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 60594 1252 0 0 990 9 0 0 25 0 5 0 598898403 256946176 50517 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 62731 50517 179 55 0 60617 0
[pid=879/tid=887] ppid=877 vsize=250924 CPUtime=2.3 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 4786 1252 0 0 230 0 0 0 25 0 5 0 598898482 256946176 50517 33554432000 4194304 4417332 140733731243536 18446744073709551615 4254862 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=250924 CPUtime=2.29 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 4784 1252 0 0 229 0 0 0 25 0 5 0 598898482 256946176 50517 33554432000 4194304 4417332 140733731243536 18446744073709551615 4254041 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=250924 CPUtime=2.29 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 7372 1252 0 0 228 1 0 0 25 0 5 0 598898482 256946176 50517 33554432000 4194304 4417332 140733731243536 18446744073709551615 4239395 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=250924 CPUtime=2.29 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 10125 1252 0 0 228 1 0 0 25 0 5 0 598898482 256946176 50517 33554432000 4194304 4417332 140733731243536 18446744073709551615 4354236 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 9.99
Current children cumulated vsize (KiB) 250924

[startup+6.30041 s]
/proc/loadavg: 7.65 7.99 7.98 9/186 890
/proc/meminfo: memFree=29099088/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=335040 CPUtime=22.77 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 87753 1252 0 0 2263 14 0 0 25 0 5 0 598898403 343080960 71546 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 83760 71546 179 55 0 81646 0
[pid=879/tid=887] ppid=877 vsize=335040 CPUtime=5.5 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 14396 1252 0 0 548 2 0 0 25 0 5 0 598898482 343080960 71546 33554432000 4194304 4417332 140733731243536 18446744073709551615 4239401 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=335040 CPUtime=5.5 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 7987 1252 0 0 549 1 0 0 25 0 5 0 598898482 343080960 71546 33554432000 4194304 4417332 140733731243536 18446744073709551615 4239408 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=335040 CPUtime=5.46 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 13779 1252 0 0 544 2 0 0 25 0 5 0 598898482 343080960 71546 33554432000 4194304 4417332 140733731243536 18446744073709551615 4239411 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=335040 CPUtime=5.49 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 18064 1252 0 0 546 3 0 0 25 0 5 0 598898482 343080960 71546 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 22.77
Current children cumulated vsize (KiB) 335040

[startup+12.7002 s]
/proc/loadavg: 7.68 7.99 7.98 9/186 890
/proc/meminfo: memFree=28969440/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=380104 CPUtime=48.33 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 103945 1252 0 0 4817 16 0 0 25 0 5 0 598898403 389226496 82812 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 95026 82812 179 55 0 92912 0
[pid=879/tid=887] ppid=877 vsize=380104 CPUtime=11.9 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 14492 1252 0 0 1188 2 0 0 25 0 5 0 598898482 389226496 82812 33554432000 4194304 4417332 140733731243536 18446744073709551615 4249186 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=380104 CPUtime=11.89 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 14394 1252 0 0 1188 1 0 0 25 0 5 0 598898482 389226496 82812 33554432000 4194304 4417332 140733731243536 18446744073709551615 4258389 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=380104 CPUtime=11.83 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 13779 1252 0 0 1181 2 0 0 25 0 5 0 598898482 389226496 82812 33554432000 4194304 4417332 140733731243536 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=380104 CPUtime=11.89 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 27753 1252 0 0 1185 4 0 0 25 0 5 0 598898482 389226496 82812 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 48.33
Current children cumulated vsize (KiB) 380104

[startup+25.5009 s]
/proc/loadavg: 7.83 8.00 7.99 9/186 890
/proc/meminfo: memFree=28918384/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=416140 CPUtime=99.47 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 168247 1252 0 0 9918 29 0 0 25 0 5 0 598898403 426127360 91821 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 104035 91821 179 55 0 101921 0
[pid=879/tid=887] ppid=877 vsize=416140 CPUtime=24.7 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 33624 1252 0 0 2463 7 0 0 25 0 5 0 598898482 426127360 91821 33554432000 4194304 4417332 140733731243536 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=416140 CPUtime=24.69 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 34151 1252 0 0 2464 5 0 0 25 0 5 0 598898482 426127360 91821 33554432000 4194304 4417332 140733731243536 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=416140 CPUtime=24.56 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 24479 1252 0 0 2452 4 0 0 25 0 5 0 598898482 426127360 91821 33554432000 4194304 4417332 140733731243536 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=416140 CPUtime=24.69 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 42466 1252 0 0 2463 6 0 0 25 0 5 0 598898482 426127360 91821 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364656 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 99.47
Current children cumulated vsize (KiB) 416140

[startup+51.1011 s]
/proc/loadavg: 7.89 8.00 7.99 9/186 891
/proc/meminfo: memFree=28827440/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=454584 CPUtime=201.73 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 291681 1252 0 0 20125 48 0 0 25 0 5 0 598898403 465494016 101464 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 113646 101464 179 55 0 111532 0
[pid=879/tid=887] ppid=877 vsize=454584 CPUtime=50.3 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 52672 1252 0 0 5020 10 0 0 25 0 5 0 598898482 465494016 101464 33554432000 4194304 4417332 140733731243536 18446744073709551615 4249181 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=454584 CPUtime=50.29 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 62916 1252 0 0 5020 9 0 0 25 0 5 0 598898482 465494016 101464 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=454584 CPUtime=50.02 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 80358 1252 0 0 4989 13 0 0 25 0 5 0 598898482 465494016 101464 33554432000 4194304 4417332 140733731243536 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=454584 CPUtime=50.29 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 62208 1252 0 0 5019 10 0 0 25 0 5 0 598898482 465494016 101464 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 201.73
Current children cumulated vsize (KiB) 454584

[startup+102.307 s]
/proc/loadavg: 7.95 8.00 7.99 9/186 892
/proc/meminfo: memFree=28583132/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=576152 CPUtime=406.26 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 492259 1252 0 0 40547 79 0 0 25 0 5 0 598898403 589979648 131824 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 144038 131824 179 55 0 141924 0
[pid=879/tid=887] ppid=877 vsize=576152 CPUtime=101.5 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 108072 1252 0 0 10132 18 0 0 25 0 5 0 598898482 589979648 131824 33554432000 4194304 4417332 140733731243536 18446744073709551615 4250017 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=576152 CPUtime=101.49 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 115569 1252 0 0 10132 17 0 0 25 0 5 0 598898482 589979648 131824 33554432000 4194304 4417332 140733731243536 18446744073709551615 4250047 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=576152 CPUtime=100.95 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 150777 1252 0 0 10070 25 0 0 25 0 5 0 598898482 589979648 131824 33554432000 4194304 4417332 140733731243536 18446744073709551615 4354401 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=576152 CPUtime=101.5 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 84314 1252 0 0 10136 14 0 0 25 0 5 0 598898482 589979648 131824 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 406.26
Current children cumulated vsize (KiB) 576152

[startup+162.301 s]
/proc/loadavg: 7.98 8.00 7.99 9/186 894
/proc/meminfo: memFree=28358548/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=771632 CPUtime=645.91 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 642387 1252 0 0 64495 96 0 0 25 0 5 0 598898403 790151168 180694 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 192908 180694 179 55 0 190794 0
[pid=879/tid=887] ppid=877 vsize=771632 CPUtime=161.51 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 141605 1252 0 0 16129 22 0 0 25 0 5 0 598898482 790151168 180694 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=771632 CPUtime=161.49 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 134510 1252 0 0 16130 19 0 0 25 0 5 0 598898482 790151168 180694 33554432000 4194304 4417332 140733731243536 18446744073709551615 4249193 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=771632 CPUtime=160.62 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 208736 1252 0 0 16031 31 0 0 25 0 5 0 598898482 790151168 180694 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364957 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=771632 CPUtime=161.49 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 124009 1252 0 0 16130 19 0 0 25 0 5 0 598898482 790151168 180694 33554432000 4194304 4417332 140733731243536 18446744073709551615 4199406 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 645.91
Current children cumulated vsize (KiB) 771632


################
# More data... #
################

[pid=879/tid=888] ppid=877 vsize=1384756 CPUtime=761.44 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 356160 1252 0 0 76096 48 0 0 25 0 5 0 598898482 1417990144 334007 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=1384756 CPUtime=757.37 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 470745 1252 0 0 75667 70 0 0 25 0 5 0 598898482 1417990144 334007 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=1384756 CPUtime=761.52 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 308210 1252 0 0 76102 50 0 0 25 0 5 0 598898482 1417990144 334007 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3042.67
Current children cumulated vsize (KiB) 1384756

[startup+822.301 s]
/proc/loadavg: 8.17 8.08 8.01 9/186 912
/proc/meminfo: memFree=26672660/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=1485088 CPUtime=3282.33 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 1939426 1252 0 0 327936 297 0 0 25 0 5 0 598898403 1520730112 359058 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 371272 359058 179 55 0 369158 0
[pid=879/tid=887] ppid=877 vsize=1485088 CPUtime=821.52 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 673837 1252 0 0 82048 104 0 0 25 0 5 0 598898482 1520730112 359058 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=1485088 CPUtime=821.44 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 405606 1252 0 0 82086 58 0 0 25 0 5 0 598898482 1520730112 359058 33554432000 4194304 4417332 140733731243536 18446744073709551615 4251100 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=1485088 CPUtime=817.04 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 494772 1252 0 0 81630 74 0 0 25 0 5 0 598898482 1520730112 359058 33554432000 4194304 4417332 140733731243536 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=1485088 CPUtime=821.51 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 331684 1252 0 0 82096 55 0 0 25 0 5 0 598898482 1520730112 359058 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3282.33
Current children cumulated vsize (KiB) 1485088

[startup+882.301 s]
/proc/loadavg: 8.18 8.10 8.02 9/186 914
/proc/meminfo: memFree=26434292/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=1630956 CPUtime=3522 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 2081803 1252 0 0 351884 316 0 0 25 0 5 0 598898403 1670098944 395525 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 407739 395525 179 55 0 405625 0
[pid=879/tid=887] ppid=877 vsize=1630956 CPUtime=881.52 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 719667 1252 0 0 88042 110 0 0 25 0 5 0 598898482 1670098944 395525 33554432000 4194304 4417332 140733731243536 18446744073709551615 4249110 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=1630956 CPUtime=881.44 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 438744 1252 0 0 88083 61 0 0 25 0 5 0 598898482 1670098944 395525 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=1630956 CPUtime=876.71 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 533257 1252 0 0 87591 80 0 0 25 0 5 0 598898482 1670098944 395525 33554432000 4194304 4417332 140733731243536 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=1630956 CPUtime=881.51 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 356608 1252 0 0 88091 60 0 0 25 0 5 0 598898482 1670098944 395525 33554432000 4194304 4417332 140733731243536 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3522
Current children cumulated vsize (KiB) 1630956

[startup+942.3 s]
/proc/loadavg: 8.17 8.11 8.02 9/186 916
/proc/meminfo: memFree=25951896/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=2105388 CPUtime=3761.67 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 2352370 1252 0 0 375812 355 0 0 25 0 5 0 598898403 2155917312 514133 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 526347 514133 179 55 0 524233 0
[pid=879/tid=887] ppid=877 vsize=2105388 CPUtime=941.52 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 773778 1252 0 0 94036 116 0 0 25 0 5 0 598898482 2155917312 514133 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=2105388 CPUtime=941.42 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 494929 1252 0 0 94071 71 0 0 25 0 5 0 598898482 2155917312 514133 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=2105388 CPUtime=936.39 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 672851 1252 0 0 93542 97 0 0 25 0 5 0 598898482 2155917312 514133 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=2105388 CPUtime=941.52 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 377285 1252 0 0 94087 65 0 0 25 0 5 0 598898482 2155917312 514133 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3761.67
Current children cumulated vsize (KiB) 2105388

[startup+1002.3 s]
/proc/loadavg: 8.16 8.12 8.03 9/186 917
/proc/meminfo: memFree=25893080/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=2000608 CPUtime=4001.35 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 2468192 1252 0 0 399758 377 0 0 25 0 5 0 598898403 2048622592 487938 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 500152 487938 179 55 0 498038 0
[pid=879/tid=887] ppid=877 vsize=2000608 CPUtime=1001.52 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 797432 1252 0 0 100033 119 0 0 25 0 5 0 598898482 2048622592 487938 33554432000 4194304 4417332 140733731243536 18446744073709551615 4366303 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=2000608 CPUtime=1001.42 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 543571 1252 0 0 100063 79 0 0 25 0 5 0 598898482 2048622592 487938 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=2000608 CPUtime=996.06 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 716377 1252 0 0 99499 107 0 0 25 0 5 0 598898482 2048622592 487938 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=2000608 CPUtime=1001.52 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 377285 1252 0 0 100087 65 0 0 25 0 5 0 598898482 2048622592 487938 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4001.35
Current children cumulated vsize (KiB) 2000608

[startup+1062.3 s]
/proc/loadavg: 8.15 8.12 8.03 9/186 919
/proc/meminfo: memFree=25946628/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=1828724 CPUtime=4241.03 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 2560823 1252 0 0 423714 389 0 0 25 0 5 0 598898403 1872613376 428616 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 457181 428616 179 55 0 455067 0
[pid=879/tid=887] ppid=877 vsize=1828724 CPUtime=1061.53 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 840854 1252 0 0 106028 125 0 0 25 0 5 0 598898482 1872613376 428616 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=1828724 CPUtime=1061.42 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 570725 1252 0 0 106060 82 0 0 25 0 5 0 598898482 1872613376 428616 33554432000 4194304 4417332 140733731243536 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=1828724 CPUtime=1055.74 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 738432 1252 0 0 105463 111 0 0 25 0 5 0 598898482 1872613376 428616 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=1828724 CPUtime=1061.52 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 377285 1252 0 0 106087 65 0 0 25 0 5 0 598898482 1872613376 428616 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4241.03
Current children cumulated vsize (KiB) 1828724

[startup+1122.3 s]
/proc/loadavg: 8.09 8.11 8.03 9/186 920
/proc/meminfo: memFree=26069848/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=1703436 CPUtime=4480.69 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 2678220 1252 0 0 447661 408 0 0 25 0 5 0 598898403 1744318464 397294 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 425859 397294 179 55 0 423745 0
[pid=879/tid=887] ppid=877 vsize=1703436 CPUtime=1121.53 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 868906 1252 0 0 112023 130 0 0 25 0 5 0 598898482 1744318464 397294 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=1703436 CPUtime=1121.41 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 585212 1252 0 0 112056 85 0 0 25 0 5 0 598898482 1744318464 397294 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=1703436 CPUtime=1115.41 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 757344 1252 0 0 111426 115 0 0 25 0 5 0 598898482 1744318464 397294 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=1703436 CPUtime=1121.53 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 433231 1252 0 0 112080 73 0 0 25 0 5 0 598898482 1744318464 397294 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4480.69
Current children cumulated vsize (KiB) 1703436

[startup+1182.3 s]
/proc/loadavg: 8.07 8.10 8.03 9/186 922
/proc/meminfo: memFree=25646868/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=1932308 CPUtime=4720.38 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 2802665 1252 0 0 471613 425 0 0 25 0 5 0 598898403 1978683392 454511 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 483077 454511 179 55 0 480963 0
[pid=879/tid=887] ppid=877 vsize=1932308 CPUtime=1181.53 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 923110 1252 0 0 118015 138 0 0 25 0 5 0 598898482 1978683392 454511 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=1932308 CPUtime=1181.41 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 644152 1252 0 0 118049 92 0 0 25 0 5 0 598898482 1978683392 454511 33554432000 4194304 4417332 140733731243536 18446744073709551615 4357218 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=1932308 CPUtime=1175.09 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 757344 1252 0 0 117394 115 0 0 25 0 5 0 598898482 1978683392 454511 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=1932308 CPUtime=1181.53 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 444532 1252 0 0 118079 74 0 0 25 0 5 0 598898482 1978683392 454511 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4720.38
Current children cumulated vsize (KiB) 1932308



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.31 s]
/proc/loadavg: 8.05 8.09 8.03 5/180 924
/proc/meminfo: memFree=27530080/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=1979852 CPUtime=4800.29 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 2830935 1252 0 0 479600 429 0 0 25 0 5 0 598898403 2027368448 466397 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 494963 466397 179 55 0 492849 0
[pid=879/tid=887] ppid=877 vsize=1979852 CPUtime=1201.55 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 939494 1252 0 0 120013 142 0 0 25 0 5 0 598898482 2027368448 466397 33554432000 4194304 4417332 140733731243536 18446744073709551615 4263109 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=1979852 CPUtime=1201.42 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 656038 1252 0 0 120049 93 0 0 25 0 5 0 598898482 2027368448 466397 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=1979852 CPUtime=1194.98 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 757344 1252 0 0 119383 115 0 0 25 0 5 0 598898482 2027368448 466397 33554432000 4194304 4417332 140733731243536 18446744073709551615 4250432 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=1979852 CPUtime=1201.54 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 444532 1252 0 0 120080 74 0 0 25 0 5 0 598898482 2027368448 466397 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.29
Current children cumulated vsize (KiB) 1979852

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.31 s]
/proc/loadavg: 8.05 8.09 8.03 5/180 924
/proc/meminfo: memFree=27530080/32950928 swapFree=67111352/67111528
[pid=879] ppid=877 vsize=1979852 CPUtime=4800.29 cores=1,3,5,7
/proc/879/stat : 879 (plingeling) S 877 879 384 0 -1 4202496 2830935 1252 0 0 479600 429 0 0 25 0 5 0 598898403 2027368448 466397 33554432000 4194304 4417332 140733731243536 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/879/statm: 494963 466397 179 55 0 492849 0
[pid=879/tid=887] ppid=877 vsize=1979852 CPUtime=1201.55 cores=1,3,5,7
/proc/879/task/887/stat : 887 (plingeling) R 877 879 384 0 -1 4202560 939494 1252 0 0 120013 142 0 0 25 0 5 0 598898482 2027368448 466397 33554432000 4194304 4417332 140733731243536 18446744073709551615 4263109 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=879/tid=888] ppid=877 vsize=1979852 CPUtime=1201.42 cores=1,3,5,7
/proc/879/task/888/stat : 888 (plingeling) R 877 879 384 0 -1 4202560 656038 1252 0 0 120049 93 0 0 25 0 5 0 598898482 2027368448 466397 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=879/tid=889] ppid=877 vsize=1979852 CPUtime=1194.98 cores=1,3,5,7
/proc/879/task/889/stat : 889 (plingeling) R 877 879 384 0 -1 4202560 757344 1252 0 0 119383 115 0 0 25 0 5 0 598898482 2027368448 466397 33554432000 4194304 4417332 140733731243536 18446744073709551615 4250432 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=879/tid=890] ppid=877 vsize=1979852 CPUtime=1201.54 cores=1,3,5,7
/proc/879/task/890/stat : 890 (plingeling) R 877 879 384 0 -1 4202560 444532 1252 0 0 120080 74 0 0 25 0 5 0 598898482 2027368448 466397 33554432000 4194304 4417332 140733731243536 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.29
Current children cumulated vsize (KiB) 1979852

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.4
CPU time (s): 4800.42
CPU user time (s): 4796.04
CPU system time (s): 4.38333
CPU usage (%): 399.237
Max. virtual memory (cumulated for all children) (KiB): 2112016

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.04
system time used= 4.38333
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2832187
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 91
involuntary context switches= 36626

runsolver used 2.02069 second user time and 4.54931 second system time

The end

Launcher Data 

Begin job on node113 at 2011-04-29 16:17:57
IDJOB=3249360
IDBENCH=83166
IDSOLVER=1605
FILE ID=node113/3249360-1304086677
RUNJOBID= node113-1304085472-719
PBS_JOBID= 13170537
Free space on /tmp= 71148 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-21x40.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3249360-1304086677/watcher-3249360-1304086677 -o /tmp/evaluation-result-3249360-1304086677/solver-3249360-1304086677 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3249360-1304086677.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 65a5698edfd6f3a12089595d81c196e3
RANDOM SEED=238024815

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      29374936 kB
Buffers:        697456 kB
Cached:        2269416 kB
SwapCached:         12 kB
Active:         179204 kB
Inactive:      2879168 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      29374936 kB
SwapTotal:    67111528 kB
SwapFree:     67111352 kB
Dirty:           17876 kB
Writeback:           4 kB
AnonPages:       91352 kB
Mapped:          15096 kB
Slab:           453232 kB
PageTables:       4320 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   272796 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71152 MiB
End job on node113 at 2011-04-29 16:38:02