Trace number 3280145

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.31 1203.05

General information on the benchmark

Nameindustrial/anbulagan/
hard-sat/partial-10-17-s.cnf
MD5SUMf72920912a1bb14f90e9fea5dee0ec1c
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark77.9931
Satisfiable
(Un)Satisfiability was proved
Number of variables298900
Number of clauses1409628
Sum of the clauses size3261218
Maximum clause length10
Minimum clause length1
Number of clauses of size 122283
Number of clauses of size 21089480
Number of clauses of size 3242405
Number of clauses of size 46160
Number of clauses of size 524640
Number of clauses of size over 524660

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3280145-1304036318/watcher-3280145-1304036318 -o /tmp/evaluation-result-3280145-1304036318/solver-3280145-1304036318 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3280145-1304036318.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.46 7.68 7.67 7/181 26308
/proc/meminfo: memFree=19670540/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=12864 CPUtime=0 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) R 26306 26308 26261 0 -1 4202496 1302 1252 0 0 0 0 0 0 21 0 1 0 593862611 13172736 1231 33554432000 4194304 4417332 140734753061168 18446744073709551615 251367243531 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/26308/statm: 3216 1237 146 55 0 1102 0

[startup+0.0286551 s]
/proc/loadavg: 6.46 7.68 7.67 7/181 26308
/proc/meminfo: memFree=19670540/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=22896 CPUtime=0.01 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) R 26306 26308 26261 0 -1 4202496 3817 1252 0 0 1 0 0 0 21 0 1 0 593862611 23445504 3746 33554432000 4194304 4417332 140734753061168 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/26308/statm: 5724 3746 147 55 0 3610 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 22896

[startup+0.100651 s]
/proc/loadavg: 6.46 7.68 7.67 7/181 26308
/proc/meminfo: memFree=19670540/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=40776 CPUtime=0.09 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) R 26306 26308 26261 0 -1 4202496 8303 1252 0 0 8 1 0 0 21 0 1 0 593862611 41754624 8216 33554432000 4194304 4417332 140734753061168 18446744073709551615 251367546624 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/26308/statm: 10194 8216 147 55 0 8080 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 40776

[startup+0.3006 s]
/proc/loadavg: 6.46 7.68 7.67 7/181 26308
/proc/meminfo: memFree=19670540/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=104780 CPUtime=0.29 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) R 26306 26308 26261 0 -1 4202496 24370 1252 0 0 26 3 0 0 22 0 1 0 593862611 107294720 24217 33554432000 4194304 4417332 140734753061168 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/26308/statm: 26195 24217 147 55 0 24081 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 104780

[startup+0.700534 s]
/proc/loadavg: 6.46 7.68 7.67 7/181 26308
/proc/meminfo: memFree=19670540/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=195704 CPUtime=0.69 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) R 26306 26308 26261 0 -1 4202496 47349 1252 0 0 64 5 0 0 23 0 1 0 593862611 200400896 46948 33554432000 4194304 4417332 140734753061168 18446744073709551615 251367546624 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/26308/statm: 48926 46948 147 55 0 46812 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 195704

[startup+1.50038 s]
/proc/loadavg: 6.46 7.68 7.67 6/182 26314
/proc/meminfo: memFree=19460252/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=302760 CPUtime=1.49 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) R 26306 26308 26261 0 -1 4202496 74082 1252 0 0 140 9 0 0 25 0 1 0 593862611 310026240 73681 33554432000 4194304 4417332 140734753061168 18446744073709551615 251367546624 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/26308/statm: 75690 73681 148 55 0 73576 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 302760

[startup+3.10103 s]
/proc/loadavg: 6.46 7.68 7.67 9/186 26318
/proc/meminfo: memFree=19418556/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=367816 CPUtime=7.07 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 118000 1252 0 0 691 16 0 0 25 0 5 0 593862611 376643584 69919 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 91954 69919 174 55 0 89840 0
[pid=26308/tid=26315] ppid=26306 vsize=367816 CPUtime=1.32 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 13440 1252 0 0 130 2 0 0 25 0 5 0 593862787 376643584 69919 33554432000 4194304 4417332 140734753061168 18446744073709551615 4284784 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26308/tid=26316] ppid=26306 vsize=367816 CPUtime=1.32 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 13489 1252 0 0 131 1 0 0 25 0 5 0 593862787 376643584 69919 33554432000 4194304 4417332 140734753061168 18446744073709551615 4284741 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=367816 CPUtime=1.32 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 11657 1252 0 0 130 2 0 0 25 0 5 0 593862787 376643584 69919 33554432000 4194304 4417332 140734753061168 18446744073709551615 4284289 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=367816 CPUtime=1.32 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 5320 1252 0 0 132 0 0 0 19 0 5 0 593862787 376643584 69919 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 7.07
Current children cumulated vsize (KiB) 367816

[startup+6.30043 s]
/proc/loadavg: 6.58 7.69 7.67 9/186 26318
/proc/meminfo: memFree=19438672/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=381032 CPUtime=19.85 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 162715 1252 0 0 1962 23 0 0 25 0 5 0 593862611 390176768 70958 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 95258 70958 179 55 0 93144 0
[pid=26308/tid=26315] ppid=26306 vsize=381032 CPUtime=4.51 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 25027 1252 0 0 448 3 0 0 25 0 5 0 593862787 390176768 70958 33554432000 4194304 4417332 140734753061168 18446744073709551615 4331716 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26308/tid=26316] ppid=26306 vsize=381032 CPUtime=4.52 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 24429 1252 0 0 449 3 0 0 25 0 5 0 593862787 390176768 70958 33554432000 4194304 4417332 140734753061168 18446744073709551615 4330709 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=381032 CPUtime=4.5 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 33844 1252 0 0 445 5 0 0 25 0 5 0 593862787 390176768 70958 33554432000 4194304 4417332 140734753061168 18446744073709551615 251367240797 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=381032 CPUtime=4.52 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 5321 1252 0 0 452 0 0 0 25 0 5 0 593862787 390176768 70958 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 19.85
Current children cumulated vsize (KiB) 381032

[startup+12.7003 s]
/proc/loadavg: 6.69 7.69 7.68 9/186 26318
/proc/meminfo: memFree=19406720/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=388000 CPUtime=45.41 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 167418 1252 0 0 4518 23 0 0 25 0 5 0 593862611 397312000 72692 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 97000 72692 181 55 0 94886 0
[pid=26308/tid=26315] ppid=26306 vsize=388000 CPUtime=10.92 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 25923 1252 0 0 1088 4 0 0 25 0 5 0 593862787 397312000 72692 33554432000 4194304 4417332 140734753061168 18446744073709551615 4236845 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26308/tid=26316] ppid=26306 vsize=388000 CPUtime=10.92 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 25015 1252 0 0 1089 3 0 0 25 0 5 0 593862787 397312000 72692 33554432000 4194304 4417332 140734753061168 18446744073709551615 4236559 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=388000 CPUtime=10.86 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 37065 1252 0 0 1081 5 0 0 25 0 5 0 593862787 397312000 72692 33554432000 4194304 4417332 140734753061168 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=388000 CPUtime=10.92 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 5321 1252 0 0 1092 0 0 0 25 0 5 0 593862787 397312000 72692 33554432000 4194304 4417332 140734753061168 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 45.41
Current children cumulated vsize (KiB) 388000

[startup+25.5009 s]
/proc/loadavg: 6.98 7.71 7.68 9/186 26354
/proc/meminfo: memFree=19224588/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=375348 CPUtime=96.54 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 167418 1252 0 0 9631 23 0 0 25 0 5 0 593862611 384356352 69529 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 93837 69529 181 55 0 91723 0
[pid=26308/tid=26315] ppid=26306 vsize=375348 CPUtime=23.72 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 25923 1252 0 0 2368 4 0 0 25 0 5 0 593862787 384356352 69529 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364308 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26308/tid=26316] ppid=26306 vsize=375348 CPUtime=23.72 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 25015 1252 0 0 2369 3 0 0 25 0 5 0 593862787 384356352 69529 33554432000 4194304 4417332 140734753061168 18446744073709551615 4281949 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=375348 CPUtime=23.58 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 37065 1252 0 0 2353 5 0 0 25 0 5 0 593862787 384356352 69529 33554432000 4194304 4417332 140734753061168 18446744073709551615 4353443 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=375348 CPUtime=23.72 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 5321 1252 0 0 2372 0 0 0 25 0 5 0 593862787 384356352 69529 33554432000 4194304 4417332 140734753061168 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 96.54
Current children cumulated vsize (KiB) 375348

[startup+51.1012 s]
/proc/loadavg: 7.33 7.73 7.69 9/186 26355
/proc/meminfo: memFree=19183472/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=402592 CPUtime=198.81 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 175053 1252 0 0 19856 25 0 0 25 0 5 0 593862611 412254208 72610 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 100648 72610 181 55 0 98534 0
[pid=26308/tid=26315] ppid=26306 vsize=402592 CPUtime=49.32 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 26797 1252 0 0 4928 4 0 0 25 0 5 0 593862787 412254208 72610 33554432000 4194304 4417332 140734753061168 18446744073709551615 4265485 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26308/tid=26316] ppid=26306 vsize=402592 CPUtime=49.32 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 25628 1252 0 0 4929 3 0 0 25 0 5 0 593862787 412254208 72610 33554432000 4194304 4417332 140734753061168 18446744073709551615 4346414 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=402592 CPUtime=49.05 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 42827 1252 0 0 4899 6 0 0 25 0 5 0 593862787 412254208 72610 33554432000 4194304 4417332 140734753061168 18446744073709551615 4237189 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=402592 CPUtime=49.32 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 5707 1252 0 0 4932 0 0 0 25 0 5 0 593862787 412254208 72610 33554432000 4194304 4417332 140734753061168 18446744073709551615 4265360 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 198.81
Current children cumulated vsize (KiB) 402592

[startup+102.307 s]
/proc/loadavg: 7.71 7.77 7.70 9/186 26356
/proc/meminfo: memFree=19095204/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=444192 CPUtime=403.35 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 187382 1252 0 0 40309 26 0 0 25 0 5 0 593862611 454852608 83010 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 111048 83010 181 55 0 108934 0
[pid=26308/tid=26315] ppid=26306 vsize=444192 CPUtime=100.53 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 28859 1252 0 0 10049 4 0 0 25 0 5 0 593862787 454852608 83010 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26308/tid=26316] ppid=26306 vsize=444192 CPUtime=100.53 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 29393 1252 0 0 10049 4 0 0 25 0 5 0 593862787 454852608 83010 33554432000 4194304 4417332 140734753061168 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=444192 CPUtime=99.98 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 46737 1252 0 0 9991 7 0 0 25 0 5 0 593862787 454852608 83010 33554432000 4194304 4417332 140734753061168 18446744073709551615 4357838 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=444192 CPUtime=100.53 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 8299 1252 0 0 10052 1 0 0 25 0 5 0 593862787 454852608 83010 33554432000 4194304 4417332 140734753061168 18446744073709551615 4356952 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 403.35
Current children cumulated vsize (KiB) 444192

[startup+162.301 s]
/proc/loadavg: 7.93 7.82 7.72 9/186 26358
/proc/meminfo: memFree=18979200/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=484788 CPUtime=643.01 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 201143 1252 0 0 64273 28 0 0 25 0 5 0 593862611 496422912 96425 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 121197 96425 181 55 0 119083 0
[pid=26308/tid=26315] ppid=26306 vsize=484788 CPUtime=160.52 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 34799 1252 0 0 16048 4 0 0 25 0 5 0 593862787 496422912 96425 33554432000 4194304 4417332 140734753061168 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26308/tid=26316] ppid=26306 vsize=484788 CPUtime=160.52 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 32158 1252 0 0 16048 4 0 0 25 0 5 0 593862787 496422912 96425 33554432000 4194304 4417332 140734753061168 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=484788 CPUtime=159.64 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 50185 1252 0 0 15957 7 0 0 25 0 5 0 593862787 496422912 96425 33554432000 4194304 4417332 140734753061168 18446744073709551615 4354410 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=484788 CPUtime=160.53 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 9907 1252 0 0 16052 1 0 0 25 0 5 0 593862787 496422912 96425 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364308 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 643.01
Current children cumulated vsize (KiB) 484788

[startup+222.301 s]
/proc/loadavg: 8.06 7.88 7.75 9/186 26360
/proc/meminfo: memFree=18997660/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=499912 CPUtime=882.68 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 205651 1252 0 0 88240 28 0 0 25 0 5 0 593862611 511909888 97970 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 124978 97970 181 55 0 122864 0
[pid=26308/tid=26315] ppid=26306 vsize=499912 CPUtime=220.53 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 35823 1252 0 0 22048 5 0 0 25 0 5 0 593862787 511909888 97970 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 5 0 0 0

################
# More data... #
################

[pid=26308/tid=26316] ppid=26306 vsize=749572 CPUtime=700.52 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 40674 1252 0 0 70047 5 0 0 25 0 5 0 593862787 767561728 160385 33554432000 4194304 4417332 140734753061168 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=749572 CPUtime=696.72 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 75759 1252 0 0 69662 10 0 0 25 0 5 0 593862787 767561728 160385 33554432000 4194304 4417332 140734753061168 18446744073709551615 4321669 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=749572 CPUtime=700.54 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 38480 1252 0 0 70049 5 0 0 25 0 5 0 593862787 767561728 160385 33554432000 4194304 4417332 140734753061168 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2800.11
Current children cumulated vsize (KiB) 749572

[startup+762.307 s]
/proc/loadavg: 8.20 8.08 7.88 9/186 26410
/proc/meminfo: memFree=18667232/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=695136 CPUtime=3039.8 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 288976 1252 0 0 303942 38 0 0 25 0 5 0 593862611 711819264 146776 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 173784 146776 181 55 0 171670 0
[pid=26308/tid=26315] ppid=26306 vsize=695136 CPUtime=760.54 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 55935 1252 0 0 76047 7 0 0 25 0 5 0 593862787 711819264 146776 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26308/tid=26316] ppid=26306 vsize=695136 CPUtime=760.53 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 40718 1252 0 0 76048 5 0 0 25 0 5 0 593862787 711819264 146776 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=695136 CPUtime=756.39 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 75803 1252 0 0 75629 10 0 0 25 0 5 0 593862787 711819264 146776 33554432000 4194304 4417332 140734753061168 18446744073709551615 4354401 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=695136 CPUtime=760.55 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 42426 1252 0 0 76050 5 0 0 25 0 5 0 593862787 711819264 146776 33554432000 4194304 4417332 140734753061168 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3039.8
Current children cumulated vsize (KiB) 695136

[startup+822.301 s]
/proc/loadavg: 8.21 8.10 7.90 9/186 26412
/proc/meminfo: memFree=18590944/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=694968 CPUtime=3279.46 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 288976 1252 0 0 327908 38 0 0 25 0 5 0 593862611 711647232 146734 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 173742 146734 181 55 0 171628 0
[pid=26308/tid=26315] ppid=26306 vsize=694968 CPUtime=820.54 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 55935 1252 0 0 82047 7 0 0 25 0 5 0 593862787 711647232 146734 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26308/tid=26316] ppid=26306 vsize=694968 CPUtime=820.52 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 40718 1252 0 0 82047 5 0 0 25 0 5 0 593862787 711647232 146734 33554432000 4194304 4417332 140734753061168 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=694968 CPUtime=816.07 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 75803 1252 0 0 81597 10 0 0 25 0 5 0 593862787 711647232 146734 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=694968 CPUtime=820.54 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 42426 1252 0 0 82049 5 0 0 25 0 5 0 593862787 711647232 146734 33554432000 4194304 4417332 140734753061168 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3279.46
Current children cumulated vsize (KiB) 694968

[startup+882.3 s]
/proc/loadavg: 8.14 8.09 7.91 9/186 26413
/proc/meminfo: memFree=18571576/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=728840 CPUtime=3519.14 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 298146 1252 0 0 351874 40 0 0 25 0 5 0 593862611 746332160 155202 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 182210 155202 181 55 0 180096 0
[pid=26308/tid=26315] ppid=26306 vsize=728840 CPUtime=880.54 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 59497 1252 0 0 88046 8 0 0 25 0 5 0 593862787 746332160 155202 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26308/tid=26316] ppid=26306 vsize=728840 CPUtime=880.52 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 40942 1252 0 0 88047 5 0 0 25 0 5 0 593862787 746332160 155202 33554432000 4194304 4417332 140734753061168 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=728840 CPUtime=875.74 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 81187 1252 0 0 87563 11 0 0 25 0 5 0 593862787 746332160 155202 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=728840 CPUtime=880.54 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 42426 1252 0 0 88049 5 0 0 25 0 5 0 593862787 746332160 155202 33554432000 4194304 4417332 140734753061168 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3519.14
Current children cumulated vsize (KiB) 728840

[startup+942.3 s]
/proc/loadavg: 8.11 8.09 7.92 9/186 26415
/proc/meminfo: memFree=18600812/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=667336 CPUtime=3758.82 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 303837 1252 0 0 375842 40 0 0 25 0 5 0 593862611 683352064 139858 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 166834 139858 181 55 0 164720 0
[pid=26308/tid=26315] ppid=26306 vsize=667336 CPUtime=940.55 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 59538 1252 0 0 94047 8 0 0 25 0 5 0 593862787 683352064 139858 33554432000 4194304 4417332 140734753061168 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26308/tid=26316] ppid=26306 vsize=667336 CPUtime=940.52 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 40984 1252 0 0 94047 5 0 0 25 0 5 0 593862787 683352064 139858 33554432000 4194304 4417332 140734753061168 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=667336 CPUtime=935.42 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 81226 1252 0 0 93531 11 0 0 25 0 5 0 593862787 683352064 139858 33554432000 4194304 4417332 140734753061168 18446744073709551615 4365846 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=667336 CPUtime=940.55 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 47995 1252 0 0 94049 6 0 0 25 0 5 0 593862787 683352064 139858 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364575 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3758.82
Current children cumulated vsize (KiB) 667336

[startup+1002.3 s]
/proc/loadavg: 8.10 8.09 7.92 9/186 26416
/proc/meminfo: memFree=18629676/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=674596 CPUtime=3998.49 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 342287 1252 0 0 399803 46 0 0 25 0 5 0 593862611 690786304 141673 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 168649 141673 181 55 0 166535 0
[pid=26308/tid=26315] ppid=26306 vsize=674596 CPUtime=1000.54 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 61586 1252 0 0 100046 8 0 0 25 0 5 0 593862787 690786304 141673 33554432000 4194304 4417332 140734753061168 18446744073709551615 4232601 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26308/tid=26316] ppid=26306 vsize=674596 CPUtime=1000.51 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 42687 1252 0 0 100046 5 0 0 25 0 5 0 593862787 690786304 141673 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=674596 CPUtime=995.09 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 94058 1252 0 0 99495 14 0 0 25 0 5 0 593862787 690786304 141673 33554432000 4194304 4417332 140734753061168 18446744073709551615 4365894 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=674596 CPUtime=1000.55 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 69862 1252 0 0 100047 8 0 0 25 0 5 0 593862787 690786304 141673 33554432000 4194304 4417332 140734753061168 18446744073709551615 4357470 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3998.49
Current children cumulated vsize (KiB) 674596

[startup+1062.3 s]
/proc/loadavg: 8.09 8.08 7.93 9/186 26418
/proc/meminfo: memFree=18563076/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=713220 CPUtime=4238.18 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 351911 1252 0 0 423770 48 0 0 25 0 5 0 593862611 730337280 151297 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 178305 151297 181 55 0 176191 0
[pid=26308/tid=26315] ppid=26306 vsize=713220 CPUtime=1060.55 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 64818 1252 0 0 106047 8 0 0 25 0 5 0 593862787 730337280 151297 33554432000 4194304 4417332 140734753061168 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26308/tid=26316] ppid=26306 vsize=713220 CPUtime=1060.52 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 44414 1252 0 0 106046 6 0 0 25 0 5 0 593862787 730337280 151297 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=713220 CPUtime=1054.77 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 94058 1252 0 0 105463 14 0 0 25 0 5 0 593862787 730337280 151297 33554432000 4194304 4417332 140734753061168 18446744073709551615 4365849 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=713220 CPUtime=1060.55 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 74527 1252 0 0 106046 9 0 0 25 0 5 0 593862787 730337280 151297 33554432000 4194304 4417332 140734753061168 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4238.18
Current children cumulated vsize (KiB) 713220

[startup+1122.3 s]
/proc/loadavg: 8.08 8.08 7.93 9/186 26420
/proc/meminfo: memFree=18446124/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=824156 CPUtime=4477.86 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 397840 1252 0 0 447732 54 0 0 25 0 5 0 593862611 843935744 179031 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 206039 179031 181 55 0 203925 0
[pid=26308/tid=26315] ppid=26306 vsize=824156 CPUtime=1120.55 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 67593 1252 0 0 112046 9 0 0 25 0 5 0 593862787 843935744 179031 33554432000 4194304 4417332 140734753061168 18446744073709551615 4251091 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26308/tid=26316] ppid=26306 vsize=824156 CPUtime=1120.52 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 44454 1252 0 0 112046 6 0 0 25 0 5 0 593862787 843935744 179031 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=824156 CPUtime=1114.44 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 105119 1252 0 0 111429 15 0 0 25 0 5 0 593862787 843935744 179031 33554432000 4194304 4417332 140734753061168 18446744073709551615 4250924 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=824156 CPUtime=1120.55 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 106580 1252 0 0 112042 13 0 0 25 0 5 0 593862787 843935744 179031 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4477.86
Current children cumulated vsize (KiB) 824156

[startup+1182.3 s]
/proc/loadavg: 8.07 8.08 7.94 9/186 26421
/proc/meminfo: memFree=18339840/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=931420 CPUtime=4717.54 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 444615 1252 0 0 471695 59 0 0 25 0 5 0 593862611 953774080 205847 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 232855 205847 181 55 0 230741 0
[pid=26308/tid=26315] ppid=26306 vsize=931420 CPUtime=1180.55 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 80798 1252 0 0 118045 10 0 0 25 0 5 0 593862787 953774080 205847 33554432000 4194304 4417332 140734753061168 18446744073709551615 4357458 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26308/tid=26316] ppid=26306 vsize=931420 CPUtime=1180.51 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 50394 1252 0 0 118045 6 0 0 25 0 5 0 593862787 953774080 205847 33554432000 4194304 4417332 140734753061168 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=931420 CPUtime=1174.12 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 116792 1252 0 0 117395 17 0 0 25 0 5 0 593862787 953774080 205847 33554432000 4194304 4417332 140734753061168 18446744073709551615 4281851 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=931420 CPUtime=1180.56 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 122537 1252 0 0 118041 15 0 0 25 0 5 0 593862787 953774080 205847 33554432000 4194304 4417332 140734753061168 18446744073709551615 4366419 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4717.54
Current children cumulated vsize (KiB) 931420



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203 s]
/proc/loadavg: 8.13 8.09 7.94 9/186 26422
/proc/meminfo: memFree=18323832/32950928 swapFree=67111364/67111528
[pid=26308] ppid=26306 vsize=923960 CPUtime=4800.25 cores=1,3,5,7
/proc/26308/stat : 26308 (plingeling) S 26306 26308 26261 0 -1 4202496 448711 1252 0 0 479965 60 0 0 25 0 5 0 593862611 946135040 203982 33554432000 4194304 4417332 140734753061168 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/26308/statm: 230990 203982 181 55 0 228876 0
[pid=26308/tid=26315] ppid=26306 vsize=923960 CPUtime=1201.26 cores=1,3,5,7
/proc/26308/task/26315/stat : 26315 (plingeling) R 26306 26308 26261 0 -1 4202560 80798 1252 0 0 120116 10 0 0 25 0 5 0 593862787 946135040 203982 33554432000 4194304 4417332 140734753061168 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26308/tid=26316] ppid=26306 vsize=923960 CPUtime=1201.22 cores=1,3,5,7
/proc/26308/task/26316/stat : 26316 (plingeling) R 26306 26308 26261 0 -1 4202560 50394 1252 0 0 120116 6 0 0 25 0 5 0 593862787 946135040 203982 33554432000 4194304 4417332 140734753061168 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=26308/tid=26317] ppid=26306 vsize=923960 CPUtime=1194.71 cores=1,3,5,7
/proc/26308/task/26317/stat : 26317 (plingeling) R 26306 26308 26261 0 -1 4202560 116792 1252 0 0 119454 17 0 0 25 0 5 0 593862787 946135040 203982 33554432000 4194304 4417332 140734753061168 18446744073709551615 4281855 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26308/tid=26318] ppid=26306 vsize=923960 CPUtime=1201.26 cores=1,3,5,7
/proc/26308/task/26318/stat : 26318 (plingeling) R 26306 26308 26261 0 -1 4202560 126633 1252 0 0 120111 15 0 0 25 0 5 0 593862787 946135040 203982 33554432000 4194304 4417332 140734753061168 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.25
Current children cumulated vsize (KiB) 923960

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.05
CPU time (s): 4800.31
CPU user time (s): 4799.67
CPU system time (s): 0.641902
CPU usage (%): 399.012
Max. virtual memory (cumulated for all children) (KiB): 947804

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.67
system time used= 0.641902
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 449963
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 228
involuntary context switches= 33794

runsolver used 1.79073 second user time and 4.77927 second system time

The end

Launcher Data 

Begin job on node113 at 2011-04-29 02:18:39
IDJOB=3280145
IDBENCH=20349
IDSOLVER=1605
FILE ID=node113/3280145-1304036318
RUNJOBID= node113-1304036318-26280
PBS_JOBID= 13170352
Free space on /tmp= 71132 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT07/industrial/anbulagan/hard-sat/partial-10-17-s.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3280145-1304036318/watcher-3280145-1304036318 -o /tmp/evaluation-result-3280145-1304036318/solver-3280145-1304036318 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3280145-1304036318.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f72920912a1bb14f90e9fea5dee0ec1c
RANDOM SEED=2126233132

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      19670820 kB
Buffers:       1732836 kB
Cached:       10804456 kB
SwapCached:        164 kB
Active:        6365808 kB
Inactive:      6320008 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      19670820 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           33936 kB
Writeback:           0 kB
AnonPages:      147880 kB
Mapped:          14664 kB
Slab:           528400 kB
PageTables:       4528 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   333176 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71124 MiB
End job on node113 at 2011-04-29 02:38:44