Trace number 3259350

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.34 1201.75

General information on the benchmark

NameCRAFTED/rbsat/crafted/forced/
rbsat-v945c61409gyes10.cnf
MD5SUM601a386973128161e9173e2bdf583672
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.58791
Satisfiable
(Un)Satisfiability was proved
Number of variables945
Number of clauses61409
Sum of the clauses size123673
Maximum clause length21
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 261364
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 545

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3259350-1304054953/watcher-3259350-1304054953 -o /tmp/evaluation-result-3259350-1304054953/solver-3259350-1304054953 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3259350-1304054953.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.83 7.81 7.96 2/174 2547
/proc/meminfo: memFree=18302752/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=8872 CPUtime=0 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) R 2545 2547 1994 0 -1 4202496 283 1251 0 0 0 0 0 0 22 0 1 0 517095706 9084928 212 33554432000 4194304 4417332 140734995199664 18446744073709551615 230808862475 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/2547/statm: 2218 214 145 55 0 104 0

[startup+0.0278899 s]
/proc/loadavg: 6.83 7.81 7.96 2/174 2547
/proc/meminfo: memFree=18302752/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=13308 CPUtime=0.02 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) R 2545 2547 1994 0 -1 4202496 1401 1251 0 0 2 0 0 0 22 0 1 0 517095706 13627392 1330 33554432000 4194304 4417332 140734995199664 18446744073709551615 230808784509 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/2547/statm: 3327 1330 147 55 0 1213 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 13308

[startup+0.160828 s]
/proc/loadavg: 6.83 7.81 7.96 2/174 2547
/proc/meminfo: memFree=18302752/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=60400 CPUtime=0.5 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 4544 1251 0 0 50 0 0 0 22 0 5 0 517095706 61849600 2906 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 15100 2906 177 55 0 12986 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 60400

[startup+0.300803 s]
/proc/loadavg: 6.83 7.81 7.96 2/174 2547
/proc/meminfo: memFree=18302752/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=130016 CPUtime=1.06 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 5828 1251 0 0 105 1 0 0 22 0 5 0 517095706 133136384 3915 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 32504 3915 181 55 0 30390 0
Current children cumulated CPU time (s) 1.06
Current children cumulated vsize (KiB) 130016

[startup+0.700728 s]
/proc/loadavg: 6.83 7.81 7.96 2/174 2547
/proc/meminfo: memFree=18302752/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=136416 CPUtime=2.66 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 8090 1251 0 0 265 1 0 0 22 0 5 0 517095706 139689984 5515 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 34104 5515 181 55 0 31990 0
Current children cumulated CPU time (s) 2.66
Current children cumulated vsize (KiB) 136416

[startup+1.50058 s]
/proc/loadavg: 6.83 7.81 7.96 9/186 2573
/proc/meminfo: memFree=18229976/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=135304 CPUtime=5.85 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 10836 1251 0 0 584 1 0 0 22 0 5 0 517095706 138551296 5267 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 33826 5267 181 55 0 31712 0
[pid=2547/tid=2554] ppid=2545 vsize=135304 CPUtime=1.45 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 689 1251 0 0 145 0 0 0 25 0 5 0 517095711 138551296 5267 33554432000 4194304 4417332 140734995199664 18446744073709551615 4336217 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=135304 CPUtime=1.44 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 829 1251 0 0 144 0 0 0 25 0 5 0 517095711 138551296 5267 33554432000 4194304 4417332 140734995199664 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=135304 CPUtime=1.45 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 774 1251 0 0 145 0 0 0 25 0 5 0 517095711 138551296 5267 33554432000 4194304 4417332 140734995199664 18446744073709551615 4250678 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=135304 CPUtime=1.45 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 6107 1251 0 0 144 1 0 0 25 0 5 0 517095711 138551296 5267 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.85
Current children cumulated vsize (KiB) 135304

[startup+3.10029 s]
/proc/loadavg: 6.83 7.81 7.96 9/186 2573
/proc/meminfo: memFree=18223036/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=143344 CPUtime=12.25 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 17140 1251 0 0 1223 2 0 0 22 0 5 0 517095706 146784256 7247 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 35836 7247 181 55 0 33722 0
[pid=2547/tid=2554] ppid=2545 vsize=143344 CPUtime=3.05 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 1185 1251 0 0 305 0 0 0 25 0 5 0 517095711 146784256 7247 33554432000 4194304 4417332 140734995199664 18446744073709551615 4249171 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=143344 CPUtime=3.03 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 1325 1251 0 0 303 0 0 0 25 0 5 0 517095711 146784256 7247 33554432000 4194304 4417332 140734995199664 18446744073709551615 4235997 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=143344 CPUtime=3.05 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 1184 1251 0 0 305 0 0 0 25 0 5 0 517095711 146784256 7247 33554432000 4194304 4417332 140734995199664 18446744073709551615 4365076 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=143344 CPUtime=3.05 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 11009 1251 0 0 304 1 0 0 25 0 5 0 517095711 146784256 7247 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.25
Current children cumulated vsize (KiB) 143344

[startup+6.3007 s]
/proc/loadavg: 7.01 7.83 7.96 9/186 2574
/proc/meminfo: memFree=18193464/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=148600 CPUtime=25.03 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 26712 1251 0 0 2499 4 0 0 22 0 5 0 517095706 152166400 8561 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 37150 8561 181 55 0 35036 0
[pid=2547/tid=2554] ppid=2545 vsize=148600 CPUtime=6.25 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 1185 1251 0 0 625 0 0 0 25 0 5 0 517095711 152166400 8561 33554432000 4194304 4417332 140734995199664 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=148600 CPUtime=6.22 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 1325 1251 0 0 622 0 0 0 25 0 5 0 517095711 152166400 8561 33554432000 4194304 4417332 140734995199664 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=148600 CPUtime=6.25 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 1821 1251 0 0 625 0 0 0 25 0 5 0 517095711 152166400 8561 33554432000 4194304 4417332 140734995199664 18446744073709551615 4232566 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=148600 CPUtime=6.25 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 19944 1251 0 0 622 3 0 0 25 0 5 0 517095711 152166400 8561 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.03
Current children cumulated vsize (KiB) 148600

[startup+12.7005 s]
/proc/loadavg: 7.09 7.83 7.96 9/186 2574
/proc/meminfo: memFree=18148980/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=177148 CPUtime=50.6 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 46570 1251 0 0 5053 7 0 0 22 0 5 0 517095706 181399552 15718 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 44287 15718 181 55 0 42173 0
[pid=2547/tid=2554] ppid=2545 vsize=177148 CPUtime=12.65 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 3391 1251 0 0 1265 0 0 0 25 0 5 0 517095711 181399552 15718 33554432000 4194304 4417332 140734995199664 18446744073709551615 4353458 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=177148 CPUtime=12.58 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 4875 1251 0 0 1258 0 0 0 25 0 5 0 517095711 181399552 15718 33554432000 4194304 4417332 140734995199664 18446744073709551615 4365045 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=177148 CPUtime=12.65 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 3469 1251 0 0 1265 0 0 0 25 0 5 0 517095711 181399552 15718 33554432000 4194304 4417332 140734995199664 18446744073709551615 4199406 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=177148 CPUtime=12.65 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 32398 1251 0 0 1261 4 0 0 25 0 5 0 517095711 181399552 15718 33554432000 4194304 4417332 140734995199664 18446744073709551615 4320859 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.6
Current children cumulated vsize (KiB) 177148

[startup+25.5012 s]
/proc/loadavg: 7.29 7.84 7.96 9/186 2574
/proc/meminfo: memFree=18052876/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=222864 CPUtime=101.73 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 97732 1251 0 0 10160 13 0 0 22 0 5 0 517095706 228212736 27127 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 55716 27127 181 55 0 53602 0
[pid=2547/tid=2554] ppid=2545 vsize=222864 CPUtime=25.45 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 11226 1251 0 0 2544 1 0 0 25 0 5 0 517095711 228212736 27127 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=222864 CPUtime=25.31 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 15862 1251 0 0 2529 2 0 0 25 0 5 0 517095711 228212736 27127 33554432000 4194304 4417332 140734995199664 18446744073709551615 4365977 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=222864 CPUtime=25.44 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 16322 1251 0 0 2543 1 0 0 25 0 5 0 517095711 228212736 27127 33554432000 4194304 4417332 140734995199664 18446744073709551615 4366576 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=222864 CPUtime=25.45 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 51885 1251 0 0 2538 7 0 0 25 0 5 0 517095711 228212736 27127 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.73
Current children cumulated vsize (KiB) 222864

[startup+51.1005 s]
/proc/loadavg: 7.53 7.85 7.96 9/186 2575
/proc/meminfo: memFree=17819548/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=278020 CPUtime=203.99 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 161429 1251 0 0 20377 22 0 0 22 0 5 0 517095706 284692480 40916 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 69505 40916 181 55 0 67391 0
[pid=2547/tid=2554] ppid=2545 vsize=278020 CPUtime=51.05 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 24185 1251 0 0 5102 3 0 0 25 0 5 0 517095711 284692480 40916 33554432000 4194304 4417332 140734995199664 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=278020 CPUtime=50.78 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 30923 1251 0 0 5074 4 0 0 25 0 5 0 517095711 284692480 40916 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=278020 CPUtime=51.05 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 30139 1251 0 0 5102 3 0 0 25 0 5 0 517095711 284692480 40916 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=278020 CPUtime=51.05 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 73745 1251 0 0 5095 10 0 0 25 0 5 0 517095711 284692480 40916 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.99
Current children cumulated vsize (KiB) 278020

[startup+102.307 s]
/proc/loadavg: 7.79 7.87 7.96 9/186 2576
/proc/meminfo: memFree=17501220/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=350196 CPUtime=408.54 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 259996 1251 0 0 40816 38 0 0 22 0 5 0 517095706 358600704 58960 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 87549 58960 181 55 0 85435 0
[pid=2547/tid=2554] ppid=2545 vsize=350196 CPUtime=102.26 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 41496 1251 0 0 10221 5 0 0 25 0 5 0 517095711 358600704 58960 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=350196 CPUtime=101.69 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 51973 1251 0 0 10162 7 0 0 25 0 5 0 517095711 358600704 58960 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=350196 CPUtime=102.26 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 55078 1251 0 0 10219 7 0 0 25 0 5 0 517095711 358600704 58960 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=350196 CPUtime=102.26 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 109012 1251 0 0 10209 17 0 0 25 0 5 0 517095711 358600704 58960 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 408.54
Current children cumulated vsize (KiB) 350196

[startup+162.301 s]
/proc/loadavg: 8.04 7.92 7.97 9/186 2578
/proc/meminfo: memFree=17425192/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=381260 CPUtime=648.2 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 379118 1251 0 0 64764 56 0 0 22 0 5 0 517095706 390410240 66758 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 95315 66758 181 55 0 93201 0
[pid=2547/tid=2554] ppid=2545 vsize=381260 CPUtime=162.26 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 68723 1251 0 0 16217 9 0 0 25 0 5 0 517095711 390410240 66758 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=381260 CPUtime=161.37 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 81125 1251 0 0 16125 12 0 0 25 0 5 0 517095711 390410240 66758 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=381260 CPUtime=162.25 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 81731 1251 0 0 16214 11 0 0 25 0 5 0 517095711 390410240 66758 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=381260 CPUtime=162.25 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 145102 1251 0 0 16203 22 0 0 25 0 5 0 517095711 390410240 66758 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364800 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 648.2
Current children cumulated vsize (KiB) 381260


################
# More data... #
################

[pid=2547/tid=2555] ppid=2545 vsize=844224 CPUtime=758.11 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 286802 1251 0 0 75772 39 0 0 25 0 5 0 517095711 864485376 182467 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=844224 CPUtime=762.28 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 259037 1251 0 0 76191 37 0 0 25 0 5 0 517095711 864485376 182467 33554432000 4194304 4417332 140734995199664 18446744073709551615 4354410 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=844224 CPUtime=762.28 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 336934 1251 0 0 76170 58 0 0 25 0 5 0 517095711 864485376 182467 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3045.02
Current children cumulated vsize (KiB) 844224

[startup+822.3 s]
/proc/loadavg: 8.00 8.01 8.00 9/186 2595
/proc/meminfo: memFree=15924336/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=797772 CPUtime=3284.67 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 1193272 1251 0 0 328287 180 0 0 22 0 5 0 517095706 816918528 170886 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 199443 170886 181 55 0 197329 0
[pid=2547/tid=2554] ppid=2545 vsize=797772 CPUtime=822.28 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 258917 1251 0 0 82191 37 0 0 25 0 5 0 517095711 816918528 170886 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364938 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=797772 CPUtime=817.79 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 299276 1251 0 0 81737 42 0 0 25 0 5 0 517095711 816918528 170886 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=797772 CPUtime=822.27 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 287516 1251 0 0 82186 41 0 0 25 0 5 0 517095711 816918528 170886 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=797772 CPUtime=822.28 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 345126 1251 0 0 82169 59 0 0 25 0 5 0 517095711 816918528 170886 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3284.67
Current children cumulated vsize (KiB) 797772

[startup+882.3 s]
/proc/loadavg: 8.03 8.02 8.00 9/186 2597
/proc/meminfo: memFree=15833052/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=796636 CPUtime=3524.35 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 1219678 1251 0 0 352252 183 0 0 22 0 5 0 517095706 815755264 170602 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 199159 170602 181 55 0 197045 0
[pid=2547/tid=2554] ppid=2545 vsize=796636 CPUtime=882.27 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 261593 1251 0 0 88190 37 0 0 25 0 5 0 517095711 815755264 170602 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=796636 CPUtime=877.46 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 317447 1251 0 0 87702 44 0 0 25 0 5 0 517095711 815755264 170602 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=796636 CPUtime=882.28 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 293075 1251 0 0 88186 42 0 0 25 0 5 0 517095711 815755264 170602 33554432000 4194304 4417332 140734995199664 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=796636 CPUtime=882.28 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 345126 1251 0 0 88169 59 0 0 25 0 5 0 517095711 815755264 170602 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3524.35
Current children cumulated vsize (KiB) 796636

[startup+942.3 s]
/proc/loadavg: 8.12 8.05 8.01 9/186 2599
/proc/meminfo: memFree=15587512/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=1027488 CPUtime=3764.04 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 1314837 1251 0 0 376208 196 0 0 22 0 5 0 517095706 1052147712 228315 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 256872 228315 181 55 0 254758 0
[pid=2547/tid=2554] ppid=2545 vsize=1027488 CPUtime=942.28 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 276401 1251 0 0 94189 39 0 0 25 0 5 0 517095711 1052147712 228315 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=1027488 CPUtime=937.14 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 334521 1251 0 0 93669 45 0 0 25 0 5 0 517095711 1052147712 228315 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=1027488 CPUtime=942.28 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 321004 1251 0 0 94183 45 0 0 25 0 5 0 517095711 1052147712 228315 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=1027488 CPUtime=942.27 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 380474 1251 0 0 94162 65 0 0 25 0 5 0 517095711 1052147712 228315 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3764.04
Current children cumulated vsize (KiB) 1027488

[startup+1002.3 s]
/proc/loadavg: 8.12 8.05 8.00 9/186 2600
/proc/meminfo: memFree=16081504/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=1114716 CPUtime=4003.72 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 1364752 1251 0 0 400168 204 0 0 22 0 5 0 517095706 1141469184 250122 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 278679 250122 181 55 0 276565 0
[pid=2547/tid=2554] ppid=2545 vsize=1114716 CPUtime=1002.28 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 281072 1251 0 0 100188 40 0 0 25 0 5 0 517095711 1141469184 250122 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=1114716 CPUtime=996.81 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 360668 1251 0 0 99633 48 0 0 25 0 5 0 517095711 1141469184 250122 33554432000 4194304 4417332 140734995199664 18446744073709551615 4365003 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=1114716 CPUtime=1002.28 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 321004 1251 0 0 100183 45 0 0 25 0 5 0 517095711 1141469184 250122 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=1114716 CPUtime=1002.28 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 399571 1251 0 0 100159 69 0 0 25 0 5 0 517095711 1141469184 250122 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4003.72
Current children cumulated vsize (KiB) 1114716

[startup+1062.3 s]
/proc/loadavg: 8.08 8.05 8.00 9/186 2602
/proc/meminfo: memFree=16356884/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=822152 CPUtime=4243.4 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 1463180 1251 0 0 424121 219 0 0 22 0 5 0 517095706 841883648 176949 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 205538 176949 181 55 0 203424 0
[pid=2547/tid=2554] ppid=2545 vsize=822152 CPUtime=1062.28 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 290040 1251 0 0 106187 41 0 0 25 0 5 0 517095711 841883648 176949 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=822152 CPUtime=1056.49 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 377665 1251 0 0 105598 51 0 0 25 0 5 0 517095711 841883648 176949 33554432000 4194304 4417332 140734995199664 18446744073709551615 4259600 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=822152 CPUtime=1062.28 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 347574 1251 0 0 106178 50 0 0 25 0 5 0 517095711 841883648 176949 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=822152 CPUtime=1062.28 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 445464 1251 0 0 106152 76 0 0 25 0 5 0 517095711 841883648 176949 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4243.4
Current children cumulated vsize (KiB) 822152

[startup+1122.3 s]
/proc/loadavg: 8.06 8.06 8.00 9/186 2603
/proc/meminfo: memFree=16059632/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=957140 CPUtime=4483.07 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 1515587 1251 0 0 448081 226 0 0 22 0 5 0 517095706 980111360 210696 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 239285 210696 181 55 0 237171 0
[pid=2547/tid=2554] ppid=2545 vsize=957140 CPUtime=1122.28 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 325350 1251 0 0 112183 45 0 0 25 0 5 0 517095711 980111360 210696 33554432000 4194304 4417332 140734995199664 18446744073709551615 4263118 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=957140 CPUtime=1116.16 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 394529 1251 0 0 111562 54 0 0 25 0 5 0 517095711 980111360 210696 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364942 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=957140 CPUtime=1122.28 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 347574 1251 0 0 112178 50 0 0 25 0 5 0 517095711 980111360 210696 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=957140 CPUtime=1122.29 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 445697 1251 0 0 112153 76 0 0 25 0 5 0 517095711 980111360 210696 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364473 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4483.07
Current children cumulated vsize (KiB) 957140

[startup+1182.3 s]
/proc/loadavg: 8.05 8.06 8.00 9/186 2605
/proc/meminfo: memFree=16119756/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=893784 CPUtime=4722.76 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 1555915 1251 0 0 472044 232 0 0 22 0 5 0 517095706 915234816 194889 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 223446 194889 181 55 0 221332 0
[pid=2547/tid=2554] ppid=2545 vsize=893784 CPUtime=1182.29 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 340887 1251 0 0 118181 48 0 0 25 0 5 0 517095711 915234816 194889 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=893784 CPUtime=1175.84 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 419320 1251 0 0 117527 57 0 0 25 0 5 0 517095711 915234816 194889 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364973 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=893784 CPUtime=1182.29 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 347574 1251 0 0 118179 50 0 0 25 0 5 0 517095711 915234816 194889 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=893784 CPUtime=1182.29 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 445697 1251 0 0 118153 76 0 0 25 0 5 0 517095711 915234816 194889 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4722.76
Current children cumulated vsize (KiB) 893784



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.04 8.05 8.00 9/186 2605
/proc/meminfo: memFree=15887496/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=909172 CPUtime=4800.27 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 1595860 1251 0 0 479790 237 0 0 22 0 5 0 517095706 930992128 198704 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 227293 198704 181 55 0 225179 0
[pid=2547/tid=2554] ppid=2545 vsize=909172 CPUtime=1201.7 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 346635 1251 0 0 120121 49 0 0 25 0 5 0 517095711 930992128 198704 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=909172 CPUtime=1195.13 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 421951 1251 0 0 119456 57 0 0 25 0 5 0 517095711 930992128 198704 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364736 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=909172 CPUtime=1201.69 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 363359 1251 0 0 120117 52 0 0 25 0 5 0 517095711 930992128 198704 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364990 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=909172 CPUtime=1201.7 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 461478 1251 0 0 120092 78 0 0 25 0 5 0 517095711 930992128 198704 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.27
Current children cumulated vsize (KiB) 909172

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.04 8.05 8.00 9/186 2605
/proc/meminfo: memFree=15887496/32951124 swapFree=67111528/67111528
[pid=2547] ppid=2545 vsize=909172 CPUtime=4800.27 cores=1,3,5,7
/proc/2547/stat : 2547 (plingeling) S 2545 2547 1994 0 -1 4202496 1595860 1251 0 0 479790 237 0 0 22 0 5 0 517095706 930992128 198704 33554432000 4194304 4417332 140734995199664 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/2547/statm: 227293 198704 181 55 0 225179 0
[pid=2547/tid=2554] ppid=2545 vsize=909172 CPUtime=1201.7 cores=1,3,5,7
/proc/2547/task/2554/stat : 2554 (plingeling) R 2545 2547 1994 0 -1 4202560 346635 1251 0 0 120121 49 0 0 25 0 5 0 517095711 930992128 198704 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2547/tid=2555] ppid=2545 vsize=909172 CPUtime=1195.13 cores=1,3,5,7
/proc/2547/task/2555/stat : 2555 (plingeling) R 2545 2547 1994 0 -1 4202560 421951 1251 0 0 119456 57 0 0 25 0 5 0 517095711 930992128 198704 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364736 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2547/tid=2556] ppid=2545 vsize=909172 CPUtime=1201.69 cores=1,3,5,7
/proc/2547/task/2556/stat : 2556 (plingeling) R 2545 2547 1994 0 -1 4202560 363359 1251 0 0 120117 52 0 0 25 0 5 0 517095711 930992128 198704 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364990 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2547/tid=2557] ppid=2545 vsize=909172 CPUtime=1201.7 cores=1,3,5,7
/proc/2547/task/2557/stat : 2557 (plingeling) R 2545 2547 1994 0 -1 4202560 461478 1251 0 0 120092 78 0 0 25 0 5 0 517095711 930992128 198704 33554432000 4194304 4417332 140734995199664 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.27
Current children cumulated vsize (KiB) 909172

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.75
CPU time (s): 4800.34
CPU user time (s): 4797.93
CPU system time (s): 2.41563
CPU usage (%): 399.447
Max. virtual memory (cumulated for all children) (KiB): 1122908

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.93
system time used= 2.41563
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1597111
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 97
involuntary context switches= 32593

runsolver used 2.10768 second user time and 4.45332 second system time

The end

Launcher Data 

Begin job on node104 at 2011-04-29 07:29:13
IDJOB=3259350
IDBENCH=71570
IDSOLVER=1605
FILE ID=node104/3259350-1304054953
RUNJOBID= node104-1304054952-2534
PBS_JOBID= 13170409
Free space on /tmp= 71548 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT09/CRAFTED/rbsat/crafted/forced/rbsat-v945c61409gyes10.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3259350-1304054953/watcher-3259350-1304054953 -o /tmp/evaluation-result-3259350-1304054953/solver-3259350-1304054953 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3259350-1304054953.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 601a386973128161e9173e2bdf583672
RANDOM SEED=848674108

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18303280 kB
Buffers:       2196020 kB
Cached:       11798040 kB
SwapCached:          0 kB
Active:        2343876 kB
Inactive:     11718616 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18303280 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            1352 kB
Writeback:           0 kB
AnonPages:       67936 kB
Mapped:          14484 kB
Slab:           523008 kB
PageTables:       4844 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   192604 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71544 MiB
End job on node104 at 2011-04-29 07:49:16