Trace number 3299582

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.09 1201.51

General information on the benchmark

NameSAT02/handmade/zhang-lintao/
xor-chain/x1_80.shuffled.cnf
MD5SUM53a7d1541ad9c0dde902ec3a505ae8fc
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark0.001998
Satisfiable
(Un)Satisfiability was proved
Number of variables238
Number of clauses634
Sum of the clauses size1900
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22
Number of clauses of size 3632
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...107650/instance-3299582-1304107650.cnf
0.00/0.00	c Solving...
4800.05/1201.51	
4800.05/1201.51	*** INTERRUPTED! ***
4800.05/1201.51	*** Shutting down threads...
4800.05/1201.51	s UNKNOWN
4800.05/1201.51	
4800.05/1201.51	c INTERRUPTED   : 1
4800.05/1201.51	c Models        : 0+    
4800.05/1201.51	c Time          : 1201.507s (Solving: 1201.51s 1st Model: 0.00s Unsat: 0.00s)
4800.05/1201.51	c CPU Time      : 4800.070s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299582-1304107650/watcher-3299582-1304107650 -o /tmp/evaluation-result-3299582-1304107650/solver-3299582-1304107650 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299582-1304107650.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.01 8.05 8.01 5/180 15296
/proc/meminfo: memFree=24200980/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=36892 CPUtime=0 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) S 15294 15296 14339 0 -1 4202496 706 0 0 0 0 0 0 0 25 0 4 0 503181105 37777408 630 33554432000 4194304 4964704 140734688532656 18446744073709551615 255118584729 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/15296/statm: 9223 633 428 189 0 3572 0
[pid=15296/tid=15297] ppid=15294 vsize=36892 CPUtime=0 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) S 15294 15296 14339 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 4 0 503181105 37777408 646 33554432000 4194304 4964704 140734688532656 18446744073709551615 255118584729 0 0 4096 18946 18446604471135233024 0 0 -1 1 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=36892 CPUtime=0 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) S 15294 15296 14339 0 -1 4202560 18 0 0 0 0 0 0 0 25 0 4 0 503181105 37777408 651 33554432000 4194304 4964704 140734688532656 18446744073709551615 255118584729 0 0 4096 18946 18446604471135233024 0 0 -1 1 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=36892 CPUtime=0 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 42 0 0 0 0 0 0 0 25 0 4 0 503181105 37777408 651 33554432000 4194304 4964704 140734688532656 18446744073709551615 4690368 0 0 4096 18946 0 0 0 -1 1 0 0 0

[startup+0.020596 s]
/proc/loadavg: 8.01 8.05 8.01 5/180 15296
/proc/meminfo: memFree=24200980/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=233500 CPUtime=0.05 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 871 0 0 0 5 0 0 0 18 0 4 0 503181105 239104000 795 33554432000 4194304 4964704 140734688532656 18446744073709551615 4660043 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/15296/statm: 58375 796 457 189 0 52724 0
[pid=15296/tid=15297] ppid=15294 vsize=233500 CPUtime=0.01 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 57 0 0 0 1 0 0 0 25 0 4 0 503181105 239104000 796 33554432000 4194304 4964704 140734688532656 18446744073709551615 255106873838 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=233500 CPUtime=0.01 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 61 0 0 0 1 0 0 0 25 0 4 0 503181105 239104000 796 33554432000 4194304 4964704 140734688532656 18446744073709551615 4654479 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=233500 CPUtime=0.01 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 72 0 0 0 1 0 0 0 18 0 4 0 503181105 239104000 796 33554432000 4194304 4964704 140734688532656 18446744073709551615 4654517 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 233500

[startup+0.105165 s]
/proc/loadavg: 8.01 8.05 8.01 5/180 15296
/proc/meminfo: memFree=24200980/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=233764 CPUtime=0.39 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 1125 0 0 0 39 0 0 0 18 0 4 0 503181105 239374336 1049 33554432000 4194304 4964704 140734688532656 18446744073709551615 255106873887 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/15296/statm: 58441 1049 457 189 0 52790 0
[pid=15296/tid=15297] ppid=15294 vsize=233764 CPUtime=0.09 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 103 0 0 0 9 0 0 0 25 0 4 0 503181105 239374336 1049 33554432000 4194304 4964704 140734688532656 18446744073709551615 255106873838 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=233764 CPUtime=0.09 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 177 0 0 0 9 0 0 0 25 0 4 0 503181105 239374336 1049 33554432000 4194304 4964704 140734688532656 18446744073709551615 255106873887 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=233764 CPUtime=0.09 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 118 0 0 0 9 0 0 0 18 0 4 0 503181105 239374336 1049 33554432000 4194304 4964704 140734688532656 18446744073709551615 255106873887 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.39
Current children cumulated vsize (KiB) 233764

[startup+0.300626 s]
/proc/loadavg: 8.01 8.05 8.01 5/180 15296
/proc/meminfo: memFree=24200980/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=233892 CPUtime=1.17 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 1329 0 0 0 117 0 0 0 18 0 4 0 503181105 239505408 1253 33554432000 4194304 4964704 140734688532656 18446744073709551615 4320996 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/15296/statm: 58473 1253 458 189 0 52822 0
[pid=15296/tid=15297] ppid=15294 vsize=233892 CPUtime=0.29 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 129 0 0 0 29 0 0 0 25 0 4 0 503181105 239505408 1253 33554432000 4194304 4964704 140734688532656 18446744073709551615 4362191 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=233892 CPUtime=0.29 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 303 0 0 0 29 0 0 0 25 0 4 0 503181105 239505408 1253 33554432000 4194304 4964704 140734688532656 18446744073709551615 4663216 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=233892 CPUtime=0.29 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 126 0 0 0 29 0 0 0 18 0 4 0 503181105 239505408 1253 33554432000 4194304 4964704 140734688532656 18446744073709551615 4668472 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1.17
Current children cumulated vsize (KiB) 233892

[startup+0.700556 s]
/proc/loadavg: 8.01 8.05 8.01 5/180 15296
/proc/meminfo: memFree=24200980/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=234288 CPUtime=2.76 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 1631 0 0 0 276 0 0 0 18 0 4 0 503181105 239910912 1555 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670248 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/15296/statm: 58572 1555 458 189 0 52921 0
[pid=15296/tid=15297] ppid=15294 vsize=234288 CPUtime=0.69 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 155 0 0 0 69 0 0 0 25 0 4 0 503181105 239910912 1555 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670431 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=234288 CPUtime=0.69 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 456 0 0 0 69 0 0 0 25 0 4 0 503181105 239910912 1555 33554432000 4194304 4964704 140734688532656 18446744073709551615 4321025 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=234288 CPUtime=0.69 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 172 0 0 0 69 0 0 0 18 0 4 0 503181105 239910912 1555 33554432000 4194304 4964704 140734688532656 18446744073709551615 4658292 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2.76
Current children cumulated vsize (KiB) 234288

[startup+1.50042 s]
/proc/loadavg: 8.01 8.05 8.01 9/184 15300
/proc/meminfo: memFree=24196104/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=234632 CPUtime=5.95 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 1910 0 0 0 594 1 0 0 20 0 4 0 503181105 240263168 1834 33554432000 4194304 4964704 140734688532656 18446744073709551615 4644860 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/15296/statm: 58658 1834 458 189 0 53007 0
[pid=15296/tid=15297] ppid=15294 vsize=234632 CPUtime=1.48 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 186 0 0 0 148 0 0 0 18 0 4 0 503181105 240263168 1834 33554432000 4194304 4964704 140734688532656 18446744073709551615 4332375 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=234632 CPUtime=1.48 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 584 0 0 0 148 0 0 0 25 0 4 0 503181105 240263168 1834 33554432000 4194304 4964704 140734688532656 18446744073709551615 4325296 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=234632 CPUtime=1.48 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 220 0 0 0 148 0 0 0 20 0 4 0 503181105 240263168 1834 33554432000 4194304 4964704 140734688532656 18446744073709551615 4362996 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.95
Current children cumulated vsize (KiB) 234632

[startup+3.10013 s]
/proc/loadavg: 8.01 8.05 8.01 9/184 15300
/proc/meminfo: memFree=24194616/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=234876 CPUtime=12.35 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 2187 0 0 0 1233 2 0 0 25 0 4 0 503181105 240513024 2111 33554432000 4194304 4964704 140734688532656 18446744073709551615 4364587 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/15296/statm: 58719 2111 458 189 0 53068 0
[pid=15296/tid=15297] ppid=15294 vsize=234876 CPUtime=3.07 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 254 0 0 0 307 0 0 0 20 0 4 0 503181105 240513024 2111 33554432000 4194304 4964704 140734688532656 18446744073709551615 4342232 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=234876 CPUtime=3.08 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 744 0 0 0 308 0 0 0 25 0 4 0 503181105 240513024 2111 33554432000 4194304 4964704 140734688532656 18446744073709551615 4684027 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=234876 CPUtime=3.08 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 240 0 0 0 308 0 0 0 25 0 4 0 503181105 240513024 2111 33554432000 4194304 4964704 140734688532656 18446744073709551615 4345130 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.35
Current children cumulated vsize (KiB) 234876

[startup+6.30057 s]
/proc/loadavg: 8.01 8.05 8.01 9/184 15300
/proc/meminfo: memFree=24192552/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=235136 CPUtime=25.13 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 2458 0 0 0 2509 4 0 0 25 0 4 0 503181105 240779264 2382 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670255 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/15296/statm: 58784 2382 458 189 0 53133 0
[pid=15296/tid=15297] ppid=15294 vsize=235136 CPUtime=6.25 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 330 0 0 0 625 0 0 0 25 0 4 0 503181105 240779264 2382 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670181 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=235136 CPUtime=6.28 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 859 0 0 0 627 1 0 0 25 0 4 0 503181105 240779264 2382 33554432000 4194304 4964704 140734688532656 18446744073709551615 255106436027 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=235136 CPUtime=6.29 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 257 0 0 0 628 1 0 0 25 0 4 0 503181105 240779264 2382 33554432000 4194304 4964704 140734688532656 18446744073709551615 4658344 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.13
Current children cumulated vsize (KiB) 235136

[startup+12.7004 s]
/proc/loadavg: 8.00 8.05 8.01 9/184 15301
/proc/meminfo: memFree=24189940/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=235484 CPUtime=50.7 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 2818 0 0 0 5062 8 0 0 20 0 4 0 503181105 241135616 2742 33554432000 4194304 4964704 140734688532656 18446744073709551615 4659143 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/15296/statm: 58871 2742 458 189 0 53220 0
[pid=15296/tid=15297] ppid=15294 vsize=235484 CPUtime=12.62 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 433 0 0 0 1261 1 0 0 25 0 4 0 503181105 241135616 2742 33554432000 4194304 4964704 140734688532656 18446744073709551615 4668645 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=235484 CPUtime=12.68 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 1010 0 0 0 1266 2 0 0 25 0 4 0 503181105 241135616 2742 33554432000 4194304 4964704 140734688532656 18446744073709551615 4654527 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=235484 CPUtime=12.68 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 342 0 0 0 1267 1 0 0 25 0 4 0 503181105 241135616 2742 33554432000 4194304 4964704 140734688532656 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.7
Current children cumulated vsize (KiB) 235484

[startup+25.5002 s]
/proc/loadavg: 8.00 8.05 8.01 9/184 15301
/proc/meminfo: memFree=24187972/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=235868 CPUtime=101.81 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 3188 0 0 0 10167 14 0 0 25 0 4 0 503181105 241528832 3112 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670248 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/15296/statm: 58967 3112 458 189 0 53316 0
[pid=15296/tid=15297] ppid=15294 vsize=235868 CPUtime=25.35 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 526 0 0 0 2532 3 0 0 25 0 4 0 503181105 241528832 3112 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=235868 CPUtime=25.47 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 1182 0 0 0 2544 3 0 0 25 0 4 0 503181105 241528832 3112 33554432000 4194304 4964704 140734688532656 18446744073709551615 4668464 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=235868 CPUtime=25.48 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 409 0 0 0 2545 3 0 0 25 0 4 0 503181105 241528832 3112 33554432000 4194304 4964704 140734688532656 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.81
Current children cumulated vsize (KiB) 235868

[startup+51.1007 s]
/proc/loadavg: 8.00 8.04 8.00 9/184 15302
/proc/meminfo: memFree=24185236/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=236252 CPUtime=204.04 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 3570 0 0 0 20375 29 0 0 25 0 4 0 503181105 241922048 3492 33554432000 4194304 4964704 140734688532656 18446744073709551615 4338784 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/15296/statm: 59063 3492 458 189 0 53412 0
[pid=15296/tid=15297] ppid=15294 vsize=236252 CPUtime=50.83 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 621 0 0 0 5076 7 0 0 25 0 4 0 503181105 241922048 3492 33554432000 4194304 4964704 140734688532656 18446744073709551615 4653732 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=236252 CPUtime=51.05 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 1336 0 0 0 5097 8 0 0 25 0 4 0 503181105 241922048 3492 33554432000 4194304 4964704 140734688532656 18446744073709551615 4320934 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=236252 CPUtime=51.06 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 494 0 0 0 5100 6 0 0 22 0 4 0 503181105 241922048 3492 33554432000 4194304 4964704 140734688532656 18446744073709551615 4325293 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 204.04
Current children cumulated vsize (KiB) 236252

[startup+102.307 s]
/proc/loadavg: 8.04 8.05 8.00 9/184 15303
/proc/meminfo: memFree=24180264/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=236652 CPUtime=408.57 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 3907 0 0 0 40815 42 0 0 25 0 4 0 503181105 242331648 3829 33554432000 4194304 4964704 140734688532656 18446744073709551615 4332341 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/15296/statm: 59163 3829 458 189 0 53512 0
[pid=15296/tid=15297] ppid=15294 vsize=236652 CPUtime=102.01 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 717 0 0 0 10190 11 0 0 25 0 4 0 503181105 242331648 3829 33554432000 4194304 4964704 140734688532656 18446744073709551615 4684662 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=236652 CPUtime=102.24 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 1455 0 0 0 10212 12 0 0 25 0 4 0 503181105 242331648 3829 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670450 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=236652 CPUtime=102.04 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 551 0 0 0 10194 10 0 0 25 0 4 0 503181105 242331648 3829 33554432000 4194304 4964704 140734688532656 18446744073709551615 255106466362 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 408.57
Current children cumulated vsize (KiB) 236652

[startup+162.3 s]

################
# More data... #
################

[pid=15296] ppid=15294 vsize=237204 CPUtime=2805.48 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 4622 0 0 0 280409 139 0 0 25 0 4 0 503181105 242896896 4544 33554432000 4194304 4964704 140734688532656 18446744073709551615 4371989 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/15296/statm: 59301 4544 458 189 0 53650 0
[pid=15296/tid=15297] ppid=15294 vsize=237204 CPUtime=701.93 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 868 0 0 0 70158 35 0 0 25 0 4 0 503181105 242896896 4544 33554432000 4194304 4964704 140734688532656 18446744073709551615 4364704 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=237204 CPUtime=702.07 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 1612 0 0 0 70167 40 0 0 25 0 4 0 503181105 242896896 4544 33554432000 4194304 4964704 140734688532656 18446744073709551615 4362958 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=237204 CPUtime=701.67 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 738 0 0 0 70132 35 0 0 25 0 4 0 503181105 242896896 4544 33554432000 4194304 4964704 140734688532656 18446744073709551615 4332343 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2805.48
Current children cumulated vsize (KiB) 237204

[startup+762.307 s]
/proc/loadavg: 8.06 8.06 8.00 9/184 15321
/proc/meminfo: memFree=24158216/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=237204 CPUtime=3045.23 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 4636 0 0 0 304384 139 0 0 25 0 4 0 503181105 242896896 4558 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670181 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/15296/statm: 59301 4558 458 189 0 53650 0
[pid=15296/tid=15297] ppid=15294 vsize=237204 CPUtime=761.94 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 876 0 0 0 76159 35 0 0 25 0 4 0 503181105 242896896 4558 33554432000 4194304 4964704 140734688532656 18446744073709551615 4654505 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=237204 CPUtime=762.08 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 1612 0 0 0 76168 40 0 0 25 0 4 0 503181105 242896896 4558 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=237204 CPUtime=761.68 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 740 0 0 0 76133 35 0 0 25 0 4 0 503181105 242896896 4558 33554432000 4194304 4964704 140734688532656 18446744073709551615 4653154 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3045.23
Current children cumulated vsize (KiB) 237204

[startup+822.301 s]
/proc/loadavg: 8.06 8.06 8.00 9/184 15322
/proc/meminfo: memFree=24156456/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=237204 CPUtime=3284.95 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 4649 0 0 0 328356 139 0 0 25 0 4 0 503181105 242896896 4571 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670357 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/15296/statm: 59301 4571 458 189 0 53650 0
[pid=15296/tid=15297] ppid=15294 vsize=237204 CPUtime=821.94 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 876 0 0 0 82159 35 0 0 25 0 4 0 503181105 242896896 4571 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=237204 CPUtime=822.08 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 1612 0 0 0 82168 40 0 0 25 0 4 0 503181105 242896896 4571 33554432000 4194304 4964704 140734688532656 18446744073709551615 4668484 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=237204 CPUtime=821.68 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 740 0 0 0 82133 35 0 0 25 0 4 0 503181105 242896896 4571 33554432000 4194304 4964704 140734688532656 18446744073709551615 4325338 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3284.95
Current children cumulated vsize (KiB) 237204

[startup+882.301 s]
/proc/loadavg: 8.10 8.07 8.01 9/184 15324
/proc/meminfo: memFree=24154816/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=237204 CPUtime=3524.67 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 4652 0 0 0 352328 139 0 0 25 0 4 0 503181105 242896896 4574 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670250 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/15296/statm: 59301 4574 458 189 0 53650 0
[pid=15296/tid=15297] ppid=15294 vsize=237204 CPUtime=881.94 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 876 0 0 0 88159 35 0 0 25 0 4 0 503181105 242896896 4574 33554432000 4194304 4964704 140734688532656 18446744073709551615 4362240 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=237204 CPUtime=882.08 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 1612 0 0 0 88168 40 0 0 25 0 4 0 503181105 242896896 4574 33554432000 4194304 4964704 140734688532656 18446744073709551615 4683877 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=237204 CPUtime=881.68 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 740 0 0 0 88133 35 0 0 25 0 4 0 503181105 242896896 4574 33554432000 4194304 4964704 140734688532656 18446744073709551615 255106424723 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3524.67
Current children cumulated vsize (KiB) 237204

[startup+942.301 s]
/proc/loadavg: 8.04 8.06 8.00 10/184 15325
/proc/meminfo: memFree=24154428/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=237204 CPUtime=3764.41 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 4671 0 0 0 376302 139 0 0 25 0 4 0 503181105 242896896 4593 33554432000 4194304 4964704 140734688532656 18446744073709551615 4334298 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/15296/statm: 59301 4593 458 189 0 53650 0
[pid=15296/tid=15297] ppid=15294 vsize=237204 CPUtime=941.94 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 876 0 0 0 94159 35 0 0 25 0 4 0 503181105 242896896 4593 33554432000 4194304 4964704 140734688532656 18446744073709551615 4364583 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=237204 CPUtime=942.08 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 1615 0 0 0 94168 40 0 0 25 0 4 0 503181105 242896896 4593 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670260 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=237204 CPUtime=941.68 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 740 0 0 0 94133 35 0 0 25 0 4 0 503181105 242896896 4593 33554432000 4194304 4964704 140734688532656 18446744073709551615 4342167 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3764.41
Current children cumulated vsize (KiB) 237204

[startup+1002.3 s]
/proc/loadavg: 8.01 8.05 8.00 9/184 15327
/proc/meminfo: memFree=24153540/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=237204 CPUtime=4004.13 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 4675 0 0 0 400274 139 0 0 25 0 4 0 503181105 242896896 4597 33554432000 4194304 4964704 140734688532656 18446744073709551615 4658308 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/15296/statm: 59301 4597 458 189 0 53650 0
[pid=15296/tid=15297] ppid=15294 vsize=237204 CPUtime=1001.94 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 876 0 0 0 100159 35 0 0 25 0 4 0 503181105 242896896 4597 33554432000 4194304 4964704 140734688532656 18446744073709551615 4658299 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=237204 CPUtime=1002.08 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 1615 0 0 0 100168 40 0 0 25 0 4 0 503181105 242896896 4597 33554432000 4194304 4964704 140734688532656 18446744073709551615 4363296 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=237204 CPUtime=1001.68 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 740 0 0 0 100133 35 0 0 25 0 4 0 503181105 242896896 4597 33554432000 4194304 4964704 140734688532656 18446744073709551615 4342213 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4004.13
Current children cumulated vsize (KiB) 237204

[startup+1062.3 s]
/proc/loadavg: 5.74 7.42 7.79 5/175 15350
/proc/meminfo: memFree=24227728/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=237204 CPUtime=4243.86 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 4686 0 0 0 424246 140 0 0 25 0 4 0 503181105 242896896 4608 33554432000 4194304 4964704 140734688532656 18446744073709551615 4644736 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/15296/statm: 59301 4608 458 189 0 53650 0
[pid=15296/tid=15297] ppid=15294 vsize=237204 CPUtime=1061.94 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 878 0 0 0 106159 35 0 0 25 0 4 0 503181105 242896896 4608 33554432000 4194304 4964704 140734688532656 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=237204 CPUtime=1062.09 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 1615 0 0 0 106168 41 0 0 25 0 4 0 503181105 242896896 4608 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=237204 CPUtime=1061.68 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 749 0 0 0 106133 35 0 0 25 0 4 0 503181105 242896896 4608 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670495 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4243.86
Current children cumulated vsize (KiB) 237204

[startup+1122.3 s]
/proc/loadavg: 4.67 6.81 7.55 5/175 15351
/proc/meminfo: memFree=24227784/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=237204 CPUtime=4483.59 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 4707 0 0 0 448219 140 0 0 25 0 4 0 503181105 242896896 4629 33554432000 4194304 4964704 140734688532656 18446744073709551615 4658341 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/15296/statm: 59301 4629 458 189 0 53650 0
[pid=15296/tid=15297] ppid=15294 vsize=237204 CPUtime=1121.94 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 883 0 0 0 112159 35 0 0 25 0 4 0 503181105 242896896 4629 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670466 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=237204 CPUtime=1122.09 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 1615 0 0 0 112168 41 0 0 25 0 4 0 503181105 242896896 4629 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670281 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=237204 CPUtime=1121.68 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 749 0 0 0 112133 35 0 0 25 0 4 0 503181105 242896896 4629 33554432000 4194304 4964704 140734688532656 18446744073709551615 4673205 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4483.59
Current children cumulated vsize (KiB) 237204

[startup+1182.3 s]
/proc/loadavg: 4.25 6.29 7.33 5/175 15353
/proc/meminfo: memFree=24227892/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=237204 CPUtime=4723.33 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 4715 0 0 0 472193 140 0 0 25 0 4 0 503181105 242896896 4637 33554432000 4194304 4964704 140734688532656 18446744073709551615 4670250 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/15296/statm: 59301 4637 458 189 0 53650 0
[pid=15296/tid=15297] ppid=15294 vsize=237204 CPUtime=1181.94 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 883 0 0 0 118159 35 0 0 25 0 4 0 503181105 242896896 4637 33554432000 4194304 4964704 140734688532656 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=237204 CPUtime=1182.09 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 1615 0 0 0 118168 41 0 0 25 0 4 0 503181105 242896896 4637 33554432000 4194304 4964704 140734688532656 18446744073709551615 4660077 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=237204 CPUtime=1181.68 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 749 0 0 0 118133 35 0 0 25 0 4 0 503181105 242896896 4637 33554432000 4194304 4964704 140734688532656 18446744073709551615 4660043 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4723.33
Current children cumulated vsize (KiB) 237204



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.5 s]
/proc/loadavg: 4.24 6.16 7.26 5/175 15353
/proc/meminfo: memFree=24227768/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=237204 CPUtime=4800.05 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 4723 0 0 0 479865 140 0 0 25 0 4 0 503181105 242896896 4645 33554432000 4194304 4964704 140734688532656 18446744073709551615 4684649 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/15296/statm: 59301 4645 458 189 0 53650 0
[pid=15296/tid=15297] ppid=15294 vsize=237204 CPUtime=1201.15 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 883 0 0 0 120080 35 0 0 25 0 4 0 503181105 242896896 4645 33554432000 4194304 4964704 140734688532656 18446744073709551615 255106465408 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=237204 CPUtime=1201.3 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 1615 0 0 0 120089 41 0 0 25 0 4 0 503181105 242896896 4645 33554432000 4194304 4964704 140734688532656 18446744073709551615 4342208 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=237204 CPUtime=1200.89 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 749 0 0 0 120054 35 0 0 25 0 4 0 503181105 242896896 4645 33554432000 4194304 4964704 140734688532656 18446744073709551615 4660050 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.05
Current children cumulated vsize (KiB) 237204

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.5 s]
/proc/loadavg: 4.24 6.16 7.26 5/175 15353
/proc/meminfo: memFree=24227768/32951124 swapFree=67111524/67111528
[pid=15296] ppid=15294 vsize=237204 CPUtime=4800.05 cores=1,3,5,7
/proc/15296/stat : 15296 (claspmt) R 15294 15296 14339 0 -1 4202496 4723 0 0 0 479865 140 0 0 25 0 4 0 503181105 242896896 4645 33554432000 4194304 4964704 140734688532656 18446744073709551615 4684649 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/15296/statm: 59301 4645 458 189 0 53650 0
[pid=15296/tid=15297] ppid=15294 vsize=237204 CPUtime=1201.15 cores=1,3,5,7
/proc/15296/task/15297/stat : 15297 (claspmt) R 15294 15296 14339 0 -1 4202560 883 0 0 0 120080 35 0 0 25 0 4 0 503181105 242896896 4645 33554432000 4194304 4964704 140734688532656 18446744073709551615 255106465408 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15296/tid=15298] ppid=15294 vsize=237204 CPUtime=1201.3 cores=1,3,5,7
/proc/15296/task/15298/stat : 15298 (claspmt) R 15294 15296 14339 0 -1 4202560 1615 0 0 0 120089 41 0 0 25 0 4 0 503181105 242896896 4645 33554432000 4194304 4964704 140734688532656 18446744073709551615 4342208 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15296/tid=15299] ppid=15294 vsize=237204 CPUtime=1200.89 cores=1,3,5,7
/proc/15296/task/15299/stat : 15299 (claspmt) R 15294 15296 14339 0 -1 4202560 749 0 0 0 120054 35 0 0 25 0 4 0 503181105 242896896 4645 33554432000 4194304 4964704 140734688532656 18446744073709551615 4660050 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.05
Current children cumulated vsize (KiB) 237204

Child status: 0
Real time (s): 1201.51
CPU time (s): 4800.09
CPU user time (s): 4798.68
CPU system time (s): 1.40879
CPU usage (%): 399.504
Max. virtual memory (cumulated for all children) (KiB): 237204

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.68
system time used= 1.40878
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4735
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 237873
involuntary context switches= 21488

runsolver used 1.66975 second user time and 3.80242 second system time

The end

Launcher Data 

Begin job on node144 at 2011-04-29 22:07:30
IDJOB=3299582
IDBENCH=87811
IDSOLVER=1683
FILE ID=node144/3299582-1304107650
RUNJOBID= node144-1304106180-14895
PBS_JOBID= 13170634
Free space on /tmp= 72408 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT02/handmade/zhang-lintao/xor-chain/x1_80.shuffled.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299582-1304107650/watcher-3299582-1304107650 -o /tmp/evaluation-result-3299582-1304107650/solver-3299582-1304107650 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299582-1304107650.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 53a7d1541ad9c0dde902ec3a505ae8fc
RANDOM SEED=775108510

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24201252 kB
Buffers:       2125224 kB
Cached:        5968464 kB
SwapCached:          4 kB
Active:         238720 kB
Inactive:      7962824 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24201252 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:             800 kB
Writeback:           0 kB
AnonPages:      106884 kB
Mapped:          15716 kB
Slab:           485936 kB
PageTables:       5024 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   262168 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72408 MiB
End job on node144 at 2011-04-29 22:27:33