Trace number 3263456

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.23 1201.83

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_22_70_7-dir.shuffled-as.sat03-154.cnf
MD5SUMaa9ee2fa26214e80fac6d004d5d0b003
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables660
Number of clauses56654
Sum of the clauses size113924
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 256632
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 522

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3263456-1304101047/watcher-3263456-1304101047 -o /tmp/evaluation-result-3263456-1304101047/solver-3263456-1304101047 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3263456-1304101047.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.03 8.01 7.65 1/172 9622
/proc/meminfo: memFree=29748544/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=20132 CPUtime=0 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 584 0 0 0 0 0 0 0 22 0 1 0 502520048 20615168 451 33554432000 4194304 4623224 140734075618976 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/9622/statm: 5033 451 297 105 0 537 0

[startup+0.0878019 s]
/proc/loadavg: 8.03 8.01 7.65 1/172 9622
/proc/meminfo: memFree=29748544/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=253244 CPUtime=0.28 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 3235 0 0 0 28 0 0 0 23 0 4 0 502520048 259321856 2544 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 63311 2544 343 105 0 58815 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 253244

[startup+0.100799 s]
/proc/loadavg: 8.03 8.01 7.65 1/172 9622
/proc/meminfo: memFree=29748544/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=253744 CPUtime=0.34 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 3584 0 0 0 33 1 0 0 23 0 4 0 502520048 259833856 2644 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510206 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 63436 2644 343 105 0 58940 0
Current children cumulated CPU time (s) 0.34
Current children cumulated vsize (KiB) 253744

[startup+0.300766 s]
/proc/loadavg: 8.03 8.01 7.65 1/172 9622
/proc/meminfo: memFree=29748544/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=256112 CPUtime=1.14 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 6403 0 0 0 112 2 0 0 23 0 4 0 502520048 262258688 5090 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510635 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 64028 5090 345 105 0 59532 0
Current children cumulated CPU time (s) 1.14
Current children cumulated vsize (KiB) 256112

[startup+0.700693 s]
/proc/loadavg: 8.03 8.01 7.65 1/172 9622
/proc/meminfo: memFree=29748544/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=261704 CPUtime=2.74 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 9604 0 0 0 271 3 0 0 25 0 4 0 502520048 267984896 7725 33554432000 4194304 4623224 140734075618976 18446744073709551615 4509955 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 65426 7725 346 105 0 60930 0
Current children cumulated CPU time (s) 2.74
Current children cumulated vsize (KiB) 261704

[startup+1.50055 s]
/proc/loadavg: 8.03 8.01 7.65 9/184 9639
/proc/meminfo: memFree=29674244/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=273692 CPUtime=5.93 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 16131 0 0 0 589 4 0 0 25 0 4 0 502520048 280260608 11542 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510635 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 68423 11542 345 105 0 63927 0
[pid=9622/tid=9624] ppid=9620 vsize=273692 CPUtime=1.47 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 3064 0 0 0 146 1 0 0 25 0 4 0 502520049 280260608 11542 33554432000 4194304 4623224 140734075618976 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=273692 CPUtime=1.47 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 4451 0 0 0 146 1 0 0 25 0 4 0 502520049 280260608 11542 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376850 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=273692 CPUtime=1.47 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 2277 0 0 0 147 0 0 0 20 0 4 0 502520049 280260608 11542 33554432000 4194304 4623224 140734075618976 18446744073709551615 4577664 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 273692

[startup+3.10027 s]
/proc/loadavg: 8.03 8.01 7.65 9/184 9639
/proc/meminfo: memFree=29647528/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=280816 CPUtime=12.33 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 28973 0 0 0 1226 7 0 0 25 0 4 0 502520048 287555584 16197 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 70204 16199 346 105 0 65708 0
[pid=9622/tid=9624] ppid=9620 vsize=280816 CPUtime=3.05 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 4956 0 0 0 304 1 0 0 25 0 4 0 502520049 287555584 16199 33554432000 4194304 4623224 140734075618976 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=280816 CPUtime=3.07 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 6692 0 0 0 306 1 0 0 25 0 4 0 502520049 287555584 16200 33554432000 4194304 4623224 140734075618976 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=280816 CPUtime=3.07 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 8563 0 0 0 306 1 0 0 25 0 4 0 502520049 287555584 16201 33554432000 4194304 4623224 140734075618976 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 280816

[startup+6.3007 s]
/proc/loadavg: 8.11 8.03 7.66 9/184 9639
/proc/meminfo: memFree=29588068/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=290700 CPUtime=25.11 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 61596 0 0 0 2498 13 0 0 25 0 4 0 502520048 297676800 23742 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 72675 23742 357 105 0 68179 0
[pid=9622/tid=9624] ppid=9620 vsize=290700 CPUtime=6.24 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 8830 0 0 0 621 3 0 0 25 0 4 0 502520049 297676800 23742 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376823 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=290700 CPUtime=6.27 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 9726 0 0 0 625 2 0 0 25 0 4 0 502520049 297676800 23742 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=290700 CPUtime=6.27 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 30919 0 0 0 623 4 0 0 25 0 4 0 502520049 297676800 23742 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 290700

[startup+12.7006 s]
/proc/loadavg: 8.10 8.02 7.66 9/184 9640
/proc/meminfo: memFree=29501176/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=318760 CPUtime=50.66 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 112766 0 0 0 5044 22 0 0 25 0 4 0 502520048 326410240 33119 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510006 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 79690 33119 362 105 0 75194 0
[pid=9622/tid=9624] ppid=9620 vsize=318760 CPUtime=12.6 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 16263 0 0 0 1256 4 0 0 25 0 4 0 502520049 326410240 33119 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=318760 CPUtime=12.67 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 15576 0 0 0 1263 4 0 0 25 0 4 0 502520049 326410240 33119 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=318760 CPUtime=12.67 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 64710 0 0 0 1258 9 0 0 25 0 4 0 502520049 326410240 33119 33554432000 4194304 4623224 140734075618976 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.66
Current children cumulated vsize (KiB) 318760

[startup+25.5003 s]
/proc/loadavg: 8.08 8.02 7.66 9/184 9640
/proc/meminfo: memFree=29383240/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=360256 CPUtime=101.79 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 235621 0 0 0 10136 43 0 0 25 0 4 0 502520048 368902144 49609 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 90064 49609 364 105 0 85568 0
[pid=9622/tid=9624] ppid=9620 vsize=360256 CPUtime=25.34 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 23984 0 0 0 2528 6 0 0 25 0 4 0 502520049 368902144 49609 33554432000 4194304 4623224 140734075618976 18446744073709551615 254261272583 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=360256 CPUtime=25.47 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 25083 0 0 0 2539 8 0 0 25 0 4 0 502520049 368902144 49609 33554432000 4194304 4623224 140734075618976 18446744073709551615 4462896 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=360256 CPUtime=25.47 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 163245 0 0 0 2523 24 0 0 25 0 4 0 502520049 368902144 49609 33554432000 4194304 4623224 140734075618976 18446744073709551615 254261274866 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.79
Current children cumulated vsize (KiB) 360256

[startup+51.1007 s]
/proc/loadavg: 8.12 8.04 7.67 9/184 9640
/proc/meminfo: memFree=29147712/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=492208 CPUtime=204.06 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 343024 0 0 0 20341 65 0 0 25 0 4 0 502520048 504020992 79811 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 123052 79811 449 105 0 118556 0
[pid=9622/tid=9624] ppid=9620 vsize=492208 CPUtime=50.79 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 36362 0 0 0 5070 9 0 0 25 0 4 0 502520049 504020992 79811 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=492208 CPUtime=51.06 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 30427 0 0 0 5095 11 0 0 25 0 4 0 502520049 504020992 79811 33554432000 4194304 4623224 140734075618976 18446744073709551615 4378368 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=492208 CPUtime=51.08 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 222023 0 0 0 5074 34 0 0 25 0 4 0 502520049 504020992 79811 33554432000 4194304 4623224 140734075618976 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 204.06
Current children cumulated vsize (KiB) 492208

[startup+102.307 s]
/proc/loadavg: 8.09 8.04 7.69 9/184 9642
/proc/meminfo: memFree=28750648/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=754168 CPUtime=408.6 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 738253 0 0 0 40722 138 0 0 25 0 4 0 502520048 772268032 127890 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510006 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 188542 127890 408 105 0 184046 0
[pid=9622/tid=9624] ppid=9620 vsize=754168 CPUtime=101.72 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 54437 0 0 0 10159 13 0 0 25 0 4 0 502520049 772268032 127890 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=754168 CPUtime=102.27 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 46100 0 0 0 10205 22 0 0 25 0 4 0 502520049 772268032 127890 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=754168 CPUtime=102.28 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 523632 0 0 0 10146 82 0 0 25 0 4 0 502520049 772268032 127890 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 408.6
Current children cumulated vsize (KiB) 754168

[startup+162.301 s]
/proc/loadavg: 8.07 8.05 7.72 9/184 9643
/proc/meminfo: memFree=28349124/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=1051728 CPUtime=648.23 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 1286482 0 0 0 64595 228 0 0 25 0 4 0 502520048 1076969472 182988 33554432000 4194304 4623224 140734075618976 18446744073709551615 4414885 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 262932 182988 396 105 0 258436 0
[pid=9622/tid=9624] ppid=9620 vsize=1051728 CPUtime=161.39 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 62058 0 0 0 16121 18 0 0 25 0 4 0 502520049 1076969472 182988 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376880 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=1051728 CPUtime=162.25 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 61589 0 0 0 16198 27 0 0 25 0 4 0 502520049 1076969472 182988 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=1051728 CPUtime=162.26 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 912838 0 0 0 16082 144 0 0 25 0 4 0 502520049 1076969472 182988 33554432000 4194304 4623224 140734075618976 18446744073709551615 4366391 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 648.23
Current children cumulated vsize (KiB) 1051728

[startup+222.3 s]
/proc/loadavg: 8.02 8.04 7.73 9/184 9645
/proc/meminfo: memFree=27402996/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=1173620 CPUtime=887.9 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 1485400 0 0 0 88520 270 0 0 25 0 4 0 502520048 1201786880 227300 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 293405 227300 397 105 0 288909 0
[pid=9622/tid=9624] ppid=9620 vsize=1173620 CPUtime=221.06 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 86848 0 0 0 22084 22 0 0 25 0 4 0 502520049 1201786880 227300 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376865 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=1173620 CPUtime=222.25 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 69865 0 0 0 22190 35 0 0 25 0 4 0 502520049 1201786880 227300 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376883 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=1173620 CPUtime=222.27 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 1030128 0 0 0 22065 162 0 0 25 0 4 0 502520049 1201786880 227300 33554432000 4194304 4623224 140734075618976 18446744073709551615 4365056 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 887.9
Current children cumulated vsize (KiB) 1173620

[startup+282.301 s]

################
# More data... #
################


[startup+702.301 s]
/proc/loadavg: 8.03 8.05 7.84 9/184 9661
/proc/meminfo: memFree=25700900/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=2199740 CPUtime=2805.19 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 5829889 0 0 0 279523 996 0 0 25 0 4 0 502520048 2252533760 414879 33554432000 4194304 4623224 140734075618976 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 549935 414879 344 105 0 545439 0
[pid=9622/tid=9624] ppid=9620 vsize=2199740 CPUtime=698.43 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 141144 0 0 0 69806 37 0 0 25 0 4 0 502520049 2252533760 414879 33554432000 4194304 4623224 140734075618976 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=2199740 CPUtime=702.21 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 135108 0 0 0 70153 68 0 0 25 0 4 0 502520049 2252533760 414879 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=2199740 CPUtime=702.25 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 4666916 0 0 0 69478 747 0 0 25 0 4 0 502520049 2252533760 414879 33554432000 4194304 4623224 140734075618976 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2805.19
Current children cumulated vsize (KiB) 2199740

[startup+762.307 s]
/proc/loadavg: 8.01 8.04 7.85 9/184 9663
/proc/meminfo: memFree=25622620/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=2238332 CPUtime=3044.89 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 6459079 0 0 0 303383 1106 0 0 25 0 4 0 502520048 2292051968 422116 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510123 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 559583 422117 344 105 0 555087 0
[pid=9622/tid=9624] ppid=9620 vsize=2238332 CPUtime=758.11 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 142333 0 0 0 75773 38 0 0 25 0 4 0 502520049 2292051968 422117 33554432000 4194304 4623224 140734075618976 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=2238332 CPUtime=762.21 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 137284 0 0 0 76152 69 0 0 25 0 4 0 502520049 2292051968 422117 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=2238332 CPUtime=762.26 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 5200610 0 0 0 75388 838 0 0 25 0 4 0 502520049 2292051968 422117 33554432000 4194304 4623224 140734075618976 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3044.89
Current children cumulated vsize (KiB) 2238332

[startup+822.3 s]
/proc/loadavg: 8.00 8.03 7.85 9/184 9664
/proc/meminfo: memFree=25546340/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=2251796 CPUtime=3284.54 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 7018632 0 0 0 327256 1198 0 0 25 0 4 0 502520048 2305839104 429916 33554432000 4194304 4623224 140734075618976 18446744073709551615 4415014 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 562949 429916 344 105 0 558453 0
[pid=9622/tid=9624] ppid=9620 vsize=2251796 CPUtime=817.78 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 142883 0 0 0 81740 38 0 0 25 0 4 0 502520049 2305839104 429916 33554432000 4194304 4623224 140734075618976 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=2251796 CPUtime=822.2 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 141325 0 0 0 82149 71 0 0 25 0 4 0 502520049 2305839104 429916 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=2251796 CPUtime=822.25 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 5656391 0 0 0 81315 910 0 0 25 0 4 0 502520049 2305839104 429916 33554432000 4194304 4623224 140734075618976 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3284.54
Current children cumulated vsize (KiB) 2251796

[startup+882.301 s]
/proc/loadavg: 8.00 8.02 7.86 9/184 9666
/proc/meminfo: memFree=25367016/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=2299844 CPUtime=3524.21 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 7674202 0 0 0 351118 1303 0 0 25 0 4 0 502520048 2355040256 470452 33554432000 4194304 4623224 140734075618976 18446744073709551615 4414885 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 574961 470452 344 105 0 570465 0
[pid=9622/tid=9624] ppid=9620 vsize=2299844 CPUtime=877.45 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 143451 0 0 0 87707 38 0 0 25 0 4 0 502520049 2355040256 470454 33554432000 4194304 4623224 140734075618976 18446744073709551615 4357647 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=2299844 CPUtime=882.19 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 149623 0 0 0 88144 75 0 0 25 0 4 0 502520049 2355040256 470454 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=2299844 CPUtime=882.25 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 6249924 0 0 0 87225 1000 0 0 25 0 4 0 502520049 2355040256 470454 33554432000 4194304 4623224 140734075618976 18446744073709551615 4577678 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3524.21
Current children cumulated vsize (KiB) 2299844

[startup+942.301 s]
/proc/loadavg: 8.04 8.03 7.87 9/184 9667
/proc/meminfo: memFree=25079688/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=2836780 CPUtime=3763.89 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 8005592 0 0 0 375035 1354 0 0 25 0 4 0 502520048 2904862720 534341 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 709195 534341 344 105 0 704699 0
[pid=9622/tid=9624] ppid=9620 vsize=2836780 CPUtime=937.14 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 144010 0 0 0 93675 39 0 0 25 0 4 0 502520049 2904862720 534341 33554432000 4194304 4623224 140734075618976 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=2836780 CPUtime=942.19 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 151580 0 0 0 94142 77 0 0 25 0 4 0 502520049 2904862720 534341 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=2836780 CPUtime=942.25 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 6304794 0 0 0 93215 1010 0 0 25 0 4 0 502520049 2904862720 534341 33554432000 4194304 4623224 140734075618976 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3763.89
Current children cumulated vsize (KiB) 2836780

[startup+1002.3 s]
/proc/loadavg: 8.09 8.04 7.88 9/184 9669
/proc/meminfo: memFree=24866764/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=2840412 CPUtime=4003.55 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 8042409 0 0 0 398995 1360 0 0 25 0 4 0 502520048 2908581888 540012 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 710103 540012 344 105 0 705607 0
[pid=9622/tid=9624] ppid=9620 vsize=2840412 CPUtime=996.81 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 144477 0 0 0 99642 39 0 0 25 0 4 0 502520049 2908581888 540012 33554432000 4194304 4623224 140734075618976 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=2840412 CPUtime=1002.18 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 151880 0 0 0 100141 77 0 0 25 0 4 0 502520049 2908581888 540012 33554432000 4194304 4623224 140734075618976 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=2840412 CPUtime=1002.26 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 6306454 0 0 0 99215 1011 0 0 25 0 4 0 502520049 2908581888 540012 33554432000 4194304 4623224 140734075618976 18446744073709551615 4364715 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4003.55
Current children cumulated vsize (KiB) 2840412

[startup+1062.3 s]
/proc/loadavg: 8.10 8.04 7.89 9/184 9670
/proc/meminfo: memFree=24723536/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=2912360 CPUtime=4243.23 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 8151933 0 0 0 422938 1385 0 0 25 0 4 0 502520048 2982256640 568180 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510101 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 728090 568180 344 105 0 723594 0
[pid=9622/tid=9624] ppid=9620 vsize=2912360 CPUtime=1056.48 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 145074 0 0 0 105609 39 0 0 25 0 4 0 502520049 2982256640 568180 33554432000 4194304 4623224 140734075618976 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=2912360 CPUtime=1062.18 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 152393 0 0 0 106140 78 0 0 25 0 4 0 502520049 2982256640 568180 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=2912360 CPUtime=1062.26 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 6309071 0 0 0 105214 1012 0 0 25 0 4 0 502520049 2982256640 568180 33554432000 4194304 4623224 140734075618976 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4243.23
Current children cumulated vsize (KiB) 2912360

[startup+1122.3 s]
/proc/loadavg: 8.13 8.06 7.91 9/184 9672
/proc/meminfo: memFree=24574716/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=2984360 CPUtime=4482.9 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 8250321 0 0 0 446883 1407 0 0 25 0 4 0 502520048 3055984640 600160 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 746090 600160 344 105 0 741594 0
[pid=9622/tid=9624] ppid=9620 vsize=2984360 CPUtime=1116.15 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 145710 0 0 0 111576 39 0 0 25 0 4 0 502520049 3055984640 600160 33554432000 4194304 4623224 140734075618976 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=2984360 CPUtime=1122.18 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 154964 0 0 0 112136 82 0 0 25 0 4 0 502520049 3055984640 600160 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=2984360 CPUtime=1122.25 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 6311130 0 0 0 111213 1012 0 0 25 0 4 0 502520049 3055984640 600160 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4482.9
Current children cumulated vsize (KiB) 2984360

[startup+1182.3 s]
/proc/loadavg: 8.22 8.10 7.93 9/184 9674
/proc/meminfo: memFree=24307608/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=3064844 CPUtime=4722.58 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 8402922 0 0 0 470818 1440 0 0 25 0 4 0 502520048 3138400256 634999 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 766211 634999 344 105 0 761715 0
[pid=9622/tid=9624] ppid=9620 vsize=3064844 CPUtime=1175.83 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 187706 0 0 0 117538 45 0 0 25 0 4 0 502520049 3138400256 634999 33554432000 4194304 4623224 140734075618976 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=3064844 CPUtime=1182.18 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 159259 0 0 0 118128 90 0 0 25 0 4 0 502520049 3138400256 634999 33554432000 4194304 4623224 140734075618976 18446744073709551615 4289723 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=3064844 CPUtime=1182.26 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 6384767 0 0 0 117202 1024 0 0 25 0 4 0 502520049 3138400256 634999 33554432000 4194304 4623224 140734075618976 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4722.58
Current children cumulated vsize (KiB) 3064844



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.15 8.09 7.93 9/184 9674
/proc/meminfo: memFree=24286392/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=3064844 CPUtime=4800.09 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) R 9620 9622 9165 0 -1 4202496 8466154 0 0 0 478556 1453 0 0 25 0 4 0 502520048 3138400256 637186 33554432000 4194304 4623224 140734075618976 18446744073709551615 4510244 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 766211 637186 344 105 0 761715 0
[pid=9622/tid=9624] ppid=9620 vsize=3064844 CPUtime=1195.13 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4202560 187706 0 0 0 119468 45 0 0 25 0 4 0 502520049 3138400256 637186 33554432000 4194304 4623224 140734075618976 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9622/tid=9625] ppid=9620 vsize=3064844 CPUtime=1201.58 cores=1,3,5,7
/proc/9622/task/9625/stat : 9625 (SArTagnan) R 9620 9622 9165 0 -1 4202560 160988 0 0 0 120065 93 0 0 25 0 4 0 502520049 3138400256 637186 33554432000 4194304 4623224 140734075618976 18446744073709551615 4278260 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9622/tid=9626] ppid=9620 vsize=3064844 CPUtime=1201.67 cores=1,3,5,7
/proc/9622/task/9626/stat : 9626 (SArTagnan) R 9620 9622 9165 0 -1 4202560 6443105 0 0 0 119133 1034 0 0 25 0 4 0 502520049 3138400256 637186 33554432000 4194304 4623224 140734075618976 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.09
Current children cumulated vsize (KiB) 3064844

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.81 s]
/proc/loadavg: 8.15 8.09 7.93 9/184 9674
/proc/meminfo: memFree=24286392/32951124 swapFree=67111348/67111528
[pid=9622] ppid=9620 vsize=0 CPUtime=4800.21 cores=1,3,5,7
/proc/9622/stat : 9622 (SArTagnan) Z 9620 9622 9165 0 -1 4203548 8466154 0 0 0 478558 1463 0 0 25 0 2 0 502520048 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/9622/statm: 0 0 0 0 0 0 0
[pid=9622/tid=9624] ppid=9620 vsize=0 CPUtime=1195.23 cores=1,3,5,7
/proc/9622/task/9624/stat : 9624 (SArTagnan) R 9620 9622 9165 0 -1 4203588 187706 0 0 0 119468 55 0 0 25 0 2 0 502520049 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.83
CPU time (s): 4800.23
CPU user time (s): 4785.58
CPU system time (s): 14.6468
CPU usage (%): 399.411
Max. virtual memory (cumulated for all children) (KiB): 3350844

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4785.58
system time used= 14.6468
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 8466154
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2856
involuntary context switches= 29205

runsolver used 1.76573 second user time and 4.79827 second system time

The end

Launcher Data 

Begin job on node140 at 2011-04-29 20:17:27
IDJOB=3263456
IDBENCH=83976
IDSOLVER=1656
FILE ID=node140/3263456-1304101047
RUNJOBID= node140-1304099843-9510
PBS_JOBID= 13170605
Free space on /tmp= 72664 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_22_70_7-dir.shuffled-as.sat03-154.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3263456-1304101047/watcher-3263456-1304101047 -o /tmp/evaluation-result-3263456-1304101047/solver-3263456-1304101047 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3263456-1304101047.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= aa9ee2fa26214e80fac6d004d5d0b003
RANDOM SEED=1088909093

node140.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29748824 kB
Buffers:       1005476 kB
Cached:        1643548 kB
SwapCached:        180 kB
Active:         262776 kB
Inactive:      2448972 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29748824 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:             824 kB
Writeback:           0 kB
AnonPages:       62452 kB
Mapped:          14296 kB
Slab:           426360 kB
PageTables:       4656 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   185960 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72660 MiB
End job on node140 at 2011-04-29 20:37:31