Trace number 3287427

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.21 1201.78

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf
MD5SUMee159af2e208d290f7f3fefd15c344f2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark731.23
Satisfiable
(Un)Satisfiability was proved
Number of variables44692
Number of clauses129620
Sum of the clauses size302444
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 286412
Number of clauses of size 343206
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3287427-1304065153/watcher-3287427-1304065153 -o /tmp/evaluation-result-3287427-1304065153/solver-3287427-1304065153 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3287427-1304065153.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.75 7.96 7.94 6/180 13200
/proc/meminfo: memFree=26275032/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=25352 CPUtime=0 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 1260 0 0 0 0 0 0 0 25 0 1 0 518114003 25960448 1197 33554432000 4194304 4623224 140734256114016 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/13200/statm: 6338 1198 296 105 0 1842 0

[startup+0.074234 s]
/proc/loadavg: 7.75 7.96 7.94 6/180 13200
/proc/meminfo: memFree=26275032/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=215496 CPUtime=0.08 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 9634 0 0 0 8 0 0 0 25 0 4 0 518114003 220667904 7829 33554432000 4194304 4623224 140734256114016 18446744073709551615 4498768 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 53874 7829 327 105 0 49378 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 215496

[startup+0.175038 s]
/proc/loadavg: 7.75 7.96 7.94 6/180 13200
/proc/meminfo: memFree=26275032/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=281032 CPUtime=0.49 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 10164 0 0 0 49 0 0 0 25 0 4 0 518114003 287776768 8359 33554432000 4194304 4623224 140734256114016 18446744073709551615 4412446 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 70258 8359 335 105 0 65762 0
Current children cumulated CPU time (s) 0.49
Current children cumulated vsize (KiB) 281032

[startup+0.301018 s]
/proc/loadavg: 7.75 7.96 7.94 6/180 13200
/proc/meminfo: memFree=26275032/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=281032 CPUtime=0.99 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 10534 0 0 0 99 0 0 0 25 0 4 0 518114003 287776768 8729 33554432000 4194304 4623224 140734256114016 18446744073709551615 4510621 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 70258 8729 342 105 0 65762 0
Current children cumulated CPU time (s) 0.99
Current children cumulated vsize (KiB) 281032

[startup+0.700951 s]
/proc/loadavg: 7.75 7.96 7.94 6/180 13200
/proc/meminfo: memFree=26275032/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=283956 CPUtime=2.6 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 13186 0 0 0 259 1 0 0 25 0 4 0 518114003 290770944 9584 33554432000 4194304 4623224 140734256114016 18446744073709551615 4412592 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 70989 9584 342 105 0 66493 0
Current children cumulated CPU time (s) 2.6
Current children cumulated vsize (KiB) 283956

[startup+1.50082 s]
/proc/loadavg: 7.75 7.96 7.94 9/184 13204
/proc/meminfo: memFree=26230856/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=289880 CPUtime=5.79 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 19162 0 0 0 577 2 0 0 25 0 4 0 518114003 296837120 10727 33554432000 4194304 4623224 140734256114016 18446744073709551615 4412522 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 72470 10727 343 105 0 67974 0
[pid=13200/tid=13202] ppid=13198 vsize=289880 CPUtime=1.42 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 2198 0 0 0 142 0 0 0 25 0 4 0 518114009 296837120 10727 33554432000 4194304 4623224 140734256114016 18446744073709551615 4363742 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=289880 CPUtime=1.42 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 2102 0 0 0 142 0 0 0 25 0 4 0 518114009 296837120 10727 33554432000 4194304 4623224 140734256114016 18446744073709551615 4377179 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=289880 CPUtime=1.43 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 4489 0 0 0 143 0 0 0 25 0 4 0 518114009 296837120 10727 33554432000 4194304 4623224 140734256114016 18446744073709551615 4289875 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.79
Current children cumulated vsize (KiB) 289880

[startup+3.10055 s]
/proc/loadavg: 7.75 7.96 7.94 9/184 13204
/proc/meminfo: memFree=26220936/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=294900 CPUtime=12.18 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 29275 0 0 0 1215 3 0 0 25 0 4 0 518114003 301977600 12430 33554432000 4194304 4623224 140734256114016 18446744073709551615 4412513 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 73725 12430 343 105 0 69229 0
[pid=13200/tid=13202] ppid=13198 vsize=294900 CPUtime=3.02 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 3450 0 0 0 302 0 0 0 25 0 4 0 518114009 301977600 12430 33554432000 4194304 4623224 140734256114016 18446744073709551615 4289972 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=294900 CPUtime=3.01 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 3221 0 0 0 301 0 0 0 25 0 4 0 518114009 301977600 12430 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=294900 CPUtime=3.03 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 10994 0 0 0 302 1 0 0 25 0 4 0 518114009 301977600 12430 33554432000 4194304 4623224 140734256114016 18446744073709551615 4571982 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.18
Current children cumulated vsize (KiB) 294900

[startup+6.30101 s]
/proc/loadavg: 7.77 7.96 7.94 9/184 13204
/proc/meminfo: memFree=26199944/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=307644 CPUtime=24.96 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 51184 0 0 0 2489 7 0 0 25 0 4 0 518114003 315027456 16447 33554432000 4194304 4623224 140734256114016 18446744073709551615 4412513 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 76911 16464 343 105 0 72415 0
[pid=13200/tid=13202] ppid=13198 vsize=307644 CPUtime=6.23 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 6368 0 0 0 622 1 0 0 25 0 4 0 518114009 315027456 16477 33554432000 4194304 4623224 140734256114016 18446744073709551615 4289723 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=307644 CPUtime=6.19 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 6091 0 0 0 619 0 0 0 25 0 4 0 518114009 315027456 16491 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=307644 CPUtime=6.23 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 24922 0 0 0 620 3 0 0 25 0 4 0 518114009 315027456 16491 33554432000 4194304 4623224 140734256114016 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 24.96
Current children cumulated vsize (KiB) 307644

[startup+12.7009 s]
/proc/loadavg: 7.79 7.96 7.94 9/184 13204
/proc/meminfo: memFree=26114128/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=349836 CPUtime=50.53 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 93399 0 0 0 5038 15 0 0 25 0 4 0 518114003 358232064 27834 33554432000 4194304 4623224 140734256114016 18446744073709551615 4498513 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 87459 27834 343 105 0 82963 0
[pid=13200/tid=13202] ppid=13198 vsize=349836 CPUtime=12.62 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 13315 0 0 0 1260 2 0 0 25 0 4 0 518114009 358232064 27834 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=349836 CPUtime=12.56 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 14338 0 0 0 1254 2 0 0 25 0 4 0 518114009 358232064 27834 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=349836 CPUtime=12.63 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 43913 0 0 0 1257 6 0 0 25 0 4 0 518114009 358232064 27834 33554432000 4194304 4623224 140734256114016 18446744073709551615 4363742 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.53
Current children cumulated vsize (KiB) 349836

[startup+25.5008 s]
/proc/loadavg: 7.84 7.96 7.94 9/184 13205
/proc/meminfo: memFree=25852388/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=469840 CPUtime=101.65 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 155326 0 0 0 10141 24 0 0 25 0 4 0 518114003 481116160 81133 33554432000 4194304 4623224 140734256114016 18446744073709551615 4507275 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 117460 81133 355 105 0 112964 0
[pid=13200/tid=13202] ppid=13198 vsize=469840 CPUtime=25.42 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 23502 0 0 0 2539 3 0 0 25 0 4 0 518114009 481116160 81133 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=469840 CPUtime=25.28 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 23358 0 0 0 2525 3 0 0 25 0 4 0 518114009 481116160 81133 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376582 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=469840 CPUtime=25.42 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 52211 0 0 0 2534 8 0 0 25 0 4 0 518114009 481116160 81133 33554432000 4194304 4623224 140734256114016 18446744073709551615 4577447 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.65
Current children cumulated vsize (KiB) 469840

[startup+51.1005 s]
/proc/loadavg: 7.95 7.98 7.95 9/184 13206
/proc/meminfo: memFree=25724132/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=522120 CPUtime=203.91 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 174514 0 0 0 20363 28 0 0 25 0 4 0 518114003 534650880 91738 33554432000 4194304 4623224 140734256114016 18446744073709551615 4517408 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 130530 91738 363 105 0 126034 0
[pid=13200/tid=13202] ppid=13198 vsize=522120 CPUtime=51.02 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 27806 0 0 0 5098 4 0 0 25 0 4 0 518114009 534650880 91738 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376835 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=522120 CPUtime=50.75 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 27320 0 0 0 5071 4 0 0 25 0 4 0 518114009 534650880 91738 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376993 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=522120 CPUtime=51.02 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 52533 0 0 0 5094 8 0 0 25 0 4 0 518114009 534650880 91738 33554432000 4194304 4623224 140734256114016 18446744073709551615 251813907418 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 203.91
Current children cumulated vsize (KiB) 522120

[startup+102.307 s]
/proc/loadavg: 8.09 8.01 7.96 9/184 13207
/proc/meminfo: memFree=25505712/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=578600 CPUtime=408.46 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 215359 0 0 0 40809 37 0 0 25 0 4 0 518114003 592486400 98170 33554432000 4194304 4623224 140734256114016 18446744073709551615 4517612 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 144650 98170 353 105 0 140154 0
[pid=13200/tid=13202] ppid=13198 vsize=578600 CPUtime=102.23 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 41615 0 0 0 10217 6 0 0 25 0 4 0 518114009 592486400 98170 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=578600 CPUtime=101.67 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 33040 0 0 0 10162 5 0 0 25 0 4 0 518114009 592486400 98170 33554432000 4194304 4623224 140734256114016 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=578600 CPUtime=102.23 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 56333 0 0 0 10214 9 0 0 25 0 4 0 518114009 592486400 98170 33554432000 4194304 4623224 140734256114016 18446744073709551615 4577456 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 408.46
Current children cumulated vsize (KiB) 578600

[startup+162.301 s]
/proc/loadavg: 8.13 8.04 7.97 9/184 13208
/proc/meminfo: memFree=25293728/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=667692 CPUtime=648.12 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 492168 0 0 0 64723 89 0 0 25 0 4 0 518114003 683716608 117853 33554432000 4194304 4623224 140734256114016 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 166923 117853 347 105 0 162427 0
[pid=13200/tid=13202] ppid=13198 vsize=667692 CPUtime=162.23 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 50438 0 0 0 16210 13 0 0 25 0 4 0 518114009 683716608 117853 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=667692 CPUtime=161.34 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 36982 0 0 0 16127 7 0 0 25 0 4 0 518114009 683716608 117853 33554432000 4194304 4623224 140734256114016 18446744073709551615 4366391 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=667692 CPUtime=162.22 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 317309 0 0 0 16170 52 0 0 25 0 4 0 518114009 683716608 117853 33554432000 4194304 4623224 140734256114016 18446744073709551615 4364906 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 648.12
Current children cumulated vsize (KiB) 667692

[startup+222.301 s]
/proc/loadavg: 8.14 8.06 7.98 9/184 13210
/proc/meminfo: memFree=25140160/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=733048 CPUtime=887.78 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 857650 0 0 0 88619 159 0 0 25 0 4 0 518114003 750641152 136930 33554432000 4194304 4623224 140734256114016 18446744073709551615 4510093 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 183262 136930 347 105 0 178766 0
[pid=13200/tid=13202] ppid=13198 vsize=733048 CPUtime=222.22 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 74915 0 0 0 22198 24 0 0 25 0 4 0 518114009 750641152 136930 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=733048 CPUtime=221.01 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 42410 0 0 0 22093 8 0 0 25 0 4 0 518114009 750641152 136930 33554432000 4194304 4623224 140734256114016 18446744073709551615 4366341 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=733048 CPUtime=222.22 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 635385 0 0 0 22116 106 0 0 25 0 4 0 518114009 750641152 136930 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 887.78
Current children cumulated vsize (KiB) 733048

[startup+282.301 s]

################
# More data... #
################

[pid=13200] ppid=13198 vsize=1334776 CPUtime=2805.19 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 2623066 0 0 0 279991 528 0 0 25 0 4 0 518114003 1366810624 265644 33554432000 4194304 4623224 140734256114016 18446744073709551615 4510034 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 333694 265644 401 105 0 329198 0
[pid=13200/tid=13202] ppid=13198 vsize=1334776 CPUtime=702.23 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 138371 0 0 0 70136 87 0 0 25 0 4 0 518114009 1366810624 265644 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=1334776 CPUtime=698.4 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 66473 0 0 0 69813 27 0 0 25 0 4 0 518114009 1366810624 265644 33554432000 4194304 4623224 140734256114016 18446744073709551615 4289711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=1334776 CPUtime=702.22 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 2238067 0 0 0 69845 377 0 0 25 0 4 0 518114009 1366810624 265644 33554432000 4194304 4623224 140734256114016 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2805.19
Current children cumulated vsize (KiB) 1334776

[startup+762.307 s]
/proc/loadavg: 8.00 8.05 8.00 9/184 13224
/proc/meminfo: memFree=23802940/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=1561212 CPUtime=3044.88 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 2805595 0 0 0 303930 558 0 0 25 0 4 0 518114003 1598681088 295129 33554432000 4194304 4623224 140734256114016 18446744073709551615 4507139 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 390303 295129 580 105 0 385807 0
[pid=13200/tid=13202] ppid=13198 vsize=1561212 CPUtime=762.24 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 173615 0 0 0 76130 94 0 0 25 0 4 0 518114009 1598681088 295129 33554432000 4194304 4623224 140734256114016 18446744073709551615 4366391 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=1561212 CPUtime=758.08 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 74472 0 0 0 75779 29 0 0 25 0 4 0 518114009 1598681088 295129 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=1561212 CPUtime=762.23 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 2375678 0 0 0 75824 399 0 0 25 0 4 0 518114009 1598681088 295129 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376844 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3044.88
Current children cumulated vsize (KiB) 1561212

[startup+822.301 s]
/proc/loadavg: 8.00 8.04 8.00 9/184 13226
/proc/meminfo: memFree=23772376/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=1561212 CPUtime=3284.54 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 2814905 0 0 0 327893 561 0 0 25 0 4 0 518114003 1598681088 298259 33554432000 4194304 4623224 140734256114016 18446744073709551615 4507356 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 390303 298259 494 105 0 385807 0
[pid=13200/tid=13202] ppid=13198 vsize=1561212 CPUtime=822.23 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 174308 0 0 0 82129 94 0 0 25 0 4 0 518114009 1598681088 298259 33554432000 4194304 4623224 140734256114016 18446744073709551615 4377034 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=1561212 CPUtime=817.75 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 74733 0 0 0 81746 29 0 0 25 0 4 0 518114009 1598681088 298259 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=1561212 CPUtime=822.22 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 2382539 0 0 0 81822 400 0 0 25 0 4 0 518114009 1598681088 298259 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376579 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3284.54
Current children cumulated vsize (KiB) 1561212

[startup+882.301 s]
/proc/loadavg: 8.00 8.03 8.00 9/184 13228
/proc/meminfo: memFree=23662332/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=1600796 CPUtime=3524.21 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 2920940 0 0 0 351841 580 0 0 25 0 4 0 518114003 1639215104 310328 33554432000 4194304 4623224 140734256114016 18446744073709551615 4510167 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 400199 310328 553 105 0 395703 0
[pid=13200/tid=13202] ppid=13198 vsize=1600796 CPUtime=882.24 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 175675 0 0 0 88129 95 0 0 25 0 4 0 518114009 1639215104 310328 33554432000 4194304 4623224 140734256114016 18446744073709551615 4377885 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=1600796 CPUtime=877.42 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 77244 0 0 0 87711 31 0 0 25 0 4 0 518114009 1639215104 310328 33554432000 4194304 4623224 140734256114016 18446744073709551615 4289700 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=1600796 CPUtime=882.22 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 2482860 0 0 0 87806 416 0 0 25 0 4 0 518114009 1639215104 310328 33554432000 4194304 4623224 140734256114016 18446744073709551615 4550498 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3524.21
Current children cumulated vsize (KiB) 1600796

[startup+942.301 s]
/proc/loadavg: 8.00 8.02 8.00 9/184 13229
/proc/meminfo: memFree=23603748/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=1600796 CPUtime=3763.89 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 2991910 0 0 0 375791 598 0 0 25 0 4 0 518114003 1639215104 317555 33554432000 4194304 4623224 140734256114016 18446744073709551615 4510226 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 400199 317555 407 105 0 395703 0
[pid=13200/tid=13202] ppid=13198 vsize=1600796 CPUtime=942.23 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 179126 0 0 0 94124 99 0 0 25 0 4 0 518114009 1639215104 317555 33554432000 4194304 4623224 140734256114016 18446744073709551615 4289942 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=1600796 CPUtime=937.09 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 78813 0 0 0 93676 33 0 0 25 0 4 0 518114009 1639215104 317555 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=1600796 CPUtime=942.23 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 2547475 0 0 0 93796 427 0 0 25 0 4 0 518114009 1639215104 317555 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3763.89
Current children cumulated vsize (KiB) 1600796

[startup+1002.3 s]
/proc/loadavg: 8.00 8.02 8.00 9/184 13231
/proc/meminfo: memFree=23495956/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=1600796 CPUtime=4003.57 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 3302566 0 0 0 399698 659 0 0 25 0 4 0 518114003 1639215104 329618 33554432000 4194304 4623224 140734256114016 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 400199 329618 407 105 0 395703 0
[pid=13200/tid=13202] ppid=13198 vsize=1600796 CPUtime=1002.23 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 184311 0 0 0 100117 106 0 0 25 0 4 0 518114009 1639215104 329618 33554432000 4194304 4623224 140734256114016 18446744073709551615 4463640 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=1600796 CPUtime=996.77 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 79907 0 0 0 99643 34 0 0 25 0 4 0 518114009 1639215104 329618 33554432000 4194304 4623224 140734256114016 18446744073709551615 4289785 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=1600796 CPUtime=1002.23 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 2850244 0 0 0 99744 479 0 0 25 0 4 0 518114009 1639215104 329618 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4003.57
Current children cumulated vsize (KiB) 1600796

[startup+1062.3 s]
/proc/loadavg: 8.09 8.04 8.01 9/184 13232
/proc/meminfo: memFree=23328368/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=1620700 CPUtime=4243.24 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 3605385 0 0 0 423613 711 0 0 25 0 4 0 518114003 1659596800 339992 33554432000 4194304 4623224 140734256114016 18446744073709551615 4517833 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 405175 339992 407 105 0 400679 0
[pid=13200/tid=13202] ppid=13198 vsize=1620700 CPUtime=1062.23 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 188520 0 0 0 106112 111 0 0 25 0 4 0 518114009 1659596800 339992 33554432000 4194304 4623224 140734256114016 18446744073709551615 4289775 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=1620700 CPUtime=1056.44 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 90464 0 0 0 105609 35 0 0 25 0 4 0 518114009 1659596800 339992 33554432000 4194304 4623224 140734256114016 18446744073709551615 4463051 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=1620700 CPUtime=1062.23 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 3136915 0 0 0 105699 524 0 0 25 0 4 0 518114009 1659596800 339992 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4243.24
Current children cumulated vsize (KiB) 1620700

[startup+1122.3 s]
/proc/loadavg: 8.19 8.08 8.02 9/184 13234
/proc/meminfo: memFree=23235804/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=1620700 CPUtime=4482.91 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 3885088 0 0 0 447530 761 0 0 25 0 4 0 518114003 1659596800 346479 33554432000 4194304 4623224 140734256114016 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 405175 346479 407 105 0 400679 0
[pid=13200/tid=13202] ppid=13198 vsize=1620700 CPUtime=1122.23 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 190490 0 0 0 112110 113 0 0 25 0 4 0 518114009 1659596800 346479 33554432000 4194304 4623224 140734256114016 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=1620700 CPUtime=1116.11 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 90751 0 0 0 111576 35 0 0 25 0 4 0 518114009 1659596800 346479 33554432000 4194304 4623224 140734256114016 18446744073709551615 4316766 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=1620700 CPUtime=1122.23 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 3413179 0 0 0 111652 571 0 0 25 0 4 0 518114009 1659596800 346479 33554432000 4194304 4623224 140734256114016 18446744073709551615 4377679 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4482.91
Current children cumulated vsize (KiB) 1620700

[startup+1182.3 s]
/proc/loadavg: 6.57 7.69 7.89 5/175 13254
/proc/meminfo: memFree=25066852/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=1729444 CPUtime=4722.6 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 4166551 0 0 0 471447 813 0 0 25 0 4 0 518114003 1770950656 357337 33554432000 4194304 4623224 140734256114016 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 432361 357337 407 105 0 427865 0
[pid=13200/tid=13202] ppid=13198 vsize=1729444 CPUtime=1182.23 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 196024 0 0 0 118109 114 0 0 25 0 4 0 518114009 1770950656 357337 33554432000 4194304 4623224 140734256114016 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=1729444 CPUtime=1175.79 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 90869 0 0 0 117544 35 0 0 25 0 4 0 518114009 1770950656 357337 33554432000 4194304 4623224 140734256114016 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=1729444 CPUtime=1182.23 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 3687953 0 0 0 117601 622 0 0 25 0 4 0 518114009 1770950656 357337 33554432000 4194304 4623224 140734256114016 18446744073709551615 4376766 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4722.6
Current children cumulated vsize (KiB) 1729444



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 5.84 7.45 7.81 5/175 13254
/proc/meminfo: memFree=25063752/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=1729444 CPUtime=4800.11 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 4257601 0 0 0 479181 830 0 0 25 0 4 0 518114003 1770950656 357889 33554432000 4194304 4623224 140734256114016 18446744073709551615 4507421 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 432361 357889 407 105 0 427865 0
[pid=13200/tid=13202] ppid=13198 vsize=1729444 CPUtime=1201.64 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 196039 0 0 0 120050 114 0 0 25 0 4 0 518114009 1770950656 357889 33554432000 4194304 4623224 140734256114016 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=1729444 CPUtime=1195.09 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 90873 0 0 0 119474 35 0 0 25 0 4 0 518114009 1770950656 357889 33554432000 4194304 4623224 140734256114016 18446744073709551615 251813907341 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=1729444 CPUtime=1201.64 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 3778660 0 0 0 119525 639 0 0 25 0 4 0 518114009 1770950656 357889 33554432000 4194304 4623224 140734256114016 18446744073709551615 4377484 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.11
Current children cumulated vsize (KiB) 1729444

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 5.84 7.45 7.81 5/175 13254
/proc/meminfo: memFree=25063752/32950928 swapFree=67111524/67111528
[pid=13200] ppid=13198 vsize=1729444 CPUtime=4800.11 cores=1,3,5,7
/proc/13200/stat : 13200 (SArTagnan) R 13198 13200 11981 0 -1 4202496 4257601 0 0 0 479181 830 0 0 25 0 4 0 518114003 1770950656 357889 33554432000 4194304 4623224 140734256114016 18446744073709551615 4507421 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/13200/statm: 432361 357889 407 105 0 427865 0
[pid=13200/tid=13202] ppid=13198 vsize=1729444 CPUtime=1201.64 cores=1,3,5,7
/proc/13200/task/13202/stat : 13202 (SArTagnan) R 13198 13200 11981 0 -1 4202560 196039 0 0 0 120050 114 0 0 25 0 4 0 518114009 1770950656 357889 33554432000 4194304 4623224 140734256114016 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=13200/tid=13203] ppid=13198 vsize=1729444 CPUtime=1195.09 cores=1,3,5,7
/proc/13200/task/13203/stat : 13203 (SArTagnan) R 13198 13200 11981 0 -1 4202560 90873 0 0 0 119474 35 0 0 25 0 4 0 518114009 1770950656 357889 33554432000 4194304 4623224 140734256114016 18446744073709551615 251813907341 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=13200/tid=13204] ppid=13198 vsize=1729444 CPUtime=1201.64 cores=1,3,5,7
/proc/13200/task/13204/stat : 13204 (SArTagnan) R 13198 13200 11981 0 -1 4202560 3778660 0 0 0 119525 639 0 0 25 0 4 0 518114009 1770950656 357889 33554432000 4194304 4623224 140734256114016 18446744073709551615 4377484 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.11
Current children cumulated vsize (KiB) 1729444

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.78
CPU time (s): 4800.21
CPU user time (s): 4791.84
CPU system time (s): 8.37073
CPU usage (%): 399.426
Max. virtual memory (cumulated for all children) (KiB): 1729444

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4791.84
system time used= 8.37073
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4257601
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1170
involuntary context switches= 31388

runsolver used 2.05169 second user time and 4.50031 second system time

The end

Launcher Data 

Begin job on node126 at 2011-04-29 10:19:13
IDJOB=3287427
IDBENCH=82466
IDSOLVER=1656
FILE ID=node126/3287427-1304065153
RUNJOBID= node126-1304062030-12000
PBS_JOBID= 13170454
Free space on /tmp= 71592 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3287427-1304065153/watcher-3287427-1304065153 -o /tmp/evaluation-result-3287427-1304065153/solver-3287427-1304065153 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3287427-1304065153.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ee159af2e208d290f7f3fefd15c344f2
RANDOM SEED=1632159481

node126.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      26275304 kB
Buffers:       1415264 kB
Cached:        4429156 kB
SwapCached:          4 kB
Active:         561456 kB
Inactive:      5570108 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      26275304 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            3156 kB
Writeback:           0 kB
AnonPages:      286928 kB
Mapped:          15372 kB
Slab:           480576 kB
PageTables:       4956 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   488852 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71596 MiB
End job on node126 at 2011-04-29 10:39:17