Trace number 3281493

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.42 1203.7

General information on the benchmark

NameSAT_RACE08/Q1/
SAT_dat.k85.cnf
MD5SUMdce41996d9c5153aa0c253fa128d227c
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark43.2814
Satisfiable
(Un)Satisfiability was proved
Number of variables181484
Number of clauses890298
Sum of the clauses size2349692
Maximum clause length19
Minimum clause length1
Number of clauses of size 1771
Number of clauses of size 2667172
Number of clauses of size 3144951
Number of clauses of size 424791
Number of clauses of size 510950
Number of clauses of size over 541663

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3281493-1304040840/watcher-3281493-1304040840 -o /tmp/evaluation-result-3281493-1304040840/solver-3281493-1304040840 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3281493-1304040840.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.93 7.98 7.92 5/178 6923
/proc/meminfo: memFree=25470812/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=18348 CPUtime=0 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 404 0 0 0 0 0 0 0 21 0 1 0 515682772 18788352 341 33554432000 4194304 4623224 140733241151408 18446744073709551615 242970550016 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/6923/statm: 4587 341 290 105 0 91 0

[startup+0.0709091 s]
/proc/loadavg: 7.93 7.98 7.92 5/178 6923
/proc/meminfo: memFree=25470812/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=56660 CPUtime=0.06 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 4840 0 0 0 5 1 0 0 21 0 1 0 515682772 58019840 4175 33554432000 4194304 4623224 140733241151408 18446744073709551615 242970550016 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/6923/statm: 14165 4176 297 105 0 9669 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 56660

[startup+0.100897 s]
/proc/loadavg: 7.93 7.98 7.92 5/178 6923
/proc/meminfo: memFree=25470812/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=59520 CPUtime=0.09 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 6601 0 0 0 8 1 0 0 21 0 1 0 515682772 60948480 4876 33554432000 4194304 4623224 140733241151408 18446744073709551615 242970550016 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/6923/statm: 14880 4876 297 105 0 10384 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 59520

[startup+0.300869 s]
/proc/loadavg: 7.93 7.98 7.92 5/178 6923
/proc/meminfo: memFree=25470812/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=78504 CPUtime=0.29 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 18060 0 0 0 27 2 0 0 22 0 1 0 515682772 80388096 9574 33554432000 4194304 4623224 140733241151408 18446744073709551615 242970211013 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/6923/statm: 19626 9576 297 105 0 15130 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 78504

[startup+0.700765 s]
/proc/loadavg: 7.93 7.98 7.92 5/178 6923
/proc/meminfo: memFree=25470812/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=445520 CPUtime=1.31 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 63827 0 0 0 122 9 0 0 18 0 4 0 515682772 456212480 46813 33554432000 4194304 4623224 140733241151408 18446744073709551615 4359578 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 111380 46813 334 105 0 106884 0
Current children cumulated CPU time (s) 1.31
Current children cumulated vsize (KiB) 445520

[startup+1.50063 s]
/proc/loadavg: 7.93 7.98 7.92 9/182 6927
/proc/meminfo: memFree=25276480/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=458452 CPUtime=4.5 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 77436 0 0 0 439 11 0 0 19 0 4 0 515682772 469454848 51212 33554432000 4194304 4623224 140733241151408 18446744073709551615 4412768 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 114613 51212 335 105 0 110117 0
[pid=6923/tid=6925] ppid=6921 vsize=458452 CPUtime=0.99 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 5588 0 0 0 99 0 0 0 25 0 4 0 515682821 469454848 51212 33554432000 4194304 4623224 140733241151408 18446744073709551615 4483204 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=458452 CPUtime=1 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 6469 0 0 0 99 1 0 0 25 0 4 0 515682821 469454848 51212 33554432000 4194304 4623224 140733241151408 18446744073709551615 4316740 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=458452 CPUtime=0.99 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 11502 0 0 0 99 0 0 0 25 0 4 0 515682821 469454848 51212 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4.5
Current children cumulated vsize (KiB) 458452

[startup+3.10035 s]
/proc/loadavg: 7.93 7.98 7.92 9/182 6927
/proc/meminfo: memFree=25275856/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=462852 CPUtime=10.9 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 88406 0 0 0 1076 14 0 0 22 0 4 0 515682772 473960448 52009 33554432000 4194304 4623224 140733241151408 18446744073709551615 4510923 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 115713 52009 343 105 0 111217 0
[pid=6923/tid=6925] ppid=6921 vsize=462852 CPUtime=2.6 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 5918 0 0 0 259 1 0 0 25 0 4 0 515682821 473960448 52009 33554432000 4194304 4623224 140733241151408 18446744073709551615 4377885 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=462852 CPUtime=2.6 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 6818 0 0 0 259 1 0 0 25 0 4 0 515682821 473960448 52009 33554432000 4194304 4623224 140733241151408 18446744073709551615 4377703 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=462852 CPUtime=2.59 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 18871 0 0 0 257 2 0 0 25 0 4 0 515682821 473960448 52009 33554432000 4194304 4623224 140733241151408 18446744073709551615 4289581 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 10.9
Current children cumulated vsize (KiB) 462852

[startup+6.3008 s]
/proc/loadavg: 8.10 8.01 7.93 11/182 6927
/proc/meminfo: memFree=25228244/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=522084 CPUtime=23.68 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 152103 0 0 0 2346 22 0 0 25 0 4 0 515682772 534614016 64755 33554432000 4194304 4623224 140733241151408 18446744073709551615 4526860 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 130521 64755 343 105 0 126025 0
[pid=6923/tid=6925] ppid=6921 vsize=522084 CPUtime=5.79 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 16231 0 0 0 577 2 0 0 25 0 4 0 515682821 534614016 64755 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=522084 CPUtime=5.8 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 17069 0 0 0 578 2 0 0 25 0 4 0 515682821 534614016 64755 33554432000 4194304 4623224 140733241151408 18446744073709551615 4289775 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=522084 CPUtime=5.77 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 51065 0 0 0 571 6 0 0 25 0 4 0 515682821 534614016 64755 33554432000 4194304 4623224 140733241151408 18446744073709551615 4550297 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 23.68
Current children cumulated vsize (KiB) 522084

[startup+12.7007 s]
/proc/loadavg: 8.41 8.08 7.95 9/182 6927
/proc/meminfo: memFree=25137884/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=575388 CPUtime=48.44 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 223738 0 0 0 4810 34 0 0 25 0 4 0 515682772 589197312 84988 33554432000 4194304 4623224 140733241151408 18446744073709551615 4507318 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 143847 84988 343 105 0 139351 0
[pid=6923/tid=6925] ppid=6921 vsize=575388 CPUtime=11.75 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 27915 0 0 0 1170 5 0 0 25 0 4 0 515682821 589197312 84988 33554432000 4194304 4623224 140733241151408 18446744073709551615 4377579 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=575388 CPUtime=11.87 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 28753 0 0 0 1184 3 0 0 25 0 4 0 515682821 589197312 84988 33554432000 4194304 4623224 140733241151408 18446744073709551615 4330746 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=575388 CPUtime=12.09 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 87526 0 0 0 1197 12 0 0 25 0 4 0 515682821 589197312 84988 33554432000 4194304 4623224 140733241151408 18446744073709551615 4363755 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 48.44
Current children cumulated vsize (KiB) 575388

[startup+25.5005 s]
/proc/loadavg: 8.32 8.07 7.95 9/182 6928
/proc/meminfo: memFree=24528688/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=1370764 CPUtime=99.49 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 565604 0 0 0 9867 82 0 0 25 0 4 0 515682772 1403662336 234658 33554432000 4194304 4623224 140733241151408 18446744073709551615 4359291 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 342691 234658 347 105 0 338195 0
[pid=6923/tid=6925] ppid=6921 vsize=1370764 CPUtime=24.54 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 92820 0 0 0 2440 14 0 0 25 0 4 0 515682821 1403662336 234658 33554432000 4194304 4623224 140733241151408 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=1370764 CPUtime=24.57 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 85331 0 0 0 2447 10 0 0 25 0 4 0 515682821 1403662336 234658 33554432000 4194304 4623224 140733241151408 18446744073709551615 242970206165 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=1370764 CPUtime=24.86 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 156697 0 0 0 2463 23 0 0 25 0 4 0 515682821 1403662336 234658 33554432000 4194304 4623224 140733241151408 18446744073709551615 4467803 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 99.49
Current children cumulated vsize (KiB) 1370764

[startup+51.1011 s]
/proc/loadavg: 8.27 8.08 7.96 9/182 6928
/proc/meminfo: memFree=24412780/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=1457896 CPUtime=201.69 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 639672 0 0 0 20069 100 0 0 25 0 4 0 515682772 1492885504 254949 33554432000 4194304 4623224 140733241151408 18446744073709551615 4510034 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 364474 254949 347 105 0 359978 0
[pid=6923/tid=6925] ppid=6921 vsize=1457896 CPUtime=50.14 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 95807 0 0 0 4999 15 0 0 25 0 4 0 515682821 1492885504 254949 33554432000 4194304 4623224 140733241151408 18446744073709551615 4330746 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=1457896 CPUtime=50.04 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 87810 0 0 0 4992 12 0 0 25 0 4 0 515682821 1492885504 254949 33554432000 4194304 4623224 140733241151408 18446744073709551615 4462471 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=1457896 CPUtime=50.4 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 178923 0 0 0 5010 30 0 0 25 0 4 0 515682821 1492885504 254949 33554432000 4194304 4623224 140733241151408 18446744073709551615 4289574 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 201.69
Current children cumulated vsize (KiB) 1457896

[startup+102.306 s]
/proc/loadavg: 8.18 8.08 7.96 10/182 6930
/proc/meminfo: memFree=24262648/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=1509648 CPUtime=406.21 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 736745 0 0 0 40498 123 0 0 25 0 4 0 515682772 1545879552 279518 33554432000 4194304 4623224 140733241151408 18446744073709551615 4510226 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 377412 279518 347 105 0 372916 0
[pid=6923/tid=6925] ppid=6921 vsize=1509648 CPUtime=101.34 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 102126 0 0 0 10115 19 0 0 25 0 4 0 515682821 1545879552 279518 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=1509648 CPUtime=101.23 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 90545 0 0 0 10109 14 0 0 25 0 4 0 515682821 1545879552 279518 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=1509648 CPUtime=101.32 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 230675 0 0 0 10093 39 0 0 25 0 4 0 515682821 1545879552 279518 33554432000 4194304 4623224 140733241151408 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 406.21
Current children cumulated vsize (KiB) 1509648

[startup+162.301 s]
/proc/loadavg: 8.20 8.10 7.97 9/182 6961
/proc/meminfo: memFree=25043124/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=1604828 CPUtime=645.7 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 803993 0 0 0 64430 140 0 0 25 0 4 0 515682772 1643343872 304895 33554432000 4194304 4623224 140733241151408 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 401207 304895 347 105 0 396711 0
[pid=6923/tid=6925] ppid=6921 vsize=1604828 CPUtime=161.33 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 122370 0 0 0 16110 23 0 0 25 0 4 0 515682821 1643343872 304895 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376745 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=1604828 CPUtime=161.2 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 92942 0 0 0 16105 15 0 0 25 0 4 0 515682821 1643343872 304895 33554432000 4194304 4623224 140733241151408 18446744073709551615 4354672 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=1604828 CPUtime=160.86 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 235175 0 0 0 16046 40 0 0 25 0 4 0 515682821 1643343872 304895 33554432000 4194304 4623224 140733241151408 18446744073709551615 4330827 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 645.7
Current children cumulated vsize (KiB) 1604828

[startup+222.307 s]
/proc/loadavg: 8.30 8.14 8.00 9/182 6993
/proc/meminfo: memFree=24457864/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=1642080 CPUtime=880.46 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 836279 0 0 0 87892 154 0 0 25 0 4 0 515682772 1681489920 320423 33554432000 4194304 4623224 140733241151408 18446744073709551615 4510285 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 410520 320423 347 105 0 406024 0
[pid=6923/tid=6925] ppid=6921 vsize=1642080 CPUtime=221.35 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 124897 0 0 0 22109 26 0 0 25 0 4 0 515682821 1681489920 320423 33554432000 4194304 4623224 140733241151408 18446744073709551615 4289853 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=1642080 CPUtime=218.71 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 111204 0 0 0 21850 21 0 0 25 0 4 0 515682821 1681489920 320423 33554432000 4194304 4623224 140733241151408 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=1642080 CPUtime=218.1 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 237374 0 0 0 21769 41 0 0 25 0 4 0 515682821 1681489920 320423 33554432000 4194304 4623224 140733241151408 18446744073709551615 4366349 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 880.46
Current children cumulated vsize (KiB) 1642080

[startup+282.3 s]

################
# More data... #
################

[pid=6923] ppid=6921 vsize=2240044 CPUtime=2797.82 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 2252982 0 0 0 279385 397 0 0 25 0 4 0 515682772 2293805056 431854 33554432000 4194304 4623224 140733241151408 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 560011 431854 345 105 0 555515 0
[pid=6923/tid=6925] ppid=6921 vsize=2240044 CPUtime=701.35 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 185700 0 0 0 70091 44 0 0 25 0 4 0 515682821 2293805056 431854 33554432000 4194304 4623224 140733241151408 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=2240044 CPUtime=698.69 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 138792 0 0 0 69837 32 0 0 25 0 4 0 515682821 2293805056 431854 33554432000 4194304 4623224 140733241151408 18446744073709551615 4462458 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=2240044 CPUtime=695.5 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 1410809 0 0 0 69331 219 0 0 25 0 4 0 515682821 2293805056 431854 33554432000 4194304 4623224 140733241151408 18446744073709551615 4363989 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2797.82
Current children cumulated vsize (KiB) 2240044

[startup+762.301 s]
/proc/loadavg: 8.14 8.12 8.02 10/182 7007
/proc/meminfo: memFree=23251228/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=2298480 CPUtime=3037.52 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 2393027 0 0 0 303333 419 0 0 25 0 4 0 515682772 2353643520 444761 33554432000 4194304 4623224 140733241151408 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 574620 444761 345 105 0 570124 0
[pid=6923/tid=6925] ppid=6921 vsize=2298480 CPUtime=761.35 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 187350 0 0 0 76090 45 0 0 25 0 4 0 515682821 2353643520 444761 33554432000 4194304 4623224 140733241151408 18446744073709551615 4460982 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=2298480 CPUtime=758.7 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 141016 0 0 0 75837 33 0 0 25 0 4 0 515682821 2353643520 444761 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=2298480 CPUtime=755.18 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 1543082 0 0 0 75280 238 0 0 25 0 4 0 515682821 2353643520 444761 33554432000 4194304 4623224 140733241151408 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3037.52
Current children cumulated vsize (KiB) 2298480

[startup+822.3 s]
/proc/loadavg: 7.88 8.05 8.00 9/182 7069
/proc/meminfo: memFree=24570484/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=2303928 CPUtime=3277.17 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 2497991 0 0 0 327275 442 0 0 25 0 4 0 515682772 2359222272 454803 33554432000 4194304 4623224 140733241151408 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 575982 454803 345 105 0 571486 0
[pid=6923/tid=6925] ppid=6921 vsize=2303928 CPUtime=821.34 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 189751 0 0 0 82088 46 0 0 25 0 4 0 515682821 2359222272 454803 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=2303928 CPUtime=818.68 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 141494 0 0 0 81832 36 0 0 25 0 4 0 515682821 2359222272 454803 33554432000 4194304 4623224 140733241151408 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=2303928 CPUtime=814.85 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 1642021 0 0 0 81231 254 0 0 25 0 4 0 515682821 2359222272 454803 33554432000 4194304 4623224 140733241151408 18446744073709551615 4364437 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3277.17
Current children cumulated vsize (KiB) 2303928

[startup+882.307 s]
/proc/loadavg: 7.99 8.05 8.00 9/182 7071
/proc/meminfo: memFree=24425072/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=2447868 CPUtime=3516.83 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 2804841 0 0 0 351185 498 0 0 25 0 4 0 515682772 2506616832 465206 33554432000 4194304 4623224 140733241151408 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 611967 465206 345 105 0 607471 0
[pid=6923/tid=6925] ppid=6921 vsize=2447868 CPUtime=881.35 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 230313 0 0 0 88083 52 0 0 25 0 4 0 515682821 2506616832 465206 33554432000 4194304 4623224 140733241151408 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=2447868 CPUtime=878.66 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 142868 0 0 0 87826 40 0 0 25 0 4 0 515682821 2506616832 465206 33554432000 4194304 4623224 140733241151408 18446744073709551615 4316919 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=2447868 CPUtime=874.53 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 1903883 0 0 0 87154 299 0 0 25 0 4 0 515682821 2506616832 465206 33554432000 4194304 4623224 140733241151408 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3516.83
Current children cumulated vsize (KiB) 2447868

[startup+942.301 s]
/proc/loadavg: 8.06 8.07 8.01 9/182 7072
/proc/meminfo: memFree=24237708/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=2451828 CPUtime=3756.48 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 2919916 0 0 0 375128 520 0 0 25 0 4 0 515682772 2510671872 478589 33554432000 4194304 4623224 140733241151408 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 612957 478589 345 105 0 608461 0
[pid=6923/tid=6925] ppid=6921 vsize=2451828 CPUtime=941.35 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 235199 0 0 0 94080 55 0 0 25 0 4 0 515682821 2510671872 478589 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=2451828 CPUtime=938.65 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 146073 0 0 0 93823 42 0 0 25 0 4 0 515682821 2510671872 478589 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376835 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=2451828 CPUtime=934.2 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 2007849 0 0 0 93106 314 0 0 25 0 4 0 515682821 2510671872 478589 33554432000 4194304 4623224 140733241151408 18446744073709551615 242970247495 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3756.48
Current children cumulated vsize (KiB) 2451828

[startup+1002.3 s]
/proc/loadavg: 8.02 8.05 8.00 9/182 7074
/proc/meminfo: memFree=24094728/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=2519120 CPUtime=3996.17 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 3414204 0 0 0 399018 599 0 0 25 0 4 0 515682772 2579578880 493420 33554432000 4194304 4623224 140733241151408 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 629780 493420 345 105 0 625284 0
[pid=6923/tid=6925] ppid=6921 vsize=2519120 CPUtime=1001.35 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 238993 0 0 0 100077 58 0 0 25 0 4 0 515682821 2579578880 493420 33554432000 4194304 4623224 140733241151408 18446744073709551615 4289723 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=2519120 CPUtime=998.65 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 146639 0 0 0 99823 42 0 0 25 0 4 0 515682821 2579578880 493420 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=2519120 CPUtime=993.88 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 2494776 0 0 0 99001 387 0 0 25 0 4 0 515682821 2579578880 493420 33554432000 4194304 4623224 140733241151408 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3996.17
Current children cumulated vsize (KiB) 2519120

[startup+1062.3 s]
/proc/loadavg: 8.07 8.06 8.00 9/182 7075
/proc/meminfo: memFree=23950740/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=2519120 CPUtime=4235.85 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 3828727 0 0 0 422919 666 0 0 25 0 4 0 515682772 2579578880 497723 33554432000 4194304 4623224 140733241151408 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 629780 497723 345 105 0 625284 0
[pid=6923/tid=6925] ppid=6921 vsize=2519120 CPUtime=1061.35 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 242861 0 0 0 106073 62 0 0 25 0 4 0 515682821 2579578880 497723 33554432000 4194304 4623224 140733241151408 18446744073709551615 4289678 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=2519120 CPUtime=1058.65 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 147214 0 0 0 105823 42 0 0 25 0 4 0 515682821 2579578880 497723 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=2519120 CPUtime=1053.56 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 2901973 0 0 0 104907 449 0 0 25 0 4 0 515682821 2579578880 497723 33554432000 4194304 4623224 140733241151408 18446744073709551615 4555177 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4235.85
Current children cumulated vsize (KiB) 2519120

[startup+1122.3 s]
/proc/loadavg: 8.09 8.06 8.00 9/182 7077
/proc/meminfo: memFree=23760884/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=2747548 CPUtime=4475.52 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 4360247 0 0 0 446798 754 0 0 25 0 4 0 515682772 2813489152 509164 33554432000 4194304 4623224 140733241151408 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 686887 509164 345 105 0 682391 0
[pid=6923/tid=6925] ppid=6921 vsize=2747548 CPUtime=1121.35 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 246513 0 0 0 112068 67 0 0 25 0 4 0 515682821 2813489152 509164 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=2747548 CPUtime=1118.65 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 173529 0 0 0 111819 46 0 0 25 0 4 0 515682821 2813489152 509164 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376692 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=2747548 CPUtime=1113.23 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 3343676 0 0 0 110803 520 0 0 25 0 4 0 515682821 2813489152 509164 33554432000 4194304 4623224 140733241151408 18446744073709551615 4555653 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4475.52
Current children cumulated vsize (KiB) 2747548

[startup+1182.3 s]
/proc/loadavg: 8.09 8.06 8.00 9/182 7079
/proc/meminfo: memFree=23600284/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=2747548 CPUtime=4715.2 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 4875751 0 0 0 470679 841 0 0 25 0 4 0 515682772 2813489152 523531 33554432000 4194304 4623224 140733241151408 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 686887 523531 345 105 0 682391 0
[pid=6923/tid=6925] ppid=6921 vsize=2747548 CPUtime=1181.35 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 250290 0 0 0 118063 72 0 0 25 0 4 0 515682821 2813489152 523531 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=2747548 CPUtime=1178.65 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 176139 0 0 0 117818 47 0 0 25 0 4 0 515682821 2813489152 523531 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=2747548 CPUtime=1172.91 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 3850912 0 0 0 116690 601 0 0 25 0 4 0 515682821 2813489152 523531 33554432000 4194304 4623224 140733241151408 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4715.2
Current children cumulated vsize (KiB) 2747548



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.6 s]
/proc/loadavg: 8.06 8.06 8.00 9/182 7079
/proc/meminfo: memFree=23567420/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=2747548 CPUtime=4800.29 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 5049174 0 0 0 479161 868 0 0 25 0 4 0 515682772 2813489152 527385 33554432000 4194304 4623224 140733241151408 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 686887 527385 345 105 0 682391 0
[pid=6923/tid=6925] ppid=6921 vsize=2747548 CPUtime=1202.65 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 251077 0 0 0 120193 72 0 0 25 0 4 0 515682821 2813489152 527385 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=2747548 CPUtime=1199.96 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 176334 0 0 0 119948 48 0 0 25 0 4 0 515682821 2813489152 527385 33554432000 4194304 4623224 140733241151408 18446744073709551615 4317197 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=2747548 CPUtime=1194.09 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 4022189 0 0 0 118782 627 0 0 25 0 4 0 515682821 2813489152 527385 33554432000 4194304 4623224 140733241151408 18446744073709551615 4550459 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.29
Current children cumulated vsize (KiB) 2747548

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.6 s]
/proc/loadavg: 8.06 8.06 8.00 9/182 7079
/proc/meminfo: memFree=23567420/32951132 swapFree=67111364/67111528
[pid=6923] ppid=6921 vsize=2747548 CPUtime=4800.29 cores=1,3,5,7
/proc/6923/stat : 6923 (SArTagnan) R 6921 6923 6266 0 -1 4202496 5049174 0 0 0 479161 868 0 0 25 0 4 0 515682772 2813489152 527385 33554432000 4194304 4623224 140733241151408 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/6923/statm: 686887 527385 345 105 0 682391 0
[pid=6923/tid=6925] ppid=6921 vsize=2747548 CPUtime=1202.65 cores=1,3,5,7
/proc/6923/task/6925/stat : 6925 (SArTagnan) R 6921 6923 6266 0 -1 4202560 251077 0 0 0 120193 72 0 0 25 0 4 0 515682821 2813489152 527385 33554432000 4194304 4623224 140733241151408 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6923/tid=6926] ppid=6921 vsize=2747548 CPUtime=1199.96 cores=1,3,5,7
/proc/6923/task/6926/stat : 6926 (SArTagnan) R 6921 6923 6266 0 -1 4202560 176334 0 0 0 119948 48 0 0 25 0 4 0 515682821 2813489152 527385 33554432000 4194304 4623224 140733241151408 18446744073709551615 4317197 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6923/tid=6927] ppid=6921 vsize=2747548 CPUtime=1194.09 cores=1,3,5,7
/proc/6923/task/6927/stat : 6927 (SArTagnan) R 6921 6923 6266 0 -1 4202560 4022189 0 0 0 118782 627 0 0 25 0 4 0 515682821 2813489152 527385 33554432000 4194304 4623224 140733241151408 18446744073709551615 4550459 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.29
Current children cumulated vsize (KiB) 2747548

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.7
CPU time (s): 4800.42
CPU user time (s): 4791.64
CPU system time (s): 8.77667
CPU usage (%): 398.804
Max. virtual memory (cumulated for all children) (KiB): 2923012

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4791.64
system time used= 8.77666
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5049180
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 778
involuntary context switches= 33330

runsolver used 1.87971 second user time and 4.74028 second system time

The end

Launcher Data 

Begin job on node128 at 2011-04-29 03:34:01
IDJOB=3281493
IDBENCH=53034
IDSOLVER=1656
FILE ID=node128/3281493-1304040840
RUNJOBID= node128-1304040269-6856
PBS_JOBID= 13170357
Free space on /tmp= 66944 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT_RACE08/Q1/SAT_dat.k85.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3281493-1304040840/watcher-3281493-1304040840 -o /tmp/evaluation-result-3281493-1304040840/solver-3281493-1304040840 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3281493-1304040840.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= dce41996d9c5153aa0c253fa128d227c
RANDOM SEED=1995247220

node128.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5434.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      25470968 kB
Buffers:       1263356 kB
Cached:        4386880 kB
SwapCached:        160 kB
Active:        1389232 kB
Inactive:      5502264 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      25470968 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           21752 kB
Writeback:           0 kB
AnonPages:     1240772 kB
Mapped:          15816 kB
Slab:           523628 kB
PageTables:       7240 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:  1672248 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66940 MiB
End job on node128 at 2011-04-29 03:54:07