Trace number 3264512

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.39 1201.81

General information on the benchmark

NameSAT04/handmade/connamacher/connm-d-0.02/
connm-ue-csp-sat-n1200-d-0.02-s405595518.used-as.sat04-950.cnf
MD5SUM287d3b23c6f72107e24ae4186653564e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark950.907
Satisfiable
(Un)Satisfiability was proved
Number of variables1124
Number of clauses13289
Sum of the clauses size40148
Maximum clause length4
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 313008
Number of clauses of size 4281
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3264512-1304104415/watcher-3264512-1304104415 -o /tmp/evaluation-result-3264512-1304104415/solver-3264512-1304104415 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3264512-1304104415.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.11 8.04 7.31 6/180 4045
/proc/meminfo: memFree=29535828/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=19860 CPUtime=0 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 759 0 0 0 0 0 0 0 23 0 1 0 600672162 20336640 662 33554432000 4194304 4623224 140735428593248 18446744073709551615 231895187664 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/4045/statm: 4916 617 297 105 0 420 0

[startup+0.0564221 s]
/proc/loadavg: 8.11 8.04 7.31 6/180 4045
/proc/meminfo: memFree=29535828/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=250748 CPUtime=0.19 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 2464 0 0 0 19 0 0 0 18 0 4 0 600672162 256765952 1811 33554432000 4194304 4623224 140735428593248 18446744073709551615 4360117 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 62687 1811 340 105 0 58191 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 250748

[startup+0.100413 s]
/proc/loadavg: 8.11 8.04 7.31 6/180 4045
/proc/meminfo: memFree=29535828/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=250680 CPUtime=0.36 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 2904 0 0 0 36 0 0 0 18 0 4 0 600672162 256696320 2045 33554432000 4194304 4623224 140735428593248 18446744073709551615 4513719 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 62670 2045 341 105 0 58174 0
Current children cumulated CPU time (s) 0.36
Current children cumulated vsize (KiB) 250680

[startup+0.300377 s]
/proc/loadavg: 8.11 8.04 7.31 6/180 4045
/proc/meminfo: memFree=29535828/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=251336 CPUtime=1.16 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 4301 0 0 0 116 0 0 0 18 0 4 0 600672162 257368064 3005 33554432000 4194304 4623224 140735428593248 18446744073709551615 4425597 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 62834 3005 341 105 0 58338 0
Current children cumulated CPU time (s) 1.16
Current children cumulated vsize (KiB) 251336

[startup+0.700303 s]
/proc/loadavg: 8.11 8.04 7.31 6/180 4045
/proc/meminfo: memFree=29535828/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=254188 CPUtime=2.76 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 6975 0 0 0 276 0 0 0 18 0 4 0 600672162 260288512 4443 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510172 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 63547 4443 342 105 0 59051 0
Current children cumulated CPU time (s) 2.76
Current children cumulated vsize (KiB) 254188

[startup+1.50115 s]
/proc/loadavg: 8.11 8.04 7.31 10/184 4049
/proc/meminfo: memFree=29503688/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=257928 CPUtime=5.96 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 14946 0 0 0 594 2 0 0 20 0 4 0 600672162 264118272 6403 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510206 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 64482 6403 342 105 0 59986 0
[pid=4045/tid=4047] ppid=4043 vsize=257928 CPUtime=1.48 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 1345 0 0 0 148 0 0 0 25 0 4 0 600672163 264118272 6403 33554432000 4194304 4623224 140735428593248 18446744073709551615 4461031 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=257928 CPUtime=1.48 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 2056 0 0 0 148 0 0 0 20 0 4 0 600672163 264118272 6403 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=257928 CPUtime=1.47 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 8264 0 0 0 147 0 0 0 25 0 4 0 600672163 264118272 6403 33554432000 4194304 4623224 140735428593248 18446744073709551615 4546853 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.96
Current children cumulated vsize (KiB) 257928

[startup+3.10085 s]
/proc/loadavg: 8.10 8.04 7.31 9/184 4049
/proc/meminfo: memFree=29484976/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=262140 CPUtime=12.35 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 26525 0 0 0 1231 4 0 0 25 0 4 0 600672162 268431360 9622 33554432000 4194304 4623224 140735428593248 18446744073709551615 4280346 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 65535 9622 342 105 0 61039 0
[pid=4045/tid=4047] ppid=4043 vsize=262140 CPUtime=3.08 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 2145 0 0 0 308 0 0 0 25 0 4 0 600672163 268431360 9622 33554432000 4194304 4623224 140735428593248 18446744073709551615 4377071 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=262140 CPUtime=3.07 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 2980 0 0 0 307 0 0 0 25 0 4 0 600672163 268431360 9622 33554432000 4194304 4623224 140735428593248 18446744073709551615 4377852 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=262140 CPUtime=3.07 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 16791 0 0 0 306 1 0 0 25 0 4 0 600672163 268431360 9622 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.35
Current children cumulated vsize (KiB) 262140

[startup+6.30026 s]
/proc/loadavg: 8.10 8.04 7.31 9/184 4049
/proc/meminfo: memFree=29447548/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=273300 CPUtime=25.13 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 59067 0 0 0 2504 9 0 0 25 0 4 0 600672162 279859200 14509 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510472 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 68325 14509 342 105 0 63829 0
[pid=4045/tid=4047] ppid=4043 vsize=273300 CPUtime=6.28 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 3877 0 0 0 627 1 0 0 25 0 4 0 600672163 279859200 14509 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=273300 CPUtime=6.28 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 6052 0 0 0 627 1 0 0 25 0 4 0 600672163 279859200 14509 33554432000 4194304 4623224 140735428593248 18446744073709551615 4377401 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=273300 CPUtime=6.25 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 43197 0 0 0 620 5 0 0 25 0 4 0 600672163 279859200 14509 33554432000 4194304 4623224 140735428593248 18446744073709551615 4550453 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.13
Current children cumulated vsize (KiB) 273300

[startup+12.7011 s]
/proc/loadavg: 8.09 8.04 7.32 9/184 4049
/proc/meminfo: memFree=29392108/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=283340 CPUtime=50.7 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 114803 0 0 0 5049 21 0 0 25 0 4 0 600672162 290140160 22200 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510285 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 70835 22200 365 105 0 66339 0
[pid=4045/tid=4047] ppid=4043 vsize=283340 CPUtime=12.68 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 6787 0 0 0 1265 3 0 0 25 0 4 0 600672163 290140160 22200 33554432000 4194304 4623224 140735428593248 18446744073709551615 4461235 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=283340 CPUtime=12.68 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 10074 0 0 0 1265 3 0 0 25 0 4 0 600672163 290140160 22200 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=283340 CPUtime=12.61 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 89662 0 0 0 1249 12 0 0 25 0 4 0 600672163 290140160 22200 33554432000 4194304 4623224 140735428593248 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.7
Current children cumulated vsize (KiB) 283340

[startup+25.5007 s]
/proc/loadavg: 8.07 8.04 7.32 9/184 4050
/proc/meminfo: memFree=29326260/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=300120 CPUtime=101.82 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 202832 0 0 0 10144 38 0 0 25 0 4 0 600672162 307322880 31903 33554432000 4194304 4623224 140735428593248 18446744073709551615 4517574 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 75030 31903 342 105 0 70534 0
[pid=4045/tid=4047] ppid=4043 vsize=300120 CPUtime=25.48 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 10596 0 0 0 2543 5 0 0 25 0 4 0 600672163 307322880 31903 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=300120 CPUtime=25.48 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 13935 0 0 0 2542 6 0 0 25 0 4 0 600672163 307322880 31903 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=300120 CPUtime=25.34 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 166671 0 0 0 2510 24 0 0 25 0 4 0 600672163 307322880 31903 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.82
Current children cumulated vsize (KiB) 300120

[startup+51.1009 s]
/proc/loadavg: 8.10 8.05 7.35 9/184 4050
/proc/meminfo: memFree=29207308/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=348220 CPUtime=204.09 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 319868 0 0 0 20347 62 0 0 25 0 4 0 600672162 356577280 50025 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 87055 50025 342 105 0 82559 0
[pid=4045/tid=4047] ppid=4043 vsize=348220 CPUtime=51.07 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 18232 0 0 0 5100 7 0 0 25 0 4 0 600672163 356577280 50025 33554432000 4194304 4623224 140735428593248 18446744073709551615 4377475 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=348220 CPUtime=51.08 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 22173 0 0 0 5097 11 0 0 25 0 4 0 600672163 356577280 50025 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376766 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=348220 CPUtime=50.8 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 255279 0 0 0 5042 38 0 0 25 0 4 0 600672163 356577280 50025 33554432000 4194304 4623224 140735428593248 18446744073709551615 4377579 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 204.09
Current children cumulated vsize (KiB) 348220

[startup+102.306 s]
/proc/loadavg: 8.20 8.08 7.40 9/184 4052
/proc/meminfo: memFree=29001444/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=531840 CPUtime=408.63 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 676415 0 0 0 40729 134 0 0 25 0 4 0 600672162 544604160 81233 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 132960 81233 342 105 0 128464 0
[pid=4045/tid=4047] ppid=4043 vsize=531840 CPUtime=102.29 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 23108 0 0 0 10215 14 0 0 25 0 4 0 600672163 544604160 81233 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=531840 CPUtime=102.29 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 32633 0 0 0 10214 15 0 0 25 0 4 0 600672163 544604160 81233 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376662 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=531840 CPUtime=101.72 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 565501 0 0 0 10079 93 0 0 25 0 4 0 600672163 544604160 81233 33554432000 4194304 4623224 140735428593248 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 408.63
Current children cumulated vsize (KiB) 531840

[startup+162.301 s]
/proc/loadavg: 8.25 8.11 7.45 9/184 4053
/proc/meminfo: memFree=28798284/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=716952 CPUtime=648.28 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 1158246 0 0 0 64604 224 0 0 25 0 4 0 600672162 734158848 116327 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510285 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 179238 116327 342 105 0 174742 0
[pid=4045/tid=4047] ppid=4043 vsize=716952 CPUtime=162.28 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 33093 0 0 0 16210 18 0 0 25 0 4 0 600672163 734158848 116327 33554432000 4194304 4623224 140735428593248 18446744073709551615 4463842 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=716952 CPUtime=162.28 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 49245 0 0 0 16207 21 0 0 25 0 4 0 600672163 734158848 116327 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=716952 CPUtime=161.4 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 977384 0 0 0 15974 166 0 0 25 0 4 0 600672163 734158848 116327 33554432000 4194304 4623224 140735428593248 18446744073709551615 4377613 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 648.28
Current children cumulated vsize (KiB) 716952

[startup+222.301 s]
/proc/loadavg: 8.15 8.11 7.48 9/184 4055
/proc/meminfo: memFree=28593992/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=799704 CPUtime=887.95 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 1620434 0 0 0 88484 311 0 0 25 0 4 0 600672162 818896896 152268 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510896 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 199926 152268 344 105 0 195430 0
[pid=4045/tid=4047] ppid=4043 vsize=799704 CPUtime=222.28 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 37107 0 0 0 22204 24 0 0 25 0 4 0 600672163 818896896 152268 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=799704 CPUtime=222.28 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 55123 0 0 0 22203 25 0 0 25 0 4 0 600672163 818896896 152268 33554432000 4194304 4623224 140735428593248 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=799704 CPUtime=221.06 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 1377262 0 0 0 21871 235 0 0 25 0 4 0 600672163 818896896 152268 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 887.95
Current children cumulated vsize (KiB) 799704

[startup+282.301 s]

################
# More data... #
################

[pid=4045] ppid=4043 vsize=1597404 CPUtime=2805.38 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 4214001 0 0 0 279720 818 0 0 25 0 4 0 600672162 1635741696 323430 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 399351 323430 344 105 0 394855 0
[pid=4045/tid=4047] ppid=4043 vsize=1597404 CPUtime=702.28 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 78015 0 0 0 70177 51 0 0 25 0 4 0 600672163 1635741696 323430 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=1597404 CPUtime=702.3 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 87776 0 0 0 70186 44 0 0 25 0 4 0 600672163 1635741696 323430 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=1597404 CPUtime=698.46 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 3683383 0 0 0 69183 663 0 0 25 0 4 0 600672163 1635741696 323430 33554432000 4194304 4623224 140735428593248 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2805.38
Current children cumulated vsize (KiB) 1597404

[startup+762.307 s]
/proc/loadavg: 8.08 8.13 7.76 9/184 4069
/proc/meminfo: memFree=27473760/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=1775472 CPUtime=3045.08 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 4641846 0 0 0 303608 900 0 0 25 0 4 0 600672162 1818083328 347098 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510896 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 443868 347098 343 105 0 439372 0
[pid=4045/tid=4047] ppid=4043 vsize=1775472 CPUtime=762.29 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 80282 0 0 0 76175 54 0 0 25 0 4 0 600672163 1818083328 347098 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=1775472 CPUtime=762.3 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 106099 0 0 0 76180 50 0 0 25 0 4 0 600672163 1818083328 347098 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=1775472 CPUtime=758.13 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 4043311 0 0 0 75086 727 0 0 25 0 4 0 600672163 1818083328 347098 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3045.08
Current children cumulated vsize (KiB) 1775472

[startup+822.301 s]
/proc/loadavg: 8.03 8.10 7.77 9/184 4071
/proc/meminfo: memFree=27274172/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=1972504 CPUtime=3284.72 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 5111269 0 0 0 327489 983 0 0 25 0 4 0 600672162 2019844096 380180 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510932 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 493126 380180 570 105 0 488630 0
[pid=4045/tid=4047] ppid=4043 vsize=1972504 CPUtime=822.28 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 81627 0 0 0 82172 56 0 0 25 0 4 0 600672163 2019844096 380180 33554432000 4194304 4623224 140735428593248 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=1972504 CPUtime=822.3 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 109793 0 0 0 82175 55 0 0 25 0 4 0 600672163 2019844096 380180 33554432000 4194304 4623224 140735428593248 18446744073709551615 4377147 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=1972504 CPUtime=817.79 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 4415924 0 0 0 80988 791 0 0 25 0 4 0 600672163 2019844096 380180 33554432000 4194304 4623224 140735428593248 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3284.72
Current children cumulated vsize (KiB) 1972504

[startup+882.3 s]
/proc/loadavg: 8.01 8.08 7.78 9/184 4073
/proc/meminfo: memFree=27164256/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=1999224 CPUtime=3524.39 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 5489986 0 0 0 351384 1055 0 0 25 0 4 0 600672162 2047205376 401348 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 499806 401348 571 105 0 495310 0
[pid=4045/tid=4047] ppid=4043 vsize=1999224 CPUtime=882.28 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 81987 0 0 0 88172 56 0 0 25 0 4 0 600672163 2047205376 401348 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=1999224 CPUtime=882.3 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 112872 0 0 0 88170 60 0 0 25 0 4 0 600672163 2047205376 401348 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=1999224 CPUtime=877.46 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 4777037 0 0 0 86890 856 0 0 25 0 4 0 600672163 2047205376 401348 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3524.39
Current children cumulated vsize (KiB) 1999224

[startup+942.301 s]
/proc/loadavg: 8.00 8.06 7.79 9/184 4074
/proc/meminfo: memFree=27061640/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=2074364 CPUtime=3764.07 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 5841049 0 0 0 375284 1123 0 0 25 0 4 0 600672162 2124148736 414185 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510177 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 518591 414185 570 105 0 514095 0
[pid=4045/tid=4047] ppid=4043 vsize=2074364 CPUtime=942.28 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 82138 0 0 0 94172 56 0 0 25 0 4 0 600672163 2124148736 414185 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=2074364 CPUtime=942.3 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 115853 0 0 0 94164 66 0 0 25 0 4 0 600672163 2124148736 414185 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=2074364 CPUtime=937.14 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 5118449 0 0 0 92797 917 0 0 25 0 4 0 600672163 2124148736 414185 33554432000 4194304 4623224 140735428593248 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3764.07
Current children cumulated vsize (KiB) 2074364

[startup+1002.3 s]
/proc/loadavg: 8.00 8.05 7.81 9/184 4076
/proc/meminfo: memFree=26912648/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=2144392 CPUtime=4003.75 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 6247479 0 0 0 399183 1192 0 0 25 0 4 0 600672162 2195857408 445641 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 536098 445641 560 105 0 531602 0
[pid=4045/tid=4047] ppid=4043 vsize=2144392 CPUtime=1002.28 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 99294 0 0 0 100170 58 0 0 25 0 4 0 600672163 2195857408 445641 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=2144392 CPUtime=1002.3 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 118811 0 0 0 100160 70 0 0 25 0 4 0 600672163 2195857408 445641 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=2144392 CPUtime=996.81 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 5481081 0 0 0 98705 976 0 0 25 0 4 0 600672163 2195857408 445641 33554432000 4194304 4623224 140735428593248 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4003.75
Current children cumulated vsize (KiB) 2144392

[startup+1062.3 s]
/proc/loadavg: 8.08 8.05 7.82 9/184 4077
/proc/meminfo: memFree=26815516/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=2314184 CPUtime=4243.42 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 6673918 0 0 0 423077 1265 0 0 25 0 4 0 600672162 2369724416 461747 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 578546 461747 468 105 0 574050 0
[pid=4045/tid=4047] ppid=4043 vsize=2314184 CPUtime=1062.29 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 99662 0 0 0 106170 59 0 0 25 0 4 0 600672163 2369724416 461747 33554432000 4194304 4623224 140735428593248 18446744073709551615 4377679 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=2314184 CPUtime=1062.31 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 121529 0 0 0 106156 75 0 0 25 0 4 0 600672163 2369724416 461747 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=2314184 CPUtime=1056.49 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 5845124 0 0 0 104612 1037 0 0 25 0 4 0 600672163 2369724416 461747 33554432000 4194304 4623224 140735428593248 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4243.42
Current children cumulated vsize (KiB) 2314184

[startup+1122.3 s]
/proc/loadavg: 8.10 8.06 7.83 9/184 4079
/proc/meminfo: memFree=26600944/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=2616768 CPUtime=4483.07 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 7203327 0 0 0 446948 1359 0 0 25 0 4 0 600672162 2679570432 508542 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 654192 508542 342 105 0 649696 0
[pid=4045/tid=4047] ppid=4043 vsize=2616768 CPUtime=1122.29 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 101092 0 0 0 112169 60 0 0 25 0 4 0 600672163 2679570432 508542 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=2616768 CPUtime=1122.29 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 127966 0 0 0 112148 81 0 0 25 0 4 0 600672163 2679570432 508542 33554432000 4194304 4623224 140735428593248 18446744073709551615 4377923 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=2616768 CPUtime=1116.14 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 6212084 0 0 0 110509 1105 0 0 25 0 4 0 600672163 2679570432 508542 33554432000 4194304 4623224 140735428593248 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4483.07
Current children cumulated vsize (KiB) 2616768

[startup+1182.3 s]
/proc/loadavg: 8.15 8.08 7.85 9/184 4081
/proc/meminfo: memFree=26488680/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=2634220 CPUtime=4722.75 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 7591760 0 0 0 470844 1431 0 0 25 0 4 0 600672162 2697441280 526767 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 658555 526767 342 105 0 654059 0
[pid=4045/tid=4047] ppid=4043 vsize=2634220 CPUtime=1182.3 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 102445 0 0 0 118168 62 0 0 25 0 4 0 600672163 2697441280 526767 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=2634220 CPUtime=1182.29 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 130412 0 0 0 118144 85 0 0 25 0 4 0 600672163 2697441280 526767 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=2634220 CPUtime=1175.82 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 6585682 0 0 0 116414 1168 0 0 25 0 4 0 600672163 2697441280 526767 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4722.75
Current children cumulated vsize (KiB) 2634220



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.10 8.07 7.85 7/183 4082
/proc/meminfo: memFree=26501296/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=2637028 CPUtime=4800.27 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 7712003 0 0 0 478573 1454 0 0 25 0 4 0 600672162 2700316672 531940 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 659257 531940 342 105 0 654761 0
[pid=4045/tid=4047] ppid=4043 vsize=2637028 CPUtime=1201.7 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 103310 0 0 0 120108 62 0 0 25 0 4 0 600672163 2700316672 531941 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=2637028 CPUtime=1201.7 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 131136 0 0 0 120084 86 0 0 25 0 4 0 600672163 2700316672 531941 33554432000 4194304 4623224 140735428593248 18446744073709551615 231895151649 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=2637028 CPUtime=1195.12 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 6701534 0 0 0 118323 1189 0 0 25 0 4 0 600672163 2700316672 531941 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.27
Current children cumulated vsize (KiB) 2637028

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.10 8.07 7.85 7/183 4082
/proc/meminfo: memFree=26501296/32950928 swapFree=67111356/67111528
[pid=4045] ppid=4043 vsize=2637028 CPUtime=4800.27 cores=1,3,5,7
/proc/4045/stat : 4045 (SArTagnan) R 4043 4045 3901 0 -1 4202496 7712003 0 0 0 478573 1454 0 0 25 0 4 0 600672162 2700316672 531940 33554432000 4194304 4623224 140735428593248 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/4045/statm: 659257 531940 342 105 0 654761 0
[pid=4045/tid=4047] ppid=4043 vsize=2637028 CPUtime=1201.7 cores=1,3,5,7
/proc/4045/task/4047/stat : 4047 (SArTagnan) R 4043 4045 3901 0 -1 4202560 103310 0 0 0 120108 62 0 0 25 0 4 0 600672163 2700316672 531941 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=4045/tid=4048] ppid=4043 vsize=2637028 CPUtime=1201.7 cores=1,3,5,7
/proc/4045/task/4048/stat : 4048 (SArTagnan) R 4043 4045 3901 0 -1 4202560 131136 0 0 0 120084 86 0 0 25 0 4 0 600672163 2700316672 531941 33554432000 4194304 4623224 140735428593248 18446744073709551615 231895151649 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=4045/tid=4049] ppid=4043 vsize=2637028 CPUtime=1195.12 cores=1,3,5,7
/proc/4045/task/4049/stat : 4049 (SArTagnan) R 4043 4045 3901 0 -1 4202560 6701534 0 0 0 118323 1189 0 0 25 0 4 0 600672163 2700316672 531941 33554432000 4194304 4623224 140735428593248 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.27
Current children cumulated vsize (KiB) 2637028

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.81
CPU time (s): 4800.39
CPU user time (s): 4785.75
CPU system time (s): 14.6378
CPU usage (%): 399.432
Max. virtual memory (cumulated for all children) (KiB): 3051884

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4785.75
system time used= 14.6378
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7712004
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2299
involuntary context switches= 31562

runsolver used 1.82072 second user time and 4.74228 second system time

The end

Launcher Data 

Begin job on node114 at 2011-04-29 21:13:35
IDJOB=3264512
IDBENCH=84643
IDSOLVER=1656
FILE ID=node114/3264512-1304104415
RUNJOBID= node114-1304103211-3920
PBS_JOBID= 13170639
Free space on /tmp= 71804 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT04/handmade/connamacher/connm-d-0.02/connm-ue-csp-sat-n1200-d-0.02-s405595518.used-as.sat04-950.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3264512-1304104415/watcher-3264512-1304104415 -o /tmp/evaluation-result-3264512-1304104415/solver-3264512-1304104415 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3264512-1304104415.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 287d3b23c6f72107e24ae4186653564e
RANDOM SEED=1599447657

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      29536464 kB
Buffers:       1058004 kB
Cached:        1783624 kB
SwapCached:        168 kB
Active:         108292 kB
Inactive:      2801676 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      29536464 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:             840 kB
Writeback:          16 kB
AnonPages:       67468 kB
Mapped:          15192 kB
Slab:           440632 kB
PageTables:       4692 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   242176 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71804 MiB
End job on node114 at 2011-04-29 21:33:39