Trace number 3439431

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.5 5009.68

General information on the benchmark

NameSAT04/handmade/connamacher/connm-d-0.02/
connm-ue-csp-sat-n1200-d-0.02-s405595518.used-as.sat04-950.cnf
MD5SUM287d3b23c6f72107e24ae4186653564e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1595.59
Satisfiable
(Un)Satisfiability was proved
Number of variables1124
Number of clauses13289
Sum of the clauses size40148
Maximum clause length4
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 313008
Number of clauses of size 4281
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439431-1306963376/watcher-3439431-1306963376 -o /tmp/evaluation-result-3439431-1306963376/solver-3439431-1306963376 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439431-1306963376.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.10 8.13 7.79 1/429 6034
/proc/meminfo: memFree=21169572/32951124 swapFree=60787360/67111528
[pid=6034] ppid=6032 vsize=96740 CPUtime=0 cores=0-7
/proc/6034/stat : 6034 (SArTagnan) R 6032 6034 5882 0 -1 4202496 2071 0 0 0 0 0 0 0 25 0 8 0 807935496 99061760 1803 33554432000 4194304 4625164 140733883240352 18446744073709551615 255377357809 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/6034/statm: 24185 1803 301 106 0 19688 0
[pid=6034/tid=6035] ppid=6032 vsize=96740 CPUtime=0 cores=0-7
/proc/6034/task/6035/stat : 6035 (SArTagnan) R 6032 6034 5882 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 8 0 807935497 99061760 1803 33554432000 4194304 4625164 140733883240352 18446744073709551615 47525653841842 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6036] ppid=6032 vsize=96740 CPUtime=0 cores=0-7
/proc/6034/task/6036/stat : 6036 (SArTagnan) R 6032 6034 5882 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 807935497 99061760 1803 33554432000 4194304 4625164 140733883240352 18446744073709551615 255377357809 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6037] ppid=6032 vsize=96740 CPUtime=0 cores=0-7
/proc/6034/task/6037/stat : 6037 (SArTagnan) R 6032 6034 5882 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 807935497 99061760 1803 33554432000 4194304 4625164 140733883240352 18446744073709551615 255377357809 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6038] ppid=6032 vsize=96740 CPUtime=0 cores=0-7
/proc/6034/task/6038/stat : 6038 (SArTagnan) R 6032 6034 5882 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 807935497 99061760 1803 33554432000 4194304 4625164 140733883240352 18446744073709551615 47525653841836 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6034/tid=6039] ppid=6032 vsize=96740 CPUtime=0 cores=0-7
/proc/6034/task/6039/stat : 6039 (SArTagnan) R 6032 6034 5882 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 807935497 99061760 1803 33554432000 4194304 4625164 140733883240352 18446744073709551615 47525653841842 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6034/tid=6040] ppid=6032 vsize=96740 CPUtime=0 cores=0-7
/proc/6034/task/6040/stat : 6040 (SArTagnan) R 6032 6034 5882 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 807935497 99061760 1803 33554432000 4194304 4625164 140733883240352 18446744073709551615 47525653841832 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6034/tid=6041] ppid=6032 vsize=96740 CPUtime=0 cores=0-7
/proc/6034/task/6041/stat : 6041 (SArTagnan) R 6032 6034 5882 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 807935497 99061760 1803 33554432000 4194304 4625164 140733883240352 18446744073709551615 47525653841842 0 0 4096 2 0 0 0 -1 5 0 0 0

[startup+0.035044 s]
/proc/loadavg: 8.10 8.13 7.79 1/429 6034
/proc/meminfo: memFree=21169572/32951124 swapFree=60787360/67111528
[pid=6034] ppid=6032 vsize=96740 CPUtime=0.15 cores=0-7
/proc/6034/stat : 6034 (SArTagnan) R 6032 6034 5882 0 -1 4202496 2071 0 0 0 15 0 0 0 25 0 8 0 807935496 99061760 1803 33554432000 4194304 4625164 140733883240352 18446744073709551615 47525653841842 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6034/statm: 24185 1803 301 106 0 19688 0
[pid=6034/tid=6035] ppid=6032 vsize=96740 CPUtime=0.02 cores=0-7
/proc/6034/task/6035/stat : 6035 (SArTagnan) R 6032 6034 5882 0 -1 4202560 1 0 0 0 2 0 0 0 25 0 8 0 807935497 99061760 1803 33554432000 4194304 4625164 140733883240352 18446744073709551615 47525653841842 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6036] ppid=6032 vsize=96740 CPUtime=0 cores=0-7
/proc/6034/task/6036/stat : 6036 (SArTagnan) R 6032 6034 5882 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 807935497 99061760 1803 33554432000 4194304 4625164 140733883240352 18446744073709551615 255377357809 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6037] ppid=6032 vsize=96740 CPUtime=0.01 cores=0-7
/proc/6034/task/6037/stat : 6037 (SArTagnan) R 6032 6034 5882 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 807935497 99061760 1803 33554432000 4194304 4625164 140733883240352 18446744073709551615 47525653841840 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6034/tid=6038] ppid=6032 vsize=96740 CPUtime=0.01 cores=0-7
/proc/6034/task/6038/stat : 6038 (SArTagnan) R 6032 6034 5882 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 807935497 99061760 1803 33554432000 4194304 4625164 140733883240352 18446744073709551615 47525653841840 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6034/tid=6039] ppid=6032 vsize=96740 CPUtime=0.01 cores=0-7
/proc/6034/task/6039/stat : 6039 (SArTagnan) R 6032 6034 5882 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 807935497 99061760 1803 33554432000 4194304 4625164 140733883240352 18446744073709551615 47525653841842 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6034/tid=6040] ppid=6032 vsize=96740 CPUtime=0.02 cores=0-7
/proc/6034/task/6040/stat : 6040 (SArTagnan) R 6032 6034 5882 0 -1 4202560 0 0 0 0 2 0 0 0 25 0 8 0 807935497 99061760 1803 33554432000 4194304 4625164 140733883240352 18446744073709551615 47525653841842 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6034/tid=6041] ppid=6032 vsize=96740 CPUtime=0.02 cores=0-7
/proc/6034/task/6041/stat : 6041 (SArTagnan) R 6032 6034 5882 0 -1 4202560 0 0 0 0 2 0 0 0 25 0 8 0 807935497 99061760 1803 33554432000 4194304 4625164 140733883240352 18446744073709551615 47525653841836 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 96740

[startup+0.191985 s]
/proc/loadavg: 8.10 8.13 7.79 1/429 6034
/proc/meminfo: memFree=21169572/32951124 swapFree=60787360/67111528
[pid=6034] ppid=6032 vsize=297524 CPUtime=1.34 cores=0-7
/proc/6034/stat : 6034 (SArTagnan) R 6032 6034 5882 0 -1 4202496 5047 0 0 0 134 0 0 0 25 0 8 0 807935496 304664576 3729 33554432000 4194304 4625164 140733883240352 18446744073709551615 4511967 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6034/statm: 74381 3729 349 106 0 69884 0
[pid=6034/tid=6035] ppid=6032 vsize=297524 CPUtime=0.14 cores=0-7
/proc/6034/task/6035/stat : 6035 (SArTagnan) R 6032 6034 5882 0 -1 4202560 254 0 0 0 14 0 0 0 25 0 8 0 807935497 304664576 3729 33554432000 4194304 4625164 140733883240352 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6034/tid=6036] ppid=6032 vsize=297524 CPUtime=0.13 cores=0-7
/proc/6034/task/6036/stat : 6036 (SArTagnan) R 6032 6034 5882 0 -1 4202560 286 0 0 0 13 0 0 0 25 0 8 0 807935497 304664576 3729 33554432000 4194304 4625164 140733883240352 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6037] ppid=6032 vsize=297524 CPUtime=0.17 cores=0-7
/proc/6034/task/6037/stat : 6037 (SArTagnan) R 6032 6034 5882 0 -1 4202560 919 0 0 0 17 0 0 0 18 0 8 0 807935497 304664576 3729 33554432000 4194304 4625164 140733883240352 18446744073709551615 4351925 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6034/tid=6038] ppid=6032 vsize=297524 CPUtime=0.17 cores=0-7
/proc/6034/task/6038/stat : 6038 (SArTagnan) R 6032 6034 5882 0 -1 4202560 289 0 0 0 17 0 0 0 18 0 8 0 807935497 304664576 3730 33554432000 4194304 4625164 140733883240352 18446744073709551615 4465246 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6034/tid=6039] ppid=6032 vsize=297524 CPUtime=0.17 cores=0-7
/proc/6034/task/6039/stat : 6039 (SArTagnan) R 6032 6034 5882 0 -1 4202560 298 0 0 0 17 0 0 0 25 0 8 0 807935497 304664576 3731 33554432000 4194304 4625164 140733883240352 18446744073709551615 4340391 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6034/tid=6040] ppid=6032 vsize=297524 CPUtime=0.17 cores=0-7
/proc/6034/task/6040/stat : 6040 (SArTagnan) R 6032 6034 5882 0 -1 4202560 272 0 0 0 17 0 0 0 18 0 8 0 807935497 304664576 3731 33554432000 4194304 4625164 140733883240352 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6034/tid=6041] ppid=6032 vsize=297524 CPUtime=0.17 cores=0-7
/proc/6034/task/6041/stat : 6041 (SArTagnan) R 6032 6034 5882 0 -1 4202560 274 0 0 0 17 0 0 0 18 0 8 0 807935497 304664576 3731 33554432000 4194304 4625164 140733883240352 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1.34
Current children cumulated vsize (KiB) 297524

[startup+0.300966 s]
/proc/loadavg: 8.10 8.13 7.79 1/429 6034
/proc/meminfo: memFree=21169572/32951124 swapFree=60787360/67111528
[pid=6034] ppid=6032 vsize=300152 CPUtime=2.2 cores=0-7
/proc/6034/stat : 6034 (SArTagnan) R 6032 6034 5882 0 -1 4202496 7123 0 0 0 220 0 0 0 25 0 8 0 807935496 307355648 4456 33554432000 4194304 4625164 140733883240352 18446744073709551615 4338085 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6034/statm: 75038 4456 349 106 0 70541 0
[pid=6034/tid=6035] ppid=6032 vsize=300152 CPUtime=0.25 cores=0-7
/proc/6034/task/6035/stat : 6035 (SArTagnan) R 6032 6034 5882 0 -1 4202560 471 0 0 0 25 0 0 0 25 0 8 0 807935497 307355648 4456 33554432000 4194304 4625164 140733883240352 18446744073709551615 4351906 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6034/tid=6036] ppid=6032 vsize=300152 CPUtime=0.24 cores=0-7
/proc/6034/task/6036/stat : 6036 (SArTagnan) R 6032 6034 5882 0 -1 4202560 489 0 0 0 24 0 0 0 25 0 8 0 807935497 307355648 4456 33554432000 4194304 4625164 140733883240352 18446744073709551615 4351786 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6037] ppid=6032 vsize=300152 CPUtime=0.28 cores=0-7
/proc/6034/task/6037/stat : 6037 (SArTagnan) R 6032 6034 5882 0 -1 4202560 1433 0 0 0 28 0 0 0 18 0 8 0 807935497 307355648 4456 33554432000 4194304 4625164 140733883240352 18446744073709551615 4339183 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6034/tid=6038] ppid=6032 vsize=300152 CPUtime=0.28 cores=0-7
/proc/6034/task/6038/stat : 6038 (SArTagnan) R 6032 6034 5882 0 -1 4202560 488 0 0 0 28 0 0 0 18 0 8 0 807935497 307355648 4456 33554432000 4194304 4625164 140733883240352 18446744073709551615 4352577 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6034/tid=6039] ppid=6032 vsize=300152 CPUtime=0.28 cores=0-7
/proc/6034/task/6039/stat : 6039 (SArTagnan) R 6032 6034 5882 0 -1 4202560 510 0 0 0 28 0 0 0 25 0 8 0 807935497 307355648 4456 33554432000 4194304 4625164 140733883240352 18446744073709551615 4289632 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6034/tid=6040] ppid=6032 vsize=300152 CPUtime=0.28 cores=0-7
/proc/6034/task/6040/stat : 6040 (SArTagnan) R 6032 6034 5882 0 -1 4202560 471 0 0 0 28 0 0 0 18 0 8 0 807935497 307355648 4456 33554432000 4194304 4625164 140733883240352 18446744073709551615 4462600 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6034/tid=6041] ppid=6032 vsize=300152 CPUtime=0.28 cores=0-7
/proc/6034/task/6041/stat : 6041 (SArTagnan) R 6032 6034 5882 0 -1 4202560 474 0 0 0 28 0 0 0 18 0 8 0 807935497 307355648 4456 33554432000 4194304 4625164 140733883240352 18446744073709551615 4353104 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.2
Current children cumulated vsize (KiB) 300152

[startup+0.700894 s]
/proc/loadavg: 8.10 8.13 7.79 1/429 6034
/proc/meminfo: memFree=21169572/32951124 swapFree=60787360/67111528
[pid=6034] ppid=6032 vsize=306996 CPUtime=5.4 cores=0-7
/proc/6034/stat : 6034 (SArTagnan) R 6032 6034 5882 0 -1 4202496 12014 0 0 0 539 1 0 0 25 0 8 0 807935496 314363904 6957 33554432000 4194304 4625164 140733883240352 18446744073709551615 4511982 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6034/statm: 76749 6957 349 106 0 72252 0
[pid=6034/tid=6035] ppid=6032 vsize=306996 CPUtime=0.65 cores=0-7
/proc/6034/task/6035/stat : 6035 (SArTagnan) R 6032 6034 5882 0 -1 4202560 967 0 0 0 65 0 0 0 25 0 8 0 807935497 314363904 6957 33554432000 4194304 4625164 140733883240352 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6034/tid=6036] ppid=6032 vsize=306996 CPUtime=0.64 cores=0-7
/proc/6034/task/6036/stat : 6036 (SArTagnan) R 6032 6034 5882 0 -1 4202560 952 0 0 0 64 0 0 0 25 0 8 0 807935497 314363904 6957 33554432000 4194304 4625164 140733883240352 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6037] ppid=6032 vsize=306996 CPUtime=0.67 cores=0-7
/proc/6034/task/6037/stat : 6037 (SArTagnan) R 6032 6034 5882 0 -1 4202560 3477 0 0 0 67 0 0 0 18 0 8 0 807935497 314363904 6957 33554432000 4194304 4625164 140733883240352 18446744073709551615 4575558 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6034/tid=6038] ppid=6032 vsize=306996 CPUtime=0.68 cores=0-7
/proc/6034/task/6038/stat : 6038 (SArTagnan) R 6032 6034 5882 0 -1 4202560 689 0 0 0 68 0 0 0 18 0 8 0 807935497 314363904 6957 33554432000 4194304 4625164 140733883240352 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6034/tid=6039] ppid=6032 vsize=306996 CPUtime=0.68 cores=0-7
/proc/6034/task/6039/stat : 6039 (SArTagnan) R 6032 6034 5882 0 -1 4202560 984 0 0 0 68 0 0 0 25 0 8 0 807935497 314363904 6957 33554432000 4194304 4625164 140733883240352 18446744073709551615 4348918 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6034/tid=6040] ppid=6032 vsize=306996 CPUtime=0.68 cores=0-7
/proc/6034/task/6040/stat : 6040 (SArTagnan) R 6032 6034 5882 0 -1 4202560 937 0 0 0 68 0 0 0 18 0 8 0 807935497 314363904 6957 33554432000 4194304 4625164 140733883240352 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6034/tid=6041] ppid=6032 vsize=306996 CPUtime=0.68 cores=0-7
/proc/6034/task/6041/stat : 6041 (SArTagnan) R 6032 6034 5882 0 -1 4202560 945 0 0 0 68 0 0 0 18 0 8 0 807935497 314363904 6957 33554432000 4194304 4625164 140733883240352 18446744073709551615 4339600 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.4
Current children cumulated vsize (KiB) 306996

[startup+1.50075 s]
/proc/loadavg: 8.10 8.13 7.79 9/437 6042
/proc/meminfo: memFree=21134672/32951124 swapFree=60787360/67111528
[pid=6034] ppid=6032 vsize=315592 CPUtime=11.79 cores=0-7
/proc/6034/stat : 6034 (SArTagnan) R 6032 6034 5882 0 -1 4202496 21702 0 0 0 1177 2 0 0 25 0 8 0 807935496 323166208 10576 33554432000 4194304 4625164 140733883240352 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6034/statm: 78898 10576 349 106 0 74401 0
[pid=6034/tid=6035] ppid=6032 vsize=315592 CPUtime=1.43 cores=0-7
/proc/6034/task/6035/stat : 6035 (SArTagnan) R 6032 6034 5882 0 -1 4202560 1556 0 0 0 143 0 0 0 25 0 8 0 807935497 323166208 10576 33554432000 4194304 4625164 140733883240352 18446744073709551615 4464522 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6034/tid=6036] ppid=6032 vsize=315592 CPUtime=1.44 cores=0-7
/proc/6034/task/6036/stat : 6036 (SArTagnan) R 6032 6034 5882 0 -1 4202560 1505 0 0 0 144 0 0 0 25 0 8 0 807935497 323166208 10576 33554432000 4194304 4625164 140733883240352 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6037] ppid=6032 vsize=315592 CPUtime=1.48 cores=0-7
/proc/6034/task/6037/stat : 6037 (SArTagnan) R 6032 6034 5882 0 -1 4202560 8785 0 0 0 147 1 0 0 19 0 8 0 807935497 323166208 10576 33554432000 4194304 4625164 140733883240352 18446744073709551615 4552388 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6034/tid=6038] ppid=6032 vsize=315592 CPUtime=1.48 cores=0-7
/proc/6034/task/6038/stat : 6038 (SArTagnan) R 6032 6034 5882 0 -1 4202560 1496 0 0 0 148 0 0 0 19 0 8 0 807935497 323166208 10576 33554432000 4194304 4625164 140733883240352 18446744073709551615 4462650 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6034/tid=6039] ppid=6032 vsize=315592 CPUtime=1.48 cores=0-7
/proc/6034/task/6039/stat : 6039 (SArTagnan) R 6032 6034 5882 0 -1 4202560 1506 0 0 0 148 0 0 0 25 0 8 0 807935497 323166208 10576 33554432000 4194304 4625164 140733883240352 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6034/tid=6040] ppid=6032 vsize=315592 CPUtime=1.48 cores=0-7
/proc/6034/task/6040/stat : 6040 (SArTagnan) R 6032 6034 5882 0 -1 4202560 1477 0 0 0 148 0 0 0 19 0 8 0 807935497 323166208 10576 33554432000 4194304 4625164 140733883240352 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6034/tid=6041] ppid=6032 vsize=315592 CPUtime=1.48 cores=0-7
/proc/6034/task/6041/stat : 6041 (SArTagnan) R 6032 6034 5882 0 -1 4202560 1480 0 0 0 148 0 0 0 19 0 8 0 807935497 323166208 10576 33554432000 4194304 4625164 140733883240352 18446744073709551615 4462461 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.79
Current children cumulated vsize (KiB) 315592

[startup+3.10045 s]
/proc/loadavg: 8.10 8.13 7.79 9/437 6042
/proc/meminfo: memFree=21117188/32951124 swapFree=60787360/67111528
[pid=6034] ppid=6032 vsize=323852 CPUtime=24.58 cores=0-7
/proc/6034/stat : 6034 (SArTagnan) R 6032 6034 5882 0 -1 4202496 40784 0 0 0 2452 6 0 0 25 0 8 0 807935496 331624448 16513 33554432000 4194304 4625164 140733883240352 18446744073709551615 4392604 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6034/statm: 80963 16513 349 106 0 76466 0
[pid=6034/tid=6035] ppid=6032 vsize=323852 CPUtime=3.01 cores=0-7
/proc/6034/task/6035/stat : 6035 (SArTagnan) R 6032 6034 5882 0 -1 4202560 2582 0 0 0 301 0 0 0 25 0 8 0 807935497 331624448 16513 33554432000 4194304 4625164 140733883240352 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6034/tid=6036] ppid=6032 vsize=323852 CPUtime=3.04 cores=0-7
/proc/6034/task/6036/stat : 6036 (SArTagnan) R 6032 6034 5882 0 -1 4202560 1911 0 0 0 304 0 0 0 25 0 8 0 807935497 331624448 16513 33554432000 4194304 4625164 140733883240352 18446744073709551615 4462457 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6037] ppid=6032 vsize=323852 CPUtime=3.07 cores=0-7
/proc/6034/task/6037/stat : 6037 (SArTagnan) R 6032 6034 5882 0 -1 4202560 22131 0 0 0 304 3 0 0 25 0 8 0 807935497 331624448 16513 33554432000 4194304 4625164 140733883240352 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6034/tid=6038] ppid=6032 vsize=323852 CPUtime=3.08 cores=0-7
/proc/6034/task/6038/stat : 6038 (SArTagnan) R 6032 6034 5882 0 -1 4202560 1870 0 0 0 308 0 0 0 25 0 8 0 807935497 331624448 16514 33554432000 4194304 4625164 140733883240352 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6034/tid=6039] ppid=6032 vsize=323852 CPUtime=3.08 cores=0-7
/proc/6034/task/6039/stat : 6039 (SArTagnan) R 6032 6034 5882 0 -1 4202560 2587 0 0 0 308 0 0 0 25 0 8 0 807935497 331624448 16514 33554432000 4194304 4625164 140733883240352 18446744073709551615 4349263 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6034/tid=6040] ppid=6032 vsize=323852 CPUtime=3.08 cores=0-7
/proc/6034/task/6040/stat : 6040 (SArTagnan) R 6032 6034 5882 0 -1 4202560 2393 0 0 0 308 0 0 0 25 0 8 0 807935497 331624448 16514 33554432000 4194304 4625164 140733883240352 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6034/tid=6041] ppid=6032 vsize=323852 CPUtime=3.08 cores=0-7
/proc/6034/task/6041/stat : 6041 (SArTagnan) R 6032 6034 5882 0 -1 4202560 2495 0 0 0 308 0 0 0 25 0 8 0 807935497 331624448 16514 33554432000 4194304 4625164 140733883240352 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.58
Current children cumulated vsize (KiB) 323852

[startup+6.30086 s]
/proc/loadavg: 8.09 8.13 7.79 9/437 6042
/proc/meminfo: memFree=21074048/32951124 swapFree=60787360/67111528
[pid=6034] ppid=6032 vsize=405752 CPUtime=50.13 cores=0-7
/proc/6034/stat : 6034 (SArTagnan) R 6032 6034 5882 0 -1 4202496 75746 0 0 0 5001 12 0 0 25 0 8 0 807935496 415490048 25915 33554432000 4194304 4625164 140733883240352 18446744073709551615 4512315 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6034/statm: 101438 25915 349 106 0 96941 0
[pid=6034/tid=6035] ppid=6032 vsize=405752 CPUtime=6.16 cores=0-7
/proc/6034/task/6035/stat : 6035 (SArTagnan) R 6032 6034 5882 0 -1 4202560 3960 0 0 0 616 0 0 0 25 0 8 0 807935497 415490048 25915 33554432000 4194304 4625164 140733883240352 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6034/tid=6036] ppid=6032 vsize=405752 CPUtime=6.23 cores=0-7
/proc/6034/task/6036/stat : 6036 (SArTagnan) R 6032 6034 5882 0 -1 4202560 3865 0 0 0 623 0 0 0 25 0 8 0 807935497 415490048 25915 33554432000 4194304 4625164 140733883240352 18446744073709551615 4465141 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6037] ppid=6032 vsize=405752 CPUtime=6.27 cores=0-7
/proc/6034/task/6037/stat : 6037 (SArTagnan) R 6032 6034 5882 0 -1 4202560 48080 0 0 0 620 7 0 0 25 0 8 0 807935497 415490048 25915 33554432000 4194304 4625164 140733883240352 18446744073709551615 255393285147 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6034/tid=6038] ppid=6032 vsize=405752 CPUtime=6.27 cores=0-7
/proc/6034/task/6038/stat : 6038 (SArTagnan) R 6032 6034 5882 0 -1 4202560 2847 0 0 0 627 0 0 0 25 0 8 0 807935497 415490048 25915 33554432000 4194304 4625164 140733883240352 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6034/tid=6039] ppid=6032 vsize=405752 CPUtime=6.27 cores=0-7
/proc/6034/task/6039/stat : 6039 (SArTagnan) R 6032 6034 5882 0 -1 4202560 3852 0 0 0 627 0 0 0 25 0 8 0 807935497 415490048 25915 33554432000 4194304 4625164 140733883240352 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6034/tid=6040] ppid=6032 vsize=405752 CPUtime=6.28 cores=0-7
/proc/6034/task/6040/stat : 6040 (SArTagnan) R 6032 6034 5882 0 -1 4202560 3878 0 0 0 628 0 0 0 25 0 8 0 807935497 415490048 25915 33554432000 4194304 4625164 140733883240352 18446744073709551615 4464208 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6034/tid=6041] ppid=6032 vsize=405752 CPUtime=6.28 cores=0-7
/proc/6034/task/6041/stat : 6041 (SArTagnan) R 6032 6034 5882 0 -1 4202560 2839 0 0 0 628 0 0 0 25 0 8 0 807935497 415490048 25915 33554432000 4194304 4625164 140733883240352 18446744073709551615 4352855 0 0 4096 2 0 0 0 -1 5 0 0 0

################
# More data... #
################

[pid=6034/tid=6037] ppid=6032 vsize=5901396 CPUtime=4662.37 cores=0-7
/proc/6034/task/6037/stat : 6037 (SArTagnan) R 6032 6034 5882 0 -1 4202560 15665820 0 0 0 463396 2841 0 0 25 0 8 0 807935497 6043029504 1244866 33554432000 4194304 4625164 140733883240352 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6034/tid=6038] ppid=6032 vsize=5901396 CPUtime=4662.42 cores=0-7
/proc/6034/task/6038/stat : 6038 (SArTagnan) R 6032 6034 5882 0 -1 4202560 113172 0 0 0 466216 26 0 0 25 0 8 0 807935497 6043029504 1244866 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6034/tid=6039] ppid=6032 vsize=5901396 CPUtime=4661.35 cores=0-7
/proc/6034/task/6039/stat : 6039 (SArTagnan) R 6032 6034 5882 0 -1 4202560 119580 0 0 0 466107 28 0 0 25 0 8 0 807935497 6043029504 1244866 33554432000 4194304 4625164 140733883240352 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6034/tid=6040] ppid=6032 vsize=5901396 CPUtime=4662.28 cores=0-7
/proc/6034/task/6040/stat : 6040 (SArTagnan) R 6032 6034 5882 0 -1 4202560 349939 0 0 0 466147 81 0 0 25 0 8 0 807935497 6043029504 1244866 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6034/tid=6041] ppid=6032 vsize=5901396 CPUtime=4661.89 cores=0-7
/proc/6034/task/6041/stat : 6041 (SArTagnan) R 6032 6034 5882 0 -1 4202560 124198 0 0 0 466156 33 0 0 25 0 8 0 807935497 6043029504 1244866 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37228.4
Current children cumulated vsize (KiB) 5901396

[startup+4722.32 s]
/proc/loadavg: 8.23 8.17 8.16 10/437 6180
/proc/meminfo: memFree=16165244/32951124 swapFree=60787360/67111528
[pid=6034] ppid=6032 vsize=5901396 CPUtime=37707.6 cores=0-7
/proc/6034/stat : 6034 (SArTagnan) R 6032 6034 5882 0 -1 4202496 17914354 0 0 0 3767431 3334 0 0 25 0 8 0 807935496 6043029504 1248102 33554432000 4194304 4625164 140733883240352 18446744073709551615 4512142 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6034/statm: 1475349 1248102 357 106 0 1470852 0
[pid=6034/tid=6035] ppid=6032 vsize=5901396 CPUtime=4652.44 cores=0-7
/proc/6034/task/6035/stat : 6035 (SArTagnan) R 6032 6034 5882 0 -1 4202560 130098 0 0 0 465209 35 0 0 25 0 8 0 807935497 6043029504 1248102 33554432000 4194304 4625164 140733883240352 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6034/tid=6036] ppid=6032 vsize=5901396 CPUtime=4722.36 cores=0-7
/proc/6034/task/6036/stat : 6036 (SArTagnan) R 6032 6034 5882 0 -1 4202560 92546 0 0 0 472209 27 0 0 25 0 8 0 807935497 6043029504 1248103 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6037] ppid=6032 vsize=5901396 CPUtime=4722.38 cores=0-7
/proc/6034/task/6037/stat : 6037 (SArTagnan) R 6032 6034 5882 0 -1 4202560 15917728 0 0 0 469343 2895 0 0 25 0 8 0 807935497 6043029504 1248104 33554432000 4194304 4625164 140733883240352 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6034/tid=6038] ppid=6032 vsize=5901396 CPUtime=4722.44 cores=0-7
/proc/6034/task/6038/stat : 6038 (SArTagnan) R 6032 6034 5882 0 -1 4202560 113206 0 0 0 472218 26 0 0 25 0 8 0 807935497 6043029504 1248104 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6034/tid=6039] ppid=6032 vsize=5901396 CPUtime=4721.36 cores=0-7
/proc/6034/task/6039/stat : 6039 (SArTagnan) R 6032 6034 5882 0 -1 4202560 119629 0 0 0 472108 28 0 0 25 0 8 0 807935497 6043029504 1248104 33554432000 4194304 4625164 140733883240352 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6034/tid=6040] ppid=6032 vsize=5901396 CPUtime=4722.3 cores=0-7
/proc/6034/task/6040/stat : 6040 (SArTagnan) R 6032 6034 5882 0 -1 4202560 349970 0 0 0 472149 81 0 0 25 0 8 0 807935497 6043029504 1248104 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6034/tid=6041] ppid=6032 vsize=5901396 CPUtime=4721.91 cores=0-7
/proc/6034/task/6041/stat : 6041 (SArTagnan) R 6032 6034 5882 0 -1 4202560 124276 0 0 0 472158 33 0 0 25 0 8 0 807935497 6043029504 1248106 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37707.6
Current children cumulated vsize (KiB) 5901396

[startup+4782.3 s]
/proc/loadavg: 8.20 8.17 8.16 9/437 6182
/proc/meminfo: memFree=16157416/32951124 swapFree=60787360/67111528
[pid=6034] ppid=6032 vsize=5901396 CPUtime=38186.6 cores=0-7
/proc/6034/stat : 6034 (SArTagnan) R 6032 6034 5882 0 -1 4202496 18170926 0 0 0 3815277 3384 0 0 25 0 8 0 807935496 6043029504 1251451 33554432000 4194304 4625164 140733883240352 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6034/statm: 1475349 1251451 357 106 0 1470852 0
[pid=6034/tid=6035] ppid=6032 vsize=5901396 CPUtime=4711.53 cores=0-7
/proc/6034/task/6035/stat : 6035 (SArTagnan) R 6032 6034 5882 0 -1 4202560 130137 0 0 0 471118 35 0 0 25 0 8 0 807935497 6043029504 1251451 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6034/tid=6036] ppid=6032 vsize=5901396 CPUtime=4782.35 cores=0-7
/proc/6034/task/6036/stat : 6036 (SArTagnan) R 6032 6034 5882 0 -1 4202560 92565 0 0 0 478208 27 0 0 25 0 8 0 807935497 6043029504 1251451 33554432000 4194304 4625164 140733883240352 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6037] ppid=6032 vsize=5901396 CPUtime=4782.38 cores=0-7
/proc/6034/task/6037/stat : 6037 (SArTagnan) R 6032 6034 5882 0 -1 4202560 16173146 0 0 0 475293 2945 0 0 25 0 8 0 807935497 6043029504 1251451 33554432000 4194304 4625164 140733883240352 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6034/tid=6038] ppid=6032 vsize=5901396 CPUtime=4782.42 cores=0-7
/proc/6034/task/6038/stat : 6038 (SArTagnan) R 6032 6034 5882 0 -1 4202560 113291 0 0 0 478216 26 0 0 25 0 8 0 807935497 6043029504 1251451 33554432000 4194304 4625164 140733883240352 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6034/tid=6039] ppid=6032 vsize=5901396 CPUtime=4781.33 cores=0-7
/proc/6034/task/6039/stat : 6039 (SArTagnan) R 6032 6034 5882 0 -1 4202560 119664 0 0 0 478105 28 0 0 25 0 8 0 807935497 6043029504 1251451 33554432000 4194304 4625164 140733883240352 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6034/tid=6040] ppid=6032 vsize=5901396 CPUtime=4782.29 cores=0-7
/proc/6034/task/6040/stat : 6040 (SArTagnan) R 6032 6034 5882 0 -1 4202560 350000 0 0 0 478148 81 0 0 25 0 8 0 807935497 6043029504 1251451 33554432000 4194304 4625164 140733883240352 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6034/tid=6041] ppid=6032 vsize=5901396 CPUtime=4781.9 cores=0-7
/proc/6034/task/6041/stat : 6041 (SArTagnan) R 6032 6034 5882 0 -1 4202560 124328 0 0 0 478157 33 0 0 25 0 8 0 807935497 6043029504 1251451 33554432000 4194304 4625164 140733883240352 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38186.6
Current children cumulated vsize (KiB) 5901396

[startup+4842.3 s]
/proc/loadavg: 8.17 8.17 8.16 9/437 6183
/proc/meminfo: memFree=16145360/32951124 swapFree=60787360/67111528
[pid=6034] ppid=6032 vsize=5901396 CPUtime=38665.7 cores=0-7
/proc/6034/stat : 6034 (SArTagnan) R 6032 6034 5882 0 -1 4202496 18415739 0 0 0 3863132 3437 0 0 25 0 8 0 807935496 6043029504 1252385 33554432000 4194304 4625164 140733883240352 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6034/statm: 1475349 1252385 350 106 0 1470852 0
[pid=6034/tid=6035] ppid=6032 vsize=5901396 CPUtime=4770.61 cores=0-7
/proc/6034/task/6035/stat : 6035 (SArTagnan) R 6032 6034 5882 0 -1 4202560 130168 0 0 0 477026 35 0 0 25 0 8 0 807935497 6043029504 1252386 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6034/tid=6036] ppid=6032 vsize=5901396 CPUtime=4842.35 cores=0-7
/proc/6034/task/6036/stat : 6036 (SArTagnan) R 6032 6034 5882 0 -1 4202560 92618 0 0 0 484208 27 0 0 25 0 8 0 807935497 6043029504 1252386 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331184 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6037] ppid=6032 vsize=5901396 CPUtime=4842.38 cores=0-7
/proc/6034/task/6037/stat : 6037 (SArTagnan) R 6032 6034 5882 0 -1 4202560 16416799 0 0 0 481241 2997 0 0 25 0 8 0 807935497 6043029504 1252386 33554432000 4194304 4625164 140733883240352 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6034/tid=6038] ppid=6032 vsize=5901396 CPUtime=4842.42 cores=0-7
/proc/6034/task/6038/stat : 6038 (SArTagnan) R 6032 6034 5882 0 -1 4202560 113369 0 0 0 484216 26 0 0 25 0 8 0 807935497 6043029504 1252386 33554432000 4194304 4625164 140733883240352 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6034/tid=6039] ppid=6032 vsize=5901396 CPUtime=4841.32 cores=0-7
/proc/6034/task/6039/stat : 6039 (SArTagnan) R 6032 6034 5882 0 -1 4202560 119718 0 0 0 484104 28 0 0 25 0 8 0 807935497 6043029504 1252387 33554432000 4194304 4625164 140733883240352 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6034/tid=6040] ppid=6032 vsize=5901396 CPUtime=4842.29 cores=0-7
/proc/6034/task/6040/stat : 6040 (SArTagnan) R 6032 6034 5882 0 -1 4202560 350030 0 0 0 484148 81 0 0 25 0 8 0 807935497 6043029504 1252387 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6034/tid=6041] ppid=6032 vsize=5901396 CPUtime=4841.9 cores=0-7
/proc/6034/task/6041/stat : 6041 (SArTagnan) R 6032 6034 5882 0 -1 4202560 124363 0 0 0 484157 33 0 0 25 0 8 0 807935497 6043029504 1252387 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38665.7
Current children cumulated vsize (KiB) 5901396

[startup+4902.3 s]
/proc/loadavg: 8.22 8.18 8.16 9/437 6185
/proc/meminfo: memFree=16137400/32951124 swapFree=60787360/67111528
[pid=6034] ppid=6032 vsize=5901396 CPUtime=39144.8 cores=0-7
/proc/6034/stat : 6034 (SArTagnan) R 6032 6034 5882 0 -1 4202496 18595088 0 0 0 3911009 3470 0 0 25 0 8 0 807935496 6043029504 1255170 33554432000 4194304 4625164 140733883240352 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6034/statm: 1475349 1255170 349 106 0 1470852 0
[pid=6034/tid=6035] ppid=6032 vsize=5901396 CPUtime=4829.7 cores=0-7
/proc/6034/task/6035/stat : 6035 (SArTagnan) R 6032 6034 5882 0 -1 4202560 130206 0 0 0 482935 35 0 0 25 0 8 0 807935497 6043029504 1255170 33554432000 4194304 4625164 140733883240352 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6034/tid=6036] ppid=6032 vsize=5901396 CPUtime=4902.35 cores=0-7
/proc/6034/task/6036/stat : 6036 (SArTagnan) R 6032 6034 5882 0 -1 4202560 92638 0 0 0 490208 27 0 0 25 0 8 0 807935497 6043029504 1255170 33554432000 4194304 4625164 140733883240352 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6037] ppid=6032 vsize=5901396 CPUtime=4902.37 cores=0-7
/proc/6034/task/6037/stat : 6037 (SArTagnan) R 6032 6034 5882 0 -1 4202560 16594687 0 0 0 487208 3029 0 0 25 0 8 0 807935497 6043029504 1255170 33554432000 4194304 4625164 140733883240352 18446744073709551615 4579376 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6034/tid=6038] ppid=6032 vsize=5901396 CPUtime=4902.42 cores=0-7
/proc/6034/task/6038/stat : 6038 (SArTagnan) R 6032 6034 5882 0 -1 4202560 113404 0 0 0 490216 26 0 0 25 0 8 0 807935497 6043029504 1255170 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6034/tid=6039] ppid=6032 vsize=5901396 CPUtime=4901.31 cores=0-7
/proc/6034/task/6039/stat : 6039 (SArTagnan) R 6032 6034 5882 0 -1 4202560 119755 0 0 0 490103 28 0 0 25 0 8 0 807935497 6043029504 1255170 33554432000 4194304 4625164 140733883240352 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6034/tid=6040] ppid=6032 vsize=5901396 CPUtime=4902.29 cores=0-7
/proc/6034/task/6040/stat : 6040 (SArTagnan) R 6032 6034 5882 0 -1 4202560 350060 0 0 0 490148 81 0 0 25 0 8 0 807935497 6043029504 1255170 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331194 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6034/tid=6041] ppid=6032 vsize=5901396 CPUtime=4901.91 cores=0-7
/proc/6034/task/6041/stat : 6041 (SArTagnan) R 6032 6034 5882 0 -1 4202560 124397 0 0 0 490157 34 0 0 25 0 8 0 807935497 6043029504 1255170 33554432000 4194304 4625164 140733883240352 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39144.8
Current children cumulated vsize (KiB) 5901396

[startup+4962.3 s]
/proc/loadavg: 8.16 8.17 8.16 9/437 6186
/proc/meminfo: memFree=16120884/32951124 swapFree=60787360/67111528
[pid=6034] ppid=6032 vsize=5966932 CPUtime=39623.9 cores=0-7
/proc/6034/stat : 6034 (SArTagnan) R 6032 6034 5882 0 -1 4202496 18660223 0 0 0 3958900 3486 0 0 25 0 8 0 807935496 6110138368 1259460 33554432000 4194304 4625164 140733883240352 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6034/statm: 1491733 1259460 349 106 0 1487236 0
[pid=6034/tid=6035] ppid=6032 vsize=5966932 CPUtime=4888.79 cores=0-7
/proc/6034/task/6035/stat : 6035 (SArTagnan) R 6032 6034 5882 0 -1 4202560 130235 0 0 0 488844 35 0 0 25 0 8 0 807935497 6110138368 1259460 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6034/tid=6036] ppid=6032 vsize=5966932 CPUtime=4962.35 cores=0-7
/proc/6034/task/6036/stat : 6036 (SArTagnan) R 6032 6034 5882 0 -1 4202560 92664 0 0 0 496208 27 0 0 25 0 8 0 807935497 6110138368 1259460 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6037] ppid=6032 vsize=5966932 CPUtime=4962.38 cores=0-7
/proc/6034/task/6037/stat : 6037 (SArTagnan) R 6032 6034 5882 0 -1 4202560 16656660 0 0 0 493194 3044 0 0 25 0 8 0 807935497 6110138368 1259460 33554432000 4194304 4625164 140733883240352 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6034/tid=6038] ppid=6032 vsize=5966932 CPUtime=4962.43 cores=0-7
/proc/6034/task/6038/stat : 6038 (SArTagnan) R 6032 6034 5882 0 -1 4202560 113435 0 0 0 496217 26 0 0 25 0 8 0 807935497 6110138368 1259460 33554432000 4194304 4625164 140733883240352 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6034/tid=6039] ppid=6032 vsize=5966932 CPUtime=4961.29 cores=0-7
/proc/6034/task/6039/stat : 6039 (SArTagnan) R 6032 6034 5882 0 -1 4202560 121834 0 0 0 496101 28 0 0 25 0 8 0 807935497 6110138368 1259460 33554432000 4194304 4625164 140733883240352 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6034/tid=6040] ppid=6032 vsize=5966932 CPUtime=4962.29 cores=0-7
/proc/6034/task/6040/stat : 6040 (SArTagnan) R 6032 6034 5882 0 -1 4202560 350092 0 0 0 496148 81 0 0 25 0 8 0 807935497 6110138368 1259460 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6034/tid=6041] ppid=6032 vsize=5966932 CPUtime=4961.91 cores=0-7
/proc/6034/task/6041/stat : 6041 (SArTagnan) R 6032 6034 5882 0 -1 4202560 124497 0 0 0 496157 34 0 0 25 0 8 0 807935497 6110138368 1259460 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39623.9
Current children cumulated vsize (KiB) 5966932



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5009.42 s]
/proc/loadavg: 8.15 8.16 8.15 9/437 6188
/proc/meminfo: memFree=16107724/32951124 swapFree=60787360/67111528
[pid=6034] ppid=6032 vsize=5976448 CPUtime=40000.2 cores=0-7
/proc/6034/stat : 6034 (SArTagnan) R 6032 6034 5882 0 -1 4202496 18663539 0 0 0 3996530 3487 0 0 25 0 8 0 807935496 6119882752 1262730 33554432000 4194304 4625164 140733883240352 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6034/statm: 1494112 1262730 349 106 0 1489615 0
[pid=6034/tid=6035] ppid=6032 vsize=5976448 CPUtime=4935.2 cores=0-7
/proc/6034/task/6035/stat : 6035 (SArTagnan) R 6032 6034 5882 0 -1 4202560 130260 0 0 0 493485 35 0 0 25 0 8 0 807935497 6119882752 1262730 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6034/tid=6036] ppid=6032 vsize=5976448 CPUtime=5009.49 cores=0-7
/proc/6034/task/6036/stat : 6036 (SArTagnan) R 6032 6034 5882 0 -1 4202560 92675 0 0 0 500922 27 0 0 25 0 8 0 807935497 6119882752 1262730 33554432000 4194304 4625164 140733883240352 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6034/tid=6037] ppid=6032 vsize=5976448 CPUtime=5009.52 cores=0-7
/proc/6034/task/6037/stat : 6037 (SArTagnan) R 6032 6034 5882 0 -1 4202560 16658964 0 0 0 497907 3045 0 0 25 0 8 0 807935497 6119882752 1262730 33554432000 4194304 4625164 140733883240352 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6034/tid=6038] ppid=6032 vsize=5976448 CPUtime=5009.57 cores=0-7
/proc/6034/task/6038/stat : 6038 (SArTagnan) R 6032 6034 5882 0 -1 4202560 113458 0 0 0 500930 27 0 0 25 0 8 0 807935497 6119882752 1262730 33554432000 4194304 4625164 140733883240352 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6034/tid=6039] ppid=6032 vsize=5976448 CPUtime=5008.41 cores=0-7
/proc/6034/task/6039/stat : 6039 (SArTagnan) R 6032 6034 5882 0 -1 4202560 122359 0 0 0 500813 28 0 0 25 0 8 0 807935497 6119882752 1262730 33554432000 4194304 4625164 140733883240352 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6034/tid=6040] ppid=6032 vsize=5976448 CPUtime=5009.42 cores=0-7
/proc/6034/task/6040/stat : 6040 (SArTagnan) R 6032 6034 5882 0 -1 4202560 350114 0 0 0 500861 81 0 0 25 0 8 0 807935497 6119882752 1262730 33554432000 4194304 4625164 140733883240352 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6034/tid=6041] ppid=6032 vsize=5976448 CPUtime=5009.04 cores=0-7
/proc/6034/task/6041/stat : 6041 (SArTagnan) R 6032 6034 5882 0 -1 4202560 124522 0 0 0 500870 34 0 0 25 0 8 0 807935497 6119882752 1262730 33554432000 4194304 4625164 140733883240352 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 5976448

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5009.6 s]
/proc/loadavg: 8.15 8.16 8.15 9/437 6188
/proc/meminfo: memFree=16107724/32951124 swapFree=60787360/67111528
[pid=6034] ppid=6032 vsize=0 CPUtime=40000.4 cores=0-7
/proc/6034/stat : 6034 (SArTagnan) Z 6032 6034 5882 0 -1 4203548 18663539 0 0 0 3996537 3503 0 0 25 0 2 0 807935496 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6034/statm: 0 0 0 0 0 0 0
[pid=6034/tid=6035] ppid=6032 vsize=0 CPUtime=4935.36 cores=0-7
/proc/6034/task/6035/stat : 6035 (SArTagnan) R 6032 6034 5882 0 -1 4203588 130260 0 0 0 493485 51 0 0 25 0 2 0 807935497 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5009.68
CPU time (s): 40000.5
CPU user time (s): 39965.4
CPU system time (s): 35.1137
CPU usage (%): 798.464
Max. virtual memory (cumulated for all children) (KiB): 5985024

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39965.4
system time used= 35.1137
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18663539
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1729
involuntary context switches= 340421

runsolver used 18.9321 second user time and 55.1056 second system time

The end

Launcher Data 

Begin job on node135 at 2011-06-01 23:22:56
IDJOB=3439431
IDBENCH=84643
IDSOLVER=1936
FILE ID=node135/3439431-1306963376
RUNJOBID= node135-1306960405-5897
PBS_JOBID= 13497616
Free space on /tmp= 73800 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT04/handmade/connamacher/connm-d-0.02/connm-ue-csp-sat-n1200-d-0.02-s405595518.used-as.sat04-950.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439431-1306963376/watcher-3439431-1306963376 -o /tmp/evaluation-result-3439431-1306963376/solver-3439431-1306963376 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439431-1306963376.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 287d3b23c6f72107e24ae4186653564e
RANDOM SEED=467888127

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21169976 kB
Buffers:        146944 kB
Cached:         277284 kB
SwapCached:       6168 kB
Active:       11249516 kB
Inactive:       273000 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21169976 kB
SwapTotal:    67111528 kB
SwapFree:     60787360 kB
Dirty:             788 kB
Writeback:           0 kB
AnonPages:    11098576 kB
Mapped:          25336 kB
Slab:           124928 kB
PageTables:      64892 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 124372776 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73800 MiB
End job on node135 at 2011-06-02 00:46:28