Trace number 3378128

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 1991.15 501.631

General information on the benchmark

Namerandom/large/
unif-k7-r85-v200-c17000-S181603592-089-UNKNOWN.cnf
MD5SUMaf7b69f0071c372d5cdc250bc7f688e1
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of clauses17000
Sum of the clauses size119000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 517000

Solver Data 

0.42/0.70	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.42/0.70	c INFO: solving HOME/instance-3378128-1305462926.cnf
0.42/0.70	c INFO: computing task features
0.52/0.82	c INFO: computed variable-clause graph statistics
0.52/0.82	c INFO: computed clause balance statistics
1.13/1.40	c INFO: computed variable balance statistics
1.33/1.63	c INFO: computed small-clause counts
1.33/1.63	c INFO: computed Horn-clause counts
1.33/1.65	c INFO: computed variable graph statistics
1.33/1.65	c INFO: collected features for HOME/instance-3378128-1305462926.cnf in 0.95 s
1.33/1.66	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.36)
1.33/1.67	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.12)
1.33/1.68	c INFO: running adaptg2wsat2009++@0 for 97 with 1199 remaining (b = 0.08)
1.33/1.69	c INFO: running adaptg2wsat2009++@0 for 97 with 1199 remaining (b = 0.07)
397.11/100.96	c INFO: running adaptg2wsat2009++@0 for 97 with 1099 remaining (b = 0.05)
401.09/101.95	c INFO: running gnovelty+2@0 for 97 with 1098 remaining (b = 0.04)
401.09/101.96	c INFO: running FH@0 for 97 with 1098 remaining (b = 0.03)
401.09/101.98	c INFO: running adaptg2wsat2009++@0 for 97 with 1098 remaining (b = 0.03)
796.88/201.23	c INFO: running adaptg2wsat2009++@0 for 97 with 999 remaining (b = 0.02)
799.87/202.25	c INFO: running FH@0 for 97 with 998 remaining (b = 0.02)
799.87/202.26	c INFO: running hybridGM3@0 for 194 with 998 remaining (b = 0.04)
812.72/205.30	c INFO: running gnovelty+2@0 for 97 with 995 remaining (b = 0.02)
1191.82/300.51	c INFO: running hybridGM3@0 for 194 with 900 remaining (b = 0.03)
1199.80/302.52	c INFO: running adaptg2wsat2009++@0 for 97 with 898 remaining (b = 0.02)
1208.13/304.62	c INFO: running hybridGM3@0 for 194 with 896 remaining (b = 0.03)
1582.78/398.83	c INFO: running hybridGM3@101 for 97 with 801 remaining (b = 0.01)
1599.06/402.92	c INFO: running FH@0 for 97 with 797 remaining (b = 0.01)
1981.56/499.14	c INFO: running hybridGM3@0 for 194 with 701 remaining (b = 0.02)
1989.47/501.14	c INFO: running hybridGM3@98 for 97 with 699 remaining (b = 0.01)
1989.86/501.21	c INFO: running TNM@0 for 699 with 699 remaining (b = 0.08)
1991.15/501.61	c INFO: running adaptg2wsat2009++@0 for 97 with 699 remaining (b = 0.01)
1991.15/501.61	Traceback (most recent call last):
1991.15/501.61	  File "HOME/solve", line 33, in <module>
1991.15/501.61	    plac.call(main)
1991.15/501.61	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 311, in call
1991.15/501.61	    cmd, result = parser_from(obj).consume(arglist)
1991.15/501.61	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 192, in consume
1991.15/501.61	    return cmd, self.func(*(args + varargs + extraopts), **kwargs)
1991.15/501.61	  File "HOME/borg/build/lib/borg/tools/solve.py", line 84, in main
1991.15/501.61	    (_, answer, _) = solver(input_path, budget / cores, cores)
1991.15/501.61	  File "HOME/borg/build/lib/borg/bilevel.py", line 202, in __call__
1991.15/501.61	    solver.go(max_cost * borg.defaults.machine_speed)
1991.15/501.61	  File "HOME/borg/build/lib/borg/solvers.py", line 179, in go
1991.15/501.61	    self._process.start()
1991.15/501.61	  File "/home/evaluation/evaluation/tools64/lib/python2.7/multiprocessing/process.py", line 94, in start
1991.15/501.61	    assert self._popen is None, 'cannot start a process twice'
1991.15/501.61	AssertionError: cannot start a process twice

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378128-1305462926/watcher-3378128-1305462926 -o /tmp/evaluation-result-3378128-1305462926/solver-3378128-1305462926 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378128-1305462926.cnf -seed 1253958526 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.67 4.38 3.46 3/333 21812
/proc/meminfo: memFree=19339408/32951124 swapFree=57331800/67111528
[pid=21812] ppid=21810 vsize=15776 CPUtime=0 cores=0,2,4,6
/proc/21812/stat : 21812 (python) S 21810 21812 21694 0 -1 4202496 893 0 0 0 0 0 0 0 25 0 1 0 657894964 16154624 776 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436015104 0 2147483391 16781312 2 18446744071699207358 0 0 17 2 0 0 0
/proc/21812/statm: 3944 776 343 364 0 431 0

[startup+0.0488219 s]
/proc/loadavg: 7.67 4.38 3.46 3/333 21812
/proc/meminfo: memFree=19339408/32951124 swapFree=57331800/67111528
[pid=21812] ppid=21810 vsize=18884 CPUtime=0.03 cores=0,2,4,6
/proc/21812/stat : 21812 (python) R 21810 21812 21694 0 -1 4202496 1286 0 0 0 2 1 0 0 18 0 1 0 657894964 19337216 1140 33554432000 4194304 5683644 140736450164848 18446744073709551615 4867748 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/21812/statm: 4721 1140 421 364 0 690 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 18884

[startup+0.100809 s]
/proc/loadavg: 7.67 4.38 3.46 3/333 21812
/proc/meminfo: memFree=19339408/32951124 swapFree=57331800/67111528
[pid=21812] ppid=21810 vsize=85620 CPUtime=0.06 cores=0,2,4,6
/proc/21812/stat : 21812 (python) R 21810 21812 21694 0 -1 4202496 2627 0 0 0 5 1 0 0 17 0 1 0 657894964 87674880 2348 33554432000 4194304 5683644 140736450164848 18446744073709551615 4898997 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/21812/statm: 21405 2348 713 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85620

[startup+0.300763 s]
/proc/loadavg: 7.67 4.38 3.46 3/333 21812
/proc/meminfo: memFree=19339408/32951124 swapFree=57331800/67111528
[pid=21812] ppid=21810 vsize=135748 CPUtime=0.18 cores=0,2,4,6
/proc/21812/stat : 21812 (python) S 21810 21812 21694 0 -1 4202496 5960 937 1 0 13 5 0 0 17 0 1 0 657894964 139005952 4151 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436013061 0 2147483391 16781312 2 0 0 0 17 2 0 0 0
/proc/21812/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.700677 s]
/proc/loadavg: 7.67 4.38 3.46 3/333 21812
/proc/meminfo: memFree=19339408/32951124 swapFree=57331800/67111528
[pid=21812] ppid=21810 vsize=278124 CPUtime=0.42 cores=0,2,4,6
/proc/21812/stat : 21812 (python) R 21810 21812 21694 0 -1 4202496 9049 937 1 0 30 12 0 0 16 0 1 0 657894964 284798976 6803 33554432000 4194304 5683644 140736450164848 18446744073709551615 47110915457023 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/21812/statm: 69531 6805 1744 364 0 5455 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 278124

[startup+1.50057 s]
/proc/loadavg: 7.67 4.38 3.46 3/337 21845
/proc/meminfo: memFree=19351080/32951124 swapFree=57331800/67111528
[pid=21812] ppid=21810 vsize=282584 CPUtime=1.23 cores=0,2,4,6
/proc/21812/stat : 21812 (python) R 21810 21812 21694 0 -1 4202496 11327 937 1 0 110 13 0 0 17 0 1 0 657894964 289366016 8059 33554432000 4194304 5683644 140736450164848 18446744073709551615 212435672492 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/21812/statm: 70646 8059 1827 364 0 6570 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 282584

[startup+3.10118 s]
/proc/loadavg: 7.67 4.38 3.46 6/349 21857
/proc/meminfo: memFree=19324324/32951124 swapFree=57331800/67111528
[pid=21812] ppid=21810 vsize=320376 CPUtime=1.42 cores=0,2,4,6
/proc/21812/stat : 21812 (python) S 21810 21812 21694 0 -1 4202496 14100 937 1 0 128 14 0 0 20 0 5 0 657894964 328065024 7309 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21812/statm: 80094 7309 1883 364 0 16003 0
[pid=21846] ppid=21812 vsize=279228 CPUtime=0 cores=0,2,4,6
/proc/21846/stat : 21846 (python) S 21812 21812 21694 0 -1 4202560 723 0 0 0 0 0 0 0 18 0 1 0 657895130 285929472 5714 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436037135 0 0 16781312 514 12948318699328078084 0 0 17 2 0 0 0
/proc/21846/statm: 69807 5714 354 364 0 5725 0
[pid=21848] ppid=21846 vsize=1018616 CPUtime=1.42 cores=0,2,4,6
/proc/21848/stat : 21848 (gnovelty+2) R 21846 21848 21848 0 -1 4202496 764 0 0 0 142 0 0 0 23 0 1 0 657895131 1043062784 501 33554432000 134512640 135663704 4293427104 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/21848/statm: 254654 501 113 282 0 254370 0
[pid=21849] ppid=21812 vsize=289620 CPUtime=0 cores=0,2,4,6
/proc/21849/stat : 21849 (python) S 21812 21812 21694 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 657895131 296570880 5762 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436037190 0 0 16781312 514 8428967468378063106 0 0 17 0 0 0 0
/proc/21849/statm: 72405 5762 348 364 0 8320 0
[pid=21851] ppid=21849 vsize=1018616 CPUtime=1.41 cores=0,2,4,6
/proc/21851/stat : 21851 (gnovelty+2) R 21849 21851 21851 0 -1 4202496 762 0 0 0 141 0 0 0 25 0 1 0 657895132 1043062784 501 33554432000 134512640 135663704 4289573520 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/21851/statm: 254654 501 113 282 0 254370 0
[pid=21852] ppid=21812 vsize=299876 CPUtime=0 cores=0,2,4,6
/proc/21852/stat : 21852 (python) S 21812 21812 21694 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 657895132 307073024 5766 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436037190 0 0 16781312 514 12948311002746716159 0 0 17 6 0 0 0
/proc/21852/statm: 74969 5766 348 364 0 10881 0
[pid=21854] ppid=21852 vsize=418500 CPUtime=1.39 cores=0,2,4,6
/proc/21854/stat : 21854 (adaptg2wsat2009) R 21852 21854 21854 0 -1 4202496 1073 0 0 0 139 0 0 0 25 0 1 0 657895133 428544000 808 33554432000 134512640 135107411 4289775808 18446744073709551615 134523261 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/21854/statm: 104625 808 49 146 0 103501 0
[pid=21855] ppid=21812 vsize=310132 CPUtime=0 cores=0,2,4,6
/proc/21855/stat : 21855 (python) S 21812 21812 21694 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 657895133 317575168 5770 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436037190 0 0 16781312 514 12948307154456018943 0 0 17 2 0 0 0
/proc/21855/statm: 77533 5770 348 364 0 13442 0
[pid=21857] ppid=21855 vsize=418500 CPUtime=1.39 cores=0,2,4,6
/proc/21857/stat : 21857 (adaptg2wsat2009) R 21855 21857 21857 0 -1 4202496 1073 0 0 0 139 0 0 0 25 0 1 0 657895134 428544000 808 33554432000 134512640 135107411 4288587984 18446744073709551615 134523314 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/21857/statm: 104625 808 49 146 0 103501 0
[pid=21812/tid=21847] ppid=21810 vsize=320376 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21847/stat : 21847 (python) S 21810 21812 21694 0 -1 4202560 23 937 0 0 0 0 0 0 19 0 5 0 657895130 328065024 7309 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 6 0 0 0
[pid=21812/tid=21850] ppid=21810 vsize=320376 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21850/stat : 21850 (python) S 21810 21812 21694 0 -1 4202560 25 937 0 0 0 0 0 0 21 0 5 0 657895132 328065024 7309 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 6 0 0 0
[pid=21812/tid=21853] ppid=21810 vsize=320376 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21853/stat : 21853 (python) S 21810 21812 21694 0 -1 4202560 24 937 0 0 0 0 0 0 23 0 5 0 657895133 328065024 7309 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 6 0 0 0
[pid=21812/tid=21856] ppid=21810 vsize=320376 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21856/stat : 21856 (python) S 21810 21812 21694 0 -1 4202560 28 937 0 0 0 0 0 0 20 0 5 0 657895134 328065024 7309 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 7.03
Current children cumulated vsize (KiB) 4373464

[startup+6.30057 s]
/proc/loadavg: 7.94 4.49 3.50 9/361 21869
/proc/meminfo: memFree=19294564/32951124 swapFree=57331800/67111528
[pid=21812] ppid=21810 vsize=320376 CPUtime=1.42 cores=0,2,4,6
/proc/21812/stat : 21812 (python) S 21810 21812 21694 0 -1 4202496 14100 937 1 0 128 14 0 0 20 0 5 0 657894964 328065024 7309 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21812/statm: 80094 7309 1883 364 0 16003 0
[pid=21846] ppid=21812 vsize=279228 CPUtime=0.01 cores=0,2,4,6
/proc/21846/stat : 21846 (python) S 21812 21812 21694 0 -1 4202560 879 0 0 0 1 0 0 0 18 0 1 0 657895130 285929472 5737 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436037135 0 0 16781312 514 12948318699328078084 0 0 17 0 0 0 0
/proc/21846/statm: 69807 5737 377 364 0 5725 0
[pid=21848] ppid=21846 vsize=1018616 CPUtime=4.6 cores=0,2,4,6
/proc/21848/stat : 21848 (gnovelty+2) R 21846 21848 21848 0 -1 4202496 764 0 0 0 460 0 0 0 25 0 1 0 657895131 1043062784 501 33554432000 134512640 135663704 4293427104 18446744073709551615 134525224 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/21848/statm: 254654 501 113 282 0 254370 0
[pid=21849] ppid=21812 vsize=289620 CPUtime=0 cores=0,2,4,6
/proc/21849/stat : 21849 (python) S 21812 21812 21694 0 -1 4202560 896 0 0 0 0 0 0 0 18 0 1 0 657895131 296570880 5785 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436037190 0 0 16781312 514 8428967468378063106 0 0 17 0 0 0 0
/proc/21849/statm: 72405 5785 371 364 0 8320 0
[pid=21851] ppid=21849 vsize=1018616 CPUtime=4.59 cores=0,2,4,6
/proc/21851/stat : 21851 (gnovelty+2) R 21849 21851 21851 0 -1 4202496 762 0 0 0 459 0 0 0 25 0 1 0 657895132 1043062784 501 33554432000 134512640 135663704 4289573520 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/21851/statm: 254654 501 113 282 0 254370 0
[pid=21852] ppid=21812 vsize=299876 CPUtime=0 cores=0,2,4,6
/proc/21852/stat : 21852 (python) S 21812 21812 21694 0 -1 4202560 898 0 0 0 0 0 0 0 18 0 1 0 657895132 307073024 5789 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436037190 0 0 16781312 514 12948311002746683650 0 0 17 6 0 0 0
/proc/21852/statm: 74969 5789 371 364 0 10881 0
[pid=21854] ppid=21852 vsize=418636 CPUtime=4.54 cores=0,2,4,6
/proc/21854/stat : 21854 (adaptg2wsat2009) R 21852 21854 21854 0 -1 4202496 1220 0 0 0 454 0 0 0 25 0 1 0 657895133 428683264 955 33554432000 134512640 135107411 4289775808 18446744073709551615 134537732 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/21854/statm: 104659 955 59 146 0 103535 0
[pid=21855] ppid=21812 vsize=310132 CPUtime=0 cores=0,2,4,6
/proc/21855/stat : 21855 (python) S 21812 21812 21694 0 -1 4202560 901 0 0 0 0 0 0 0 18 0 1 0 657895133 317575168 5793 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436037190 0 0 16781312 514 12948307154455986433 0 0 17 2 0 0 0
/proc/21855/statm: 77533 5793 371 364 0 13442 0
[pid=21857] ppid=21855 vsize=418636 CPUtime=4.59 cores=0,2,4,6
/proc/21857/stat : 21857 (adaptg2wsat2009) R 21855 21857 21857 0 -1 4202496 1219 0 0 0 459 0 0 0 25 0 1 0 657895134 428683264 954 33554432000 134512640 135107411 4288587984 18446744073709551615 134532318 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/21857/statm: 104659 954 59 146 0 103535 0
[pid=21812/tid=21847] ppid=21810 vsize=320376 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21847/stat : 21847 (python) S 21810 21812 21694 0 -1 4202560 23 937 0 0 0 0 0 0 19 0 5 0 657895130 328065024 7309 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 6 0 0 0
[pid=21812/tid=21850] ppid=21810 vsize=320376 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21850/stat : 21850 (python) S 21810 21812 21694 0 -1 4202560 25 937 0 0 0 0 0 0 21 0 5 0 657895132 328065024 7309 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 6 0 0 0
[pid=21812/tid=21853] ppid=21810 vsize=320376 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21853/stat : 21853 (python) S 21810 21812 21694 0 -1 4202560 24 937 0 0 0 0 0 0 23 0 5 0 657895133 328065024 7309 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 6 0 0 0
[pid=21812/tid=21856] ppid=21810 vsize=320376 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21856/stat : 21856 (python) S 21810 21812 21694 0 -1 4202560 28 937 0 0 0 0 0 0 20 0 5 0 657895134 328065024 7309 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 19.75
Current children cumulated vsize (KiB) 4373736

[startup+12.7014 s]
/proc/loadavg: 7.94 4.55 3.52 9/361 21869
/proc/meminfo: memFree=19291384/32951124 swapFree=57331800/67111528
[pid=21812] ppid=21810 vsize=320376 CPUtime=1.42 cores=0,2,4,6
/proc/21812/stat : 21812 (python) S 21810 21812 21694 0 -1 4202496 14100 937 1 0 128 14 0 0 20 0 5 0 657894964 328065024 7309 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21812/statm: 80094 7309 1883 364 0 16003 0
[pid=21846] ppid=21812 vsize=279228 CPUtime=0.02 cores=0,2,4,6
/proc/21846/stat : 21846 (python) S 21812 21812 21694 0 -1 4202560 882 0 0 0 1 1 0 0 18 0 1 0 657895130 285929472 5737 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436037135 0 0 16781312 514 15961425582470693124 0 0 17 0 0 0 0
/proc/21846/statm: 69807 5737 377 364 0 5725 0
[pid=21848] ppid=21846 vsize=1018616 CPUtime=10.98 cores=0,2,4,6
/proc/21848/stat : 21848 (gnovelty+2) R 21846 21848 21848 0 -1 4202496 764 0 0 0 1098 0 0 0 25 0 1 0 657895131 1043062784 501 33554432000 134512640 135663704 4293427104 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/21848/statm: 254654 501 113 282 0 254370 0
[pid=21849] ppid=21812 vsize=289620 CPUtime=0.02 cores=0,2,4,6
/proc/21849/stat : 21849 (python) S 21812 21812 21694 0 -1 4202560 901 0 0 0 1 1 0 0 18 0 1 0 657895131 296570880 5785 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436037190 0 0 16781312 514 15961425582470693122 0 0 17 0 0 0 0
/proc/21849/statm: 72405 5785 371 364 0 8320 0
[pid=21851] ppid=21849 vsize=1018616 CPUtime=10.96 cores=0,2,4,6
/proc/21851/stat : 21851 (gnovelty+2) R 21849 21851 21851 0 -1 4202496 762 0 0 0 1096 0 0 0 25 0 1 0 657895132 1043062784 501 33554432000 134512640 135663704 4289573520 18446744073709551615 134524498 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/21851/statm: 254654 501 113 282 0 254370 0
[pid=21852] ppid=21812 vsize=299876 CPUtime=0.02 cores=0,2,4,6
/proc/21852/stat : 21852 (python) S 21812 21812 21694 0 -1 4202560 900 0 0 0 1 1 0 0 18 0 1 0 657895132 307073024 5789 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436037190 0 0 16781312 514 15961425582470693122 0 0 17 6 0 0 0
/proc/21852/statm: 74969 5789 371 364 0 10881 0
[pid=21854] ppid=21852 vsize=418636 CPUtime=10.85 cores=0,2,4,6
/proc/21854/stat : 21854 (adaptg2wsat2009) R 21852 21854 21854 0 -1 4202496 1220 0 0 0 1085 0 0 0 25 0 1 0 657895133 428683264 955 33554432000 134512640 135107411 4289775808 18446744073709551615 134531239 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/21854/statm: 104659 955 59 146 0 103535 0
[pid=21855] ppid=21812 vsize=310132 CPUtime=0.02 cores=0,2,4,6
/proc/21855/stat : 21855 (python) S 21812 21812 21694 0 -1 4202560 903 0 0 0 1 1 0 0 18 0 1 0 657895133 317575168 5793 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436037190 0 0 16781312 514 15961425582470693121 0 0 17 2 0 0 0
/proc/21855/statm: 77533 5793 371 364 0 13442 0
[pid=21857] ppid=21855 vsize=418636 CPUtime=10.99 cores=0,2,4,6
/proc/21857/stat : 21857 (adaptg2wsat2009) R 21855 21857 21857 0 -1 4202496 1219 0 0 0 1099 0 0 0 25 0 1 0 657895134 428683264 954 33554432000 134512640 135107411 4288587984 18446744073709551615 134532416 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/21857/statm: 104659 954 59 146 0 103535 0
[pid=21812/tid=21847] ppid=21810 vsize=320376 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21847/stat : 21847 (python) S 21810 21812 21694 0 -1 4202560 23 937 0 0 0 0 0 0 19 0 5 0 657895130 328065024 7309 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 6 0 0 0
[pid=21812/tid=21850] ppid=21810 vsize=320376 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21850/stat : 21850 (python) S 21810 21812 21694 0 -1 4202560 25 937 0 0 0 0 0 0 21 0 5 0 657895132 328065024 7309 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 6 0 0 0
[pid=21812/tid=21853] ppid=21810 vsize=320376 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21853/stat : 21853 (python) S 21810 21812 21694 0 -1 4202560 24 937 0 0 0 0 0 0 23 0 5 0 657895133 328065024 7309 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 6 0 0 0
[pid=21812/tid=21856] ppid=21810 vsize=320376 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21856/stat : 21856 (python) S 21810 21812 21694 0 -1 4202560 28 937 0 0 0 0 0 0 20 0 5 0 657895134 328065024 7309 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 45.28
Current children cumulated vsize (KiB) 4373736

[startup+25.5009 s]
/proc/loadavg: 8.11 4.75 3.61 9/361 21869
/proc/meminfo: memFree=19292372/32951124 swapFree=57331800/67111528
[pid=21812] ppid=21810 vsize=320376 CPUtime=1.42 cores=0,2,4,6

################
# More data... #
################

/proc/21854/stat : 21854 (adaptg2wsat2009) T 21852 21854 21854 0 -1 4202496 1220 0 0 0 9792 0 0 0 25 0 1 0 657895133 428683264 955 33554432000 134512640 135107411 4289775808 18446744073709551615 134531232 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/21854/statm: 104659 955 59 146 0 103535 0
[pid=21852/tid=21872] ppid=21812 vsize=299876 CPUtime=0 cores=0,2,4,6
/proc/21852/task/21872/stat : 21872 (python) S 21812 21812 21694 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 657905059 307073024 5819 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 514 18446604447337522240 0 0 -1 6 0 0 0
[pid=21855] ppid=21812 vsize=310132 CPUtime=0.25 cores=0,2,4,6
/proc/21855/stat : 21855 (python) S 21812 21812 21694 0 -1 4202560 1085 0 0 0 14 11 0 0 19 0 2 0 657895133 317575168 5823 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/21855/statm: 77533 5823 400 364 0 13442 0
[pid=21857] ppid=21855 vsize=418636 CPUtime=100.23 cores=0,2,4,6
/proc/21857/stat : 21857 (adaptg2wsat2009) T 21855 21857 21857 0 -1 4202496 1219 0 0 0 10023 0 0 0 25 0 1 0 657895134 428683264 954 33554432000 134512640 135107411 4288587984 18446744073709551615 134531600 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/21857/statm: 104659 954 59 146 0 103535 0
[pid=21855/tid=21893] ppid=21812 vsize=310132 CPUtime=0 cores=0,2,4,6
/proc/21855/task/21893/stat : 21893 (python) S 21812 21812 21694 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 657905158 317575168 5823 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 514 18446604447337521344 0 0 -1 2 0 0 0
[pid=21873] ppid=21812 vsize=320520 CPUtime=0.26 cores=0,2,4,6
/proc/21873/stat : 21873 (python) S 21812 21812 21694 0 -1 4202560 1092 0 0 0 14 12 0 0 19 0 2 0 657905060 328212480 5844 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/21873/statm: 80130 5844 400 364 0 16036 0
[pid=21875] ppid=21873 vsize=418636 CPUtime=100.23 cores=0,2,4,6
/proc/21875/stat : 21875 (adaptg2wsat2009) T 21873 21875 21875 0 -1 4202496 1222 0 0 0 10023 0 0 0 25 0 1 0 657905061 428683264 955 33554432000 134512640 135107411 4290290448 18446744073709551615 134531779 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/21875/statm: 104659 955 59 146 0 103535 0
[pid=21873/tid=21951] ppid=21812 vsize=320520 CPUtime=0 cores=0,2,4,6
/proc/21873/task/21951/stat : 21951 (python) S 21812 21812 21694 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 657915086 328212480 5844 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 514 18446604445493491712 0 0 -1 4 0 0 0
[pid=21894] ppid=21812 vsize=331316 CPUtime=0.28 cores=0,2,4,6
/proc/21894/stat : 21894 (python) S 21812 21812 21694 0 -1 4202560 1091 0 0 0 16 12 0 0 19 0 2 0 657905159 339267584 5983 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/21894/statm: 82829 5983 399 364 0 18732 0
[pid=21896] ppid=21894 vsize=1018616 CPUtime=101.7 cores=0,2,4,6
/proc/21896/stat : 21896 (gnovelty+2) T 21894 21896 21896 0 -1 4202496 765 0 0 0 10170 0 0 0 25 0 1 0 657905159 1043062784 501 33554432000 134512640 135663704 4286650320 18446744073709551615 134524548 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/21896/statm: 254654 501 113 282 0 254370 0
[pid=21894/tid=21963] ppid=21812 vsize=331316 CPUtime=0 cores=0,2,4,6
/proc/21894/task/21963/stat : 21963 (python) S 21812 21812 21694 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 657915493 339267584 5983 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 514 18446604444540564480 0 0 -1 6 0 0 0
[pid=21897] ppid=21812 vsize=341572 CPUtime=0.25 cores=0,2,4,6
/proc/21897/stat : 21897 (python) S 21812 21812 21694 0 -1 4202560 1105 0 0 0 14 11 0 0 18 0 2 0 657905160 349769728 5987 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/21897/statm: 85393 5987 399 364 0 21293 0
[pid=21900] ppid=21897 vsize=248652 CPUtime=99.98 cores=0,2,4,6
/proc/21900/stat : 21900 (FH) T 21897 21900 21900 0 -1 4202496 1118 0 0 0 9996 2 0 0 25 0 1 0 657905161 254619648 856 33554432000 134512640 134936988 4287039728 18446744073709551615 134554071 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/21900/statm: 62163 856 41 104 0 61667 0
[pid=21897/tid=21956] ppid=21812 vsize=341572 CPUtime=0 cores=0,2,4,6
/proc/21897/task/21956/stat : 21956 (python) S 21812 21812 21694 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 657915188 349769728 5987 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 514 18446604452489698176 0 0 -1 0 0 0 0
[pid=21901] ppid=21812 vsize=351828 CPUtime=0.27 cores=0,2,4,6
/proc/21901/stat : 21901 (python) S 21812 21812 21694 0 -1 4202560 1142 0 0 0 13 14 0 0 18 0 2 0 657905162 360271872 5997 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/21901/statm: 87957 5997 405 364 0 23854 0
[pid=21903] ppid=21901 vsize=418636 CPUtime=99.72 cores=0,2,4,6
/proc/21903/stat : 21903 (adaptg2wsat2009) T 21901 21903 21903 0 -1 4202496 1224 0 0 0 9972 0 0 0 25 0 1 0 657905162 428683264 955 33554432000 134512640 135107411 4294872320 18446744073709551615 134531552 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/21903/statm: 104659 955 59 146 0 103535 0
[pid=21901/tid=21955] ppid=21812 vsize=351828 CPUtime=0 cores=0,2,4,6
/proc/21901/task/21955/stat : 21955 (python) S 21812 21812 21694 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 657915188 360271872 5997 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 514 18446604450236028736 0 0 -1 4 0 0 0
[pid=21952] ppid=21812 vsize=362084 CPUtime=0.26 cores=0,2,4,6
/proc/21952/stat : 21952 (python) S 21812 21812 21694 0 -1 4202560 1133 0 0 0 14 12 0 0 19 0 2 0 657915087 370774016 6001 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/21952/statm: 90521 6001 406 364 0 26415 0
[pid=21954] ppid=21952 vsize=418636 CPUtime=98.93 cores=0,2,4,6
/proc/21954/stat : 21954 (adaptg2wsat2009) T 21952 21954 21954 0 -1 4202496 1228 0 0 0 9893 0 0 0 25 0 1 0 657915088 428683264 957 33554432000 134512640 135107411 4290331104 18446744073709551615 134531613 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/21954/statm: 104659 957 59 146 0 103535 0
[pid=21952/tid=21986] ppid=21812 vsize=362084 CPUtime=0 cores=0,2,4,6
/proc/21952/task/21986/stat : 21986 (python) S 21812 21812 21694 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 657925014 370774016 6001 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 514 18446604448666915776 0 0 -1 0 0 0 0
[pid=21957] ppid=21812 vsize=372340 CPUtime=0.27 cores=0,2,4,6
/proc/21957/stat : 21957 (python) S 21812 21812 21694 0 -1 4202560 1118 0 0 0 14 13 0 0 19 0 2 0 657915189 381276160 5999 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/21957/statm: 93085 5999 400 364 0 28976 0
[pid=21959] ppid=21957 vsize=248652 CPUtime=98.09 cores=0,2,4,6
/proc/21959/stat : 21959 (FH) T 21957 21959 21959 0 -1 4202496 1125 0 0 0 9809 0 0 0 25 0 1 0 657915189 254619648 857 33554432000 134512640 134936988 4292739312 18446744073709551615 134554261 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/21959/statm: 62163 857 41 104 0 61667 0
[pid=21957/tid=21990] ppid=21812 vsize=372340 CPUtime=0 cores=0,2,4,6
/proc/21957/task/21990/stat : 21990 (python) S 21812 21812 21694 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 657925215 381276160 5999 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 514 18446604449368851776 0 0 -1 4 0 0 0
[pid=21960] ppid=21812 vsize=382596 CPUtime=0.82 cores=0,2,4,6
/proc/21960/stat : 21960 (python) S 21812 21812 21694 0 -1 4202560 1173 0 0 0 40 42 0 0 18 0 2 0 657915190 391778304 6003 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/21960/statm: 95649 6003 400 364 0 31537 0
[pid=21962] ppid=21960 vsize=268420 CPUtime=294.44 cores=0,2,4,6
/proc/21962/stat : 21962 (hybridGM3) T 21960 21962 21962 0 -1 4202496 5161 0 0 0 29444 0 0 0 25 0 1 0 657915190 274862080 4895 33554432000 134512640 135204385 4288847712 18446744073709551615 134538395 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/21962/statm: 67105 4895 63 169 0 66935 0
[pid=21960/tid=22016] ppid=21812 vsize=382596 CPUtime=0 cores=0,2,4,6
/proc/21960/task/22016/stat : 22016 (python) S 21812 21812 21694 0 -1 4202560 50 0 0 0 0 0 0 0 18 0 2 0 657934846 391778304 6003 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 514 18446604450580248768 0 0 -1 6 0 0 0
[pid=21964] ppid=21812 vsize=392852 CPUtime=0.26 cores=0,2,4,6
/proc/21964/stat : 21964 (python) S 21812 21812 21694 0 -1 4202560 1129 0 0 0 13 13 0 0 19 0 2 0 657915494 402280448 6007 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/21964/statm: 98213 6007 400 364 0 34098 0
[pid=21966] ppid=21964 vsize=1018616 CPUtime=98.78 cores=0,2,4,6
/proc/21966/stat : 21966 (gnovelty+2) T 21964 21966 21966 0 -1 4202496 768 0 0 0 9878 0 0 0 25 0 1 0 657915494 1043062784 501 33554432000 134512640 135663704 4292474256 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/21966/statm: 254654 501 113 282 0 254370 0
[pid=21964/tid=21994] ppid=21812 vsize=392852 CPUtime=0 cores=0,2,4,6
/proc/21964/task/21994/stat : 21994 (python) S 21812 21812 21694 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 657925424 402280448 6007 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 514 18446604453144887488 0 0 -1 0 0 0 0
[pid=21987] ppid=21812 vsize=403108 CPUtime=0.57 cores=0,2,4,6
/proc/21987/stat : 21987 (python) S 21812 21812 21694 0 -1 4202560 1164 0 0 0 29 28 0 0 18 0 2 0 657925015 412782592 6011 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436037190 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/21987/statm: 100777 6011 400 364 0 36659 0
[pid=21989] ppid=21987 vsize=268420 CPUtime=199.26 cores=0,2,4,6
/proc/21989/stat : 21989 (hybridGM3) R 21987 21989 21989 0 -1 4202496 5165 0 0 0 19926 0 0 0 25 0 1 0 657925015 274862080 4896 33554432000 134512640 135204385 4294046944 18446744073709551615 134537792 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/21989/statm: 67105 4896 63 169 0 66935 0
[pid=21987/tid=22039] ppid=21812 vsize=403108 CPUtime=0 cores=0,2,4,6
/proc/21987/task/22039/stat : 22039 (python) S 21812 21812 21694 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 657945077 412782592 6011 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 514 18446604452273185792 0 0 -1 4 0 0 0
[pid=21991] ppid=21812 vsize=413364 CPUtime=0.28 cores=0,2,4,6
/proc/21991/stat : 21991 (python) S 21812 21812 21694 0 -1 4202560 1146 0 0 0 14 14 0 0 19 0 2 0 657925216 423284736 6015 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/21991/statm: 103341 6015 400 364 0 39220 0
[pid=21993] ppid=21991 vsize=418636 CPUtime=100.3 cores=0,2,4,6
/proc/21993/stat : 21993 (adaptg2wsat2009) T 21991 21993 21993 0 -1 4202496 1229 0 0 0 10030 0 0 0 25 0 1 0 657925217 428683264 956 33554432000 134512640 135107411 4286834048 18446744073709551615 134532107 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/21993/statm: 104659 956 59 146 0 103535 0
[pid=21991/tid=22017] ppid=21812 vsize=413364 CPUtime=0 cores=0,2,4,6
/proc/21991/task/22017/stat : 22017 (python) S 21812 21812 21694 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 657935255 423284736 6015 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 514 18446604450236027840 0 0 -1 4 0 0 0
[pid=21995] ppid=21812 vsize=423620 CPUtime=0.55 cores=0,2,4,6
/proc/21995/stat : 21995 (python) S 21812 21812 21694 0 -1 4202560 1230 0 0 0 28 27 0 0 19 0 2 0 657925426 433786880 6057 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/21995/statm: 105905 6057 408 364 0 41781 0
[pid=21997] ppid=21995 vsize=268424 CPUtime=196.25 cores=0,2,4,6
/proc/21997/stat : 21997 (hybridGM3) T 21995 21997 21997 0 -1 4202496 5171 0 0 0 19625 0 0 0 25 0 1 0 657925426 274866176 4896 33554432000 134512640 135204385 4288090128 18446744073709551615 134538395 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/21997/statm: 67106 4896 63 169 0 66936 0
[pid=21995/tid=22040] ppid=21812 vsize=423620 CPUtime=0 cores=0,2,4,6
/proc/21995/task/22040/stat : 22040 (python) S 21812 21812 21694 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 657945084 433786880 6057 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 514 18446604441456878848 0 0 -1 0 0 0 0
[pid=22018] ppid=21812 vsize=433876 CPUtime=0.27 cores=0,2,4,6
/proc/22018/stat : 22018 (python) S 21812 21812 21694 0 -1 4202560 1043 0 0 0 13 14 0 0 18 0 1 0 657935256 444289024 6032 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436037190 0 0 16781312 514 15961425582470693121 0 0 17 6 0 0 0
/proc/22018/statm: 108469 6032 379 364 0 44342 0
[pid=22020] ppid=22018 vsize=248652 CPUtime=95.93 cores=0,2,4,6
/proc/22020/stat : 22020 (FH) R 22018 22020 22020 0 -1 4202496 1132 0 0 0 9593 0 0 0 25 0 1 0 657935256 254619648 857 33554432000 134512640 134936988 4294384608 18446744073709551615 134545198 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/22020/statm: 62163 857 41 104 0 61667 0
[pid=22036] ppid=21812 vsize=444132 CPUtime=0 cores=0,2,4,6
/proc/22036/stat : 22036 (python) S 21812 21812 21694 0 -1 4202560 853 0 0 0 0 0 0 0 18 0 1 0 657944878 454791168 6013 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436037190 0 0 16781312 514 284280934679675137 0 0 17 2 0 0 0
/proc/22036/statm: 111033 6013 356 364 0 46903 0
[pid=22038] ppid=22036 vsize=268424 CPUtime=2.35 cores=0,2,4,6
/proc/22038/stat : 22038 (hybridGM3) R 22036 22038 22038 0 -1 4202496 5175 0 0 0 235 0 0 0 25 0 1 0 657944879 274866176 4896 33554432000 134512640 135204385 4292194688 18446744073709551615 134538541 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/22038/statm: 67106 4896 63 169 0 66936 0
[pid=22041] ppid=21812 vsize=454520 CPUtime=0 cores=0,2,4,6
/proc/22041/stat : 22041 (python) S 21812 21812 21694 0 -1 4202560 819 0 0 0 0 0 0 0 19 0 1 0 657945085 465428480 6009 33554432000 4194304 5683644 140736450164848 18446744073709551615 212436037190 0 0 16781312 514 13012501591087906815 0 0 17 2 0 0 0
/proc/22041/statm: 113630 6009 346 364 0 49497 0
[pid=22043] ppid=22041 vsize=453032 CPUtime=0.31 cores=0,2,4,6
/proc/22043/stat : 22043 (TNM) R 22041 22043 22043 0 -1 4202496 957 0 0 0 31 0 0 0 21 0 1 0 657945085 463904768 685 33554432000 134512640 135008748 4291592544 18446744073709551615 134523271 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/22043/statm: 113258 685 45 122 0 112158 0
[pid=21812/tid=21847] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21847/stat : 21847 (python) S 21810 21812 21694 0 -1 4202560 23 937 0 0 0 0 0 0 19 0 19 0 657895130 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 6 0 0 0
[pid=21812/tid=21850] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21850/stat : 21850 (python) S 21810 21812 21694 0 -1 4202560 25 937 0 0 0 0 0 0 21 0 19 0 657895132 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 6 0 0 0
[pid=21812/tid=21853] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21853/stat : 21853 (python) S 21810 21812 21694 0 -1 4202560 24 937 0 0 0 0 0 0 23 0 19 0 657895133 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 6 0 0 0
[pid=21812/tid=21856] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21856/stat : 21856 (python) S 21810 21812 21694 0 -1 4202560 28 937 0 0 0 0 0 0 20 0 19 0 657895134 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 2 0 0 0
[pid=21812/tid=21874] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21874/stat : 21874 (python) S 21810 21812 21694 0 -1 4202560 30 937 0 0 0 0 0 0 20 0 19 0 657905060 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 2 0 0 0
[pid=21812/tid=21895] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21895/stat : 21895 (python) S 21810 21812 21694 0 -1 4202560 24 937 0 0 0 0 0 0 20 0 19 0 657905159 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 6 0 0 0
[pid=21812/tid=21898] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21898/stat : 21898 (python) S 21810 21812 21694 0 -1 4202560 35 937 0 0 0 0 0 0 22 0 19 0 657905160 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 6 0 0 0
[pid=21812/tid=21902] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21902/stat : 21902 (python) S 21810 21812 21694 0 -1 4202560 28 937 0 0 0 0 0 0 23 0 19 0 657905162 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 2 0 0 0
[pid=21812/tid=21953] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21953/stat : 21953 (python) S 21810 21812 21694 0 -1 4202560 22 937 0 0 0 0 0 0 20 0 19 0 657915087 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 2 0 0 0
[pid=21812/tid=21958] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21958/stat : 21958 (python) S 21810 21812 21694 0 -1 4202560 23 937 0 0 0 0 0 0 20 0 19 0 657915189 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 4 0 0 0
[pid=21812/tid=21961] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21961/stat : 21961 (python) S 21810 21812 21694 0 -1 4202560 28 937 0 0 0 0 0 0 18 0 19 0 657915190 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 2 0 0 0
[pid=21812/tid=21965] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21965/stat : 21965 (python) S 21810 21812 21694 0 -1 4202560 24 937 0 0 0 0 0 0 20 0 19 0 657915494 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 2 0 0 0
[pid=21812/tid=21988] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21988/stat : 21988 (python) S 21810 21812 21694 0 -1 4202560 32 937 0 0 0 0 0 0 18 0 19 0 657925015 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 2 0 0 0
[pid=21812/tid=21992] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21992/stat : 21992 (python) S 21810 21812 21694 0 -1 4202560 27 937 0 0 0 0 0 0 20 0 19 0 657925216 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 2 0 0 0
[pid=21812/tid=21996] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/21996/stat : 21996 (python) S 21810 21812 21694 0 -1 4202560 26 937 0 0 0 0 0 0 20 0 19 0 657925426 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 2 0 0 0
[pid=21812/tid=22019] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/22019/stat : 22019 (python) S 21810 21812 21694 0 -1 4202560 27 937 0 0 0 0 0 0 20 0 19 0 657935256 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 2 0 0 0
[pid=21812/tid=22037] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/22037/stat : 22037 (python) S 21810 21812 21694 0 -1 4202560 26 937 0 0 0 0 0 0 20 0 19 0 657944878 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 2 0 0 0
[pid=21812/tid=22042] ppid=21810 vsize=464764 CPUtime=0 cores=0,2,4,6
/proc/21812/task/22042/stat : 22042 (python) S 21810 21812 21694 0 -1 4202560 25 937 0 0 0 0 0 0 20 0 19 0 657945085 475918336 7579 33554432000 4194304 5683644 140736450164848 18446744073709551615 212447840689 0 0 16781312 2 18446604453903145792 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1991.15
Current children cumulated vsize (KiB) 15940548

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21812 and gives
#  childrusage.ru_utime.tv_sec=302
#  childrusage.ru_utime.tv_usec=503012
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=889560
# CPU time returned by wait4() is 305.393
# while last known CPU time is 1991.15
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 501.631
CPU time (s): 1991.15
CPU user time (s): 1988.36
CPU system time (s): 2.79
CPU usage (%): 396.935
Max. virtual memory (cumulated for all children) (KiB): 15940548

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 302.503
system time used= 2.88956
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 63394
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8481
involuntary context switches= 2667

runsolver used 3.03554 second user time and 6.16306 second system time

The end

Launcher Data 

Begin job on node102 at 2011-05-15 14:35:26
IDJOB=3378128
IDBENCH=82537
IDSOLVER=1859
FILE ID=node102/3378128-1305462926
RUNJOBID= node102-1305462764-21712
PBS_JOBID= 13324973
Free space on /tmp= 73552 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v200-c17000-S181603592-089-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378128-1305462926/watcher-3378128-1305462926 -o /tmp/evaluation-result-3378128-1305462926/solver-3378128-1305462926 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378128-1305462926.cnf -seed 1253958526 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= af7b69f0071c372d5cdc250bc7f688e1
RANDOM SEED=1253958526

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19339572 kB
Buffers:         35276 kB
Cached:         793932 kB
SwapCached:      89916 kB
Active:        4076440 kB
Inactive:      9344416 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19339572 kB
SwapTotal:    67111528 kB
SwapFree:     57331800 kB
Dirty:           78048 kB
Writeback:           0 kB
AnonPages:    12512680 kB
Mapped:          14900 kB
Slab:            63324 kB
PageTables:      62352 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 63408960 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73584 MiB
End job on node102 at 2011-05-15 14:43:50