Trace number 3322187

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (exit code) 1197.54 400.101

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v125-c2662-S1300400916-048.SATISFIABLE.cnf
MD5SUM2d20051b8a7a248788d1c2610fe5ea54
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.023995
Satisfiable
(Un)Satisfiability was proved
Number of variables125
Number of clauses2662
Sum of the clauses size13310
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 52662
Number of clauses of size over 50

Solver Data 

0.32/0.46	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.46	c INFO: solving HOME/instance-3322187-1304375590.cnf
0.32/0.46	c INFO: computing task features
0.32/0.48	c INFO: computed variable-clause graph statistics
0.32/0.48	c INFO: computed clause balance statistics
0.41/0.55	c INFO: computed variable balance statistics
0.41/0.58	c INFO: computed small-clause counts
0.41/0.58	c INFO: computed Horn-clause counts
0.41/0.59	c INFO: computed variable graph statistics
0.41/0.59	c INFO: collected features for HOME/instance-3322187-1304375590.cnf in 0.12 s
0.51/0.62	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.63)
0.51/0.66	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.07)
0.62/0.70	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.30)
0.62/0.73	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.31)
0.62/0.77	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.28)
0.74/0.81	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.25)
0.74/0.85	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.22)
0.74/0.89	c INFO: running march_hi@0 for 388 with 39999 remaining (b = 0.16)
0.74/0.89	Traceback (most recent call last):
0.74/0.89	  File "HOME/solve", line 33, in <module>
0.74/0.89	    plac.call(main)
0.74/0.89	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 311, in call
0.74/0.89	    cmd, result = parser_from(obj).consume(arglist)
0.74/0.89	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 192, in consume
0.74/0.89	    return cmd, self.func(*(args + varargs + extraopts), **kwargs)
0.74/0.89	  File "HOME/borg/build/lib/borg/tools/solve.py", line 84, in main
0.74/0.89	    (_, answer, _) = solver(input_path, budget, cores)
0.74/0.89	  File "HOME/borg/build/lib/borg/bilevel.py", line 226, in __call__
0.74/0.89	    process.die()
0.74/0.89	  File "HOME/borg/build/lib/borg/solvers.py", line 185, in die
0.74/0.89	    os.kill(self._process.pid, signal.SIGUSR1)
0.74/0.89	OSError: [Errno 3] No such process

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322187-1304375590/watcher-3322187-1304375590 -o /tmp/evaluation-result-3322187-1304375590/solver-3322187-1304375590 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322187-1304375590.cnf -seed 2009912455 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.82 8.22 8.40 1/283 30436
/proc/meminfo: memFree=14493400/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=15780 CPUtime=0 cores=0-7
/proc/30436/stat : 30436 (python) S 30434 30436 28873 0 -1 4202496 927 0 0 0 0 0 0 0 20 0 1 0 549157763 16158720 806 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594864640 0 2147483391 16781312 2 18446744071699215550 0 0 17 2 0 0 0
/proc/30436/statm: 3945 806 356 364 0 432 0

[startup+0.051088 s]
/proc/loadavg: 6.82 8.22 8.40 1/283 30436
/proc/meminfo: memFree=14493400/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=29792 CPUtime=0.02 cores=0-7
/proc/30436/stat : 30436 (python) R 30434 30436 28873 0 -1 4202496 1460 0 0 0 2 0 0 0 20 0 1 0 549157763 30507008 1299 33554432000 4194304 5683644 140734546171968 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/30436/statm: 7448 1299 443 364 0 818 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 29792

[startup+0.101078 s]
/proc/loadavg: 6.82 8.22 8.40 1/283 30436
/proc/meminfo: memFree=14493400/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=104232 CPUtime=0.07 cores=0-7
/proc/30436/stat : 30436 (python) R 30434 30436 28873 0 -1 4202496 3078 0 0 0 5 2 0 0 17 0 1 0 549157763 106733568 2758 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594866432 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/30436/statm: 26058 2764 847 364 0 1806 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104232

[startup+0.301056 s]
/proc/loadavg: 6.82 8.22 8.40 1/283 30436
/proc/meminfo: memFree=14493400/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=187744 CPUtime=0.24 cores=0-7
/proc/30436/stat : 30436 (python) R 30434 30436 28873 0 -1 4202496 6800 932 1 0 18 6 0 0 18 0 1 0 549157763 192249856 4864 33554432000 4194304 5683644 140734546171968 18446744073709551615 235589903848 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/30436/statm: 46936 4864 1383 364 0 3724 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 187744

[startup+0.700974 s]
/proc/loadavg: 6.82 8.22 8.40 1/283 30436
/proc/meminfo: memFree=14493400/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=299588 CPUtime=0.62 cores=0-7
/proc/30436/stat : 30436 (python) R 30434 30436 28873 0 -1 4202496 11142 2428 1 0 52 8 2 0 22 0 3 0 549157763 306778112 7225 33554432000 4194304 5683644 140734546171968 18446744073709551615 4539735 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/30436/statm: 74897 7225 1876 364 0 10812 0
Current children cumulated CPU time (s) 0.62
Current children cumulated vsize (KiB) 299588

[startup+1.50089 s]
/proc/loadavg: 6.82 8.22 8.40 5/291 30467
/proc/meminfo: memFree=14455012/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=375576 CPUtime=1.08 cores=0-7
/proc/30436/stat : 30436 (python) S 30434 30436 28873 0 -1 4202496 15690 7377 1 0 70 10 26 2 19 0 1 0 549157763 384589824 7390 33554432000 4194304 5683644 140734546171968 18446744073709551615 235606696767 0 0 16781312 2 18446744071562232103 0 0 17 4 0 0 0
/proc/30436/statm: 93894 7390 1891 364 0 29791 0
[pid=30453] ppid=30436 vsize=309992 CPUtime=0 cores=0-7
/proc/30453/stat : 30453 (python) S 30436 30436 28873 0 -1 4202560 761 0 0 0 0 0 0 0 17 0 1 0 549157837 317431808 5718 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 7660244738452193537 0 0 17 3 0 0 0
/proc/30453/statm: 77498 5718 348 364 0 13407 0
[pid=30455] ppid=30453 vsize=1992 CPUtime=0.75 cores=0-7
/proc/30455/stat : 30455 (march_hi) R 30453 30455 30455 0 -1 4202496 603 0 0 0 75 0 0 0 25 0 1 0 549157837 2039808 337 33554432000 4194304 4955518 140736398232096 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30455/statm: 498 337 106 186 0 311 0
[pid=30456] ppid=30436 vsize=385784 CPUtime=0 cores=0-7
/proc/30456/stat : 30456 (python) S 30436 30436 28873 0 -1 4202560 734 0 0 0 0 0 0 0 15 0 1 0 549157841 395042816 5895 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 13193321500955869443 0 0 17 1 0 0 0
/proc/30456/statm: 96446 5895 348 364 0 32352 0
[pid=30458] ppid=30456 vsize=1992 CPUtime=0.71 cores=0-7
/proc/30458/stat : 30458 (march_hi) R 30456 30458 30458 0 -1 4202496 590 0 0 0 71 0 0 0 22 0 1 0 549157841 2039808 335 33554432000 4194304 4955518 140734916629216 18446744073709551615 4206595 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/30458/statm: 498 335 106 186 0 311 0
[pid=30459] ppid=30436 vsize=396040 CPUtime=0 cores=0-7
/proc/30459/stat : 30459 (python) S 30436 30436 28873 0 -1 4202560 736 0 0 0 0 0 0 0 17 0 1 0 549157845 405544960 5871 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 13193312704862847236 0 0 17 1 0 0 0
/proc/30459/statm: 99010 5871 348 364 0 34913 0
[pid=30461] ppid=30459 vsize=1992 CPUtime=0.68 cores=0-7
/proc/30461/stat : 30461 (march_hi) R 30459 30461 30461 0 -1 4202496 588 0 0 0 68 0 0 0 24 0 1 0 549157845 2039808 332 33554432000 4194304 4955518 140733558902080 18446744073709551615 4297472 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30461/statm: 498 332 106 186 0 311 0
Current children cumulated CPU time (s) 3.22
Current children cumulated vsize (KiB) 1473368

[startup+3.10055 s]
/proc/loadavg: 6.82 8.22 8.40 5/291 30467
/proc/meminfo: memFree=14453524/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=375576 CPUtime=1.08 cores=0-7
/proc/30436/stat : 30436 (python) S 30434 30436 28873 0 -1 4202496 15690 7377 1 0 70 10 26 2 19 0 1 0 549157763 384589824 7390 33554432000 4194304 5683644 140734546171968 18446744073709551615 235606696767 0 0 16781312 2 18446744071562232103 0 0 17 4 0 0 0
/proc/30436/statm: 93894 7390 1891 364 0 29791 0
[pid=30453] ppid=30436 vsize=309992 CPUtime=0 cores=0-7
/proc/30453/stat : 30453 (python) S 30436 30436 28873 0 -1 4202560 763 0 0 0 0 0 0 0 15 0 1 0 549157837 317431808 5718 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 7660244738452193537 0 0 17 3 0 0 0
/proc/30453/statm: 77498 5718 348 364 0 13407 0
[pid=30455] ppid=30453 vsize=2472 CPUtime=2.35 cores=0-7
/proc/30455/stat : 30455 (march_hi) R 30453 30455 30455 0 -1 4202496 701 0 0 0 235 0 0 0 25 0 1 0 549157837 2531328 435 33554432000 4194304 4955518 140736398232096 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30455/statm: 618 435 106 186 0 431 0
[pid=30456] ppid=30436 vsize=385784 CPUtime=0 cores=0-7
/proc/30456/stat : 30456 (python) S 30436 30436 28873 0 -1 4202560 736 0 0 0 0 0 0 0 15 0 1 0 549157841 395042816 5895 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 13193321500955869443 0 0 17 1 0 0 0
/proc/30456/statm: 96446 5895 348 364 0 32352 0
[pid=30458] ppid=30456 vsize=2472 CPUtime=2.31 cores=0-7
/proc/30458/stat : 30458 (march_hi) R 30456 30458 30458 0 -1 4202496 689 0 0 0 231 0 0 0 25 0 1 0 549157841 2531328 434 33554432000 4194304 4955518 140734916629216 18446744073709551615 4224471 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/30458/statm: 618 434 106 186 0 431 0
[pid=30459] ppid=30436 vsize=396040 CPUtime=0 cores=0-7
/proc/30459/stat : 30459 (python) S 30436 30436 28873 0 -1 4202560 738 0 0 0 0 0 0 0 15 0 1 0 549157845 405544960 5871 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 13193312704862847236 0 0 17 1 0 0 0
/proc/30459/statm: 99010 5871 348 364 0 34913 0
[pid=30461] ppid=30459 vsize=2472 CPUtime=2.28 cores=0-7
/proc/30461/stat : 30461 (march_hi) R 30459 30461 30461 0 -1 4202496 687 0 0 0 228 0 0 0 25 0 1 0 549157845 2531328 431 33554432000 4194304 4955518 140733558902080 18446744073709551615 4237818 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30461/statm: 618 431 106 186 0 431 0
Current children cumulated CPU time (s) 8.02
Current children cumulated vsize (KiB) 1474808

[startup+6.30099 s]
/proc/loadavg: 6.60 8.15 8.38 5/291 30467
/proc/meminfo: memFree=14451548/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=375576 CPUtime=1.08 cores=0-7
/proc/30436/stat : 30436 (python) S 30434 30436 28873 0 -1 4202496 15690 7377 1 0 70 10 26 2 19 0 1 0 549157763 384589824 7390 33554432000 4194304 5683644 140734546171968 18446744073709551615 235606696767 0 0 16781312 2 18446744071562232103 0 0 17 4 0 0 0
/proc/30436/statm: 93894 7390 1891 364 0 29791 0
[pid=30453] ppid=30436 vsize=309992 CPUtime=0 cores=0-7
/proc/30453/stat : 30453 (python) S 30436 30436 28873 0 -1 4202560 913 0 0 0 0 0 0 0 15 0 1 0 549157837 317431808 5741 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 7660244738452193537 0 0 17 3 0 0 0
/proc/30453/statm: 77498 5741 371 364 0 13407 0
[pid=30455] ppid=30453 vsize=3324 CPUtime=5.55 cores=0-7
/proc/30455/stat : 30455 (march_hi) R 30453 30455 30455 0 -1 4202496 867 0 0 0 555 0 0 0 25 0 1 0 549157837 3403776 601 33554432000 4194304 4955518 140736398232096 18446744073709551615 4224471 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30455/statm: 831 601 106 186 0 644 0
[pid=30456] ppid=30436 vsize=385784 CPUtime=0 cores=0-7
/proc/30456/stat : 30456 (python) S 30436 30436 28873 0 -1 4202560 809 0 0 0 0 0 0 0 15 0 1 0 549157841 395042816 5918 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 13193321500955869443 0 0 17 1 0 0 0
/proc/30456/statm: 96446 5918 371 364 0 32352 0
[pid=30458] ppid=30456 vsize=3324 CPUtime=5.51 cores=0-7
/proc/30458/stat : 30458 (march_hi) R 30456 30458 30458 0 -1 4202496 857 0 0 0 551 0 0 0 25 0 1 0 549157841 3403776 602 33554432000 4194304 4955518 140734916629216 18446744073709551615 4237810 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/30458/statm: 831 602 106 186 0 644 0
[pid=30459] ppid=30436 vsize=396040 CPUtime=0 cores=0-7
/proc/30459/stat : 30459 (python) S 30436 30436 28873 0 -1 4202560 814 0 0 0 0 0 0 0 15 0 1 0 549157845 405544960 5894 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 13193312704862847236 0 0 17 1 0 0 0
/proc/30459/statm: 99010 5894 371 364 0 34913 0
[pid=30461] ppid=30459 vsize=3324 CPUtime=5.48 cores=0-7
/proc/30461/stat : 30461 (march_hi) R 30459 30461 30461 0 -1 4202496 854 0 0 0 548 0 0 0 25 0 1 0 549157845 3403776 598 33554432000 4194304 4955518 140733558902080 18446744073709551615 4224503 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30461/statm: 831 598 106 186 0 644 0
Current children cumulated CPU time (s) 17.62
Current children cumulated vsize (KiB) 1477364

[startup+12.7009 s]
/proc/loadavg: 6.39 8.08 8.35 5/291 30467
/proc/meminfo: memFree=14446984/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=375576 CPUtime=1.08 cores=0-7
/proc/30436/stat : 30436 (python) S 30434 30436 28873 0 -1 4202496 15690 7377 1 0 70 10 26 2 19 0 1 0 549157763 384589824 7390 33554432000 4194304 5683644 140734546171968 18446744073709551615 235606696767 0 0 16781312 2 18446744071562232103 0 0 17 4 0 0 0
/proc/30436/statm: 93894 7390 1891 364 0 29791 0
[pid=30453] ppid=30436 vsize=309992 CPUtime=0.01 cores=0-7
/proc/30453/stat : 30453 (python) S 30436 30436 28873 0 -1 4202560 916 0 0 0 1 0 0 0 15 0 1 0 549157837 317431808 5741 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 7660244738452193537 0 0 17 3 0 0 0
/proc/30453/statm: 77498 5741 371 364 0 13407 0
[pid=30455] ppid=30453 vsize=5240 CPUtime=11.94 cores=0-7
/proc/30455/stat : 30455 (march_hi) R 30453 30455 30455 0 -1 4202496 1217 0 0 0 1194 0 0 0 25 0 1 0 549157837 5365760 951 33554432000 4194304 4955518 140736398232096 18446744073709551615 4297490 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30455/statm: 1310 951 106 186 0 1123 0
[pid=30456] ppid=30436 vsize=385784 CPUtime=0.02 cores=0-7
/proc/30456/stat : 30456 (python) S 30436 30436 28873 0 -1 4202560 810 0 0 0 1 1 0 0 15 0 1 0 549157841 395042816 5918 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 13193321500955869443 0 0 17 1 0 0 0
/proc/30456/statm: 96446 5918 371 364 0 32352 0
[pid=30458] ppid=30456 vsize=5240 CPUtime=11.91 cores=0-7
/proc/30458/stat : 30458 (march_hi) R 30456 30458 30458 0 -1 4202496 1208 0 0 0 1191 0 0 0 25 0 1 0 549157841 5365760 953 33554432000 4194304 4955518 140734916629216 18446744073709551615 4208784 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/30458/statm: 1310 953 106 186 0 1123 0
[pid=30459] ppid=30436 vsize=396040 CPUtime=0.02 cores=0-7
/proc/30459/stat : 30459 (python) S 30436 30436 28873 0 -1 4202560 818 0 0 0 1 1 0 0 15 0 1 0 549157845 405544960 5894 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 13193312704862847236 0 0 17 1 0 0 0
/proc/30459/statm: 99010 5894 371 364 0 34913 0
[pid=30461] ppid=30459 vsize=5240 CPUtime=11.88 cores=0-7
/proc/30461/stat : 30461 (march_hi) R 30459 30461 30461 0 -1 4202496 1205 0 0 0 1188 0 0 0 25 0 1 0 549157845 5365760 949 33554432000 4194304 4955518 140733558902080 18446744073709551615 4237750 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30461/statm: 1310 949 106 186 0 1123 0
Current children cumulated CPU time (s) 36.86
Current children cumulated vsize (KiB) 1483112

[startup+25.5006 s]
/proc/loadavg: 5.86 7.88 8.28 5/291 30467
/proc/meminfo: memFree=14438372/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=375576 CPUtime=1.08 cores=0-7
/proc/30436/stat : 30436 (python) S 30434 30436 28873 0 -1 4202496 15690 7377 1 0 70 10 26 2 19 0 1 0 549157763 384589824 7390 33554432000 4194304 5683644 140734546171968 18446744073709551615 235606696767 0 0 16781312 2 18446744071562232103 0 0 17 4 0 0 0
/proc/30436/statm: 93894 7390 1891 364 0 29791 0
[pid=30453] ppid=30436 vsize=309992 CPUtime=0.04 cores=0-7
/proc/30453/stat : 30453 (python) S 30436 30436 28873 0 -1 4202560 921 0 0 0 3 1 0 0 15 0 1 0 549157837 317431808 5741 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 7660244738452193537 0 0 17 3 0 0 0
/proc/30453/statm: 77498 5741 371 364 0 13407 0
[pid=30455] ppid=30453 vsize=9760 CPUtime=24.73 cores=0-7
/proc/30455/stat : 30455 (march_hi) R 30453 30455 30455 0 -1 4202496 1907 0 0 0 2473 0 0 0 25 0 1 0 549157837 9994240 1641 33554432000 4194304 4955518 140736398232096 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/30455/statm: 2440 1641 106 186 0 2253 0
[pid=30456] ppid=30436 vsize=385784 CPUtime=0.04 cores=0-7
/proc/30456/stat : 30456 (python) S 30436 30436 28873 0 -1 4202560 812 0 0 0 2 2 0 0 15 0 1 0 549157841 395042816 5918 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 13193321500955869443 0 0 17 1 0 0 0
/proc/30456/statm: 96446 5918 371 364 0 32352 0
[pid=30458] ppid=30456 vsize=9760 CPUtime=24.71 cores=0-7
/proc/30458/stat : 30458 (march_hi) R 30456 30458 30458 0 -1 4202496 1903 0 0 0 2471 0 0 0 25 0 1 0 549157841 9994240 1648 33554432000 4194304 4955518 140734916629216 18446744073709551615 4235624 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/30458/statm: 2440 1648 106 186 0 2253 0
[pid=30459] ppid=30436 vsize=396040 CPUtime=0.05 cores=0-7
/proc/30459/stat : 30459 (python) S 30436 30436 28873 0 -1 4202560 818 0 0 0 3 2 0 0 15 0 1 0 549157845 405544960 5894 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 13193312704862847236 0 0 17 1 0 0 0
/proc/30459/statm: 99010 5894 371 364 0 34913 0
[pid=30461] ppid=30459 vsize=9760 CPUtime=24.68 cores=0-7
/proc/30461/stat : 30461 (march_hi) R 30459 30461 30461 0 -1 4202496 1897 0 0 0 2468 0 0 0 25 0 1 0 549157845 9994240 1641 33554432000 4194304 4955518 140733558902080 18446744073709551615 4208669 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30461/statm: 2440 1641 106 186 0 2253 0
Current children cumulated CPU time (s) 75.33
Current children cumulated vsize (KiB) 1496672

[startup+51.1011 s]

################
# More data... #
################

[pid=30459] ppid=30436 vsize=396040 CPUtime=0.75 cores=0-7
/proc/30459/stat : 30459 (python) S 30436 30436 28873 0 -1 4202560 820 0 0 0 40 35 0 0 15 0 1 0 549157845 405544960 5894 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 13193312704862847236 0 0 17 1 0 0 0
/proc/30459/statm: 99010 5894 371 364 0 34913 0
[pid=30461] ppid=30459 vsize=93528 CPUtime=357.48 cores=0-7
/proc/30461/stat : 30461 (march_hi) R 30459 30461 30461 0 -1 4202496 16808 0 0 0 35745 3 0 0 25 0 1 0 549157845 95772672 16552 33554432000 4194304 4955518 140733558902080 18446744073709551615 4210533 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30461/statm: 23382 16552 106 186 0 23195 0
Current children cumulated CPU time (s) 1075.48
Current children cumulated vsize (KiB) 1747976

[startup+383.911 s]
/proc/loadavg: 4.08 5.20 6.92 5/291 30477
/proc/meminfo: memFree=14181820/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=375576 CPUtime=1.08 cores=0-7
/proc/30436/stat : 30436 (python) S 30434 30436 28873 0 -1 4202496 15690 7377 1 0 70 10 26 2 19 0 1 0 549157763 384589824 7390 33554432000 4194304 5683644 140734546171968 18446744073709551615 235606696767 0 0 16781312 2 18446744071562232103 0 0 17 4 0 0 0
/proc/30436/statm: 93894 7390 1891 364 0 29791 0
[pid=30453] ppid=30436 vsize=309992 CPUtime=0.8 cores=0-7
/proc/30453/stat : 30453 (python) S 30436 30436 28873 0 -1 4202560 998 0 0 0 42 38 0 0 15 0 1 0 549157837 317431808 5741 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 11834949647334342913 0 0 17 3 0 0 0
/proc/30453/statm: 77498 5741 371 364 0 13407 0
[pid=30455] ppid=30453 vsize=93528 CPUtime=382.71 cores=0-7
/proc/30455/stat : 30455 (march_hi) R 30453 30455 30455 0 -1 4202496 17876 0 0 0 38268 3 0 0 25 0 1 0 549157837 95772672 17610 33554432000 4194304 4955518 140736398232096 18446744073709551615 4208722 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30455/statm: 23382 17610 106 186 0 23195 0
[pid=30456] ppid=30436 vsize=385784 CPUtime=0.8 cores=0-7
/proc/30456/stat : 30456 (python) S 30436 30436 28873 0 -1 4202560 813 0 0 0 42 38 0 0 15 0 1 0 549157841 395042816 5918 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 11834949647334342915 0 0 17 1 0 0 0
/proc/30456/statm: 96446 5918 371 364 0 32352 0
[pid=30458] ppid=30456 vsize=93528 CPUtime=383.13 cores=0-7
/proc/30458/stat : 30458 (march_hi) R 30456 30458 30458 0 -1 4202496 17962 0 0 0 38310 3 0 0 25 0 1 0 549157841 95772672 17707 33554432000 4194304 4955518 140734916629216 18446744073709551615 4297429 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/30458/statm: 23382 17707 106 186 0 23195 0
[pid=30459] ppid=30436 vsize=396040 CPUtime=0.81 cores=0-7
/proc/30459/stat : 30459 (python) S 30436 30436 28873 0 -1 4202560 820 0 0 0 44 37 0 0 15 0 1 0 549157845 405544960 5894 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 11834949647334342916 0 0 17 1 0 0 0
/proc/30459/statm: 99010 5894 371 364 0 34913 0
[pid=30461] ppid=30459 vsize=93528 CPUtime=383.09 cores=0-7
/proc/30461/stat : 30461 (march_hi) R 30459 30461 30461 0 -1 4202496 17909 0 0 0 38305 4 0 0 25 0 1 0 549157845 95772672 17653 33554432000 4194304 4955518 140733558902080 18446744073709551615 4208638 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30461/statm: 23382 17653 106 186 0 23195 0
Current children cumulated CPU time (s) 1152.42
Current children cumulated vsize (KiB) 1747976

[startup+390.3 s]
/proc/loadavg: 4.07 5.18 6.90 5/291 30477
/proc/meminfo: memFree=14178596/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=375576 CPUtime=1.08 cores=0-7
/proc/30436/stat : 30436 (python) S 30434 30436 28873 0 -1 4202496 15690 7377 1 0 70 10 26 2 19 0 1 0 549157763 384589824 7390 33554432000 4194304 5683644 140734546171968 18446744073709551615 235606696767 0 0 16781312 2 18446744071562232103 0 0 17 4 0 0 0
/proc/30436/statm: 93894 7390 1891 364 0 29791 0
[pid=30453] ppid=30436 vsize=309992 CPUtime=0.82 cores=0-7
/proc/30453/stat : 30453 (python) S 30436 30436 28873 0 -1 4202560 998 0 0 0 43 39 0 0 15 0 1 0 549157837 317431808 5741 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 11834949647334342913 0 0 17 3 0 0 0
/proc/30453/statm: 77498 5741 371 364 0 13407 0
[pid=30455] ppid=30453 vsize=93528 CPUtime=389.09 cores=0-7
/proc/30455/stat : 30455 (march_hi) R 30453 30455 30455 0 -1 4202496 18121 0 0 0 38906 3 0 0 25 0 1 0 549157837 95772672 17855 33554432000 4194304 4955518 140736398232096 18446744073709551615 4237810 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30455/statm: 23382 17855 106 186 0 23195 0
[pid=30456] ppid=30436 vsize=385784 CPUtime=0.82 cores=0-7
/proc/30456/stat : 30456 (python) S 30436 30436 28873 0 -1 4202560 813 0 0 0 43 39 0 0 15 0 1 0 549157841 395042816 5918 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 13193321500955869443 0 0 17 1 0 0 0
/proc/30456/statm: 96446 5918 371 364 0 32352 0
[pid=30458] ppid=30456 vsize=93528 CPUtime=389.52 cores=0-7
/proc/30458/stat : 30458 (march_hi) R 30456 30458 30458 0 -1 4202496 18206 0 0 0 38949 3 0 0 25 0 1 0 549157841 95772672 17951 33554432000 4194304 4955518 140734916629216 18446744073709551615 4224471 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/30458/statm: 23382 17951 106 186 0 23195 0
[pid=30459] ppid=30436 vsize=396040 CPUtime=0.82 cores=0-7
/proc/30459/stat : 30459 (python) S 30436 30436 28873 0 -1 4202560 820 0 0 0 45 37 0 0 15 0 1 0 549157845 405544960 5894 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 11834949647334342916 0 0 17 1 0 0 0
/proc/30459/statm: 99010 5894 371 364 0 34913 0
[pid=30461] ppid=30459 vsize=93528 CPUtime=389.48 cores=0-7
/proc/30461/stat : 30461 (march_hi) R 30459 30461 30461 0 -1 4202496 18144 0 0 0 38944 4 0 0 25 0 1 0 549157845 95772672 17888 33554432000 4194304 4955518 140733558902080 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30461/statm: 23382 17888 106 186 0 23195 0
Current children cumulated CPU time (s) 1171.63
Current children cumulated vsize (KiB) 1747976

[startup+396.7 s]
/proc/loadavg: 4.06 5.14 6.87 5/291 30477
/proc/meminfo: memFree=14174008/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=375576 CPUtime=1.08 cores=0-7
/proc/30436/stat : 30436 (python) S 30434 30436 28873 0 -1 4202496 15690 7377 1 0 70 10 26 2 19 0 1 0 549157763 384589824 7390 33554432000 4194304 5683644 140734546171968 18446744073709551615 235606696767 0 0 16781312 2 18446744071562232103 0 0 17 4 0 0 0
/proc/30436/statm: 93894 7390 1891 364 0 29791 0
[pid=30453] ppid=30436 vsize=309992 CPUtime=0.83 cores=0-7
/proc/30453/stat : 30453 (python) S 30436 30436 28873 0 -1 4202560 998 0 0 0 44 39 0 0 15 0 1 0 549157837 317431808 5741 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 11834949647334342913 0 0 17 3 0 0 0
/proc/30453/statm: 77498 5741 371 364 0 13407 0
[pid=30455] ppid=30453 vsize=93528 CPUtime=395.49 cores=0-7
/proc/30455/stat : 30455 (march_hi) R 30453 30455 30455 0 -1 4202496 18392 0 0 0 39546 3 0 0 25 0 1 0 549157837 95772672 18126 33554432000 4194304 4955518 140736398232096 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30455/statm: 23382 18126 106 186 0 23195 0
[pid=30456] ppid=30436 vsize=385784 CPUtime=0.83 cores=0-7
/proc/30456/stat : 30456 (python) S 30436 30436 28873 0 -1 4202560 813 0 0 0 44 39 0 0 15 0 1 0 549157841 395042816 5918 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 11834949647334342915 0 0 17 1 0 0 0
/proc/30456/statm: 96446 5918 371 364 0 32352 0
[pid=30458] ppid=30456 vsize=93528 CPUtime=395.92 cores=0-7
/proc/30458/stat : 30458 (march_hi) R 30456 30458 30458 0 -1 4202496 18481 0 0 0 39589 3 0 0 25 0 1 0 549157841 95772672 18226 33554432000 4194304 4955518 140734916629216 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/30458/statm: 23382 18226 106 186 0 23195 0
[pid=30459] ppid=30436 vsize=396040 CPUtime=0.84 cores=0-7
/proc/30459/stat : 30459 (python) S 30436 30436 28873 0 -1 4202560 820 0 0 0 46 38 0 0 15 0 1 0 549157845 405544960 5894 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 11834949647334342916 0 0 17 1 0 0 0
/proc/30459/statm: 99010 5894 371 364 0 34913 0
[pid=30461] ppid=30459 vsize=93528 CPUtime=395.88 cores=0-7
/proc/30461/stat : 30461 (march_hi) R 30459 30461 30461 0 -1 4202496 18425 0 0 0 39584 4 0 0 25 0 1 0 549157845 95772672 18169 33554432000 4194304 4955518 140733558902080 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30461/statm: 23382 18169 106 186 0 23195 0
Current children cumulated CPU time (s) 1190.87
Current children cumulated vsize (KiB) 1747976

[startup+398.301 s]
/proc/loadavg: 4.06 5.14 6.87 4/289 30478
/proc/meminfo: memFree=14247556/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=375576 CPUtime=398.67 cores=0-7
/proc/30436/stat : 30436 (python) S 30434 30436 28873 0 -1 4202496 15690 27014 1 0 70 10 39741 46 18 0 1 0 549157763 384589824 7390 33554432000 4194304 5683644 140734546171968 18446744073709551615 235606696767 0 0 16781312 2 18446744071562232103 0 0 17 4 0 0 0
/proc/30436/statm: 93894 7390 1891 364 0 29791 0
[pid=30453] ppid=30436 vsize=309992 CPUtime=0.83 cores=0-7
/proc/30453/stat : 30453 (python) S 30436 30436 28873 0 -1 4202560 998 0 0 0 44 39 0 0 15 0 1 0 549157837 317431808 5741 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 11834949647334342913 0 0 17 3 0 0 0
/proc/30453/statm: 77498 5741 371 364 0 13407 0
[pid=30455] ppid=30453 vsize=93528 CPUtime=397.09 cores=0-7
/proc/30455/stat : 30455 (march_hi) R 30453 30455 30455 0 -1 4202496 18458 0 0 0 39706 3 0 0 25 0 1 0 549157837 95772672 18192 33554432000 4194304 4955518 140736398232096 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30455/statm: 23382 18192 106 186 0 23195 0
[pid=30459] ppid=30436 vsize=396040 CPUtime=0.84 cores=0-7
/proc/30459/stat : 30459 (python) S 30436 30436 28873 0 -1 4202560 820 0 0 0 46 38 0 0 15 0 1 0 549157845 405544960 5894 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 11834949647334342916 0 0 17 1 0 0 0
/proc/30459/statm: 99010 5894 371 364 0 34913 0
[pid=30461] ppid=30459 vsize=93528 CPUtime=397.48 cores=0-7
/proc/30461/stat : 30461 (march_hi) R 30459 30461 30461 0 -1 4202496 18484 0 0 0 39744 4 0 0 25 0 1 0 549157845 95772672 18228 33554432000 4194304 4955518 140733558902080 18446744073709551615 4297502 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30461/statm: 23382 18228 106 186 0 23195 0
Current children cumulated CPU time (s) 1194.91
Current children cumulated vsize (KiB) 1268664

[startup+399.101 s]
/proc/loadavg: 4.06 5.14 6.87 4/289 30478
/proc/meminfo: memFree=14247556/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=375576 CPUtime=797.77 cores=0-7
/proc/30436/stat : 30436 (python) S 30434 30436 28873 0 -1 4202496 15690 46622 1 0 70 10 79607 90 18 0 1 0 549157763 384589824 7390 33554432000 4194304 5683644 140734546171968 18446744073709551615 235606696767 0 0 16781312 2 18446744071562232103 0 0 17 4 0 0 0
/proc/30436/statm: 93894 7390 1891 364 0 29791 0
[pid=30453] ppid=30436 vsize=309992 CPUtime=0.84 cores=0-7
/proc/30453/stat : 30453 (python) S 30436 30436 28873 0 -1 4202560 998 0 0 0 44 40 0 0 15 0 1 0 549157837 317431808 5741 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 11834949647334342913 0 0 17 3 0 0 0
/proc/30453/statm: 77498 5741 371 364 0 13407 0
[pid=30455] ppid=30453 vsize=93528 CPUtime=397.88 cores=0-7
/proc/30455/stat : 30455 (march_hi) R 30453 30455 30455 0 -1 4202496 18488 0 0 0 39785 3 0 0 25 0 1 0 549157837 95772672 18222 33554432000 4194304 4955518 140736398232096 18446744073709551615 4224427 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/30455/statm: 23382 18222 106 186 0 23195 0
Current children cumulated CPU time (s) 1196.49
Current children cumulated vsize (KiB) 779096

[startup+399.501 s]
/proc/loadavg: 4.06 5.14 6.87 3/287 30479
/proc/meminfo: memFree=14322964/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=375576 CPUtime=797.77 cores=0-7
/proc/30436/stat : 30436 (python) S 30434 30436 28873 0 -1 4202496 15690 46622 1 0 70 10 79607 90 18 0 1 0 549157763 384589824 7390 33554432000 4194304 5683644 140734546171968 18446744073709551615 235606696767 0 0 16781312 2 18446744071562232103 0 0 17 4 0 0 0
/proc/30436/statm: 93894 7390 1891 364 0 29791 0
[pid=30453] ppid=30436 vsize=309992 CPUtime=0.84 cores=0-7
/proc/30453/stat : 30453 (python) S 30436 30436 28873 0 -1 4202560 998 0 0 0 44 40 0 0 15 0 1 0 549157837 317431808 5741 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 11834949647334342913 0 0 17 3 0 0 0
/proc/30453/statm: 77498 5741 371 364 0 13407 0
[pid=30455] ppid=30453 vsize=93528 CPUtime=398.28 cores=0-7
/proc/30455/stat : 30455 (march_hi) R 30453 30455 30455 0 -1 4202496 18499 0 0 0 39825 3 0 0 25 0 1 0 549157837 95772672 18233 33554432000 4194304 4955518 140736398232096 18446744073709551615 4285697 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30455/statm: 23382 18233 106 186 0 23195 0
Current children cumulated CPU time (s) 1196.89
Current children cumulated vsize (KiB) 779096

[startup+399.901 s]
/proc/loadavg: 4.06 5.14 6.87 3/287 30479
/proc/meminfo: memFree=14322964/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=375576 CPUtime=797.77 cores=0-7
/proc/30436/stat : 30436 (python) S 30434 30436 28873 0 -1 4202496 15690 46622 1 0 70 10 79607 90 18 0 1 0 549157763 384589824 7390 33554432000 4194304 5683644 140734546171968 18446744073709551615 235606696767 0 0 16781312 2 18446744071562232103 0 0 17 4 0 0 0
/proc/30436/statm: 93894 7390 1891 364 0 29791 0
[pid=30453] ppid=30436 vsize=309992 CPUtime=0.84 cores=0-7
/proc/30453/stat : 30453 (python) S 30436 30436 28873 0 -1 4202560 998 0 0 0 44 40 0 0 15 0 1 0 549157837 317431808 5741 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 7660244738452193537 0 0 17 3 0 0 0
/proc/30453/statm: 77498 5741 371 364 0 13407 0
[pid=30455] ppid=30453 vsize=93528 CPUtime=398.68 cores=0-7
/proc/30455/stat : 30455 (march_hi) R 30453 30455 30455 0 -1 4202496 18519 0 0 0 39865 3 0 0 25 0 1 0 549157837 95772672 18253 33554432000 4194304 4955518 140736398232096 18446744073709551615 4208634 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30455/statm: 23382 18253 106 186 0 23195 0
Current children cumulated CPU time (s) 1197.29
Current children cumulated vsize (KiB) 779096

[startup+400.001 s]
/proc/loadavg: 4.06 5.14 6.87 3/287 30479
/proc/meminfo: memFree=14322964/32950928 swapFree=67111404/67111528
[pid=30436] ppid=30434 vsize=375576 CPUtime=797.77 cores=0-7
/proc/30436/stat : 30436 (python) S 30434 30436 28873 0 -1 4202496 15690 46622 1 0 70 10 79607 90 18 0 1 0 549157763 384589824 7390 33554432000 4194304 5683644 140734546171968 18446744073709551615 235606696767 0 0 16781312 2 18446744071562232103 0 0 17 4 0 0 0
/proc/30436/statm: 93894 7390 1891 364 0 29791 0
[pid=30453] ppid=30436 vsize=309992 CPUtime=0.84 cores=0-7
/proc/30453/stat : 30453 (python) S 30436 30436 28873 0 -1 4202560 998 0 0 0 44 40 0 0 15 0 1 0 549157837 317431808 5741 33554432000 4194304 5683644 140734546171968 18446744073709551615 235594886726 0 0 16781312 514 7660244738452193537 0 0 17 3 0 0 0
/proc/30453/statm: 77498 5741 371 364 0 13407 0
[pid=30455] ppid=30453 vsize=93528 CPUtime=398.78 cores=0-7
/proc/30455/stat : 30455 (march_hi) R 30453 30455 30455 0 -1 4202496 18524 0 0 0 39875 3 0 0 25 0 1 0 549157837 95772672 18258 33554432000 4194304 4955518 140736398232096 18446744073709551615 4297477 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/30455/statm: 23382 18258 106 186 0 23195 0
Current children cumulated CPU time (s) 1197.39
Current children cumulated vsize (KiB) 779096

Child status: 1
Real time (s): 400.101
CPU time (s): 1197.54
CPU user time (s): 1196.08
CPU system time (s): 1.46178
CPU usage (%): 299.31
Max. virtual memory (cumulated for all children) (KiB): 1747980

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1196.08
system time used= 1.46178
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 86285
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3230
involuntary context switches= 3242

runsolver used 1.03784 second user time and 2.24166 second system time

The end

Launcher Data 

Begin job on node120 at 2011-05-03 00:33:10
IDJOB=3322187
IDBENCH=82965
IDSOLVER=1712
FILE ID=node120/3322187-1304375590
RUNJOBID= node120-1304366467-28887
PBS_JOBID= 13181751
Free space on /tmp= 73536 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v125-c2662-S1300400916-048.SATISFIABLE.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322187-1304375590/watcher-3322187-1304375590 -o /tmp/evaluation-result-3322187-1304375590/solver-3322187-1304375590 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3322187-1304375590.cnf -seed 2009912455 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 2d20051b8a7a248788d1c2610fe5ea54
RANDOM SEED=2009912455

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      14493928 kB
Buffers:        610996 kB
Cached:        2627836 kB
SwapCached:          8 kB
Active:       15901476 kB
Inactive:      2133048 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      14493928 kB
SwapTotal:    67111528 kB
SwapFree:     67111404 kB
Dirty:           32336 kB
Writeback:           0 kB
AnonPages:    14796020 kB
Mapped:          23120 kB
Slab:           312912 kB
PageTables:      44028 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 44585420 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73504 MiB
End job on node120 at 2011-05-03 00:39:50