Project

Profile

Help

Task #7425

implement script for parsing sysbench log and collecting results

Added by Mark Zaslavskiy over 4 years ago. Updated over 4 years ago.

Status:
Closed
Priority:
High
Category:
performance
Sprint/Milestone:
Start date:
18.08.2016
Due date:
% Done:

0%

Estimated time:
2:00 h
Target branch:
Test scenario:

Description

Create ruby script ./scripts/benchmark_parser/parse_log.rb that will do:
-- detect & extract sysbench results from the input file

OLTP test statistics:
    queries performed:
        read:                            389214
        write:                           111148
        other:                           55578
        total:                           555940
    transactions:                        27777  (92.36 per sec.)
    read/write requests:                 500362 (1663.72 per sec.)
    other operations:                    55578  (184.80 per sec.)
    ignored errors:                      24     (0.08 per sec.)
    reconnects:                          0      (0.00 per sec.)

General statistics:
    total time:                          300.7494s
    total number of events:              27777
    total time taken by event execution: 9609.9020s
    response time:
         min:                                 90.34ms
         avg:                                345.97ms
         max:                               2523.00ms
         approx.  95 percentile:             782.80ms

Threads fairness:
    events (avg/stddev):           868.0312/14.11
    execution time (avg/stddev):   300.3094/0.14

-- parse results using yaml parser
-- convert each value by following algorithm
--- remove text in the round brackets ()
--- remove units
--- replace keys with values with / for two keys:
    events (avg/stddev):           868.0312/14.11

to

    events_avg:  868.0312
    events_stddev:           14.11

-- "fold" keys - replace hierarchy (like http://www.convertcsv.com/json-to-csv.htm):
{
    "OLTP test statistics": {
        "queries performed": {
            "read": 389214,

to 

{ 
"OLTP_test_statistics.queries_performed.read": 389214,

-- generate build parameters
-- output values in json format (two sections: sysbench and build_params)

command line args:
-i, --input-file (log from http://max-tst-01.mariadb.com:8089/view/All/job/performance_test/3/)
-o, --output-file
-s, --silent (optional, suppress output to stdout/stderr)


Related issues

Related to [mdbci] Maria DB Continuous integration tool - Task #7421: Plan proof of concept implementation according to maxscale proposalClosed18.08.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #7483: Detect & extract sysbench results from the input fileClosed07.09.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #7484: remove text in the round brackets ()Closed07.09.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #7485: remove unitsClosed07.09.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #7486: replace keys with values with slash for two keysClosed07.09.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #7487: Fold keys - replace hierarchyClosed07.09.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #7488: output values in json formatClosed07.09.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #7489: create ./scripts/benchmark_parser/parse_log.rb fileClosed07.09.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #7501: ./scripts/benchmark_parser/parse_log.rb should store raw sysbench results to env file given using -e keyClosed08.09.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #7520: Add section with build params to generated jsonClosed13.09.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #7523: Test for sysbench parser at 7425Won't fix13.09.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #7527: Generate build parametersClosed14.09.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>

History

#1 Updated by Mark Zaslavskiy over 4 years ago

  • Related to Task #7421: Plan proof of concept implementation according to maxscale proposal added

#2 Updated by Mark Zaslavskiy over 4 years ago

OLTP test statistics:
   queries performed:
       read:                            52346
       write:                           14938
       other:                           7470
       total:                           74754
   transactions:                        3731   (12.29 per sec.)
   read/write requests:                 67284  (221.69 per sec.)
   other operations:                    7470   (24.61 per sec.)
   ignored errors:                      8      (0.03 per sec.)
   reconnects:                          0      (0.00 per sec.)

General statistics:
   total time:                          303.5025s
   total number of events:              3731
   total time taken by event execution: 9652.5899s
   response time:
        min:                                490.30ms
        avg:                               2587.13ms
        max:                              13668.15ms
        approx.  95 percentile:            5771.35ms

Threads fairness:
   events (avg/stddev):           116.5938/5.91
   execution time (avg/stddev):   301.6434/0.72

#3 Updated by Mark Zaslavskiy over 4 years ago

  • Description updated (diff)

#4 Updated by Mark Zaslavskiy over 4 years ago

  • Description updated (diff)

#5 Updated by Mark Zaslavskiy over 4 years ago

  • Description updated (diff)
  • Assignee changed from Mark Zaslavskiy to Ilfat Kinyaev

#7 Updated by Mark Zaslavskiy over 4 years ago

  • Assignee changed from Ilfat Kinyaev to Mark Zaslavskiy

#8 Updated by Mark Zaslavskiy over 4 years ago

  • Description updated (diff)

#9 Updated by Mark Zaslavskiy over 4 years ago

  • Description updated (diff)

#10 Updated by Ilfat Kinyaev over 4 years ago

  • Related to Task #7483: Detect & extract sysbench results from the input file added

#11 Updated by Ilfat Kinyaev over 4 years ago

  • Related to Task #7484: remove text in the round brackets () added

#12 Updated by Ilfat Kinyaev over 4 years ago

#13 Updated by Ilfat Kinyaev over 4 years ago

  • Related to Task #7486: replace keys with values with slash for two keys added

#14 Updated by Ilfat Kinyaev over 4 years ago

  • Related to Task #7487: Fold keys - replace hierarchy added

#15 Updated by Ilfat Kinyaev over 4 years ago

  • Related to Task #7488: output values in json format added

#16 Updated by Ilfat Kinyaev over 4 years ago

  • Related to Task #7489: create ./scripts/benchmark_parser/parse_log.rb file added

#17 Updated by Mark Zaslavskiy over 4 years ago

  • Related to Task #7501: ./scripts/benchmark_parser/parse_log.rb should store raw sysbench results to env file given using -e key added

#18 Updated by Mark Zaslavskiy over 4 years ago

  • Related to Task #7520: Add section with build params to generated json added

#19 Updated by Mark Zaslavskiy over 4 years ago

  • Priority changed from Normal to High

#20 Updated by Ilfat Kinyaev over 4 years ago

  • Related to Task #7523: Test for sysbench parser at 7425 added

#21 Updated by Ilfat Kinyaev over 4 years ago

  • Description updated (diff)

#22 Updated by Ilfat Kinyaev over 4 years ago

  • Related to Task #7527: Generate build parameters added

#23 Updated by Ilfat Kinyaev over 4 years ago

  • Description updated (diff)

#24 Updated by Mark Zaslavskiy over 4 years ago

  • Status changed from New to Closed

Also available in: Atom PDF