Project

Profile

Help

Task #7484

remove text in the round brackets ()

Added by Ilfat Kinyaev over 4 years ago. Updated over 4 years ago.

Status:
Closed
Priority:
High
Category:
performance
Sprint/Milestone:
Start date:
07.09.2016
Due date:
% Done:

0%

Estimated time:
1:00 h
Target branch:
Test scenario:

https://github.com/OSLL/mdbci/pull/309

1. Run
./scripts/benchmark_parser/parse_log.rb -i scripts/benchmark_parser/test_data/preformance_test_7483.txt -o out.json -e env

Expected result :
Found start of sysbench block
Read all sysbench_results_raw
Parsing completed!

2. Run
cat out.json | python -m json.tool
{
"benchmark_results": {
"General_statistics_response_time_approx__95_percentile": 397.97,
"General_statistics_response_time_avg": 344.44,
"General_statistics_response_time_max": 2474.96,
"General_statistics_response_time_min": 306.27,
"General_statistics_total_number_of_events": 27887,
"General_statistics_total_time": 300.4046,
"General_statistics_total_time_taken_by_event_execution": 9605.3034,
"OLTP_test_statistics_ignored_errors": 13.0,
"OLTP_test_statistics_other_operations": 55787.0,
"OLTP_test_statistics_queries_performed_other": 55787,
"OLTP_test_statistics_queries_performed_read": 390600,
"OLTP_test_statistics_queries_performed_total": 557956,
"OLTP_test_statistics_queries_performed_write": 111569,
"OLTP_test_statistics_read/write_requests": 502169.0,
"OLTP_test_statistics_reconnects": 0.0,
"OLTP_test_statistics_transactions": 27887.0,
"Threads_fairness_events_avg": 871.4688,
"Threads_fairness_events_stddev": 6.81,
"Threads_fairness_execution_time_avg": 300.1657,
"Threads_fairness_execution_time_stddev": 0.12
},
"build_params": {
"box": "NOT FOUND",
"jenkins_id": "NOT FOUND",
"job_name": "NOT FOUND",
"machine_count": "NOT FOUND",
"mariadb_version": "NOT FOUND",
"maxscale_cnf": "/home/vood/ws/mdbci/maxscale.cnf",
"maxscale_commit_id": "NOT FOUND",
"mdbci_template": "NOT FOUND",
"product": "NOT FOUND",
"product_under_test": "maxscale",
"start_time": "NOT FOUND",
"sysbench_params": "NOT FOUND",
"target": "NOT FOUND",
"test_code_commit_id": "NOT FOUND",
"test_tool": "sysbench"
}
}


Description

In ./scripts/benchmark_parser/parse_log.rb realize remove_brackets(hash):
Input: hash with brackets.
Output: hash without brackets and text in it.
Need remove text in the round brackets (), BUT keep with slash: (avg/stddev).

Given hash (slash at end shows end of one hash object):

SYSBENCH_RESULTS_RAW \
OLTP test statistics: \
    queries performed: \
        read:                            390600 \
        write:                           111569 \
        other:                           55787 \
        total:                           557956 \
    transactions:                        27887  (92.83 per sec.) \
    read/write requests:                 502169 (1671.64 per sec.) \
    other operations:                    55787  (185.71 per sec.) \
    ignored errors:                      13     (0.04 per sec.) \
    reconnects:                          0      (0.00 per sec.) \
 \
General statistics: \
    total time:                          300.4046s \
    total number of events:              27887 \
    total time taken by event execution: 9605.3034s \
    response time: \
         min:                                306.27ms \
         avg:                                344.44ms \
         max:                               2474.96ms \
         approx.  95 percentile:             397.97ms \
 \
Threads fairness: \
    events (avg/stddev):           871.4688/6.81 \
    execution time (avg/stddev):   300.1657/0.12 \

Result hash:

SYSBENCH_RESULTS_RAW \
OLTP test statistics: \
    queries performed: \
        read:                            390600 \
        write:                           111569 \
        other:                           55787 \
        total:                           557956 \
    transactions:                        27887 \
    read/write requests:                 502169 \
    other operations:                    55787  \
    ignored errors:                      13 \
    reconnects:                          0 \
 \
General statistics: \
    total time:                          300.4046s \
    total number of events:              27887 \
    total time taken by event execution: 9605.3034s \
    response time: \
         min:                                306.27ms \
         avg:                                344.44ms \
         max:                               2474.96ms \
         approx.  95 percentile:             397.97ms \
 \
Threads fairness: \
    events (avg/stddev):           871.4688/6.81 \
    execution time (avg/stddev):   300.1657/0.12 \


Related issues

Related to [mdbci] Maria DB Continuous integration tool - Task #7425: implement script for parsing sysbench log and collecting resultsClosed18.08.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>

History

#1 Updated by Ilfat Kinyaev over 4 years ago

  • Related to Task #7425: implement script for parsing sysbench log and collecting results added

#2 Updated by Ilfat Kinyaev over 4 years ago

  • Description updated (diff)

#3 Updated by Ilfat Kinyaev over 4 years ago

  • Description updated (diff)

#4 Updated by Mark Zaslavskiy over 4 years ago

  • Priority changed from Normal to High

#5 Updated by Ilfat Kinyaev over 4 years ago

  • Description updated (diff)

#6 Updated by Ilfat Kinyaev over 4 years ago

  • Description updated (diff)

#7 Updated by Ilfat Kinyaev over 4 years ago

  • Description updated (diff)

#8 Updated by Mark Zaslavskiy over 4 years ago

  • Assignee set to Ilfat Kinyaev

#9 Updated by Mark Zaslavskiy over 4 years ago

  • Status changed from New to Active / In progress
  • Assignee changed from Ilfat Kinyaev to Mark Zaslavskiy

#10 Updated by Mark Zaslavskiy over 4 years ago

  • Test scenario updated (diff)

#11 Updated by Mark Zaslavskiy over 4 years ago

  • Status changed from Active / In progress to Review

#12 Updated by Mark Zaslavskiy over 4 years ago

  • Status changed from Review to Closed

Also available in: Atom PDF