Project

Profile

Help

Task #7488

output values in json format

Added by Ilfat Kinyaev over 4 years ago. Updated over 4 years ago.

Status:
Closed
Priority:
High
Category:
performance
Sprint/Milestone:
Start date:
07.09.2016
Due date:
% Done:

0%

Estimated time:
1:00 h
Target branch:
Test scenario:

https://github.com/OSLL/mdbci/pull/308/files

1. Run
./scripts/benchmark_parser/parse_log.rb -i scripts/benchmark_parser/test_data/preformance_test_7483.txt -o out.json -e env

Expected result :
Found start of sysbench block
Read all sysbench_results_raw
Parsing completed!

2. Run
cat out.json | python -m json.tool
{
"benchmark_results": {
"General_statistics_response_time_approx__95_percentile": "397.97ms",
"General_statistics_response_time_avg": "344.44ms",
"General_statistics_response_time_max": "2474.96ms",
"General_statistics_response_time_min": "306.27ms",
"General_statistics_total_number_of_events": 27887,
"General_statistics_total_time": "300.4046s",
"General_statistics_total_time_taken_by_event_execution": "9605.3034s",
"OLTP_test_statistics_ignored_errors": "13 (0.04 per sec.)",
"OLTP_test_statistics_other_operations": "55787 (185.71 per sec.)",
"OLTP_test_statistics_queries_performed_other": 55787,
"OLTP_test_statistics_queries_performed_read": 390600,
"OLTP_test_statistics_queries_performed_total": 557956,
"OLTP_test_statistics_queries_performed_write": 111569,
"OLTP_test_statistics_read/write_requests": "502169 (1671.64 per sec.)",
"OLTP_test_statistics_reconnects": "0 (0.00 per sec.)",
"OLTP_test_statistics_transactions": "27887 (92.83 per sec.)",
"Threads_fairness_events_(avg/stddev)": "871.4688/6.81",
"Threads_fairness_execution_time_(avg/stddev)": "300.1657/0.12"
},
"build_params": {
"box": "NOT FOUND",
"jenkins_id": "NOT FOUND",
"job_name": "NOT FOUND",
"machine_count": "NOT FOUND",
"mariadb_version": "NOT FOUND",
"maxscale_cnf": "/home/vood/ws/mdbci/maxscale.cnf",
"maxscale_commit_id": "NOT FOUND",
"mdbci_template": "NOT FOUND",
"product": "NOT FOUND",
"product_under_test": "maxscale",
"start_time": "NOT FOUND",
"sysbench_params": "NOT FOUND",
"target": "NOT FOUND",
"test_code_commit_id": "NOT FOUND",
"test_tool": "sysbench"
}
}


Description

In ./scripts/benchmark_parser/parse_log.rb realize write_hash_to_json(hash, output_file):
Input: hash.
Output: file in json format with text from hash.

Generate json file from hash.

Given hash (slash at end shows end of one hash object):

SYSBENCH_RESULTS_RAW \
OLTP test statistics: \
    queries performed: \
        read:                            390600 \
        write:                           111569 \
        other:                           55787 \
        total:                           557956 \
    transactions:                        27887  (92.83 per sec.) \
    read/write requests:                 502169 (1671.64 per sec.) \
    other operations:                    55787  (185.71 per sec.) \
    ignored errors:                      13     (0.04 per sec.) \
    reconnects:                          0      (0.00 per sec.) \
 \
General statistics: \
    total time:                          300.4046s \
    total number of events:              27887 \
    total time taken by event execution: 9605.3034s \
    response time: \
         min:                                306.27ms \
         avg:                                344.44ms \
         max:                               2474.96ms \
         approx.  95 percentile:             397.97ms \
 \
Threads fairness: \
    events (avg/stddev):           871.4688/6.81 \
    execution time (avg/stddev):   300.1657/0.12 \


Related issues

Related to [mdbci] Maria DB Continuous integration tool - Task #7425: implement script for parsing sysbench log and collecting resultsClosed18.08.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>

History

#1 Updated by Ilfat Kinyaev over 4 years ago

  • Related to Task #7425: implement script for parsing sysbench log and collecting results added

#2 Updated by Mark Zaslavskiy over 4 years ago

  • Priority changed from Normal to High

#3 Updated by Ilfat Kinyaev over 4 years ago

  • Description updated (diff)

#4 Updated by Mark Zaslavskiy over 4 years ago

  • Assignee set to Alexander Kaluzhny

#5 Updated by Alexander Kaluzhny over 4 years ago

  • Status changed from New to Active / In progress

#6 Updated by Mark Zaslavskiy over 4 years ago

  • Status changed from Active / In progress to New
  • Assignee changed from Alexander Kaluzhny to Mark Zaslavskiy

#7 Updated by Mark Zaslavskiy over 4 years ago

  • Status changed from New to Active / In progress

#8 Updated by Mark Zaslavskiy over 4 years ago

  • Assignee changed from Mark Zaslavskiy to Alexander Kaluzhny
  • Test scenario updated (diff)

#9 Updated by Mark Zaslavskiy over 4 years ago

  • Assignee changed from Alexander Kaluzhny to Mark Zaslavskiy

#10 Updated by Mark Zaslavskiy over 4 years ago

  • Status changed from Active / In progress to Review

#11 Updated by Mark Zaslavskiy over 4 years ago

  • Status changed from Review to Closed

Also available in: Atom PDF