You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-10-05 - 00:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot1s.osadl.org (updated Wed Oct 04, 2023 12:45:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1486126343,17sleep60-21swapper/607:06:486
1485126141,17sleep50-21swapper/507:06:385
1477125535,17sleep40-21swapper/407:05:334
1400925034,11sleep20-21swapper/207:05:242
1485324929,17sleep70-21swapper/707:06:417
1505224525,17sleep10-21swapper/107:09:301
1478123817,18sleep30-21swapper/307:05:413
1478723716,18sleep00-21swapper/007:05:450
15322992116,4cyclictest0-21swapper/607:44:376
15322992116,2cyclictest0-21swapper/608:17:526
15322992017,2cyclictest0-21swapper/607:27:376
15322992016,3cyclictest0-21swapper/608:14:376
15322992016,3cyclictest0-21swapper/607:10:376
15322992015,4cyclictest0-21swapper/608:52:076
15322992015,2cyclictest0-21swapper/608:05:076
15322992014,3cyclictest0-21swapper/608:37:376
15297992011,3cyclictest0-21swapper/207:39:362
15322991915,3cyclictest0-21swapper/608:42:376
15322991915,3cyclictest0-21swapper/607:38:076
15303991915,1cyclictest0-21swapper/309:30:253
15322991815,2cyclictest0-21swapper/608:26:376
15322991815,2cyclictest0-21swapper/607:19:386
15322991814,3cyclictest0-21swapper/611:49:596
15322991813,4cyclictest0-21swapper/608:31:366
15310991813,4cyclictest0-21swapper/409:06:074
15322991714,2cyclictest0-21swapper/612:38:236
15322991714,2cyclictest0-21swapper/607:20:526
15322991712,4cyclictest0-21swapper/608:22:076
15322991712,2cyclictest0-21swapper/607:30:376
15282991713,1cyclictest0-21swapper/010:00:240
1532899160,1cyclictest0-21swapper/709:31:077
15322991613,2cyclictest0-21swapper/608:56:076
15322991613,2cyclictest0-21swapper/608:48:366
15322991611,4cyclictest0-21swapper/607:57:376
1529799162,13cyclictest0-21swapper/212:24:032
1532899150,1cyclictest0-21swapper/710:01:227
1532899150,12cyclictest0-21swapper/707:32:377
15322991510,2cyclictest0-21swapper/609:07:066
1532299150,14cyclictest0-21swapper/611:40:336
15310991513,1cyclictest29189-21sh12:20:004
15297991513,1cyclictest0-21swapper/208:00:262
15282991513,1cyclictest0-21swapper/008:10:010
15328991410,3cyclictest0-21swapper/710:54:377
1532899140,1cyclictest0-21swapper/711:24:237
1532299149,4cyclictest0-21swapper/607:51:526
15310991412,1cyclictest26024-21perf07:30:004
15310991411,3cyclictest0-21swapper/408:49:524
15310991411,2cyclictest0-21swapper/407:59:594
1529799145,2cyclictest0-21swapper/208:08:312
15297991412,2cyclictest0-21swapper/208:31:312
15328991310,3cyclictest0-21swapper/711:54:537
1532899130,1cyclictest0-21swapper/712:28:227
1532899130,1cyclictest0-21swapper/711:02:377
15322991310,2cyclictest0-21swapper/607:47:526
1531599138,4cyclictest0-21swapper/510:10:015
15315991310,2cyclictest0-21swapper/511:06:085
15315991310,2cyclictest0-21swapper/507:39:075
1531599130,2cyclictest0-21swapper/509:46:005
15310991310,2cyclictest0-21swapper/412:04:534
1529799139,3cyclictest0-21swapper/211:27:442
1529799139,3cyclictest0-21swapper/208:24:352
1529799138,4cyclictest0-21swapper/209:18:432
1529799136,6cyclictest12992-21ssh11:05:322
1529799133,7cyclictest0-21swapper/210:19:022
1529799133,7cyclictest0-21swapper/210:10:442
15328991210,2cyclictest0-21swapper/712:13:537
15328991210,2cyclictest0-21swapper/708:36:367
1532899120,12cyclictest0-21swapper/710:38:377
1532299120,2cyclictest0-21swapper/610:15:576
15315991211,0cyclictest2461-21snmpd12:01:235
1531599120,11cyclictest0-21swapper/510:29:235
1531099129,2cyclictest0-21swapper/411:06:224
1531099129,2cyclictest0-21swapper/409:57:364
1529799129,2cyclictest0-21swapper/209:25:042
1529799129,2cyclictest0-21swapper/209:04:152
1529799129,2cyclictest0-21swapper/208:54:242
1529799126,5cyclictest18934-21ntp_states11:40:302
1529799124,1cyclictest0-21swapper/208:10:492
1529799123,8cyclictest0-21swapper/210:38:472
1529799123,6cyclictest0-21swapper/209:56:002
1529799123,5cyclictest0-21swapper/211:20:202
1529799123,2cyclictest0-21swapper/209:32:022
1529799123,2cyclictest0-21swapper/208:57:232
1529799122,7cyclictest0-21swapper/212:18:342
1529799122,7cyclictest0-21swapper/208:28:472
15297991210,2cyclictest0-21swapper/207:28:162
1532899118,2cyclictest0-21swapper/711:38:227
15328991110,1cyclictest0-21swapper/711:26:387
1531099110,10cyclictest0-21swapper/412:05:334
1530399119,1cyclictest0-21swapper/308:40:243
1530399118,2cyclictest0-21swapper/310:05:223
1529799119,2cyclictest0-21swapper/207:43:042
1529799118,2cyclictest0-21swapper/207:57:202
1529799118,2cyclictest0-21swapper/207:52:072
1529799117,2cyclictest0-21swapper/209:13:262
1529799115,4cyclictest0-21swapper/207:47:542
1529799113,6cyclictest0-21swapper/212:25:012
1529799113,5cyclictest0-21swapper/211:17:122
1529799113,5cyclictest0-21swapper/211:13:092
1529799113,5cyclictest0-21swapper/210:41:292
1529799113,5cyclictest0-21swapper/210:22:012
1529799113,5cyclictest0-21swapper/209:50:072
1529799113,5cyclictest0-21swapper/209:05:232
1529799113,2cyclictest0-21swapper/211:46:292
1529799112,6cyclictest0-21swapper/210:56:052
1529799112,4cyclictest0-21swapper/212:32:422
1529799112,4cyclictest0-21swapper/210:52:462
1529799112,4cyclictest0-21swapper/210:31:562
1529799112,4cyclictest0-21swapper/210:05:012
1529799112,4cyclictest0-21swapper/209:40:482
1529799112,4cyclictest0-21swapper/209:40:482
1529799112,4cyclictest0-21swapper/209:38:182
1529799112,4cyclictest0-21swapper/209:38:182
1529799112,4cyclictest0-21swapper/208:45:292
1529799112,2cyclictest0-21swapper/212:13:452
1529799112,2cyclictest0-21swapper/211:00:142
1529799111,7cyclictest0-21swapper/210:45:502
15297991111,0cyclictest0-21swapper/207:10:212
1529799110,8cyclictest0-21swapper/207:22:342
1529799110,6cyclictest0-21swapper/211:52:262
1528799119,2cyclictest0-21swapper/108:20:251
15287991110,1cyclictest0-21swapper/110:55:261
1528299118,1cyclictest0-21swapper/010:40:000
1528299111,9cyclictest0-21swapper/012:15:000
1528299111,9cyclictest0-21swapper/011:45:000
1528299111,9cyclictest0-21swapper/010:00:010
1528299111,9cyclictest0-21swapper/009:55:000
1528299111,9cyclictest0-21swapper/007:19:590
1528299111,2cyclictest0-21swapper/011:54:590
15282991111,0cyclictest0-21swapper/009:05:310
15282991110,1cyclictest2461-21snmpd08:58:070
1528299110,10cyclictest11277-21latency_hist08:05:010
1532899108,2cyclictest0-21swapper/712:02:237
1532299105,2cyclictest0-21swapper/609:10:216
1532299101,2cyclictest0-21swapper/610:41:456
1531099107,3cyclictest0-21swapper/411:33:224
1531099107,2cyclictest0-21swapper/410:37:524
1531099107,2cyclictest0-21swapper/409:51:524
1531099107,2cyclictest0-21swapper/409:41:424
1531099107,2cyclictest0-21swapper/409:41:424
1531099107,2cyclictest0-21swapper/408:50:074
1531099100,9cyclictest0-21swapper/411:20:184
1531099100,9cyclictest0-21swapper/410:47:254
1531099100,9cyclictest0-21swapper/409:47:204
1531099100,9cyclictest0-21swapper/408:06:514
1531099100,9cyclictest0-21swapper/407:43:274
1531099100,9cyclictest0-21swapper/407:39:574
1530399109,1cyclictest2461-21snmpd07:30:073
15303991010,0cyclictest2461-21snmpd11:21:233
1529799106,3cyclictest0-21swapper/208:35:562
1529799106,3cyclictest0-21swapper/207:15:552
1529799106,2cyclictest0-21swapper/207:32:222
1529799105,1cyclictest0-21swapper/208:15:122
1529799104,2cyclictest0-21swapper/208:42:572
1529799103,3cyclictest0-21swapper/211:55:282
1529799103,2cyclictest0-21swapper/212:05:582
1529799103,2cyclictest0-21swapper/212:03:272
1529799102,7cyclictest0-21swapper/210:03:262
1529799102,5cyclictest0-21swapper/211:30:112
1529799102,2cyclictest0-21swapper/211:35:312
1529799102,2cyclictest0-21swapper/209:45:342
1529799101,5cyclictest0-21swapper/212:36:442
1529799101,4cyclictest0-21swapper/209:20:012
1529799100,5cyclictest0-21swapper/210:25:572
1528299107,2cyclictest0-21swapper/009:25:360
1528299107,2cyclictest0-21swapper/009:13:440
1528299107,1cyclictest0-21swapper/011:25:230
1528299106,2cyclictest0-21swapper/010:54:480
1528299105,4cyclictest0-21swapper/008:10:130
1528299101,8cyclictest0-21swapper/010:10:000
1528299101,2cyclictest0-21swapper/010:35:010
1528299101,1cyclictest0-21swapper/012:35:000
1528299101,1cyclictest0-21swapper/012:05:000
1528299100,9cyclictest7267-21latency_hist09:35:000
1528299100,9cyclictest0-21swapper/012:08:460
1528299100,9cyclictest0-21swapper/010:45:000
1528299100,9cyclictest0-21swapper/007:20:270
1528299100,8cyclictest0-21swapper/011:09:150
1528299100,8cyclictest0-21swapper/009:20:260
1528299100,8cyclictest0-21swapper/008:50:330
1528299100,8cyclictest0-21swapper/008:20:320
1528299100,7cyclictest6899-21mrtg12:00:000
1528299100,7cyclictest30702-21dump-pmu-power10:25:000
1528299100,7cyclictest28951-21perf08:40:000
1528299100,7cyclictest23904-21latency_hist08:30:010
1528299100,3cyclictest0-21swapper/008:34:340
1528299100,2cyclictest0-21swapper/011:35:280
1528299100,2cyclictest0-21swapper/007:40:300
1528299100,1cyclictest3694-21latency_hist07:50:000
153289991,7cyclictest12438-21smartctl08:05:247
153289990,8cyclictest9826-21ssh10:05:227
153289990,8cyclictest9687-21needreboot12:30:257
153289990,8cyclictest8606-21cut09:35:247
153289990,8cyclictest8606-21cut09:35:247
153289990,8cyclictest815-21ssh09:57:157
153289990,8cyclictest7906-21if_ppp009:00:257
153289990,8cyclictest7036-21grep11:30:237
153289990,8cyclictest5956-21ssh10:30:327
153289990,8cyclictest5842-21grep07:50:297
153289990,8cyclictest535-21tail08:45:277
153289990,8cyclictest342-21mailstats07:40:347
153289990,8cyclictest32296-21chrt10:55:187
153289990,8cyclictest3209-21ntpq11:55:257
153289990,8cyclictest31823-21fschecks_count10:25:237
153289990,8cyclictest30294-21munin-node07:35:277
153289990,8cyclictest26214-21chrt11:47:077
153289990,8cyclictest26188-21munin-node12:15:377
153289990,8cyclictest25900-21tr10:20:207
153289990,8cyclictest24644-21missed_timers09:20:287
153289990,8cyclictest23527-21munin-node11:15:277
153289990,8cyclictest22554-21cut10:45:307
153289990,8cyclictest20672-21grep09:45:347
153289990,8cyclictest20672-21fschecks_count10:15:237
153289990,8cyclictest2016-21chrt12:24:397
153289990,8cyclictest1916-21munin-node07:45:217
153289990,8cyclictest18156-21fschecks_count11:40:237
153289990,8cyclictest17213-21munin-node11:10:217
153289990,8cyclictest16769-21munin-node10:40:287
153289990,8cyclictest15522-21munin-node10:10:247
153289990,8cyclictest15476-21gzip12:35:297
153289990,8cyclictest12923-21grep11:05:307
153289990,8cyclictest12166-21ssh09:10:097
153289990,8cyclictest10022-21munin-node08:00:267
153289990,8cyclictest0-21swapper/709:07:557
153289990,8cyclictest0-21swapper/708:53:067
153289990,8cyclictest0-21swapper/708:20:507
153289990,8cyclictest0-21swapper/707:55:337
153229994,4cyclictest0-21swapper/609:28:376
153229993,4cyclictest0-21swapper/611:10:536
153229993,4cyclictest0-21swapper/610:34:236
153229991,5cyclictest0-21swapper/612:22:236
153229991,2cyclictest0-21swapper/609:20:086
153229990,3cyclictest0-21swapper/610:05:376
153229990,2cyclictest0-21swapper/610:11:536
153229990,2cyclictest0-21swapper/609:00:076
153159990,1cyclictest0-21swapper/510:47:395
153109996,2cyclictest0-21swapper/409:00:384
153109991,7cyclictest0-21swapper/410:22:414
153109990,8cyclictest0-21swapper/412:33:564
153109990,8cyclictest0-21swapper/411:35:404
153109990,8cyclictest0-21swapper/410:43:554
153109990,8cyclictest0-21swapper/410:10:124
153109990,2cyclictest0-21swapper/411:56:074
153039999,0cyclictest2461-21snmpd10:37:223
153039998,1cyclictest2461-21snmpd12:28:223
153039998,1cyclictest2461-21snmpd11:02:373
153039993,3cyclictest0-21swapper/309:55:263
153039991,7cyclictest0-21swapper/309:25:283
152879996,2cyclictest0-21swapper/110:18:101
152879991,7cyclictest0-21swapper/111:05:131
152879991,7cyclictest0-21swapper/107:30:001
152879991,1cyclictest0-21swapper/112:07:151
152879990,8cyclictest0-21swapper/111:34:431
152829997,1cyclictest0-21swapper/011:03:030
152829997,1cyclictest0-21swapper/008:42:300
152829996,1cyclictest0-21swapper/010:25:220
152829995,1cyclictest0-21swapper/012:25:010
152829991,5cyclictest441750kworker/u16:012:35:090
152829991,5cyclictest0-21swapper/009:15:200
152829990,8cyclictest0-21swapper/012:25:150
152829990,8cyclictest0-21swapper/010:55:330
152829990,8cyclictest0-21swapper/007:59:590
152829990,7cyclictest0-21swapper/011:31:100
152829990,7cyclictest0-21swapper/011:23:030
152829990,7cyclictest0-21swapper/011:16:230
152829990,7cyclictest0-21swapper/010:45:050
152829990,7cyclictest0-21swapper/010:16:090
152829990,7cyclictest0-21swapper/010:14:450
152829990,7cyclictest0-21swapper/008:48:120
152829990,7cyclictest0-21swapper/008:17:490
152829990,7cyclictest0-21swapper/007:52:000
152829990,1cyclictest0-21swapper/012:20:000
152829990,1cyclictest0-21swapper/011:10:050
153289981,6cyclictest0-21swapper/708:25:207
153289981,6cyclictest0-21swapper/707:25:207
153289980,7cyclictest4731-21munin-node08:55:207
153289980,7cyclictest29372-21sort08:40:207
153289980,7cyclictest28871-21ssh09:25:027
153289980,7cyclictest24461-21ssh09:50:067
153289980,7cyclictest24305-21cpu08:30:207
153289980,7cyclictest21417-21sort07:20:177
153289980,7cyclictest18117-21munin-node07:15:007
153289980,7cyclictest17682-21ssh09:15:037
153289980,7cyclictest16759-21sort08:15:207
153289980,7cyclictest15991-21munin-node07:10:197
153289980,7cyclictest14199-21grep08:10:197
153289980,7cyclictest12863-21ssh12:05:027
153289980,7cyclictest0-21swapper/709:40:047
153289980,7cyclictest0-21swapper/709:40:047
153229985,2cyclictest0-21swapper/611:55:236
153229983,4cyclictest0-21swapper/612:11:536
153229983,4cyclictest0-21swapper/610:45:486
153229983,4cyclictest0-21swapper/610:23:376
153229983,4cyclictest0-21swapper/610:03:226
153229983,4cyclictest0-21swapper/608:00:266
153229981,6cyclictest0-21swapper/610:58:306
153229981,4cyclictest0-21swapper/611:26:536
153229980,7cyclictest0-21swapper/612:17:366
153229980,5cyclictest0-21swapper/611:05:386
153229980,5cyclictest0-21swapper/611:04:236
153229980,5cyclictest0-21swapper/609:52:536
153229980,2cyclictest0-21swapper/611:52:536
153229980,2cyclictest0-21swapper/611:17:536
153159986,1cyclictest51-21rcuc/510:58:335
153159985,2cyclictest0-21swapper/512:31:025
153159983,4cyclictest0-21swapper/512:23:065
153159983,4cyclictest0-21swapper/512:10:285
153159983,4cyclictest0-21swapper/511:10:235
153159983,4cyclictest0-21swapper/510:40:265
153159980,7cyclictest0-21swapper/511:45:465
153159980,5cyclictest0-21swapper/511:24:085
153159980,5cyclictest0-21swapper/510:22:385
153159980,5cyclictest0-21swapper/507:31:555
153109985,2cyclictest0-21swapper/410:51:504
153109980,7cyclictest0-21swapper/412:13:144
153109980,7cyclictest0-21swapper/411:29:494
153109980,7cyclictest0-21swapper/410:18:134
153109980,7cyclictest0-21swapper/409:33:484
153109980,7cyclictest0-21swapper/409:28:084
153109980,7cyclictest0-21swapper/409:23:484
153109980,7cyclictest0-21swapper/408:55:354
153109980,7cyclictest0-21swapper/408:02:304
153109980,7cyclictest0-21swapper/407:10:154
153109980,5cyclictest0-21swapper/410:57:524
153109980,1cyclictest0-21swapper/407:22:214
153039983,4cyclictest0-21swapper/309:40:273
153039983,4cyclictest0-21swapper/309:40:273
153039982,4cyclictest0-21swapper/311:55:223
153039982,4cyclictest0-21swapper/308:45:233
153039981,6cyclictest0-21swapper/312:34:593
153039981,6cyclictest0-21swapper/312:05:333
153039981,6cyclictest0-21swapper/312:00:353
153039981,6cyclictest0-21swapper/311:40:303
153039981,6cyclictest0-21swapper/311:25:213
153039981,6cyclictest0-21swapper/311:17:523
153039981,6cyclictest0-21swapper/311:10:163
153039981,6cyclictest0-21swapper/310:50:283
153039981,6cyclictest0-21swapper/310:40:303
153039981,6cyclictest0-21swapper/309:50:193
153039981,6cyclictest0-21swapper/309:47:353
153039981,6cyclictest0-21swapper/309:39:543
153039981,6cyclictest0-21swapper/309:39:543
153039981,6cyclictest0-21swapper/309:21:323
153039981,6cyclictest0-21swapper/307:39:593
153039980,7cyclictest0-21swapper/312:22:153
153039980,7cyclictest0-21swapper/312:13:293
153039980,7cyclictest0-21swapper/310:56:513
152879986,1cyclictest0-21swapper/109:17:461
152879981,6cyclictest0-21swapper/112:35:201
152879981,6cyclictest0-21swapper/112:34:481
152879981,6cyclictest0-21swapper/112:25:231
152879981,6cyclictest0-21swapper/112:20:301
152879981,6cyclictest0-21swapper/112:15:361
152879981,6cyclictest0-21swapper/112:15:001
152879981,6cyclictest0-21swapper/111:55:241
152879981,6cyclictest0-21swapper/111:50:201
152879981,6cyclictest0-21swapper/111:45:231
152879981,6cyclictest0-21swapper/111:25:201
152879981,6cyclictest0-21swapper/111:15:221
152879981,6cyclictest0-21swapper/111:10:201
152879981,6cyclictest0-21swapper/111:00:301
152879981,6cyclictest0-21swapper/110:50:301
152879981,6cyclictest0-21swapper/110:45:241
152879981,6cyclictest0-21swapper/110:35:301
152879981,6cyclictest0-21swapper/110:20:231
152879981,6cyclictest0-21swapper/110:00:231
152879981,6cyclictest0-21swapper/109:55:311
152879981,6cyclictest0-21swapper/109:49:231
152879981,6cyclictest0-21swapper/109:40:221
152879981,6cyclictest0-21swapper/109:40:221
152879981,6cyclictest0-21swapper/109:29:341
152879981,6cyclictest0-21swapper/109:20:271
152879981,6cyclictest0-21swapper/109:10:211
152879981,6cyclictest0-21swapper/108:45:221
152879981,6cyclictest0-21swapper/108:40:311
152879981,6cyclictest0-21swapper/108:30:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional