You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 05:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sun Nov 30, 2025 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
220902750,5sleep022095-21unixbench_multi19:57:170
21413996939,13cyclictest0-21swapper/022:01:380
2141599662,45cyclictest31209-21chrt21:26:541
2141799613,10cyclictest15977-21cat23:07:113
87952603,11sleep00-21swapper/021:46:570
2141799604,49cyclictest0-21swapper/323:36:523
2141799604,49cyclictest0-21swapper/321:16:583
2141799604,49cyclictest0-21swapper/320:12:083
2141599604,39cyclictest0-21swapper/100:01:571
243799590,4rtkit-daemon2436-21rtkit-daemon00:16:512
2141799595,48cyclictest0-21swapper/322:29:103
2141799595,47cyclictest0-21swapper/323:41:543
2141799594,49cyclictest0-21swapper/300:16:583
2141699593,49cyclictest0-21swapper/222:26:392
21416995921,22cyclictest5766-21sort20:32:042
2141699592,50cyclictest12600-21grep19:37:182
21415995919,33cyclictest0-21swapper/119:46:221
21413995934,11cyclictest0-21swapper/021:27:140
243799580,5rtkit-daemon2436-21rtkit-daemon19:12:182
2141799584,47cyclictest0-21swapper/322:47:133
2141799584,47cyclictest0-21swapper/321:01:543
2141699584,47cyclictest0-21swapper/200:16:342
2141699583,48cyclictest17357-21diskstats20:56:592
2141699583,47cyclictest0-21swapper/222:41:542
21415995839,13cyclictest14008-21runrttasks20:49:571
21415995833,17cyclictest0-21swapper/120:06:431
21415995833,17cyclictest0-21swapper/120:06:431
20172583,12sleep00-21swapper/022:41:370
16802583,12sleep00-21swapper/019:17:040
16802583,12sleep00-21swapper/019:17:040
12982583,47sleep00-21swapper/023:46:500
2141699574,47cyclictest0-21swapper/223:12:082
2141699573,47cyclictest0-21swapper/218:57:052
2141599573,48cyclictest0-21swapper/122:32:101
204352572,47sleep00-21swapper/021:02:110
290082563,12sleep00-21swapper/019:07:000
243799560,5rtkit-daemon2436-21rtkit-daemon21:57:122
243799560,5rtkit-daemon2436-21rtkit-daemon21:02:142
243799560,5rtkit-daemon2436-21rtkit-daemon20:22:082
243799560,5rtkit-daemon2436-21rtkit-daemon20:17:162
2141799564,45cyclictest0-21swapper/321:06:563
2141799564,29cyclictest0-21swapper/321:37:163
2141699563,46cyclictest0-21swapper/223:22:022
2141699563,46cyclictest0-21swapper/223:21:352
2141699563,46cyclictest0-21swapper/223:03:072
2141699563,46cyclictest0-21swapper/223:03:072
2141699562,48cyclictest0-21swapper/222:06:522
2141599564,28cyclictest0-21swapper/123:26:061
21415995639,11cyclictest2640-21grep19:17:161
21415995639,11cyclictest2640-21grep19:17:161
2141399564,36cyclictest0-21swapper/019:02:040
61242553,44sleep30-21swapper/320:32:123
243799550,5rtkit-daemon2436-21rtkit-daemon23:26:532
243799550,5rtkit-daemon2436-21rtkit-daemon21:46:572
243799550,5rtkit-daemon2436-21rtkit-daemon21:12:142
243799550,5rtkit-daemon2436-21rtkit-daemon20:47:002
243799550,5rtkit-daemon2436-21rtkit-daemon20:12:092
243799550,5rtkit-daemon2436-21rtkit-daemon00:06:522
2141599553,39cyclictest0-21swapper/121:16:531
21415995515,23cyclictest0-21swapper/121:36:581
2141399554,33cyclictest0-21swapper/022:17:110
2141399554,30cyclictest0-21swapper/023:32:100
21413995534,10cyclictest0-21swapper/022:02:040
21413995533,10cyclictest0-21swapper/021:07:110
21413995526,13cyclictest0-21swapper/000:11:490
21413995522,14cyclictest0-21swapper/018:57:060
243799540,5rtkit-daemon2436-21rtkit-daemon23:07:092
243799540,5rtkit-daemon2436-21rtkit-daemon22:52:102
243799540,5rtkit-daemon2436-21rtkit-daemon22:37:102
243799540,5rtkit-daemon2436-21rtkit-daemon22:27:112
243799540,5rtkit-daemon2436-21rtkit-daemon22:17:112
243799540,5rtkit-daemon2436-21rtkit-daemon22:05:042
243799540,5rtkit-daemon2436-21rtkit-daemon21:51:572
243799540,5rtkit-daemon2436-21rtkit-daemon20:52:002
243799540,5rtkit-daemon2436-21rtkit-daemon20:02:012
243799540,5rtkit-daemon2436-21rtkit-daemon20:02:012
243799540,5rtkit-daemon2436-21rtkit-daemon19:47:022
243799540,5rtkit-daemon2436-21rtkit-daemon19:02:192
21417995424,13cyclictest0-21swapper/322:16:593
2141699542,45cyclictest26338-21munin-node21:16:522
2141599544,43cyclictest0-21swapper/120:22:021
2141599544,42cyclictest27343-21cat22:26:381
21413995434,8cyclictest26522-21grep20:07:120
21413995433,10cyclictest0-21swapper/023:12:100
21413995421,14cyclictest0-21swapper/022:21:590
277642533,8sleep327845-21awk19:02:163
243799530,6rtkit-daemon2436-21rtkit-daemon22:47:102
243799530,5rtkit-daemon2436-21rtkit-daemon23:52:002
243799530,5rtkit-daemon2436-21rtkit-daemon22:31:482
243799530,5rtkit-daemon2436-21rtkit-daemon22:12:112
243799530,5rtkit-daemon2436-21rtkit-daemon21:35:502
243799530,5rtkit-daemon2436-21rtkit-daemon21:35:502
243799530,5rtkit-daemon2436-21rtkit-daemon21:27:062
243799530,5rtkit-daemon2436-21rtkit-daemon20:42:072
243799530,5rtkit-daemon2436-21rtkit-daemon19:57:172
2141799533,44cyclictest2099-21munin-run20:26:423
2141699534,42cyclictest0-21swapper/221:07:122
2141699533,43cyclictest3329-21munin-run23:51:342
2141599534,43cyclictest0-21swapper/100:16:471
21415995336,11cyclictest19025-21cat21:01:421
21415995335,11cyclictest29646-21sh22:31:381
21415995335,10cyclictest8765-21cpuspeed_turbos19:31:591
2141599533,44cyclictest0-21swapper/120:46:261
2141399538,26cyclictest0-21swapper/019:46:580
2141399534,32cyclictest0-21swapper/023:09:160
21413995325,13cyclictest0-21swapper/022:46:540
21413995323,14cyclictest0-21swapper/021:32:010
21413995323,14cyclictest0-21swapper/021:32:010
21413995322,13cyclictest0-21swapper/022:27:130
104462530,4sleep010447-21sed20:42:030
42482522,9sleep30-21swapper/320:27:243
251762523,42sleep20-21swapper/220:06:562
243799520,5rtkit-daemon2436-21rtkit-daemon23:32:082
243799520,5rtkit-daemon2436-21rtkit-daemon20:37:232
243799520,5rtkit-daemon2436-21rtkit-daemon00:02:072
2141799526,28cyclictest0-21swapper/320:37:173
2141799525,11cyclictest26019-21gltestperf20:07:033
2141799524,30cyclictest0-21swapper/320:52:053
2141799523,20cyclictest0-21swapper/323:26:353
2141799523,11cyclictest0-21swapper/320:51:423
21417995223,12cyclictest0-21swapper/319:37:093
2141699523,43cyclictest0-21swapper/222:56:492
2141699523,43cyclictest0-21swapper/222:56:492
2141599524,41cyclictest0-21swapper/121:22:161
2141599524,40cyclictest0-21swapper/122:46:191
2141599524,31cyclictest0-21swapper/121:44:031
21415995235,10cyclictest26024-21crond23:31:351
2141599523,34cyclictest0-21swapper/119:26:591
2141599523,30cyclictest0-21swapper/120:16:441
2141399525,29cyclictest0-21swapper/022:51:500
2141399524,30cyclictest0-21swapper/023:17:080
21413995234,10cyclictest16360-21cut00:16:540
21413995231,10cyclictest0-21swapper/020:47:330
21413995226,12cyclictest0-21swapper/020:27:050
21413995221,13cyclictest0-21swapper/019:12:190
210772524,6sleep00-21swapper/018:47:510
317052512,9sleep00-21swapper/022:32:270
2141799515,29cyclictest0-21swapper/322:14:073
2141799514,28cyclictest0-21swapper/321:56:493
2141699514,10cyclictest0-21swapper/219:27:152
2141699513,42cyclictest0-21swapper/219:06:582
2141599514,41cyclictest0-21swapper/119:52:021
2141599514,39cyclictest0-21swapper/119:22:101
2141599514,35cyclictest0-21swapper/120:36:551
2141599514,29cyclictest0-21swapper/123:33:061
2141599513,40cyclictest0-21swapper/119:41:451
21415995128,18cyclictest0-21swapper/120:32:351
21415995121,13cyclictest0-21swapper/123:07:101
2141399515,29cyclictest0-21swapper/000:06:550
2141399515,28cyclictest0-21swapper/021:15:110
2141399515,28cyclictest0-21swapper/020:22:050
2141399515,28cyclictest0-21swapper/020:12:070
2141399515,28cyclictest0-21swapper/019:52:080
2141399514,39cyclictest0-21swapper/020:57:010
2141399514,32cyclictest0-21swapper/021:51:510
2141399514,29cyclictest0-21swapper/023:42:010
2141399514,29cyclictest0-21swapper/023:26:530
2141399514,29cyclictest0-21swapper/022:07:050
2141399514,29cyclictest0-21swapper/020:02:040
2141399514,29cyclictest0-21swapper/020:02:040
2141399514,29cyclictest0-21swapper/019:22:030
2141399514,29cyclictest0-21swapper/018:52:090
2141399514,28cyclictest0-21swapper/021:22:130
2141399514,28cyclictest0-21swapper/020:38:520
21413995129,11cyclictest0-21swapper/019:32:060
21413995128,10cyclictest0-21swapper/023:25:060
21413995120,14cyclictest0-21swapper/020:16:550
163032512,9sleep00-21swapper/020:53:370
243799500,5rtkit-daemon2436-21rtkit-daemon23:57:072
243799500,5rtkit-daemon2436-21rtkit-daemon19:17:112
243799500,5rtkit-daemon2436-21rtkit-daemon19:17:112
237602502,10sleep30-21swapper/318:56:313
2141799505,28cyclictest0-21swapper/321:49:043
2141799505,28cyclictest0-21swapper/321:24:003
2141799504,29cyclictest0-21swapper/319:22:023
21417995021,12cyclictest0-21swapper/321:27:133
21417995021,10cyclictest15476-21cat19:46:443
21417995017,14cyclictest0-21swapper/322:34:113
2141599504,24cyclictest0-21swapper/123:14:171
2141599503,41cyclictest0-21swapper/119:07:211
2141599503,40cyclictest0-21swapper/123:56:471
2141599503,40cyclictest0-21swapper/122:36:581
2141599503,30cyclictest0-21swapper/122:16:391
2141599503,30cyclictest0-21swapper/119:58:461
2141599503,29cyclictest0-21swapper/123:41:501
2141599503,23cyclictest0-21swapper/123:37:091
21415995027,17cyclictest0-21swapper/121:06:501
21415995010,32cyclictest0-21swapper/123:51:541
2141399504,39cyclictest0-21swapper/020:31:570
21413995029,10cyclictest0-21swapper/021:41:540
21413995021,12cyclictest0-21swapper/019:37:120
81662492,41sleep00-21swapper/019:31:150
53982492,40sleep00-21swapper/023:52:340
2141799495,27cyclictest0-21swapper/322:24:093
2141799495,26cyclictest0-21swapper/320:18:493
2141799494,28cyclictest0-21swapper/319:47:143
2141799494,26cyclictest0-21swapper/322:06:553
2141799494,26cyclictest0-21swapper/321:51:563
21417994918,12cyclictest18913-21cat23:16:363
21416994936,8cyclictest18330-21cpuspeed_turbos19:52:012
2141699493,41cyclictest0-21swapper/221:23:112
2141699493,40cyclictest2088-21crond20:31:372
2141699493,12cyclictest0-21swapper/219:31:572
2141599494,38cyclictest26176-21turbostat19:01:451
2141599494,28cyclictest0-21swapper/122:57:041
2141599494,28cyclictest0-21swapper/122:57:041
2141599494,28cyclictest0-21swapper/122:06:501
2141599494,28cyclictest0-21swapper/121:47:121
2141599494,28cyclictest0-21swapper/118:52:081
2141599494,27cyclictest0-21swapper/122:17:091
21415994933,11cyclictest13858-21fschecks_time00:11:531
2141599493,41cyclictest0-21swapper/119:03:021
2141599493,31cyclictest0-21swapper/119:47:071
2141599493,30cyclictest0-21swapper/123:46:481
2141599493,29cyclictest0-21swapper/122:46:581
2141599493,29cyclictest0-21swapper/120:16:561
2141599493,28cyclictest0-21swapper/119:12:041
2141599492,39cyclictest16572-21irqstats22:02:021
2141399495,36cyclictest1369-21runrttasks22:57:550
2141399495,36cyclictest1369-21runrttasks22:57:550
2141399495,27cyclictest0-21swapper/021:39:020
21413994928,10cyclictest0-21swapper/023:37:020
127112492,40sleep00-21swapper/023:01:570
127112492,40sleep00-21swapper/023:01:570
103562492,9sleep30-21swapper/319:33:443
5892482,39sleep30-21swapper/319:13:083
2141799485,27cyclictest0-21swapper/323:29:203
2141799485,27cyclictest0-21swapper/322:44:123
2141799485,25cyclictest0-21swapper/323:04:153
2141799485,25cyclictest0-21swapper/323:04:153
2141799484,38cyclictest0-21swapper/320:02:133
2141799484,38cyclictest0-21swapper/320:02:133
2141799484,37cyclictest0-21swapper/323:01:373
2141799484,37cyclictest0-21swapper/323:01:373
2141799484,27cyclictest0-21swapper/322:02:093
2141799484,27cyclictest0-21swapper/300:01:053
21417994830,9cyclictest18873-21head19:52:063
21417994820,11cyclictest0-21swapper/300:07:093
2141799482,9cyclictest0-21swapper/323:51:493
21417994818,13cyclictest0-21swapper/319:17:093
21417994818,13cyclictest0-21swapper/319:17:093
21417994817,14cyclictest0-21swapper/323:21:363
2141699484,38cyclictest0-21swapper/221:41:402
2141599484,38cyclictest0-21swapper/122:01:341
2141599484,27cyclictest0-21swapper/100:07:071
2141599483,39cyclictest0-21swapper/122:51:531
2141599483,30cyclictest0-21swapper/120:26:571
2141599483,19cyclictest0-21swapper/121:31:591
2141599483,19cyclictest0-21swapper/121:31:591
2141399485,27cyclictest0-21swapper/021:19:110
2141399483,34cyclictest0-21swapper/023:59:430
21413994829,12cyclictest14096-21gltestperf19:42:070
236542472,38sleep20-21swapper/218:55:092
2141799476,16cyclictest0-21swapper/321:11:533
2141799475,24cyclictest27278-21iostat23:31:583
2141799474,24cyclictest7003-21iostat21:42:043
2141799474,14cyclictest0-21swapper/318:51:463
2141799473,11cyclictest0-21swapper/323:47:013
21417994713,10cyclictest0-21swapper/318:57:023
2141699473,12cyclictest0-21swapper/219:41:592
2141599474,26cyclictest0-21swapper/120:07:131
2141599473,38cyclictest0-21swapper/123:16:381
21415994728,15cyclictest0-21swapper/121:13:331
21415994727,14cyclictest0-21swapper/121:03:561
2141399474,35cyclictest0-21swapper/022:46:030
2141799465,14cyclictest0-21swapper/320:01:443
2141799464,26cyclictest0-21swapper/319:27:083
2141799464,12cyclictest0-21swapper/300:11:573
2141799464,11cyclictest0-21swapper/321:01:423
21417994615,13cyclictest0-21swapper/320:45:123
2141699465,23cyclictest0-21swapper/223:40:052
2141699462,39cyclictest0-21swapper/221:42:052
2141599463,27cyclictest0-21swapper/123:01:521
2141599463,27cyclictest0-21swapper/123:01:521
21415994628,12cyclictest15969-21ls20:52:161
2141399464,25cyclictest0-21swapper/000:01:470
21413994617,12cyclictest0-21swapper/022:13:090
101762462,9sleep30-21swapper/300:02:413
2141799453,26cyclictest0-21swapper/319:07:053
2141799452,25cyclictest0-21swapper/322:52:103
2141699454,13cyclictest0-21swapper/219:22:192
21416994522,11cyclictest0-21swapper/223:43:332
2141599454,35cyclictest0-21swapper/121:51:501
21417994426,13cyclictest0-21swapper/321:32:063
21417994426,13cyclictest0-21swapper/321:32:063
2141799433,24cyclictest0-21swapper/322:36:513
243799380,4rtkit-daemon2436-21rtkit-daemon18:50:492
2141599374,28cyclictest0-21swapper/118:51:451
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional