You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-13 - 06:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Sat Jun 13, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991110,6rtkit-daemon2193-21rtkit-daemon00:04:543
2194991080,6rtkit-daemon0-21swapper/322:19:293
3229899999,71cyclictest0-21swapper/021:34:530
3229899984,86cyclictest0-21swapper/023:55:430
3230599954,66cyclictest0-21swapper/322:26:013
3229899953,84cyclictest1227-21runrttasks22:50:120
3229899953,84cyclictest1227-21runrttasks22:50:120
3229899953,23cyclictest3678-21ssh00:21:050
3229899944,83cyclictest0-21swapper/022:21:080
32298999415,61cyclictest30971-21iostat23:26:060
32298999415,61cyclictest30971-21iostat23:26:060
219499940,5rtkit-daemon2193-21rtkit-daemon00:00:552
32305999324,48cyclictest0-21swapper/323:33:153
3229899937,70cyclictest0-21swapper/021:56:210
32298999322,55cyclictest0-21swapper/023:16:100
3230599924,65cyclictest0-21swapper/320:01:223
3230599924,65cyclictest0-21swapper/320:01:223
3230599923,9cyclictest107550irq/46-eth023:26:033
3230599923,9cyclictest107550irq/46-eth023:26:033
3229899924,81cyclictest0-21swapper/022:01:180
3229899923,28cyclictest10872-21latency_hist23:45:440
32298999218,9cyclictest14308-21ssh23:01:090
3230599914,65cyclictest0-21swapper/321:50:193
3230599914,62cyclictest0-21swapper/319:21:043
3230599914,62cyclictest0-21swapper/319:21:043
3230599913,23cyclictest21067-21fschecks_time21:36:073
3229899914,80cyclictest0-21swapper/000:16:040
3230599904,70cyclictest0-21swapper/321:43:543
3229899904,78cyclictest0-21swapper/021:12:380
3229899903,80cyclictest0-21swapper/021:39:330
3230599893,23cyclictest20246-21munin-run20:45:503
32305998924,58cyclictest0-21swapper/321:30:413
32305998924,58cyclictest0-21swapper/321:30:413
3229899895,77cyclictest0-21swapper/000:07:420
3229899895,77cyclictest0-21swapper/000:07:420
3229899894,78cyclictest0-21swapper/021:42:000
3229899894,78cyclictest0-21swapper/021:01:080
3229899894,77cyclictest0-21swapper/021:16:060
3229899893,22cyclictest25031-21diskmemload22:41:130
3229899893,22cyclictest25031-21diskmemload22:41:130
32298998923,60cyclictest0-21swapper/021:21:020
3230599885,22cyclictest0-21swapper/323:11:003
3230599884,77cyclictest0-21swapper/323:21:113
3230599884,69cyclictest0-21swapper/323:04:433
3230599884,68cyclictest0-21swapper/319:16:193
3230599884,24cyclictest0-21swapper/323:19:283
3230599884,24cyclictest0-21swapper/322:49:243
3230599884,24cyclictest0-21swapper/322:49:243
3230599884,24cyclictest0-21swapper/322:36:553
3230599884,22cyclictest6573-21sort22:01:183
32305998816,12cyclictest0-21swapper/321:52:383
3229899885,77cyclictest0-21swapper/021:51:120
3229899884,76cyclictest0-21swapper/020:57:110
3229899883,77cyclictest0-21swapper/022:37:290
219499880,5rtkit-daemon2193-21rtkit-daemon19:12:512
3230599874,25cyclictest0-21swapper/300:24:273
3230599874,23cyclictest0-21swapper/322:58:553
3229899875,75cyclictest0-21swapper/023:58:410
3229899874,76cyclictest0-21swapper/023:06:020
3229899874,76cyclictest0-21swapper/022:50:570
3229899874,76cyclictest0-21swapper/000:12:330
3229899874,68cyclictest0-21swapper/020:33:160
3229899874,26cyclictest0-21swapper/023:21:040
3229899873,78cyclictest0-21swapper/023:37:450
3229899873,77cyclictest0-21swapper/023:48:480
3230599865,73cyclictest0-21swapper/322:06:113
3230599865,73cyclictest0-21swapper/322:06:113
3230599865,25cyclictest0-21swapper/321:56:153
3230599864,75cyclictest0-21swapper/323:43:523
3230599864,66cyclictest0-21swapper/323:06:133
3230599864,65cyclictest0-21swapper/321:16:233
3230599864,64cyclictest0-21swapper/322:53:173
3230599864,25cyclictest0-21swapper/319:11:063
3230599864,23cyclictest0-21swapper/323:37:533
3230599864,22cyclictest0-21swapper/322:42:453
3230599864,22cyclictest0-21swapper/322:42:453
32305998620,47cyclictest0-21swapper/321:31:093
3229899864,75cyclictest0-21swapper/022:58:260
3229899864,75cyclictest0-21swapper/022:31:190
3229899863,75cyclictest1124-21snmpd23:31:550
32298998625,52cyclictest32196-21wc20:01:110
32298998625,52cyclictest32196-21wc20:01:110
219499860,5rtkit-daemon2193-21rtkit-daemon00:22:092
3230599855,73cyclictest0-21swapper/322:14:393
3230599855,23cyclictest0-21swapper/320:57:513
3230599854,63cyclictest0-21swapper/300:10:553
3230599854,62cyclictest0-21swapper/320:26:183
3230599854,61cyclictest0-21swapper/320:46:173
3230599854,61cyclictest0-21swapper/320:46:173
3229899854,74cyclictest0-21swapper/022:27:060
3229899854,74cyclictest0-21swapper/022:06:010
3229899854,74cyclictest0-21swapper/022:06:010
3229899854,28cyclictest0-21swapper/023:14:380
3229899854,26cyclictest0-21swapper/021:46:410
3229899853,8cyclictest14254-21fschecks_count21:26:060
3229899853,8cyclictest14254-21fschecks_count21:26:060
3229899853,75cyclictest12318-21fschecks_count22:11:040
32298998522,56cyclictest0-21swapper/000:02:000
32298998518,12cyclictest0-21swapper/022:20:190
3230599844,62cyclictest0-21swapper/320:31:193
3230599844,24cyclictest0-21swapper/321:04:143
3230599844,14cyclictest0-21swapper/323:45:593
3229899844,73cyclictest0-21swapper/020:41:070
3229899843,74cyclictest0-21swapper/020:21:120
219499840,5rtkit-daemon2193-21rtkit-daemon21:06:092
3230599834,72cyclictest0-21swapper/323:57:473
3230599834,24cyclictest0-21swapper/321:14:503
3230599834,23cyclictest0-21swapper/300:08:233
3230599834,23cyclictest0-21swapper/300:08:233
32305998325,52cyclictest11651-21fgrep21:21:193
32305998323,51cyclictest1227-21runrttasks22:34:473
3229899834,72cyclictest0-21swapper/021:10:490
219499830,5rtkit-daemon2193-21rtkit-daemon21:31:082
219499830,5rtkit-daemon2193-21rtkit-daemon19:26:052
3230599825,23cyclictest0-21swapper/322:22:073
3230599825,23cyclictest0-21swapper/300:16:583
32305998230,45cyclictest6224-21cut19:06:183
3230599823,24cyclictest0-21swapper/318:56:093
3229899823,21cyclictest0-21swapper/019:12:380
219499820,5rtkit-daemon2193-21rtkit-daemon19:55:492
219499820,4rtkit-daemon2193-21rtkit-daemon22:00:592
3230599816,14cyclictest0-21swapper/319:40:543
3230599815,66cyclictest0-21swapper/320:17:523
3230599814,61cyclictest0-21swapper/323:51:083
3230599814,23cyclictest0-21swapper/321:07:043
3229899814,70cyclictest0-21swapper/020:35:590
3229899813,71cyclictest0-21swapper/019:02:360
32298998129,45cyclictest3127-21head20:06:230
32298998129,45cyclictest3127-21head20:06:230
32298998127,46cyclictest26268-21crond19:50:510
219499810,5rtkit-daemon2193-21rtkit-daemon21:59:372
219499810,5rtkit-daemon2193-21rtkit-daemon21:04:092
3230599804,68cyclictest0-21swapper/319:31:253
3229899804,69cyclictest0-21swapper/019:52:460
3230599794,59cyclictest0-21swapper/319:56:173
32305997934,38cyclictest1227-21runrttasks19:51:083
32305997923,48cyclictest16585-21sed20:36:083
3229899793,68cyclictest0-21swapper/018:56:110
3229899793,22cyclictest0-21swapper/020:27:510
219499790,5rtkit-daemon2193-21rtkit-daemon23:21:042
219499790,4rtkit-daemon2193-21rtkit-daemon22:45:582
219499790,4rtkit-daemon2193-21rtkit-daemon22:45:582
32298997820,50cyclictest0-21swapper/020:47:160
32298997820,50cyclictest0-21swapper/020:47:160
3230599774,56cyclictest0-21swapper/319:45:523
3229899773,68cyclictest0-21swapper/019:21:240
3229899773,68cyclictest0-21swapper/019:21:240
32298997720,10cyclictest23472-21unixbench_singl19:41:260
219499770,8rtkit-daemon0-21swapper/223:10:122
219499770,5rtkit-daemon2193-21rtkit-daemon22:35:352
3230599764,25cyclictest0-21swapper/320:06:083
3230599764,25cyclictest0-21swapper/320:06:083
3229899763,67cyclictest0-21swapper/020:16:390
3229899763,66cyclictest0-21swapper/019:06:130
3229899763,24cyclictest24310-21mailstats20:51:200
3229899763,21cyclictest10613-21gltestperf19:16:120
3230599755,15cyclictest0-21swapper/320:24:293
32305997525,42cyclictest3330-21fschecks_time19:01:113
3229899754,64cyclictest0-21swapper/019:26:150
3229899754,15cyclictest0-21swapper/019:31:120
3229899753,66cyclictest0-21swapper/019:56:160
219499750,7rtkit-daemon0-21swapper/223:39:482
3230599744,16cyclictest0-21swapper/320:12:283
3229899743,21cyclictest4070-21cpuspeed_turbos20:11:030
219499740,10rtkit-daemon0-21swapper/018:56:071
32305997320,10cyclictest1227-21runrttasks20:51:143
32298997317,9cyclictest20541-21cut19:36:170
219499730,8rtkit-daemon0-21swapper/200:00:022
32305997218,10cyclictest24717-21fschecks_count19:46:093
3229899724,25cyclictest0-21swapper/018:55:550
32305997117,10cyclictest16256-21unixbench_multi19:26:243
219499680,4rtkit-daemon2193-21rtkit-daemon22:26:062
229326718,42sleep22377-21interrupts20:06:102
229326718,42sleep22377-21interrupts20:06:102
32303996624,34cyclictest22988-21needreboot22:26:101
219499650,7rtkit-daemon2193-21rtkit-daemon21:23:462
32303996446,10cyclictest18213-21aten2.4-expect20:41:031
219499640,8rtkit-daemon0-21swapper/022:19:511
219499640,6rtkit-daemon0-21swapper/219:56:042
3230599625,16cyclictest0-21swapper/318:55:553
32303996228,12cyclictest0-21swapper/122:41:151
32303996228,12cyclictest0-21swapper/122:41:151
219499620,6rtkit-daemon0-21swapper/022:38:201
3230499614,13cyclictest0-21swapper/222:40:592
3230499614,13cyclictest0-21swapper/222:40:592
32303996141,13cyclictest0-21swapper/123:30:581
219499610,7rtkit-daemon0-21swapper/021:43:381
327582603,12sleep10-21swapper/121:06:081
3230499605,13cyclictest0-21swapper/222:16:052
3230499604,13cyclictest0-21swapper/222:06:042
3230499604,13cyclictest0-21swapper/222:06:042
3230499604,12cyclictest0-21swapper/200:11:092
3230399604,26cyclictest0-21swapper/123:46:071
22102602,11sleep20-21swapper/218:58:582
219499600,7rtkit-daemon0-21swapper/023:16:491
3230499594,13cyclictest0-21swapper/222:21:182
32303995941,12cyclictest0-21swapper/120:58:481
3230399593,47cyclictest0-21swapper/121:51:131
58582584,11sleep10-21swapper/123:36:131
3230499585,13cyclictest0-21swapper/222:55:512
3230399583,49cyclictest0-21swapper/123:30:231
3230399583,49cyclictest0-21swapper/123:30:231
3230499575,45cyclictest0-21swapper/221:36:012
3230499575,25cyclictest0-21swapper/223:13:462
3230499574,12cyclictest0-21swapper/221:26:232
3230499574,12cyclictest0-21swapper/221:26:232
71452564,45sleep10-21swapper/119:10:461
41882564,45sleep10-21swapper/121:11:081
3230499565,30cyclictest0-21swapper/222:51:052
32304995610,27cyclictest0-21swapper/200:06:012
32304995610,27cyclictest0-21swapper/200:06:012
271552563,46sleep10-21swapper/123:21:011
3230499555,31cyclictest0-21swapper/220:56:232
32304995540,9cyclictest10241-21unixbench_multi20:21:232
3230499554,28cyclictest0-21swapper/219:21:192
3230499554,28cyclictest0-21swapper/219:21:192
3230499554,13cyclictest0-21swapper/223:16:012
32304995538,10cyclictest23194-21cpuspeed_turbos20:51:042
32304995537,10cyclictest5080-21unixbench_singl21:11:202
3230499553,44cyclictest2521-21python23:31:132
32304995511,14cyclictest0-21swapper/223:41:052
32303995537,12cyclictest0-21swapper/121:32:071
32303995526,13cyclictest0-21swapper/100:06:011
32303995526,13cyclictest0-21swapper/100:06:011
236392554,12sleep10-21swapper/119:42:591
3230499544,31cyclictest0-21swapper/221:51:162
3230499544,12cyclictest0-21swapper/221:43:332
3230499543,44cyclictest0-21swapper/200:16:132
3230399545,34cyclictest0-21swapper/100:00:461
3230399544,8cyclictest107550irq/46-eth022:31:201
3230399544,41cyclictest13016-21gltestperf19:21:121
3230399544,41cyclictest13016-21gltestperf19:21:121
32303995437,9cyclictest10273-21df_inode22:55:591
32303995436,12cyclictest0-21swapper/121:56:501
32303995422,13cyclictest0-21swapper/123:01:001
32303995410,34cyclictest0-21swapper/119:34:511
248902543,44sleep10-21swapper/120:54:061
161512543,13sleep20-21swapper/223:05:422
144592543,12sleep10-21swapper/122:14:451
3230499534,42cyclictest0-21swapper/221:16:092
3230499534,30cyclictest0-21swapper/223:26:082
3230499534,30cyclictest0-21swapper/223:26:082
32304995321,14cyclictest0-21swapper/220:26:132
32304995320,13cyclictest0-21swapper/222:11:082
3230399535,38cyclictest0-21swapper/121:16:171
3230399535,15cyclictest0-21swapper/123:44:491
3230399534,41cyclictest18749-21gltestperf23:56:021
32303995337,11cyclictest0-21swapper/123:07:061
32303995334,12cyclictest0-21swapper/122:01:051
3230399533,24cyclictest0-21swapper/122:46:091
3230399533,24cyclictest0-21swapper/122:46:091
32303995328,17cyclictest0-21swapper/122:21:141
32303995315,22cyclictest0-21swapper/122:10:051
32303995315,22cyclictest0-21swapper/122:10:051
94042523,43sleep10-21swapper/119:14:091
3230499524,30cyclictest0-21swapper/220:46:062
3230499524,30cyclictest0-21swapper/220:46:062
3230499524,28cyclictest0-21swapper/223:46:012
3230499524,28cyclictest0-21swapper/222:36:022
32304995232,11cyclictest16320-21unixbench_multi23:51:202
32304995220,14cyclictest0-21swapper/219:34:092
3230499522,35cyclictest0-21swapper/220:16:192
3230399524,42cyclictest0-21swapper/100:15:551
3230399524,41cyclictest0-21swapper/123:11:161
3230399524,23cyclictest28671-21aten2.4-expect21:01:011
32303995236,11cyclictest0-21swapper/121:25:401
32303995233,12cyclictest0-21swapper/100:20:581
32303995233,11cyclictest27371-21tr21:46:001
81042514,41sleep10-21swapper/120:18:151
3230499514,29cyclictest0-21swapper/221:50:152
3230499514,29cyclictest0-21swapper/220:45:502
3230499514,29cyclictest0-21swapper/219:06:242
32304995131,12cyclictest4533-21tune2fs20:11:082
3230499513,31cyclictest0-21swapper/220:31:192
3230499513,29cyclictest0-21swapper/219:01:082
3230399515,29cyclictest0-21swapper/120:11:151
3230399515,29cyclictest0-21swapper/119:16:201
3230399515,28cyclictest0-21swapper/123:51:171
3230399514,29cyclictest0-21swapper/120:21:071
3230399514,23cyclictest0-21swapper/119:56:031
32303995135,11cyclictest0-21swapper/121:30:481
32303995135,11cyclictest0-21swapper/121:30:481
32303995135,11cyclictest0-21swapper/100:12:521
32303995134,9cyclictest9420-21crond22:55:451
32303995133,11cyclictest32328-21kernelversion20:01:141
32303995133,11cyclictest32328-21kernelversion20:01:141
278612513,12sleep10-21swapper/119:51:221
164942514,41sleep10-21swapper/119:28:121
3230499504,29cyclictest0-21swapper/220:37:522
32304995019,14cyclictest0-21swapper/220:01:022
32304995019,14cyclictest0-21swapper/220:01:022
3230399504,29cyclictest0-21swapper/119:46:281
3230399504,28cyclictest0-21swapper/119:01:221
32303995035,9cyclictest21318-21iwlist21:36:101
3230399502,34cyclictest0-21swapper/119:36:031
219499500,5rtkit-daemon2193-21rtkit-daemon19:39:502
31922493,40sleep10-21swapper/120:06:301
31922493,40sleep10-21swapper/120:06:301
109162493,11sleep10-21swapper/120:25:521
3230499485,28cyclictest0-21swapper/219:17:192
3230499484,26cyclictest0-21swapper/219:41:252
157002484,37sleep10-21swapper/120:35:561
153792483,39sleep10-21swapper/120:34:431
3230499464,24cyclictest0-21swapper/219:46:042
32303994631,10cyclictest0-21swapper/120:46:241
32303994631,10cyclictest0-21swapper/120:46:241
320442444,33sleep10-21swapper/118:53:011
32304993926,7cyclictest32431-21latency_hist18:55:552
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional