You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 08:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Mon Mar 16, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991250,5rtkit-daemon2484-21rtkit-daemon19:44:012
8520999231,41cyclictest112551munin-node21:33:090
8520999131,39cyclictest0-21swapper/021:53:010
248599880,6rtkit-daemon0-21swapper/123:10:151
83692870,5sleep18371-21sed23:03:001
83692870,5sleep18371-21sed23:03:001
8520998437,39cyclictest11244-21fschecks_count23:07:530
8520998434,42cyclictest10983-21crond21:32:380
8520998432,45cyclictest0-21swapper/020:17:570
8520998432,45cyclictest0-21swapper/020:17:570
8520998430,46cyclictest0-21swapper/020:03:200
8520998329,47cyclictest0-21swapper/020:36:580
8520998228,47cyclictest0-21swapper/022:52:520
8520998131,33cyclictest0-21swapper/022:26:100
8520998126,48cyclictest0-21swapper/021:23:030
8520998062,12cyclictest25751-21cat19:23:160
8520998035,38cyclictest9820-21munin-node19:53:110
8520998034,29cyclictest10559-21rm22:18:050
8520998034,29cyclictest10559-21rm22:18:050
8520998034,25cyclictest15015-21ssh21:37:540
8520998028,45cyclictest0-21swapper/021:43:560
8520998028,45cyclictest0-21swapper/021:43:560
8520997931,30cyclictest0-21swapper/021:47:520
8520997930,42cyclictest0-21swapper/019:18:050
8520997930,34cyclictest0-21swapper/020:23:140
8520997930,34cyclictest0-21swapper/020:23:140
8520997928,44cyclictest5306-21ssh22:11:330
8520997836,35cyclictest19206-21crond19:12:440
8520997833,30cyclictest14852-21taskset20:02:100
8520997830,40cyclictest0-21swapper/023:00:170
8520997830,40cyclictest0-21swapper/023:00:170
8520997829,41cyclictest0-21swapper/020:27:550
8520997829,32cyclictest0-21swapper/020:48:070
8520997826,34cyclictest0-21swapper/022:12:540
8520997825,46cyclictest0-21swapper/022:27:590
8520997824,35cyclictest0-21swapper/020:53:020
8520997735,27cyclictest23132-21ssh21:02:400
8520997732,28cyclictest19401-21fschecks_count20:08:000
8520997729,41cyclictest24288-21sed21:03:000
8520997729,41cyclictest0-21swapper/019:42:430
8520997729,41cyclictest0-21swapper/019:42:430
8520997728,34cyclictest0-21swapper/020:43:100
8520997728,18cyclictest0-21swapper/022:42:570
8520997727,32cyclictest0-21swapper/018:13:090
8520997727,32cyclictest0-21swapper/018:13:090
8520997631,37cyclictest1419-21runrttasks20:37:470
8520997629,41cyclictest0-21swapper/022:37:540
8520997629,40cyclictest0-21swapper/019:48:030
8520997625,19cyclictest0-21swapper/023:03:220
8520997625,19cyclictest0-21swapper/023:03:220
8520997529,40cyclictest0-21swapper/021:16:070
8520997529,39cyclictest30010-21ssh22:47:520
8520997528,30cyclictest0-21swapper/020:12:460
8520997527,41cyclictest0-21swapper/021:18:010
8520997525,35cyclictest0-21swapper/021:58:030
8520997523,44cyclictest0-21swapper/018:33:010
8520997429,30cyclictest0-21swapper/018:12:470
8520997427,29cyclictest20920-21ssh22:33:100
12162740,4sleep2281ktimersoftd/220:28:122
852499735,62cyclictest0-21swapper/219:48:042
8520997330,36cyclictest0-21swapper/018:03:200
8520997329,38cyclictest0-21swapper/021:11:320
8520997329,37cyclictest0-21swapper/019:27:530
8520997329,26cyclictest30218-21munin-node18:28:050
8520997327,31cyclictest0-21swapper/019:45:450
8520997327,29cyclictest0-21swapper/022:02:500
8520997326,40cyclictest0-21swapper/018:43:000
8523997227,13cyclictest0-21swapper/120:08:161
8520997228,37cyclictest0-21swapper/019:13:140
8520997227,39cyclictest7494-21munin-node18:48:180
8520997126,29cyclictest0-21swapper/018:37:570
8520997125,28cyclictest0-21swapper/017:53:190
8520997124,32cyclictest0-21swapper/019:03:100
8520997031,33cyclictest15902-21munin-node17:58:160
8520997028,37cyclictest11762-21runrttasks18:54:100
8520997026,29cyclictest0-21swapper/017:44:060
8520997023,33cyclictest0-21swapper/018:17:580
189152694,57sleep20-21swapper/218:03:062
104282680,5sleep1201ktimersoftd/117:43:211
852499674,57cyclictest0-21swapper/222:53:082
8520996721,40cyclictest0-21swapper/019:33:140
8523996648,11cyclictest0-21swapper/120:17:551
8523996648,11cyclictest0-21swapper/120:17:551
852499654,54cyclictest0-21swapper/220:53:132
852499654,54cyclictest0-21swapper/220:48:002
8520996521,31cyclictest0-21swapper/017:48:000
852499644,54cyclictest0-21swapper/221:03:092
852499644,54cyclictest0-21swapper/220:03:192
8520996419,30cyclictest0-21swapper/018:22:580
852499634,53cyclictest0-21swapper/219:53:132
8520996318,39cyclictest0-21swapper/018:58:170
8520996318,39cyclictest0-21swapper/018:58:170
28882633,9sleep13001-21unixbench_singl21:18:111
852499624,41cyclictest0-21swapper/221:51:292
852499623,53cyclictest0-21swapper/223:05:012
852499623,53cyclictest0-21swapper/223:05:012
8524996218,26cyclictest1287-21snmpd21:33:522
8523996246,9cyclictest24455-21ssh21:03:021
852499617,48cyclictest0-21swapper/222:47:542
852499614,50cyclictest0-21swapper/221:57:542
852499614,49cyclictest0-21swapper/218:13:042
852499614,49cyclictest0-21swapper/218:13:042
852499613,42cyclictest0-21swapper/222:28:012
852399614,13cyclictest0-21swapper/119:58:411
118312613,51sleep211890-21aten_r1power_en19:57:542
852499605,49cyclictest0-21swapper/222:11:422
852499605,47cyclictest0-21swapper/220:24:472
852499605,47cyclictest0-21swapper/220:24:472
852499605,24cyclictest0-21swapper/221:23:022
852499603,51cyclictest4234-21tr22:57:492
852499603,51cyclictest4234-21tr22:57:492
8524996016,26cyclictest0-21swapper/222:20:002
8524996016,26cyclictest0-21swapper/222:20:002
8523996039,14cyclictest0-21swapper/122:03:321
8523996039,14cyclictest0-21swapper/119:43:021
8520996042,11cyclictest8521-21taskset17:42:480
852499595,49cyclictest0-21swapper/222:22:532
852499594,49cyclictest0-21swapper/222:05:122
852499594,49cyclictest0-21swapper/221:53:032
852499594,49cyclictest0-21swapper/218:12:482
852499594,48cyclictest26502-21df_abs22:42:502
852499594,48cyclictest0-21swapper/221:44:052
852499594,48cyclictest0-21swapper/221:44:052
852499594,48cyclictest0-21swapper/219:32:442
852499593,50cyclictest0-21swapper/221:38:142
8524995919,23cyclictest0-21swapper/222:37:482
248599590,4rtkit-daemon2484-21rtkit-daemon20:08:452
154402593,48sleep30-21swapper/322:26:423
852499585,33cyclictest0-21swapper/218:33:182
852499584,50cyclictest0-21swapper/222:36:412
852499584,48cyclictest0-21swapper/221:31:252
852499583,49cyclictest0-21swapper/223:07:592
8524995815,25cyclictest0-21swapper/217:53:162
852399583,48cyclictest0-21swapper/121:54:191
248599580,4rtkit-daemon2484-21rtkit-daemon20:18:372
248599580,4rtkit-daemon2484-21rtkit-daemon20:18:372
248599580,4rtkit-daemon2484-21rtkit-daemon19:38:462
248599580,4rtkit-daemon2484-21rtkit-daemon19:38:462
852499574,48cyclictest0-21swapper/220:38:032
852499574,47cyclictest0-21swapper/221:14:092
852499574,46cyclictest0-21swapper/221:07:522
852499574,34cyclictest0-21swapper/219:13:042
852499573,49cyclictest0-21swapper/220:43:002
852499573,48cyclictest0-21swapper/218:00:082
8523995739,12cyclictest0-21swapper/122:29:421
852399573,48cyclictest0-21swapper/122:58:031
852399573,48cyclictest0-21swapper/122:58:031
852399573,48cyclictest0-21swapper/120:52:521
8523995713,25cyclictest0-21swapper/119:53:041
248599570,5rtkit-daemon2484-21rtkit-daemon18:26:263
852499565,31cyclictest0-21swapper/217:43:042
852499564,48cyclictest0-21swapper/221:18:372
852499564,47cyclictest0-21swapper/220:33:092
852499564,46cyclictest0-21swapper/220:57:552
852499563,47cyclictest0-21swapper/222:13:272
852499563,11cyclictest0-21swapper/220:15:422
8523995639,11cyclictest1419-21runrttasks21:26:521
8523995638,11cyclictest9214-21tail18:48:191
852399563,46cyclictest1109-21diskmemload21:32:551
852599552,47cyclictest0-21swapper/320:17:293
8525995517,33cyclictest0-21swapper/322:18:403
8525995517,33cyclictest0-21swapper/322:18:403
852499554,33cyclictest0-21swapper/218:18:092
852399554,31cyclictest0-21swapper/122:07:591
852399553,47cyclictest0-21swapper/120:26:131
852399553,47cyclictest0-21swapper/120:26:131
852399553,46cyclictest0-21swapper/119:47:471
852399553,38cyclictest0-21swapper/120:43:021
852399552,47cyclictest0-21swapper/121:14:521
8523995518,20cyclictest1419-21runrttasks21:28:011
8525995441,8cyclictest2513-21udisks-daemon21:53:013
8525995438,10cyclictest30187-21tr19:33:063
852599543,24cyclictest21099-21ssh20:58:023
8525995429,10cyclictest32044-21diskstats22:02:533
852499545,44cyclictest19224-21awk19:12:452
852399545,30cyclictest0-21swapper/121:49:071
8523995439,10cyclictest0-21swapper/120:14:561
8523995438,10cyclictest0-21swapper/122:38:421
8523995438,10cyclictest0-21swapper/120:04:441
8523995436,11cyclictest0-21swapper/119:02:561
852399543,45cyclictest0-21swapper/122:16:301
8523995416,32cyclictest26754-21munin-node21:08:011
79032542,46sleep10-21swapper/120:38:081
278552543,44sleep127918-21munin-node22:43:091
248599540,5rtkit-daemon2484-21rtkit-daemon19:08:173
133002545,11sleep30-21swapper/321:33:453
91402532,10sleep30-21swapper/321:28:053
852599533,43cyclictest0-21swapper/320:26:163
852599533,43cyclictest0-21swapper/320:26:163
8525995319,21cyclictest0-21swapper/319:47:183
852499535,38cyclictest0-21swapper/219:18:052
852499534,31cyclictest0-21swapper/218:38:102
8524995324,11cyclictest2513-21udisks-daemon19:23:072
852399534,40cyclictest0-21swapper/117:58:061
852399534,30cyclictest0-21swapper/118:17:581
852399534,27cyclictest0-21swapper/121:43:121
852399534,27cyclictest0-21swapper/121:43:121
8523995338,10cyclictest0-21swapper/121:58:181
852399533,32cyclictest0-21swapper/118:22:581
8523995321,14cyclictest0-21swapper/118:03:141
8523995321,13cyclictest12165-21nscd20:27:551
8525995238,9cyclictest0-21swapper/320:00:573
8525995234,11cyclictest0-21swapper/318:28:193
8525995217,20cyclictest25436-21taskset20:17:503
8525995217,20cyclictest25436-21taskset20:17:503
852499525,40cyclictest0-21swapper/218:42:592
852499522,26cyclictest0-21swapper/218:59:562
852499522,26cyclictest0-21swapper/218:59:562
852399525,30cyclictest0-21swapper/122:25:271
852399525,25cyclictest0-21swapper/120:33:001
852399523,45cyclictest0-21swapper/122:48:281
8523995219,14cyclictest0-21swapper/122:52:571
852599513,12cyclictest0-21swapper/321:12:583
8524995133,10cyclictest10250-21grep18:53:002
852499512,42cyclictest0-21swapper/218:23:112
8524995114,13cyclictest0-21swapper/218:48:102
8524995114,12cyclictest0-21swapper/217:48:062
8524995111,13cyclictest0-21swapper/219:03:212
852399519,31cyclictest0-21swapper/120:47:531
852399514,38cyclictest0-21swapper/118:53:061
8523995136,10cyclictest0-21swapper/122:19:371
8523995136,10cyclictest0-21swapper/122:19:371
8523995134,12cyclictest0-21swapper/122:33:091
852399513,42cyclictest0-21swapper/118:42:571
8523995121,13cyclictest0-21swapper/118:28:151
166552513,40sleep30-21swapper/317:58:073
8525995036,9cyclictest0-21swapper/320:32:583
852599503,41cyclictest0-21swapper/322:09:023
852599503,40cyclictest0-21swapper/321:58:023
8525995026,7cyclictest21754-21cat19:17:453
8525995024,12cyclictest0-21swapper/321:50:033
8525995020,12cyclictest0-21swapper/321:12:403
852599502,42cyclictest0-21swapper/320:28:503
8524995023,14cyclictest0-21swapper/218:28:032
852399504,29cyclictest0-21swapper/119:28:141
852399504,28cyclictest0-21swapper/119:23:061
852399504,28cyclictest0-21swapper/119:17:451
852399504,23cyclictest0-21swapper/118:37:571
8523995020,13cyclictest0-21swapper/118:08:171
249282502,9sleep10-21swapper/118:14:091
249282502,9sleep10-21swapper/118:14:091
248599500,5rtkit-daemon2484-21rtkit-daemon18:38:033
248599500,5rtkit-daemon2484-21rtkit-daemon18:33:413
852599499,33cyclictest0-21swapper/320:48:053
8525994935,9cyclictest0-21swapper/321:18:313
8525994935,10cyclictest0-21swapper/320:10:193
8525994930,13cyclictest0-21swapper/321:03:183
852599493,40cyclictest0-21swapper/319:22:553
852599493,38cyclictest0-21swapper/317:43:083
852599493,25cyclictest0-21swapper/320:37:433
8525994925,17cyclictest18484-21ssh20:07:423
8525994921,12cyclictest0-21swapper/322:47:503
8524994915,12cyclictest0-21swapper/219:32:532
852399496,36cyclictest0-21swapper/119:38:041
852399496,36cyclictest0-21swapper/119:38:041
852399494,27cyclictest0-21swapper/120:58:061
852399494,27cyclictest0-21swapper/117:42:491
852399494,11cyclictest15820-21memory21:38:041
290422493,38sleep128982-21munin-node19:32:531
852599484,37cyclictest0-21swapper/323:02:553
852599484,37cyclictest0-21swapper/323:02:553
8525994834,9cyclictest0-21swapper/319:53:423
852599483,41cyclictest0-21swapper/319:50:123
8523994818,12cyclictest0-21swapper/118:35:111
852599477,26cyclictest0-21swapper/322:56:113
852599475,23cyclictest0-21swapper/322:58:193
852599475,23cyclictest0-21swapper/322:58:193
852599474,24cyclictest0-21swapper/323:09:323
8525994733,10cyclictest0-21swapper/321:40:383
8525994731,10cyclictest22798-21aten_r1power_fr22:37:483
8525994731,10cyclictest22154-21cpuspeed_turbos19:17:593
8525994728,13cyclictest0-21swapper/321:42:503
8525994728,13cyclictest0-21swapper/321:42:503
852599472,41cyclictest0-21swapper/320:55:483
8525994716,26cyclictest18888-21sshd22:31:593
852399474,37cyclictest0-21swapper/117:52:471
8523994731,10cyclictest12569-21cpuspeed_turbos18:57:591
8523994731,10cyclictest12569-21cpuspeed_turbos18:57:591
852399473,37cyclictest0-21swapper/117:53:061
8523994717,13cyclictest0-21swapper/119:08:131
852599464,34cyclictest0-21swapper/319:42:433
852599464,34cyclictest0-21swapper/319:42:433
852599464,26cyclictest0-21swapper/322:46:003
852599464,25cyclictest0-21swapper/317:48:193
8525994633,7cyclictest20398-21iostat_ios22:33:003
852599456,14cyclictest0-21swapper/318:03:023
852599454,34cyclictest0-21swapper/317:53:003
8525994529,10cyclictest10747-21gltestperf18:53:053
8525994520,20cyclictest5657-21ls21:23:033
71612452,36sleep30-21swapper/318:46:323
251832452,37sleep30-21swapper/318:17:303
251832452,37sleep30-21swapper/318:17:303
852599445,33cyclictest0-21swapper/320:43:083
8525994429,9cyclictest6201-21cpuspeed_turbos22:12:513
248599440,4rtkit-daemon2484-21rtkit-daemon18:07:573
236752442,36sleep10-21swapper/119:18:551
141152442,35sleep30-21swapper/318:58:453
141152442,35sleep30-21swapper/318:58:453
852599435,32cyclictest0-21swapper/319:03:063
8525994328,9cyclictest7846-21tr18:48:003
273412432,9sleep30-21swapper/318:19:313
248599430,5rtkit-daemon2484-21rtkit-daemon17:42:133
248599410,4rtkit-daemon2484-21rtkit-daemon19:27:543
852499344,12cyclictest0-21swapper/217:42:492
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional