You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-17 - 02:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Thu Sep 17, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991030,5rtkit-daemon2193-21rtkit-daemon22:09:450
556899994,88cyclictest0-21swapper/022:21:570
556899985,20cyclictest1884-21latency21:55:530
556899964,84cyclictest0-21swapper/022:35:410
5568999513,75cyclictest14164-21ntp_offset20:35:590
556899948,10cyclictest21061-21sshd20:46:030
556899946,80cyclictest12551-21df19:45:480
5568999422,7cyclictest18552-21ssh21:31:050
556899936,80cyclictest0-21swapper/019:43:170
556899936,80cyclictest0-21swapper/019:43:170
556899935,32cyclictest0-21swapper/022:30:040
556899935,32cyclictest0-21swapper/022:30:040
556899933,83cyclictest0-21swapper/021:01:020
556899914,32cyclictest0-21swapper/021:19:480
556899914,28cyclictest0-21swapper/020:02:250
5568999134,50cyclictest0-21swapper/020:21:020
5568999134,50cyclictest0-21swapper/020:21:020
219499910,4rtkit-daemon2193-21rtkit-daemon20:16:273
556899905,32cyclictest0-21swapper/019:01:050
556899905,32cyclictest0-21swapper/018:06:050
556899904,34cyclictest0-21swapper/019:35:460
556899904,25cyclictest0-21swapper/020:12:080
556899904,14cyclictest0-21swapper/022:16:040
556899904,13cyclictest0-21swapper/020:06:060
219499900,12rtkit-daemon2193-21rtkit-daemon18:49:383
557199893,79cyclictest10173-21gltestperf18:40:561
556899896,34cyclictest0-21swapper/020:35:020
556899895,33cyclictest0-21swapper/022:50:320
556899895,32cyclictest0-21swapper/022:45:440
556899894,32cyclictest0-21swapper/021:05:520
556899894,32cyclictest0-21swapper/021:05:520
556899894,26cyclictest0-21swapper/020:41:290
5568998930,12cyclictest0-21swapper/021:40:580
5571998833,38cyclictest5434-21kworker/1:222:29:451
5571998833,38cyclictest5434-21kworker/1:222:29:451
556899885,32cyclictest0-21swapper/022:31:010
556899884,33cyclictest0-21swapper/022:00:400
556899884,26cyclictest0-21swapper/021:47:450
556899884,26cyclictest0-21swapper/021:47:450
556899884,18cyclictest0-21swapper/022:42:510
556899884,13cyclictest0-21swapper/021:20:480
5568998820,10cyclictest30575-21latency_hist19:25:360
219499880,12rtkit-daemon2193-21rtkit-daemon17:46:263
5571998722,47cyclictest0-21swapper/121:21:121
556899876,30cyclictest0-21swapper/021:11:010
556899874,33cyclictest0-21swapper/018:15:500
556899874,33cyclictest0-21swapper/017:40:220
556899874,31cyclictest0-21swapper/021:55:280
556899873,37cyclictest0-21swapper/020:56:150
5568998726,13cyclictest0-21swapper/019:31:080
219499870,5rtkit-daemon2193-21rtkit-daemon22:07:001
219499870,5rtkit-daemon2193-21rtkit-daemon17:55:553
219499870,11rtkit-daemon2193-21rtkit-daemon18:14:173
557199864,75cyclictest0-21swapper/122:45:471
5571998627,42cyclictest0-21swapper/121:10:501
5571998624,43cyclictest0-21swapper/120:50:581
556899864,30cyclictest0-21swapper/019:55:350
556899864,10cyclictest2713-21sh20:20:320
556899863,32cyclictest0-21swapper/020:51:040
5568998625,12cyclictest0-21swapper/022:14:200
219499860,5rtkit-daemon2193-21rtkit-daemon19:55:583
557199854,75cyclictest0-21swapper/122:16:421
557199853,28cyclictest29281-21munin-node21:00:431
556899855,32cyclictest0-21swapper/020:30:330
556899855,32cyclictest0-21swapper/020:30:330
556899855,12cyclictest0-21swapper/021:36:020
556899854,31cyclictest14297-21gltestperf21:25:510
556899854,11cyclictest32556-21unixbench_multi19:26:080
219499850,5rtkit-daemon2193-21rtkit-daemon22:12:233
557199843,74cyclictest0-21swapper/121:50:511
5571998424,53cyclictest25112-21switchtime19:11:071
5571998424,44cyclictest0-21swapper/121:38:191
556899844,32cyclictest0-21swapper/018:55:330
556899844,31cyclictest0-21swapper/020:00:350
556899844,31cyclictest0-21swapper/018:00:570
556899844,13cyclictest0-21swapper/017:56:090
556899844,11cyclictest13425-21unixbench_multi18:46:090
556899843,22cyclictest0-21swapper/019:10:580
5568998425,9cyclictest29408-21latency_hist18:15:380
5568998425,14cyclictest0-21swapper/017:49:110
5568998425,12cyclictest4302-21latency_hist18:30:380
5568998425,12cyclictest4302-21latency_hist18:30:380
219499840,6rtkit-daemon2193-21rtkit-daemon20:11:283
219499840,4rtkit-daemon2193-21rtkit-daemon19:53:133
557199834,72cyclictest0-21swapper/118:11:091
557199833,73cyclictest0-21swapper/120:38:511
557199833,72cyclictest0-21swapper/122:10:291
5571998328,48cyclictest13957-21unixbench_singl19:46:071
5571998325,52cyclictest17042-21cpuspeed_turbos21:30:451
5571998324,53cyclictest0-21swapper/121:55:361
556899835,33cyclictest0-21swapper/017:50:560
557199824,8cyclictest1227-21runrttasks19:51:321
557199824,70cyclictest0-21swapper/122:40:291
557199824,70cyclictest0-21swapper/120:22:101
557199824,70cyclictest0-21swapper/120:22:101
557199823,72cyclictest3920-21ssh19:31:521
557199823,72cyclictest0-21swapper/122:30:491
557199823,71cyclictest0-21swapper/120:09:211
557199823,23cyclictest0-21swapper/121:19:131
5571998222,52cyclictest0-21swapper/119:38:061
5571998220,55cyclictest0-21swapper/120:25:481
5571998220,55cyclictest0-21swapper/120:25:481
556899824,25cyclictest0-21swapper/018:20:520
219499820,5rtkit-daemon2193-21rtkit-daemon21:09:253
219499820,5rtkit-daemon2193-21rtkit-daemon21:09:253
219499820,4rtkit-daemon2193-21rtkit-daemon22:34:073
557199817,66cyclictest32068-21needreboot19:26:011
557199813,71cyclictest0-21swapper/122:21:051
557199813,71cyclictest0-21swapper/121:00:021
5571998126,40cyclictest0-21swapper/118:17:031
5571998124,9cyclictest32547-21df_inode20:15:481
557199812,72cyclictest0-21swapper/119:56:491
556899814,32cyclictest0-21swapper/018:35:500
83812800,5sleep20-21swapper/220:27:002
83812800,5sleep20-21swapper/220:27:002
557199803,70cyclictest0-21swapper/122:53:571
557199803,70cyclictest0-21swapper/118:30:581
5571998024,49cyclictest13409-21df_abs17:40:521
5571998024,49cyclictest13409-21df_abs17:40:521
5571998022,8cyclictest32576-21df_abs18:20:521
219499800,4rtkit-daemon2193-21rtkit-daemon22:54:293
219499800,4rtkit-daemon2193-21rtkit-daemon21:35:243
219499800,4rtkit-daemon2193-21rtkit-daemon21:13:253
557199793,69cyclictest0-21swapper/121:06:231
557199793,69cyclictest0-21swapper/121:06:231
557199793,69cyclictest0-21swapper/119:40:491
557199793,69cyclictest0-21swapper/119:40:491
5571997929,43cyclictest7934-21crond17:30:391
5571997926,47cyclictest19169-21cpuspeed_turbos19:00:501
5571997925,47cyclictest28847-21ssh20:10:461
5571997924,9cyclictest28781-21cpuspeed_turbos19:20:511
5571997918,10cyclictest9576-21aten_r1power_cu20:30:471
556899794,32cyclictest0-21swapper/019:05:590
556899794,32cyclictest0-21swapper/019:05:590
557199784,28cyclictest16885-21tune2fs20:40:511
557199783,67cyclictest0-21swapper/117:46:481
557199783,27cyclictest0-21swapper/120:45:481
5571997821,9cyclictest8197-21runrttasks18:36:041
5571997820,8cyclictest1227-21runrttasks18:10:311
556899784,35cyclictest0-21swapper/018:31:090
219499780,6rtkit-daemon2193-21rtkit-daemon19:31:073
557199776,10cyclictest24237-21expr21:40:491
557199773,67cyclictest22482-21munin-node18:01:121
557199773,26cyclictest23952-21awk20:01:061
5571997725,46cyclictest0-21swapper/122:04:471
5571997723,9cyclictest12463-21fschecks_time18:45:541
5571997721,9cyclictest2900-21fschecks_time18:25:551
5571997721,9cyclictest2900-21fschecks_time18:25:551
5571997712,52cyclictest0-21swapper/117:32:021
557199763,67cyclictest0-21swapper/122:40:331
557199763,29cyclictest0-21swapper/121:25:471
5571997622,9cyclictest1227-21runrttasks19:16:541
5571997610,15cyclictest0-21swapper/118:55:481
556899763,30cyclictest9973-21runrttasks17:31:150
557199753,64cyclictest0-21swapper/117:35:511
5571997524,8cyclictest27800-21missed_timers21:45:531
5571997524,8cyclictest27800-21missed_timers21:45:531
5571997421,8cyclictest22168-21hwlatdetect19:05:571
5571997421,8cyclictest22168-21hwlatdetect19:05:571
5571997412,11cyclictest0-21swapper/118:51:081
557199739,11cyclictest0-21swapper/117:51:001
219499730,5rtkit-daemon37-21ksoftirqd/320:08:583
219499730,5rtkit-daemon2193-21rtkit-daemon19:06:003
219499730,5rtkit-daemon2193-21rtkit-daemon19:06:003
5571997216,10cyclictest1227-21runrttasks17:55:561
556899724,32cyclictest0-21swapper/018:41:050
219499680,18rtkit-daemon2193-21rtkit-daemon18:09:022
557299664,44cyclictest0-21swapper/218:46:042
557199653,26cyclictest5598-21cat17:25:401
239902640,3sleep30-21swapper/320:01:103
219499640,9rtkit-daemon2193-21rtkit-daemon20:02:432
219499640,6rtkit-daemon2193-21rtkit-daemon22:25:302
219499640,6rtkit-daemon2193-21rtkit-daemon22:25:302
557299634,40cyclictest0-21swapper/221:16:042
5572996313,9cyclictest29127-21df_abs20:10:482
219499630,5rtkit-daemon2193-21rtkit-daemon22:32:222
219499630,5rtkit-daemon2193-21rtkit-daemon22:13:452
219499630,4rtkit-daemon2193-21rtkit-daemon20:40:492
219499630,13rtkit-daemon2193-21rtkit-daemon18:35:543
219499630,13rtkit-daemon2193-21rtkit-daemon17:39:262
219499620,6rtkit-daemon0-21swapper/222:25:153
219499620,4rtkit-daemon2193-21rtkit-daemon21:38:542
219499620,13rtkit-daemon2193-21rtkit-daemon20:21:272
219499620,13rtkit-daemon2193-21rtkit-daemon20:21:272
219499620,12rtkit-daemon2193-21rtkit-daemon19:57:212
219499610,5rtkit-daemon2193-21rtkit-daemon18:16:102
219499610,4rtkit-daemon2193-21rtkit-daemon20:06:432
219499610,4rtkit-daemon2193-21rtkit-daemon18:50:532
219499610,12rtkit-daemon2193-21rtkit-daemon22:55:062
219499610,12rtkit-daemon2193-21rtkit-daemon21:44:462
219499610,12rtkit-daemon2193-21rtkit-daemon20:48:492
219499610,11rtkit-daemon2193-21rtkit-daemon19:53:432
219499610,11rtkit-daemon2193-21rtkit-daemon17:42:032
219499610,11rtkit-daemon2193-21rtkit-daemon17:42:032
219499600,12rtkit-daemon2193-21rtkit-daemon21:13:482
219499600,12rtkit-daemon2193-21rtkit-daemon21:00:262
219499600,12rtkit-daemon2193-21rtkit-daemon18:26:322
219499600,12rtkit-daemon2193-21rtkit-daemon18:26:322
219499600,12rtkit-daemon2193-21rtkit-daemon17:58:032
118822607,13sleep20-21swapper/220:32:542
5573995924,27cyclictest6331-21aten_r1power_en20:25:443
5573995924,27cyclictest6331-21aten_r1power_en20:25:443
5573995923,11cyclictest6912-21timerandwakeup19:36:063
557299594,37cyclictest0-21swapper/219:30:562
557299582,38cyclictest0-21swapper/222:01:512
219499580,6rtkit-daemon2193-21rtkit-daemon17:45:562
219499580,4rtkit-daemon2193-21rtkit-daemon21:23:323
7932572,12sleep30-21swapper/322:44:203
5573995741,10cyclictest23341-21cut18:00:583
219499570,5rtkit-daemon2193-21rtkit-daemon20:17:052
5573995612,24cyclictest1084-21lldpd19:20:513
219499560,3rtkit-daemon15639-21ssh20:39:413
557399556,28cyclictest1227-21runrttasks19:40:553
557399556,28cyclictest1227-21runrttasks19:40:553
557399555,30cyclictest0-21swapper/319:45:453
557299554,36cyclictest0-21swapper/221:58:392
557299554,31cyclictest0-21swapper/221:45:452
557299554,31cyclictest0-21swapper/221:45:452
219499550,5rtkit-daemon2193-21rtkit-daemon22:49:062
219499550,5rtkit-daemon2193-21rtkit-daemon18:01:032
219499550,3rtkit-daemon17052-21ssh22:20:153
197602553,45sleep20-21swapper/221:35:302
557399545,42cyclictest34-21rcuc/321:35:473
557299544,30cyclictest0-21swapper/222:15:502
5572995422,15cyclictest0-21swapper/221:25:212
5532543,44sleep2684-21ssh21:05:472
5532543,44sleep2684-21ssh21:05:472
219499540,5rtkit-daemon2193-21rtkit-daemon20:52:562
219499540,5rtkit-daemon2193-21rtkit-daemon20:20:573
219499540,5rtkit-daemon2193-21rtkit-daemon20:20:573
74742533,43sleep37628-21fschecks_time21:15:483
557399538,27cyclictest0-21swapper/321:40:523
5573995337,9cyclictest25344-21grep19:11:093
5573995333,13cyclictest4850-21cpuspeed_turbos18:30:543
557399532,37cyclictest0-21swapper/318:58:033
557299538,27cyclictest0-21swapper/220:36:082
557299534,30cyclictest0-21swapper/219:36:032
557299533,27cyclictest0-21swapper/221:51:552
5568995328,11cyclictest0-21swapper/018:56:080
228572532,11sleep30-21swapper/322:27:153
228572532,11sleep30-21swapper/322:27:153
219499530,5rtkit-daemon2193-21rtkit-daemon22:06:013
219499530,5rtkit-daemon2193-21rtkit-daemon21:26:022
219499530,5rtkit-daemon2193-21rtkit-daemon17:30:562
219499530,4rtkit-daemon3485-21ssh22:46:213
219499530,4rtkit-daemon3215-21ssh21:57:463
557399526,29cyclictest0-21swapper/321:49:593
557399526,29cyclictest0-21swapper/321:49:593
557399524,29cyclictest0-21swapper/321:00:433
557399524,29cyclictest0-21swapper/318:20:473
5573995235,10cyclictest19744-21gltestperf19:00:563
557299524,30cyclictest0-21swapper/219:40:582
557299524,30cyclictest0-21swapper/219:40:582
557299524,29cyclictest0-21swapper/219:15:532
557299524,27cyclictest0-21swapper/222:25:142
557299524,26cyclictest0-21swapper/219:03:052
557299524,25cyclictest0-21swapper/222:05:332
5572995233,12cyclictest12944-21gltestperf19:45:532
5568995223,11cyclictest0-21swapper/017:45:390
5568995223,11cyclictest0-21swapper/017:45:390
219499520,5rtkit-daemon2193-21rtkit-daemon22:35:592
219499520,5rtkit-daemon2193-21rtkit-daemon21:00:482
219499520,5rtkit-daemon2193-21rtkit-daemon20:46:113
219499520,5rtkit-daemon2193-21rtkit-daemon19:11:002
219499520,3rtkit-daemon18405-21ssh20:42:413
557399515,27cyclictest0-21swapper/321:55:003
557399514,29cyclictest0-21swapper/320:55:543
5573995122,13cyclictest0-21swapper/320:30:473
5573995119,11cyclictest1428-21munin-run19:30:343
557299514,29cyclictest0-21swapper/218:31:132
557299514,29cyclictest0-21swapper/218:11:092
557299514,28cyclictest0-21swapper/218:36:132
5572995120,13cyclictest0-21swapper/219:05:522
5572995120,13cyclictest0-21swapper/219:05:522
219499510,5rtkit-daemon2193-21rtkit-daemon19:27:292
219499510,5rtkit-daemon2193-21rtkit-daemon17:44:413
219499510,5rtkit-daemon2193-21rtkit-daemon17:44:413
219499510,4rtkit-daemon2193-21rtkit-daemon18:08:403
557399504,39cyclictest0-21swapper/317:26:013
557399504,28cyclictest0-21swapper/322:35:453
557399504,28cyclictest0-21swapper/321:27:003
557399504,28cyclictest0-21swapper/320:50:483
557399504,28cyclictest0-21swapper/318:50:473
557399504,28cyclictest0-21swapper/318:40:513
557399504,28cyclictest0-21swapper/317:35:523
5573995020,13cyclictest0-21swapper/318:16:103
557299505,27cyclictest0-21swapper/222:40:532
557299504,28cyclictest0-21swapper/217:26:012
557299504,27cyclictest0-21swapper/217:50:552
557299504,26cyclictest0-21swapper/218:45:082
52562504,40sleep00-21swapper/017:22:040
185992502,42sleep20-21swapper/219:00:192
557399494,27cyclictest0-21swapper/322:00:473
5573994930,12cyclictest26880-21gltestperf19:15:543
557299494,27cyclictest0-21swapper/219:21:102
557399484,27cyclictest0-21swapper/318:25:573
557399484,27cyclictest0-21swapper/318:25:573
557399484,27cyclictest0-21swapper/317:51:453
557299484,27cyclictest0-21swapper/218:20:492
557399474,26cyclictest0-21swapper/317:31:033
53522474,6sleep20-21swapper/217:23:182
556899434,32cyclictest0-21swapper/017:25:540
5568994326,12cyclictest0-21swapper/019:15:520
33752414,30sleep30-21swapper/317:20:463
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional