You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 04:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Tue Jun 23, 2026 00:44:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7544992913,16cyclictest19401-21kworker/0:123:05:480
755299270,1cyclictest16612-21ssh22:50:062
7552992620,5cyclictest8665-21ssh22:42:052
755299260,25cyclictest0-21swapper/223:40:242
755299260,21cyclictest18668-21ssh22:22:122
7544992619,6cyclictest19401-21kworker/0:123:30:520
755499250,24cyclictest10024-21diskmemload22:15:233
7552992520,4cyclictest10220-21ssh00:39:452
7552992520,4cyclictest0-21swapper/223:52:542
755299250,24cyclictest780-21diskmemload23:47:312
755299250,24cyclictest0-21swapper/222:03:272
755299250,24cyclictest0-21swapper/221:28:022
755299250,21cyclictest8916-21ssh21:15:532
755299250,21cyclictest2359-21ssh00:31:372
755299250,20cyclictest780-21diskmemload23:55:472
755299250,20cyclictest780-21diskmemload00:00:112
755299250,20cyclictest0-21swapper/200:05:042
755299250,1cyclictest7943-21ssh21:45:142
755299250,19cyclictest7038-21apt-get20:15:222
755299250,0cyclictest780-21diskmemload22:47:582
755299250,0cyclictest0-21swapper/221:58:382
754799250,24cyclictest780-21diskmemload22:28:581
754799250,24cyclictest780-21diskmemload00:12:481
754799250,24cyclictest0-21swapper/121:52:241
754799250,24cyclictest0-21swapper/100:29:091
7544992523,1cyclictest780-21diskmemload22:16:570
754499250,0cyclictest0-21swapper/023:35:310
7554992423,1cyclictest30953-21ssh00:29:093
755499240,23cyclictest979-21ssh23:05:053
755499240,23cyclictest4402-21rm21:40:433
755499240,23cyclictest2989-21ssh00:04:163
755499240,23cyclictest0-21swapper/321:32:023
755499240,0cyclictest0-21swapper/319:50:233
7552992423,1cyclictest0-21swapper/221:43:272
7552992420,4cyclictest0-21swapper/222:15:492
7552992420,3cyclictest0-21swapper/221:50:542
7552992419,0cyclictest26306-21apt-get20:55:242
7552992419,0cyclictest0-21swapper/222:08:072
755299240,24cyclictest0-21swapper/222:28:182
755299240,0cyclictest780-21diskmemload21:31:052
755299240,0cyclictest0-21swapper/223:36:132
755299240,0cyclictest0-21swapper/223:18:392
755299240,0cyclictest0-21swapper/223:09:242
7547992424,0cyclictest0-21swapper/121:57:221
754799240,23cyclictest0-21swapper/123:51:321
754799240,23cyclictest0-21swapper/123:01:331
754799240,23cyclictest0-21swapper/122:44:461
754799240,23cyclictest0-21swapper/121:10:281
754799240,1cyclictest8362-21ssh23:40:241
7544992423,1cyclictest780-21diskmemload21:14:540
7544992423,1cyclictest0-21swapper/022:38:520
7544992423,1cyclictest0-21swapper/019:50:230
754499240,24cyclictest0-21swapper/022:48:050
754499240,23cyclictest780-21diskmemload22:23:560
754499240,23cyclictest0-21swapper/021:57:390
754499240,23cyclictest0-21swapper/021:24:170
754499240,1cyclictest780-21diskmemload23:02:320
754499240,0cyclictest0-21swapper/023:22:440
7554992323,0cyclictest780-21diskmemload23:32:543
7554992323,0cyclictest0-21swapper/322:47:423
7554992323,0cyclictest0-21swapper/322:14:143
7554992323,0cyclictest0-21swapper/321:12:283
7554992323,0cyclictest0-21swapper/300:20:153
7554992322,0cyclictest0-21swapper/323:40:243
7554992321,2cyclictest19065-21apt-get20:40:233
7554992321,1cyclictest32761-21sh21:37:503
755499231,1cyclictest9706-21sh23:12:013
755499230,23cyclictest780-21diskmemload22:36:473
755499230,23cyclictest0-21swapper/322:40:243
755499230,23cyclictest0-21swapper/321:45:173
755499230,22cyclictest9060-21ssh21:16:043
755499230,22cyclictest6266-21ssh00:06:023
755499230,22cyclictest31175-21ssh22:05:093
755499230,22cyclictest29763-21rm22:32:023
755499230,22cyclictest22389-21rm23:51:463
755499230,22cyclictest18646-21ssh22:22:103
755499230,22cyclictest15220-21diskmemload21:21:413
755499230,0cyclictest780-21diskmemload23:27:303
755499230,0cyclictest0-21swapper/323:24:143
755499230,0cyclictest0-21swapper/321:55:383
7552992323,0cyclictest0-21swapper/223:13:432
7552992323,0cyclictest0-21swapper/221:22:122
7552992320,3cyclictest0-21swapper/223:00:172
7552992320,3cyclictest0-21swapper/222:57:262
7552992320,0cyclictest0-21swapper/223:30:082
7552992319,0cyclictest780-21diskmemload22:37:012
755299230,23cyclictest0-21swapper/222:10:352
755299230,23cyclictest0-21swapper/221:12:542
755299230,23cyclictest0-21swapper/200:22:502
755299230,22cyclictest29685-21sh00:27:292
755299230,22cyclictest24478-21cut23:25:252
755299230,22cyclictest23628-21apt20:50:012
755299230,22cyclictest12334-21perf19:20:012
755299230,0cyclictest0-21swapper/222:30:082
7547992323,0cyclictest0-21swapper/123:34:241
7547992323,0cyclictest0-21swapper/123:25:231
7547992323,0cyclictest0-21swapper/123:21:081
7547992323,0cyclictest0-21swapper/122:12:151
7547992323,0cyclictest0-21swapper/121:39:451
7547992323,0cyclictest0-21swapper/100:36:411
7547992322,0cyclictest0-21swapper/121:32:431
7547992321,1cyclictest26021-21perf20:55:011
7547992321,1cyclictest16295-21awk22:50:001
7547992321,1cyclictest0-21swapper/123:10:321
7547992321,1cyclictest0-21swapper/121:25:231
7547992321,1cyclictest0-21swapper/100:18:151
7547992320,3cyclictest11861-21apt-get20:25:241
754799230,22cyclictest780-21diskmemload00:01:531
754799230,22cyclictest16646-21missed_timers22:20:281
754799230,22cyclictest13078-21sh22:17:121
754799230,22cyclictest0-21swapper/123:38:181
754799230,22cyclictest0-21swapper/123:08:521
754799230,22cyclictest0-21swapper/122:51:241
754799230,22cyclictest0-21swapper/122:06:541
754799230,22cyclictest0-21swapper/100:33:171
754799230,1cyclictest30455-21apache200:00:011
754799230,1cyclictest0-21swapper/121:23:531
754799230,0cyclictest0-21swapper/122:36:471
754799230,0cyclictest0-21swapper/121:49:051
754799230,0cyclictest0-21swapper/121:19:101
754799230,0cyclictest0-21swapper/100:05:541
7544992323,0cyclictest0-21swapper/022:58:400
7544992323,0cyclictest0-21swapper/000:01:030
7544992322,1cyclictest0-21swapper/022:06:160
7544992320,2cyclictest15800-21sh23:45:350
754499231,21cyclictest0-21swapper/022:50:040
754499230,2cyclictest6641-21ssh00:06:310
754499230,23cyclictest780-21diskmemload23:44:080
754499230,23cyclictest0-21swapper/021:51:310
754499230,23cyclictest0-21swapper/000:16:170
754499230,22cyclictest8702-21rm22:42:160
754499230,22cyclictest30598-21grep00:00:010
754499230,22cyclictest29257-21sh22:03:250
754499230,22cyclictest21984-21/usr/sbin/munin00:20:280
754499230,22cyclictest11902-21sh23:15:010
754499230,22cyclictest0-21swapper/021:45:280
754499230,22cyclictest0-21swapper/021:28:040
754499230,22cyclictest0-21swapper/000:11:370
754499230,0cyclictest0-21swapper/022:32:090
7554992222,0cyclictest0-21swapper/322:01:243
7554992222,0cyclictest0-21swapper/300:35:593
7554992221,0cyclictest780-21diskmemload22:26:183
7554992220,1cyclictest14710-21sh19:25:013
7554992220,1cyclictest13573-21apt-config21:50:013
755499220,21cyclictest9465-21rm00:10:023
755499220,21cyclictest780-21diskmemload23:55:233
755499220,21cyclictest30541-21ssh23:01:333
755499220,21cyclictest13722-21ssh23:45:093
755499220,21cyclictest0-21swapper/319:20:013
755499220,21cyclictest0-21swapper/300:15:323
755499220,1cyclictest17948-21ssh22:50:293
7552992222,0cyclictest0-21swapper/200:11:172
7552992220,1cyclictest16648-21apt-get20:35:222
7552992219,0cyclictest0-21swapper/221:36:482
755299220,21cyclictest18453-21apt-get23:20:242
755299220,21cyclictest0-21swapper/221:10:002
7547992220,1cyclictest0-21swapper/123:16:181
7547992220,1cyclictest0-21swapper/121:05:251
754799220,21cyclictest26862-21ssh22:30:241
754799220,21cyclictest15006-21apt-get19:25:221
754799220,21cyclictest0-21swapper/123:46:491
754799220,21cyclictest0-21swapper/122:55:241
754799220,21cyclictest0-21swapper/122:03:001
754799220,0cyclictest0-21swapper/100:22:461
7544992222,0cyclictest0-21swapper/021:40:430
7544992222,0cyclictest0-21swapper/021:15:280
7544992221,1cyclictest780-21diskmemload00:30:120
7544992221,1cyclictest19802-21apt-get19:35:230
7544992220,1cyclictest62550irq/127-eno100:25:250
7544992220,1cyclictest12329-21ls19:20:010
7544992220,1cyclictest0-21swapper/019:55:230
754499220,22cyclictest0-21swapper/021:36:370
754499220,21cyclictest780-21diskmemload23:25:380
754499220,21cyclictest780-21diskmemload23:15:340
754499220,21cyclictest780-21diskmemload00:35:560
754499220,21cyclictest0-21swapper/023:50:120
754499220,21cyclictest0-21swapper/021:30:220
754499220,1cyclictest21167-21cron20:45:000
754499220,1cyclictest0-21swapper/022:13:310
7554992120,1cyclictest32265-21apt-get20:00:233
7554992120,0cyclictest0-21swapper/320:55:243
755499210,21cyclictest780-21diskmemload23:35:423
755499210,21cyclictest0-21swapper/321:25:013
755499210,20cyclictest780-21diskmemload23:15:083
755499210,20cyclictest30803-21cron21:05:013
755499210,0cyclictest0-21swapper/319:35:233
7547992119,1cyclictest606-21dbus-daemon21:00:011
754799210,15cyclictest0-21swapper/119:45:011
754799210,0cyclictest12612-21apt-get19:20:221
754799210,0cyclictest0-21swapper/120:00:231
7544992120,1cyclictest780-21diskmemload22:25:210
7544992119,1cyclictest27146-21sh19:50:000
754499210,21cyclictest0-21swapper/019:10:230
754499210,20cyclictest0-21swapper/020:35:230
754499210,20cyclictest0-21swapper/019:45:000
754499210,1cyclictest19523-21perf19:35:010
754499210,0cyclictest0-21swapper/020:45:240
754499210,0cyclictest0-21swapper/020:20:230
7554992020,0cyclictest0-21swapper/321:05:253
755499200,0cyclictest0-21swapper/320:20:513
7552992020,0cyclictest14255-21apt-get20:30:232
7552992020,0cyclictest0-21swapper/220:00:002
7552992020,0cyclictest0-21swapper/219:35:242
755299200,20cyclictest0-21swapper/219:30:232
755299200,0cyclictest0-21swapper/219:45:232
754799200,19cyclictest16382-21munin-run20:35:001
7544992020,0cyclictest23909-21apt-get20:50:230
7544992018,1cyclictest0-21swapper/019:25:010
754499200,0cyclictest0-21swapper/019:25:220
7554991919,0cyclictest0-21swapper/319:25:223
7554991917,1cyclictest26036-21munin-plugin-st20:55:013
755299190,18cyclictest0-21swapper/220:40:232
755299190,0cyclictest0-21swapper/219:25:222
7547991919,0cyclictest0-21swapper/120:40:231
7547991919,0cyclictest0-21swapper/120:35:231
7547991919,0cyclictest0-21swapper/119:50:231
754799190,2cyclictest9183-21perf20:20:011
7544991919,0cyclictest0-21swapper/020:55:240
7554991818,0cyclictest0-21swapper/319:55:233
7554991818,0cyclictest0-21swapper/319:30:233
755499180,17cyclictest9192-21idleruntime-cro20:20:013
7552991818,0cyclictest0-21swapper/220:10:242
7552991818,0cyclictest0-21swapper/219:20:222
7547991818,0cyclictest0-21swapper/120:20:231
7547991818,0cyclictest0-21swapper/120:10:241
7547991818,0cyclictest0-21swapper/119:35:231
7544991818,0cyclictest0-21swapper/021:05:250
7544991818,0cyclictest0-21swapper/020:00:230
7544991816,1cyclictest16379-21perf20:35:000
7554991717,0cyclictest0-21swapper/320:25:243
7554991716,1cyclictest16346-21idleruntime-cro20:35:003
7554991715,1cyclictest0-21swapper/320:35:233
7554991715,1cyclictest0-21swapper/320:10:243
7552991717,0cyclictest0-21swapper/221:00:232
7552991717,0cyclictest0-21swapper/219:40:232
7547991715,1cyclictest4343-21cron20:10:011
7547991714,1cyclictest313-21systemd-journal20:00:001
7544991717,0cyclictest0-21swapper/021:00:230
7544991715,1cyclictest9189-21munin-run20:20:010
755499160,15cyclictest27192-21sed19:50:003
755499160,15cyclictest0-21swapper/319:10:293
7552991616,0cyclictest0-21swapper/220:25:242
755299160,15cyclictest8323-21perl19:10:252
754799167,8cyclictest611-21irqbalance19:34:341
7547991616,0cyclictest0-21swapper/120:45:241
7547991614,1cyclictest0-21swapper/121:00:291
7554991514,1cyclictest2464-21cstates20:05:253
7554991514,1cyclictest21464-21apt-get20:45:243
7552991515,0cyclictest0-21swapper/220:05:242
7552991514,1cyclictest11580-21perf20:25:002
7552991514,1cyclictest0-21swapper/220:55:012
7552991513,1cyclictest313-21systemd-journal20:05:012
754499159,4cyclictest313-21systemd-journal20:10:010
755499140,0cyclictest0-21swapper/319:40:203
755299140,0cyclictest0-21swapper/219:50:112
7547991414,0cyclictest0-21swapper/119:41:511
7544991413,0cyclictest0-21swapper/020:10:240
754499140,0cyclictest0-21swapper/020:25:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional