You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 13:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Jul 26, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1493199280,23cyclictest14844-21ssh21:15:340
14933992723,0cyclictest0-21swapper/223:06:452
14931992722,4cyclictest8547-21diskmemload00:38:280
1493199260,2cyclictest26254-21ssh23:50:540
1493199260,1cyclictest0-21swapper/022:47:470
1493199260,1cyclictest0-21swapper/021:24:310
1493199260,0cyclictest0-21swapper/021:35:040
14934992523,1cyclictest0-21swapper/322:38:023
1493499250,24cyclictest0-21swapper/323:42:593
1493499250,1cyclictest606-21dbus-daemon21:40:003
14933992523,1cyclictest24825-21ssh00:18:352
14933992523,1cyclictest0-21swapper/221:23:442
14933992522,2cyclictest17660-21ssh22:16:362
1493299250,24cyclictest30578-21expr22:28:081
1493299250,0cyclictest0-21swapper/121:46:221
14931992523,2cyclictest0-21swapper/000:21:160
14931992520,4cyclictest0-21swapper/023:47:200
1493199250,24cyclictest18636-21/usr/sbin/munin00:13:160
1493199250,21cyclictest8547-21diskmemload00:18:280
1493199250,21cyclictest0-21swapper/022:02:460
1493199250,1cyclictest8547-21diskmemload23:23:540
1493199250,1cyclictest14290-21ssh22:13:110
1493199250,1cyclictest0-21swapper/022:25:000
1493199250,1cyclictest0-21swapper/021:44:240
1493199250,1cyclictest0-21swapper/000:26:460
14934992424,0cyclictest0-21swapper/322:46:143
14934992423,1cyclictest0-21swapper/319:43:203
1493499240,23cyclictest8547-21diskmemload00:33:463
1493499240,23cyclictest14288-21idleruntime-cro23:40:013
1493499240,23cyclictest0-21swapper/322:25:343
1493499240,23cyclictest0-21swapper/321:23:073
1493499240,23cyclictest0-21swapper/300:00:463
1493499240,1cyclictest0-21swapper/322:51:453
14933992422,2cyclictest15314-21ssh22:13:342
1493399242,21cyclictest23591-21ssh22:21:342
1493399242,21cyclictest10920-21sh21:41:412
14933992420,0cyclictest0-21swapper/200:27:402
1493399240,23cyclictest8547-21diskmemload22:59:102
1493399240,23cyclictest0-21swapper/222:29:482
1493399240,1cyclictest0-21swapper/221:25:552
1493399240,0cyclictest8547-21diskmemload00:02:032
14932992424,0cyclictest0-21swapper/122:57:201
1493299240,24cyclictest0-21swapper/122:11:111
1493299240,24cyclictest0-21swapper/121:15:531
14931992423,1cyclictest8547-21diskmemload23:14:260
14931992423,1cyclictest12463-21ssh23:08:380
14931992421,3cyclictest0-21swapper/021:53:550
14931992421,2cyclictest30813-21ssh22:28:090
14931992420,3cyclictest0-21swapper/023:18:280
1493199240,24cyclictest8547-21diskmemload22:54:030
1493199240,23cyclictest8547-21diskmemload22:40:510
1493199240,23cyclictest8547-21diskmemload22:40:510
1493199240,23cyclictest11122-21ssh00:07:540
1493199240,23cyclictest0-21swapper/022:35:090
1493199240,23cyclictest0-21swapper/021:58:130
1493199240,21cyclictest0-21swapper/023:02:490
1493199240,1cyclictest27548-21sh21:27:590
14934992323,0cyclictest8547-21diskmemload22:03:363
14934992323,0cyclictest0-21swapper/322:06:083
14934992323,0cyclictest0-21swapper/321:59:143
14934992323,0cyclictest0-21swapper/321:17:503
14934992323,0cyclictest0-21swapper/300:35:033
14934992322,1cyclictest0-21swapper/319:40:013
14934992321,1cyclictest0-21swapper/322:55:063
1493499230,23cyclictest0-21swapper/321:12:213
1493499230,22cyclictest9724-21munin-run20:05:003
1493499230,22cyclictest23924-21ssh00:18:153
1493499230,22cyclictest16809-21diskmemload22:43:553
1493499230,22cyclictest16809-21diskmemload22:43:553
1493499230,22cyclictest0-21swapper/323:25:213
1493499230,22cyclictest0-21swapper/323:11:253
1493499230,0cyclictest8547-21diskmemload22:13:283
1493499230,0cyclictest3466-21apt-get22:33:103
1493499230,0cyclictest0-21swapper/323:50:293
1493499230,0cyclictest0-21swapper/323:24:253
1493499230,0cyclictest0-21swapper/321:28:043
14933992323,0cyclictest8547-21diskmemload23:40:312
14933992323,0cyclictest8547-21diskmemload21:36:082
14933992323,0cyclictest0-21swapper/221:17:392
14933992323,0cyclictest0-21swapper/200:22:282
14933992322,0cyclictest0-21swapper/222:47:462
14933992320,2cyclictest5663-21sh22:05:232
14933992320,2cyclictest31615-21munin-plugin-st22:00:012
14933992320,2cyclictest31568-21ssh23:56:362
14933992319,2cyclictest16071-21sh00:12:032
1493399230,2cyclictest0-21swapper/223:04:062
1493399230,23cyclictest0-21swapper/221:53:532
1493399230,22cyclictest14484-21ssh00:38:402
1493399230,22cyclictest13709-21ssh23:10:042
1493399230,1cyclictest10146-21ssh00:06:302
1493399230,0cyclictest0-21swapper/223:35:512
1493399230,0cyclictest0-21swapper/222:38:382
1493399230,0cyclictest0-21swapper/221:10:302
14932992323,0cyclictest0-21swapper/123:33:451
14932992323,0cyclictest0-21swapper/123:21:241
14932992323,0cyclictest0-21swapper/121:42:541
14932992323,0cyclictest0-21swapper/121:25:511
14932992323,0cyclictest0-21swapper/100:36:431
14932992323,0cyclictest0-21swapper/100:34:021
14932992323,0cyclictest0-21swapper/100:01:341
14932992322,1cyclictest7626-21ssh22:36:131
14932992322,1cyclictest15697-21ssh23:12:531
14932992322,1cyclictest0-21swapper/123:35:171
14932992320,2cyclictest8305-21ssh23:05:191
1493299230,23cyclictest0-21swapper/122:21:351
1493299230,23cyclictest0-21swapper/121:36:291
1493299230,23cyclictest0-21swapper/100:11:381
1493299230,22cyclictest9737-21ssh21:11:111
1493299230,22cyclictest32485-21sh00:26:211
1493299230,22cyclictest31531-21ssh23:56:341
1493299230,22cyclictest19917-21ssh23:16:031
1493299230,1cyclictest15695-21ssh23:41:391
1493299230,0cyclictest0-21swapper/123:50:231
1493299230,0cyclictest0-21swapper/123:27:491
14931992323,0cyclictest0-21swapper/023:26:060
14931992323,0cyclictest0-21swapper/000:30:320
14931992321,2cyclictest62550irq/127-eno122:15:020
14931992320,2cyclictest0-21swapper/022:31:590
1493199231,4cyclictest13-21ksoftirqd/019:58:080
1493199230,2cyclictest2939-21sh21:33:360
1493199230,23cyclictest8547-21diskmemload23:32:130
1493199230,23cyclictest0-21swapper/023:55:390
1493199230,22cyclictest21766-21perf20:30:010
1493199230,1cyclictest0-21swapper/021:49:110
1493199230,1cyclictest0-21swapper/021:11:330
1493199230,0cyclictest0-21swapper/000:00:010
14934992222,0cyclictest8547-21diskmemload00:05:073
14934992222,0cyclictest0-21swapper/322:20:393
14934992222,0cyclictest0-21swapper/321:40:233
14934992221,1cyclictest8547-21diskmemload23:58:073
14934992220,2cyclictest26495-21sh00:20:363
14934992220,1cyclictest0-21swapper/323:15:163
1493499220,21cyclictest9832-21ssh23:07:253
1493499220,21cyclictest8547-21diskmemload00:26:123
1493499220,21cyclictest0-21swapper/323:46:343
1493499220,21cyclictest0-21swapper/323:33:103
1493499220,21cyclictest0-21swapper/323:00:153
1493499220,21cyclictest0-21swapper/322:15:523
1493499220,21cyclictest0-21swapper/321:45:403
1493499220,21cyclictest0-21swapper/321:31:543
1493499220,1cyclictest20939-21ssh21:50:113
14933992221,1cyclictest4787-21ssh00:30:142
14933992221,0cyclictest0-21swapper/223:50:432
14933992221,0cyclictest0-21swapper/220:58:072
14933992220,1cyclictest8547-21diskmemload23:20:522
14933992220,1cyclictest27311-21ls19:35:012
14933992220,1cyclictest0-21swapper/219:58:082
1493399220,21cyclictest8547-21diskmemload23:25:172
1493399220,21cyclictest8547-21diskmemload21:30:082
1493399220,21cyclictest28958-21cron20:45:002
1493399220,21cyclictest1645-21rm22:30:432
1493399220,21cyclictest0-21swapper/221:46:442
1493399220,1cyclictest8547-21diskmemload22:04:032
1493399220,1cyclictest24087-21ssh22:50:242
1493399220,1cyclictest10206-21apt-get20:08:072
14932992222,0cyclictest8547-21diskmemload23:00:041
14932992222,0cyclictest0-21swapper/122:18:231
14932992222,0cyclictest0-21swapper/122:09:351
14932992222,0cyclictest0-21swapper/121:24:411
14932992222,0cyclictest0-21swapper/120:33:071
14932992222,0cyclictest0-21swapper/100:07:161
14932992221,1cyclictest32176-21ssh22:00:261
14932992221,1cyclictest27977-21ssh00:22:461
14932992220,1cyclictest23014-21apt-get19:28:061
1493299220,22cyclictest2256-1kworker/u9:021:31:191
1493299220,22cyclictest0-21swapper/123:48:051
1493299220,22cyclictest0-21swapper/100:15:021
1493299220,21cyclictest12923-21sh22:40:521
1493299220,21cyclictest12923-21sh22:40:521
1493299220,1cyclictest6909-21apt-get20:00:001
1493299220,1cyclictest17477-21apt-get20:23:071
1493299220,0cyclictest0-21swapper/121:51:251
14931992220,2cyclictest0-21swapper/022:55:040
14931992220,1cyclictest8547-21diskmemload22:05:010
14931992220,1cyclictest19723-21turbostat.cron19:20:000
1493199220,21cyclictest0-21swapper/023:35:130
1493199220,21cyclictest0-21swapper/019:25:030
1493199220,1cyclictest28992-21munin-run20:45:000
14934992121,0cyclictest8547-21diskmemload00:10:253
1493499210,20cyclictest0-21swapper/320:28:073
1493499210,20cyclictest0-21swapper/319:33:053
1493499210,1cyclictest0-21swapper/319:15:003
1493399210,21cyclictest0-21swapper/223:15:302
1493399210,21cyclictest0-21swapper/222:40:342
1493399210,21cyclictest0-21swapper/222:40:342
14932992118,2cyclictest22121-21apt-get19:25:001
1493299210,20cyclictest27807-21apt-get19:38:061
1493299210,1cyclictest26587-21grep20:40:011
1493299210,0cyclictest0-21swapper/120:08:071
1493299210,0cyclictest0-21swapper/119:43:201
1493299210,0cyclictest0-21swapper/119:33:061
14931992121,0cyclictest0-21swapper/019:38:060
14931992119,1cyclictest0-21swapper/020:08:070
14931992118,1cyclictest313-21systemd-journal20:15:000
1493199210,2cyclictest20402-21cpuspeed_turbos19:23:070
1493199210,20cyclictest0-21swapper/020:03:070
1493199210,0cyclictest15061-21apt-get20:18:070
14934992020,0cyclictest0-21swapper/319:20:003
14934992019,0cyclictest0-21swapper/321:08:073
14934992018,2cyclictest28970-21cron20:45:003
1493499200,0cyclictest0-21swapper/320:08:073
14933992020,0cyclictest19870-21apt-get20:28:072
14933992020,0cyclictest0-21swapper/220:48:062
14933992020,0cyclictest0-21swapper/219:28:062
14933992019,0cyclictest0-21swapper/220:18:072
14933992018,1cyclictest29741-21munin-run19:40:012
1493399200,0cyclictest0-21swapper/220:03:082
1493399200,0cyclictest0-21swapper/219:43:192
14932992020,0cyclictest0-21swapper/120:58:071
14932992020,0cyclictest0-21swapper/120:00:021
14932992020,0cyclictest0-21swapper/119:48:071
14932992020,0cyclictest0-21swapper/119:13:061
14932992019,1cyclictest27080-21apt-get20:43:061
1493299200,0cyclictest0-21swapper/119:18:061
14931992020,0cyclictest0-21swapper/020:23:070
14931992018,1cyclictest6184-21grep21:05:000
1493199200,2cyclictest31661-21sed19:43:280
14933991919,0cyclictest0-21swapper/220:53:072
14933991917,1cyclictest0-21swapper/221:03:082
14932991919,0cyclictest29475-21apt-get20:48:061
14932991919,0cyclictest0-21swapper/120:13:071
14931991919,0cyclictest0-21swapper/019:48:070
14931991915,3cyclictest0-21swapper/020:33:090
1493199190,1cyclictest25650-21grep20:38:120
1493499180,1cyclictest31386-21awk20:50:003
14933991818,0cyclictest0-21swapper/219:53:062
14931991818,0cyclictest0-21swapper/020:53:070
1493199180,17cyclictest0-21swapper/020:48:100
14934991717,0cyclictest0-21swapper/320:58:073
1493399170,16cyclictest20224-21apt-get19:23:062
1493399170,16cyclictest19390-21munin-run20:25:012
14931991716,1cyclictest62550irq/127-eno119:53:050
1493499160,15cyclictest22167-21cut19:25:003
14933991615,1cyclictest12656-21apt-get20:13:072
1493399160,15cyclictest25714-21ntp_states20:38:132
14932991613,2cyclictest16227-21grep20:18:131
14931991614,1cyclictest313-21systemd-journal19:15:000
14931991614,1cyclictest0-21swapper/021:10:010
1493199160,15cyclictest0-21swapper/019:33:110
14934991515,0cyclictest0-21swapper/319:28:063
14934991514,0cyclictest5000-21apt-get19:58:083
14933991513,1cyclictest8579-21munin-run21:10:012
1493399150,1cyclictest0-21swapper/219:10:332
14932991515,0cyclictest6669-21apt-get21:08:071
1493499140,14cyclictest0-21swapper/320:51:103
1493499140,14cyclictest0-21swapper/320:35:303
1493499140,14cyclictest0-21swapper/320:22:203
1493499140,14cyclictest0-21swapper/320:15:443
1493499140,0cyclictest0-21swapper/321:01:583
1493499140,0cyclictest0-21swapper/320:31:273
1493499140,0cyclictest0-21swapper/319:50:173
1493499140,0cyclictest0-21swapper/319:45:593
1493399140,14cyclictest0-21swapper/220:30:552
1493399140,14cyclictest0-21swapper/219:45:342
1493399140,14cyclictest0-21swapper/219:15:482
14932991414,0cyclictest0-21swapper/119:53:061
1493299140,0cyclictest0-21swapper/121:01:211
14934991313,0cyclictest0-21swapper/320:10:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional