You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 07:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Sun May 31, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4989992624,1cyclictest23975-21latency_hist23:05:003
4987992624,1cyclictest2793-21cron22:45:011
498999253,22cyclictest0-21swapper/322:43:303
4989992524,1cyclictest31417-21diskmemload22:09:203
4989992523,2cyclictest0-21swapper/323:23:303
4989992523,1cyclictest19206-21ssh21:28:353
4989992523,1cyclictest11386-21sh00:25:013
4989992522,2cyclictest24018-21sh22:34:383
498999252,22cyclictest0-21swapper/320:23:303
498799250,24cyclictest31417-21diskmemload00:30:501
498799250,24cyclictest18635-21idleruntime21:28:311
498799250,24cyclictest0-21swapper/121:44:101
498799250,1cyclictest0-21swapper/122:10:101
4989992424,0cyclictest0-21swapper/323:45:133
4989992423,1cyclictest31417-21diskmemload23:35:343
4989992423,1cyclictest0-21swapper/322:23:293
4989992422,1cyclictest0-21swapper/321:37:193
498999242,1cyclictest8045-21ssh22:49:573
498999242,1cyclictest0-21swapper/300:35:543
4989992421,2cyclictest9931-21apt-key21:20:003
498999241,22cyclictest0-21swapper/322:25:483
498999241,1cyclictest31417-21diskmemload21:30:553
4988992422,1cyclictest0-21swapper/222:01:252
498899240,2cyclictest313-21systemd-journal21:10:012
498899240,24cyclictest0-21swapper/221:58:282
498899240,23cyclictest12556-21sh23:24:492
498899240,23cyclictest0-21swapper/223:51:002
498899240,23cyclictest0-21swapper/222:36:552
498899240,23cyclictest0-21swapper/222:18:242
498899240,23cyclictest0-21swapper/200:00:062
498799240,23cyclictest31417-21diskmemload23:26:211
498799240,23cyclictest31417-21diskmemload00:24:571
498799240,23cyclictest0-21swapper/123:19:171
498799240,23cyclictest0-21swapper/122:05:231
498799240,23cyclictest0-21swapper/121:22:561
498799240,23cyclictest0-21swapper/100:39:581
498799240,0cyclictest19869-21apt-get19:43:291
498599243,21cyclictest62550irq/127-eno123:43:260
4985992423,1cyclictest19863-21ssh23:01:210
4985992416,4cyclictest0-21swapper/022:30:010
498599240,2cyclictest29529-21rm22:39:590
498599240,24cyclictest0-21swapper/023:35:440
498599240,23cyclictest9488-21ssh22:51:450
498599240,23cyclictest24535-21ssh23:05:280
498599240,23cyclictest10405-21sh00:23:400
4989992323,0cyclictest0-21swapper/323:19:443
4989992323,0cyclictest0-21swapper/323:12:103
4989992322,1cyclictest31417-21diskmemload00:04:103
4989992322,1cyclictest0-21swapper/321:56:163
498999232,20cyclictest31417-21diskmemload22:50:113
498999232,20cyclictest1021-21ssh21:12:443
4989992321,1cyclictest0-21swapper/321:16:283
4989992320,2cyclictest2480-21ssh00:17:053
498999231,22cyclictest0-21swapper/322:58:303
498999231,21cyclictest0-21swapper/323:06:333
498999231,21cyclictest0-21swapper/321:48:083
498999231,21cyclictest0-21swapper/300:27:053
498999231,1cyclictest0-21swapper/321:51:323
498999230,2cyclictest14542-21ssh23:27:353
498999230,23cyclictest0-21swapper/300:10:043
498999230,23cyclictest0-21swapper/300:07:513
498999230,0cyclictest31417-21diskmemload21:40:033
498999230,0cyclictest0-21swapper/323:57:343
498999230,0cyclictest0-21swapper/322:39:563
4988992322,1cyclictest21267-21apt-get23:03:292
4988992322,1cyclictest0-21swapper/223:33:242
4988992321,1cyclictest611-21irqbalance00:20:292
4988992321,1cyclictest0-21swapper/223:58:232
4988992321,1cyclictest0-21swapper/221:11:252
4988992320,2cyclictest32172-21ssh22:12:232
498899230,23cyclictest0-21swapper/223:43:452
498899230,23cyclictest0-21swapper/223:35:442
498899230,23cyclictest0-21swapper/223:25:042
498899230,23cyclictest0-21swapper/223:16:502
498899230,23cyclictest0-21swapper/221:54:562
498899230,23cyclictest0-21swapper/221:25:282
498899230,23cyclictest0-21swapper/221:20:552
498899230,23cyclictest0-21swapper/200:17:412
498899230,22cyclictest27433-21ssh21:36:402
498899230,22cyclictest0-21swapper/222:45:302
498899230,22cyclictest0-21swapper/221:42:382
498899230,22cyclictest0-21swapper/221:30:172
498899230,22cyclictest0-21swapper/221:15:362
498899230,22cyclictest0-21swapper/200:35:302
498899230,22cyclictest0-21swapper/200:30:022
498899230,22cyclictest0-21swapper/200:10:342
498899230,1cyclictest0-21swapper/223:05:282
498899230,0cyclictest0-21swapper/222:58:462
498899230,0cyclictest0-21swapper/222:51:452
498899230,0cyclictest0-21swapper/222:08:592
498899230,0cyclictest0-21swapper/200:07:292
4987992323,0cyclictest4781-21kworker/u8:121:48:331
4987992323,0cyclictest0-21swapper/123:22:011
4987992323,0cyclictest0-21swapper/122:21:131
4987992323,0cyclictest0-21swapper/122:18:441
4987992323,0cyclictest0-21swapper/100:29:581
4987992323,0cyclictest0-21swapper/100:09:361
4987992322,1cyclictest12886-21sh23:55:461
4987992321,1cyclictest29523-21apt-get20:03:291
4987992321,1cyclictest0-21swapper/122:36:241
4987992321,1cyclictest0-21swapper/100:01:561
4987992320,2cyclictest31417-21diskmemload23:07:061
4987992320,2cyclictest28950-21ssh00:11:071
498799230,2cyclictest0-21swapper/121:13:311
498799230,23cyclictest0-21swapper/123:32:191
498799230,23cyclictest0-21swapper/121:18:211
498799230,22cyclictest8325-21sh23:51:541
498799230,22cyclictest26001-21ssh21:34:571
498799230,0cyclictest31417-21diskmemload23:00:571
498799230,0cyclictest0-21swapper/123:47:531
498799230,0cyclictest0-21swapper/123:40:431
498799230,0cyclictest0-21swapper/123:38:571
498799230,0cyclictest0-21swapper/123:14:021
498799230,0cyclictest0-21swapper/122:34:451
4985992323,0cyclictest31417-21diskmemload21:48:490
4985992323,0cyclictest31417-21diskmemload00:07:130
4985992323,0cyclictest0-21swapper/023:16:500
4985992323,0cyclictest0-21swapper/022:49:070
4985992323,0cyclictest0-21swapper/022:20:230
4985992323,0cyclictest0-21swapper/022:18:240
4985992323,0cyclictest0-21swapper/021:25:280
4985992323,0cyclictest0-21swapper/000:32:480
4985992322,1cyclictest62550irq/127-eno121:15:530
4985992321,2cyclictest20663-21rm23:33:240
4985992321,1cyclictest21160-21ssh22:01:250
4985992320,2cyclictest9729-21cron19:20:010
498599230,2cyclictest9406-21ssh23:22:410
498599230,2cyclictest4137-21ssh00:18:310
498599230,23cyclictest936-21ssh21:42:380
498599230,23cyclictest7690-21ssh23:51:000
498599230,23cyclictest0-21swapper/021:20:550
498599230,22cyclictest4047-21apt-get23:48:310
498599230,22cyclictest27938-21rm21:37:330
498599230,22cyclictest22438-21sh21:32:180
498599230,22cyclictest14261-21ssh23:58:000
498599230,21cyclictest31417-21diskmemload23:25:380
498599230,0cyclictest31417-21diskmemload22:08:590
498599230,0cyclictest17240-21apt-get21:58:300
4989992221,1cyclictest30881-21ssh22:10:223
4989992220,1cyclictest20447-21ssh22:00:233
498999221,21cyclictest0-21swapper/323:40:343
498999221,1cyclictest19110-21ssh00:32:473
498999220,21cyclictest622-21gdbus19:15:003
498999220,21cyclictest0-21swapper/322:15:073
498999220,1cyclictest12125-21dump-pmu-power19:25:013
4988992222,0cyclictest0-21swapper/223:45:012
4988992222,0cyclictest0-21swapper/222:44:202
4988992222,0cyclictest0-21swapper/222:26:382
4988992222,0cyclictest0-21swapper/221:45:402
4988992220,1cyclictest22308-21apt-get20:53:302
4988992220,1cyclictest0-21swapper/200:25:492
498899221,1cyclictest0-21swapper/223:12:362
498899220,21cyclictest6565-21apt-get20:20:022
498899220,21cyclictest0-21swapper/222:30:072
498899220,21cyclictest0-21swapper/220:38:292
498899220,1cyclictest22263-21apt-get19:48:292
498899220,1cyclictest0-21swapper/222:22:422
4987992220,1cyclictest4697-21apt-get20:18:281
4987992220,1cyclictest27117-21apt-get21:03:281
4987992220,1cyclictest13770-21sh22:55:121
498799220,22cyclictest0-21swapper/122:46:081
498799220,22cyclictest0-21swapper/122:25:521
498799220,22cyclictest0-21swapper/122:00:541
498799220,21cyclictest4184-21idleruntime-cro20:15:011
498799220,21cyclictest27028-21ssh21:36:121
498799220,21cyclictest0-21swapper/121:55:251
498799220,1cyclictest97592chrt22:52:081
498799220,1cyclictest14176-21ls20:35:001
4985992222,0cyclictest0-21swapper/023:14:460
4985992221,1cyclictest0-21swapper/022:43:360
4985992220,2cyclictest16565-21gltestperf22:58:320
4985992220,1cyclictest9803-21sh21:50:060
498599220,22cyclictest31417-21diskmemload22:31:220
498599220,21cyclictest31417-21diskmemload00:25:050
498599220,21cyclictest30732-21rm22:10:080
498599220,21cyclictest28636-21ssh00:10:340
498599220,21cyclictest0-21swapper/000:36:400
498599220,1cyclictest9908-21apt-get20:28:270
498599220,1cyclictest21714-21cron19:45:000
498599220,1cyclictest0-21swapper/000:00:010
4989992121,0cyclictest0-21swapper/323:30:193
4989992121,0cyclictest0-21swapper/319:38:283
4989992119,1cyclictest24847-21grep19:53:293
498999210,20cyclictest0-21swapper/320:33:303
498999210,20cyclictest0-21swapper/319:48:293
498999210,0cyclictest19910-21apt-get20:48:283
4988992121,0cyclictest0-21swapper/220:10:022
4988992120,0cyclictest0-21swapper/219:23:282
498899210,20cyclictest0-21swapper/219:58:282
498899210,0cyclictest0-21swapper/220:28:272
4987992121,0cyclictest0-21swapper/119:28:291
498799210,20cyclictest0-21swapper/120:08:281
498799210,20cyclictest0-21swapper/120:08:281
498799210,20cyclictest0-21swapper/119:13:271
498799210,0cyclictest0-21swapper/119:18:271
4985992120,0cyclictest0-21swapper/020:53:300
498599210,21cyclictest0-21swapper/020:20:020
498599210,20cyclictest0-21swapper/019:58:280
4989992020,0cyclictest0-21swapper/319:28:283
4989992019,1cyclictest28980-21perf20:00:003
4989992019,0cyclictest0-21swapper/320:08:283
4989992019,0cyclictest0-21swapper/320:08:283
4988992019,0cyclictest0-21swapper/219:43:282
4985992020,0cyclictest31915-21apt-get20:08:280
4985992020,0cyclictest31915-21apt-get20:08:280
4985992020,0cyclictest0-21swapper/020:58:290
4985992020,0cyclictest0-21swapper/020:58:290
4985992020,0cyclictest0-21swapper/020:10:020
4985992020,0cyclictest0-21swapper/019:23:280
4985992019,1cyclictest29564-21apt-get21:08:290
498599200,0cyclictest16560-21apt-get20:40:020
498599200,0cyclictest0-21swapper/019:48:290
4989991919,0cyclictest0-21swapper/319:43:293
4989991918,1cyclictest6579-21sh20:20:013
4987991918,0cyclictest10265-21apt-get19:23:281
4985991917,1cyclictest0-21swapper/019:15:000
4989991818,0cyclictest0-21swapper/320:43:303
4988991818,0cyclictest0-21swapper/220:18:282
4988991818,0cyclictest0-21swapper/219:18:272
4988991817,1cyclictest5451-21apt-get19:13:272
4988991817,0cyclictest0-21swapper/220:40:022
4987991817,0cyclictest0-21swapper/120:23:291
4987991816,1cyclictest26609-21awk21:00:011
4987991816,1cyclictest26609-21awk21:00:011
4987991816,1cyclictest16579-21latency_hist20:40:001
4989991717,0cyclictest0-21swapper/320:13:293
4989991716,1cyclictest0-21swapper/321:08:303
4989991715,1cyclictest0-21swapper/320:53:293
4987991717,0cyclictest27052-21apt-get19:58:281
4987991717,0cyclictest0-21swapper/120:53:301
4987991714,2cyclictest26537-21perf19:55:001
4985991717,0cyclictest0-21swapper/020:18:280
4985991716,1cyclictest12659-21apt-get19:28:280
498599170,1cyclictest0-21swapper/019:53:280
498999162,11cyclictest15410-21munin-node20:56:413
498999162,11cyclictest15410-21munin-node20:56:413
4989991616,0cyclictest0-21swapper/319:33:283
4989991615,1cyclictest29523-21apt-get20:03:283
4988991616,0cyclictest0-21swapper/221:03:292
4988991616,0cyclictest0-21swapper/220:33:302
4988991616,0cyclictest0-21swapper/219:28:282
498899160,1cyclictest24660-21apt-get19:53:282
498899160,0cyclictest0-21swapper/219:33:282
4987991616,0cyclictest0-21swapper/120:40:021
4985991616,0cyclictest0-21swapper/020:33:300
498599160,16cyclictest0-21swapper/019:33:280
4989991515,0cyclictest0-21swapper/319:18:273
4989991513,1cyclictest16604-21grep20:40:003
498799150,0cyclictest0-21swapper/121:08:291
4985991515,0cyclictest0-21swapper/021:03:290
4989991414,0cyclictest0-21swapper/320:25:103
498999140,14cyclictest0-21swapper/321:02:553
4988991414,0cyclictest0-21swapper/220:58:292
4988991414,0cyclictest0-21swapper/220:58:292
4988991414,0cyclictest0-21swapper/220:01:102
4988991413,1cyclictest21114-21ps20:48:352
498899140,14cyclictest0-21swapper/220:05:552
498899140,14cyclictest0-21swapper/220:05:552
498899140,14cyclictest0-21swapper/219:35:052
4987991414,0cyclictest0-21swapper/119:30:221
498799140,14cyclictest0-21swapper/120:25:091
4985991414,0cyclictest0-21swapper/020:46:460
4985991414,0cyclictest0-21swapper/019:35:240
4985991412,1cyclictest16560-21apt-get20:40:000
498599140,0cyclictest0-21swapper/020:02:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional