You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-10 - 19:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Sep 10, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3089099261,24cyclictest25016-21diskmemload10:43:402
3088899260,25cyclictest25016-21diskmemload09:16:591
30885992625,1cyclictest62550irq/127-eno112:36:210
3089699250,24cyclictest20354-21ssh11:29:253
3089699250,24cyclictest0-21swapper/311:41:413
3088899250,24cyclictest25016-21diskmemload12:32:301
3088899250,24cyclictest0-21swapper/112:35:341
3088599250,24cyclictest3586-21cron07:20:010
3088599250,1cyclictest8776-21latency_hist10:50:000
3088599250,1cyclictest25016-21diskmemload10:22:550
3088599250,1cyclictest0-21swapper/010:13:110
30896992423,1cyclictest444-21ssh12:37:433
3089699240,23cyclictest25016-21diskmemload10:12:563
3089699240,23cyclictest25016-21diskmemload09:47:233
3089699240,1cyclictest22925-21apt-get09:36:563
30890992421,3cyclictest0-21swapper/209:16:092
30890992421,2cyclictest12043-21cpuspeed_turbos09:26:562
3089099240,23cyclictest4059-21sh10:16:552
3089099240,23cyclictest0-21swapper/210:11:562
3089099240,23cyclictest0-21swapper/209:12:262
3089099240,21cyclictest0-21swapper/209:32:372
3088899240,24cyclictest0-21swapper/112:08:131
3088899240,24cyclictest0-21swapper/109:13:331
3088899240,23cyclictest0-21swapper/112:26:101
3088899240,23cyclictest0-21swapper/111:56:521
3088899240,1cyclictest25016-21diskmemload11:51:581
3088899240,1cyclictest0-21swapper/110:17:371
30885992424,0cyclictest0-21swapper/009:10:590
30885992422,1cyclictest0-21swapper/012:20:510
3088599240,24cyclictest0-21swapper/011:48:320
3088599240,24cyclictest0-21swapper/011:40:160
3088599240,24cyclictest0-21swapper/009:18:240
3088599240,23cyclictest25016-21diskmemload11:31:190
3088599240,23cyclictest25016-21diskmemload11:11:400
3088599240,23cyclictest0-21swapper/011:04:170
3088599240,23cyclictest0-21swapper/010:16:550
3088599240,23cyclictest0-21swapper/009:01:560
3088599240,0cyclictest25016-21diskmemload11:51:430
30896992323,0cyclictest25016-21diskmemload12:20:303
30896992323,0cyclictest25016-21diskmemload09:59:233
30896992323,0cyclictest0-21swapper/312:17:073
30896992322,1cyclictest23681-21kworker/u8:010:22:093
30896992320,2cyclictest313-21systemd-journal07:20:013
30896992320,2cyclictest23402-21perf08:00:003
3089699230,23cyclictest25016-21diskmemload09:25:243
3089699230,23cyclictest0-21swapper/309:44:583
3089699230,22cyclictest3123-21sh11:13:453
3089699230,22cyclictest0-21swapper/312:07:013
3089699230,22cyclictest0-21swapper/311:56:563
3089699230,0cyclictest0-21swapper/310:28:423
3089699230,0cyclictest0-21swapper/310:17:123
3089699230,0cyclictest0-21swapper/309:10:453
30890992323,0cyclictest25016-21diskmemload11:18:212
30890992323,0cyclictest0-21swapper/211:51:012
30890992323,0cyclictest0-21swapper/210:01:372
30890992321,1cyclictest0-21swapper/212:08:212
30890992320,1cyclictest0-21swapper/212:05:012
3089099230,3cyclictest16673-21ssh11:26:392
3089099230,2cyclictest1-21systemd08:25:002
3089099230,23cyclictest25016-21diskmemload09:20:402
3089099230,23cyclictest0-21swapper/212:16:562
3089099230,23cyclictest0-21swapper/212:10:462
3089099230,23cyclictest0-21swapper/209:47:082
3089099230,23cyclictest0-21swapper/209:40:442
3089099230,22cyclictest4344-21ssh10:46:112
3089099230,22cyclictest21553-21ssh11:30:462
3089099230,22cyclictest16425-21ssh12:23:362
3089099230,22cyclictest11039-21ssh11:21:412
3089099230,0cyclictest29862-21ssh12:35:572
3089099230,0cyclictest25016-21diskmemload09:57:372
30888992323,0cyclictest0-21swapper/111:41:371
30888992323,0cyclictest0-21swapper/111:29:071
30888992323,0cyclictest0-21swapper/111:22:051
30888992323,0cyclictest0-21swapper/110:22:141
30888992323,0cyclictest0-21swapper/109:47:341
30888992321,2cyclictest19550-21ssh10:30:121
30888992321,1cyclictest7395-21ssh10:48:091
3088899230,23cyclictest0-21swapper/111:00:091
3088899230,23cyclictest0-21swapper/110:28:271
3088899230,22cyclictest9616-21dump-pmu-power11:20:011
3088899230,22cyclictest15933-21apt-get10:56:571
3088899230,1cyclictest6040-21apt-get09:50:021
3088899230,1cyclictest0-21swapper/109:43:591
3088899230,0cyclictest0-21swapper/112:22:381
3088899230,0cyclictest0-21swapper/110:41:041
3088899230,0cyclictest0-21swapper/109:55:351
3088899230,0cyclictest0-21swapper/109:37:191
30885992323,0cyclictest13-21ksoftirqd/012:30:540
30885992323,0cyclictest0-21swapper/012:00:320
30885992321,2cyclictest0-21swapper/011:20:270
30885992321,1cyclictest8862-21cat12:17:040
30885992321,1cyclictest0-21swapper/011:08:100
3088599231,1cyclictest62550irq/127-eno110:42:080
3088599230,2cyclictest0-21swapper/010:29:360
3088599230,23cyclictest0-21swapper/012:11:510
3088599230,23cyclictest0-21swapper/011:57:320
3088599230,23cyclictest0-21swapper/009:54:330
3088599230,23cyclictest0-21swapper/009:34:530
3088599230,22cyclictest28438-21diskmemload10:09:260
3088599230,22cyclictest24597-21apt10:35:010
3088599230,22cyclictest1402-21sh09:45:530
3088599230,21cyclictest21688-21sh10:02:520
3088599230,1cyclictest31018-21kworker/u8:010:59:370
3088599230,0cyclictest25016-21diskmemload09:43:120
3088599230,0cyclictest25016-21diskmemload09:22:580
3088599230,0cyclictest0-21swapper/012:27:430
3088599230,0cyclictest0-21swapper/011:26:410
3088599230,0cyclictest0-21swapper/009:55:240
30896992222,0cyclictest0-21swapper/311:15:543
30896992222,0cyclictest0-21swapper/310:40:383
30896992222,0cyclictest0-21swapper/310:36:403
30896992222,0cyclictest0-21swapper/310:32:233
30896992221,1cyclictest606-21dbus-daemon12:05:013
30896992221,1cyclictest22511-21ssh10:04:063
30896992220,1cyclictest0-21swapper/311:31:503
30896992220,1cyclictest0-21swapper/310:52:063
30896992220,1cyclictest0-21swapper/309:00:013
3089699220,22cyclictest25016-21diskmemload12:25:023
3089699220,22cyclictest0-21swapper/311:50:013
3089699220,21cyclictest5579-21ssh11:45:313
3089699220,21cyclictest25016-21diskmemload12:10:133
3089699220,21cyclictest25016-21diskmemload11:35:333
3089699220,21cyclictest11226-21apt-get07:36:553
3089699220,21cyclictest0-21swapper/308:26:553
3089699220,1cyclictest8077-21apt-get09:51:553
3089699220,1cyclictest5603-21sh09:21:043
3089699220,1cyclictest30587-21munin-run08:15:013
3089699220,1cyclictest29234-21ssh11:07:383
3089699220,1cyclictest0-21swapper/312:31:583
3089699220,0cyclictest0-21swapper/309:31:033
30890992222,0cyclictest25016-21diskmemload10:26:592
30890992222,0cyclictest0-21swapper/212:30:072
30890992222,0cyclictest0-21swapper/211:41:332
30890992222,0cyclictest0-21swapper/211:06:342
30890992220,1cyclictest32465-21ssh11:11:532
30890992220,1cyclictest16740-21ssh11:55:372
30890992220,1cyclictest0-21swapper/210:37:442
30890992220,1cyclictest0-21swapper/209:05:012
30890992219,2cyclictest9373-21ssh10:50:332
3089099220,22cyclictest0-21swapper/210:21:282
3089099220,21cyclictest6768-21sh09:50:092
3089099220,21cyclictest5228-21sh11:45:052
3089099220,21cyclictest23622-21ssh10:05:112
3089099220,21cyclictest21969-21ssh09:35:322
3089099220,0cyclictest0-21swapper/212:27:562
3089099220,0cyclictest0-21swapper/211:37:002
3089099220,0cyclictest0-21swapper/211:02:422
30888992222,0cyclictest25016-21diskmemload10:02:171
30888992222,0cyclictest0-21swapper/112:04:501
30888992222,0cyclictest0-21swapper/111:12:551
30888992222,0cyclictest0-21swapper/110:07:281
30888992222,0cyclictest0-21swapper/109:28:351
30888992221,1cyclictest0-21swapper/111:32:571
30888992220,1cyclictest17851-21munin-plugin-st08:55:011
30888992220,1cyclictest0-21swapper/112:17:551
30888992220,1cyclictest0-21swapper/110:10:111
3088899220,22cyclictest4570-21ssh12:13:081
3088899220,22cyclictest0-21swapper/107:21:551
3088899220,21cyclictest25268-21sh10:35:451
3088899220,21cyclictest0-21swapper/111:06:011
3088899220,21cyclictest0-21swapper/110:50:181
3088899220,21cyclictest0-21swapper/109:31:131
3088899220,1cyclictest0-21swapper/111:45:031
3088899220,1cyclictest0-21swapper/111:36:021
3088899220,1cyclictest0-21swapper/107:36:551
30885992222,0cyclictest0-21swapper/011:15:520
3088599220,2cyclictest22323-21ssh09:35:590
3088599220,22cyclictest0-21swapper/010:37:290
3088599220,21cyclictest6435-21apt-get07:26:560
3088599220,21cyclictest25016-21diskmemload09:25:200
3088599220,21cyclictest10596-21munin-run08:40:000
3088599220,21cyclictest0-21swapper/012:08:100
3088599220,21cyclictest0-21swapper/010:51:160
3088599220,21cyclictest0-21swapper/007:50:000
3088599220,21cyclictest0-21swapper/007:11:560
3088599220,0cyclictest0-21swapper/011:35:510
30896992121,0cyclictest0-21swapper/310:05:393
30896992120,0cyclictest15785-21apt-get08:51:553
30896992118,2cyclictest14877-21sh10:55:273
3089699210,21cyclictest0-21swapper/311:21:573
3089699210,20cyclictest0-21swapper/308:46:573
3089699210,0cyclictest25016-21diskmemload09:16:333
30890992120,1cyclictest10995-21apt-get08:41:562
30890992119,1cyclictest18566-21cron07:50:002
3089099210,21cyclictest25016-21diskmemload10:31:232
3089099210,20cyclictest0-21swapper/208:40:002
3089099210,0cyclictest23044-21apt-get09:06:572
3089099210,0cyclictest0-21swapper/210:56:002
30888992119,1cyclictest0-21swapper/108:31:561
3088899210,0cyclictest0-21swapper/108:36:551
30885992120,1cyclictest13-21ksoftirqd/007:55:000
3088599210,20cyclictest0-21swapper/007:36:550
3088599210,0cyclictest0-21swapper/007:21:550
30896992020,0cyclictest0-21swapper/309:01:563
30896992019,0cyclictest8830-21apt-get07:31:543
30896992018,1cyclictest0-21swapper/308:10:013
3089699200,0cyclictest0-21swapper/307:51:573
30890992020,0cyclictest0-21swapper/207:26:562
30890992020,0cyclictest0-21swapper/207:10:022
30890992018,1cyclictest25790-21perf08:05:012
30890992018,1cyclictest25790-21perf08:05:012
3089099200,0cyclictest28584-21apt-get08:11:572
3089099200,0cyclictest0-21swapper/207:16:552
30888992020,0cyclictest1379-21apt-get08:21:551
30888992020,0cyclictest0-21swapper/107:16:551
30888992018,1cyclictest20251-21perf09:00:011
30888992018,1cyclictest15725-21awk07:45:001
30885992020,0cyclictest0-21swapper/008:16:560
30885992019,0cyclictest0-21swapper/008:46:570
3088599201,1cyclictest151rcu_preempt08:11:560
3088599200,0cyclictest0-21swapper/009:06:570
3088599200,0cyclictest0-21swapper/008:26:550
30896991919,0cyclictest16589-21apt-get07:46:553
30896991919,0cyclictest0-21swapper/307:21:553
30896991918,1cyclictest924-21cron08:20:013
30890991919,0cyclictest0-21swapper/208:56:572
30888991919,0cyclictest0-21swapper/108:41:561
30888991919,0cyclictest0-21swapper/107:10:021
30888991918,1cyclictest22643-21idleruntime-cro09:05:011
30885991919,0cyclictest0-21swapper/008:51:550
30885991918,1cyclictest23796-21apt-get08:01:550
30885991918,1cyclictest23796-21apt-get08:01:550
30896991816,1cyclictest0-21swapper/309:10:013
30890991817,1cyclictest13328-21tr07:40:002
30888991816,1cyclictest16589-21apt-get07:46:551
30885991818,0cyclictest0-21swapper/007:31:540
30885991817,1cyclictest0-21swapper/008:21:550
30896991717,0cyclictest0-21swapper/308:41:563
30896991717,0cyclictest0-21swapper/308:36:553
30896991717,0cyclictest0-21swapper/308:01:553
30896991717,0cyclictest0-21swapper/308:01:553
30896991717,0cyclictest0-21swapper/307:10:023
30890991717,0cyclictest4036-21apt-get07:21:552
30890991717,0cyclictest30576-21apt-get08:15:022
30890991717,0cyclictest0-21swapper/208:06:572
30890991717,0cyclictest0-21swapper/207:31:542
30890991715,1cyclictest15399-21munin-run08:50:002
30888991717,0cyclictest0-21swapper/108:16:561
30888991717,0cyclictest0-21swapper/108:01:551
30888991717,0cyclictest0-21swapper/108:01:551
30888991715,1cyclictest3782-21apt-get08:26:551
30888991715,1cyclictest25032-21apt09:10:011
30885991717,0cyclictest0-21swapper/008:41:560
30885991716,1cyclictest26192-21apt-get08:06:570
30896991616,0cyclictest0-21swapper/307:41:543
30896991616,0cyclictest0-21swapper/307:26:563
30890991616,0cyclictest0-21swapper/207:41:542
30890991614,1cyclictest313-21systemd-journal07:55:002
30888991616,0cyclictest0-21swapper/108:06:571
3088899160,0cyclictest0-21swapper/107:56:561
3088599164,11cyclictest13-21ksoftirqd/009:00:010
30885991613,3cyclictest13-21ksoftirqd/007:57:050
30890991514,0cyclictest0-21swapper/208:31:572
30885991511,3cyclictest13-21ksoftirqd/008:32:000
3088599150,15cyclictest0-21swapper/007:43:530
30896991414,0cyclictest0-21swapper/308:20:183
3089699140,14cyclictest0-21swapper/308:30:283
3089099140,14cyclictest0-21swapper/208:27:162
3089099140,0cyclictest0-21swapper/208:50:202
3089099140,0cyclictest0-21swapper/207:55:282
3088899140,14cyclictest0-21swapper/107:50:111
3088899140,14cyclictest0-21swapper/107:25:051
3088899140,0cyclictest0-21swapper/108:45:411
3088899140,0cyclictest0-21swapper/107:30:501
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional