You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 00:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Mar 28, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1861499260,25cyclictest5438-21sh09:35:201
18620992523,1cyclictest0-21swapper/312:05:003
1862099250,1cyclictest17937-21sh11:53:283
18618992522,2cyclictest4911-21ssh11:42:132
1861899250,24cyclictest12011-21diskmemload12:27:232
1861899250,1cyclictest18277-21ssh11:53:592
18614992523,1cyclictest0-21swapper/111:48:101
1861499250,25cyclictest0-21swapper/111:52:271
1861499250,24cyclictest3319-21ssh12:11:421
1861499250,24cyclictest0-21swapper/110:10:061
18610992523,1cyclictest11941-21ssh10:44:530
18620992422,1cyclictest0-21swapper/311:47:003
1862099240,24cyclictest0-21swapper/310:37:303
1862099240,23cyclictest0-21swapper/309:11:393
1862099240,1cyclictest27437-21sh09:58:083
18618992421,2cyclictest313-21systemd-journal09:55:012
18618992421,0cyclictest0-21swapper/211:14:132
1861899240,24cyclictest12011-21diskmemload10:36:392
1861899240,24cyclictest0-21swapper/211:36:502
1861899240,23cyclictest23959-21idleruntime-cro12:00:002
1861899240,23cyclictest0-21swapper/210:53:442
1861899240,23cyclictest0-21swapper/209:12:372
1861899240,1cyclictest29510-21ssh11:33:532
1861899240,1cyclictest0-21swapper/212:32:332
1861899240,1cyclictest0-21swapper/210:07:152
18614992423,1cyclictest12011-21diskmemload11:39:271
1861499240,2cyclictest21613-21ssh10:54:101
1861499240,24cyclictest0-21swapper/109:48:411
1861499240,23cyclictest30265-21sed11:03:141
1861499240,23cyclictest20257-21sh11:56:511
1861499240,23cyclictest17150-21cron09:15:011
1861499240,23cyclictest14687-21sh10:16:261
1861499240,23cyclictest0-21swapper/112:34:221
1861499240,0cyclictest12011-21diskmemload10:24:041
18610992422,1cyclictest12601-21ssh10:45:290
18610992422,1cyclictest0-21swapper/011:56:120
1861099240,2cyclictest31530-21sh11:36:090
1861099240,2cyclictest13548-21ssh10:14:590
1861099240,23cyclictest0-21swapper/012:19:160
1861099240,1cyclictest12011-21diskmemload10:16:030
1861099240,1cyclictest0-21swapper/010:22:540
1861099240,0cyclictest12011-21diskmemload11:51:420
1861099240,0cyclictest0-21swapper/012:23:440
18620992323,0cyclictest0-21swapper/312:27:453
18620992323,0cyclictest0-21swapper/312:10:023
18620992323,0cyclictest0-21swapper/309:19:593
18620992322,1cyclictest12011-21diskmemload10:10:243
18620992321,1cyclictest13202-21ssh11:18:153
1862099230,2cyclictest23486-21ssh09:21:403
1862099230,2cyclictest21264-21sh11:26:283
1862099230,2cyclictest17780-21sh09:48:093
1862099230,23cyclictest12011-21diskmemload11:24:533
1862099230,23cyclictest0-21swapper/312:23:113
1862099230,23cyclictest0-21swapper/311:58:183
1862099230,23cyclictest0-21swapper/311:03:193
1862099230,23cyclictest0-21swapper/310:21:103
1862099230,22cyclictest31114-21rm12:08:083
1862099230,22cyclictest31055-21ssh11:35:153
1862099230,22cyclictest30910-21rm10:33:033
1862099230,22cyclictest12011-21diskmemload11:40:043
1862099230,22cyclictest10152-21munin-run09:40:003
1862099230,1cyclictest4266-21sh10:05:583
1862099230,0cyclictest4128-21ssh11:08:423
1862099230,0cyclictest0-21swapper/310:53:523
1862099230,0cyclictest0-21swapper/310:47:433
18618992323,0cyclictest12011-21diskmemload11:01:192
18618992323,0cyclictest0-21swapper/210:32:112
18618992323,0cyclictest0-21swapper/210:04:302
18618992323,0cyclictest0-21swapper/209:46:472
18618992321,1cyclictest0-21swapper/212:13:142
18618992321,1cyclictest0-21swapper/209:43:092
18618992320,0cyclictest0-21swapper/209:38:072
1861899230,2cyclictest24314-21ssh09:23:052
1861899230,2cyclictest15080-21turbostat11:20:002
1861899230,23cyclictest0-21swapper/210:26:342
1861899230,22cyclictest32337-21munin-plugin-st09:30:002
1861899230,22cyclictest0-21swapper/210:16:092
1861899230,1cyclictest27186-21ssh09:57:452
1861899230,0cyclictest0-21swapper/212:21:472
1861899230,0cyclictest0-21swapper/212:08:402
18614992323,0cyclictest0-21swapper/110:30:361
18614992323,0cyclictest0-21swapper/110:28:531
18614992322,1cyclictest12011-21diskmemload11:11:431
18614992321,1cyclictest6061-21sh10:39:101
18614992321,1cyclictest0-21swapper/109:00:011
18614992320,2cyclictest7218-21sh10:40:021
18614992320,2cyclictest12053-21basename09:10:011
1861499230,23cyclictest0-21swapper/109:19:481
1861499230,22cyclictest1591-21cron12:10:011
1861499230,22cyclictest13225-21ssh12:21:181
1861499230,22cyclictest0-21swapper/112:39:061
1861499230,22cyclictest0-21swapper/111:30:241
1861499230,22cyclictest0-21swapper/109:51:101
1861499230,0cyclictest12011-21diskmemload09:26:271
1861499230,0cyclictest0-21swapper/111:42:381
1861499230,0cyclictest0-21swapper/109:23:461
18610992323,0cyclictest12827-21ssh11:49:060
18610992323,0cyclictest12011-21diskmemload12:36:140
18610992323,0cyclictest12011-21diskmemload11:19:380
18610992323,0cyclictest0-21swapper/012:31:520
18610992323,0cyclictest0-21swapper/012:05:240
18610992323,0cyclictest0-21swapper/010:37:420
18610992323,0cyclictest0-21swapper/009:32:520
18610992323,0cyclictest0-21swapper/009:21:030
18610992323,0cyclictest0-21swapper/009:15:160
1861099230,23cyclictest0-21swapper/012:27:170
1861099230,22cyclictest8377-21dump-pmu-power11:45:000
1861099230,22cyclictest25984-21sh11:30:560
1861099230,22cyclictest12011-21diskmemload11:10:190
1861099230,22cyclictest12011-21diskmemload11:07:050
1861099230,22cyclictest12011-21diskmemload09:35:350
1861099230,22cyclictest0-21swapper/012:02:050
1861099230,1cyclictest26179-21ssh10:28:100
1861099230,1cyclictest0-21swapper/011:03:100
1861099230,0cyclictest12011-21diskmemload10:51:240
1861099230,0cyclictest12011-21diskmemload09:56:400
1861099230,0cyclictest0-21swapper/011:24:400
1861099230,0cyclictest0-21swapper/010:57:580
1861099230,0cyclictest0-21swapper/009:42:410
1861099230,0cyclictest0-21swapper/009:26:170
18620992222,0cyclictest0-21swapper/310:02:273
18620992222,0cyclictest0-21swapper/309:50:583
18620992222,0cyclictest0-21swapper/309:42:033
18620992222,0cyclictest0-21swapper/309:25:443
18620992221,1cyclictest16279-21kworker/u8:210:16:053
18620992220,1cyclictest7880-21ssh12:15:493
18620992220,1cyclictest30595-21munin-run11:35:013
1862099220,22cyclictest0-21swapper/309:30:193
1862099220,21cyclictest5510-21latency_hist07:50:003
1862099220,21cyclictest0-21swapper/310:40:553
1862099220,21cyclictest0-21swapper/310:29:513
1862099220,1cyclictest622-21gdbus07:35:013
1862099220,1cyclictest12011-21diskmemload12:35:043
1862099220,0cyclictest0-21swapper/310:57:503
18618992222,0cyclictest0-21swapper/212:35:022
18618992220,1cyclictest0-21swapper/211:25:542
18618992220,1cyclictest0-21swapper/211:21:302
18618992220,1cyclictest0-21swapper/209:30:392
18618992220,1cyclictest0-21swapper/209:15:192
1861899220,22cyclictest22348-21systemctl10:23:192
1861899220,21cyclictest652-21tr07:40:012
1861899220,21cyclictest0-21swapper/212:01:062
1861899220,21cyclictest0-21swapper/211:45:272
1861899220,21cyclictest0-21swapper/210:45:102
1861899220,1cyclictest7189-21ssh10:40:012
1861899220,1cyclictest22490-21ssh10:55:142
1861899220,1cyclictest12021-21latency_hist09:10:012
18614992222,0cyclictest0-21swapper/112:27:251
18614992222,0cyclictest0-21swapper/111:27:411
18614992222,0cyclictest0-21swapper/109:40:101
18614992221,0cyclictest20892-21apt-get08:23:111
1861499220,21cyclictest654-21munin-run07:40:011
1861499220,21cyclictest30493-21apt-get08:43:101
1861499220,21cyclictest13256-21sh10:46:361
1861499220,21cyclictest0-21swapper/112:15:361
1861499220,21cyclictest0-21swapper/111:15:181
1861499220,21cyclictest0-21swapper/110:00:041
1861499220,21cyclictest0-21swapper/109:56:081
1861499220,21cyclictest0-21swapper/108:18:071
1861499220,21cyclictest0-21swapper/107:53:111
1861499220,1cyclictest32589-21ssh09:30:051
1861499220,0cyclictest0-21swapper/110:55:121
18610992222,0cyclictest0-21swapper/011:26:110
18610992222,0cyclictest0-21swapper/008:33:100
18610992220,1cyclictest30576-21basename07:35:010
18610992220,1cyclictest25772-21apt07:25:010
18610992219,2cyclictest20684-21ssh09:50:220
1861099220,22cyclictest0-21swapper/012:10:320
1861099220,22cyclictest0-21swapper/010:05:290
1861099220,21cyclictest0-21swapper/010:00:030
1861099220,21cyclictest0-21swapper/007:53:100
1861099220,1cyclictest18461-21apt-get08:18:070
1861099220,0cyclictest12011-21diskmemload09:11:250
1861099220,0cyclictest0-21swapper/009:47:130
18620992121,0cyclictest0-21swapper/308:43:103
18620992119,1cyclictest0-21swapper/309:10:013
1862099210,21cyclictest0-21swapper/312:30:163
1861899210,21cyclictest12011-21diskmemload10:10:012
1861899210,21cyclictest0-21swapper/211:05:072
1861899210,20cyclictest26274-21apt-get07:28:092
1861899210,1cyclictest7240-21basename09:00:012
1861899210,0cyclictest0-21swapper/212:15:112
18614992119,1cyclictest17965-21dump-pmu-power08:15:011
1861499210,21cyclictest0-21swapper/111:05:011
1861499210,1cyclictest4828-21dump-pmu-power08:55:001
1861499210,0cyclictest0-21swapper/110:05:581
18610992120,0cyclictest13136-21cat08:05:000
18610992119,1cyclictest23350-21sh07:20:010
1861099210,20cyclictest12011-21diskmemload10:30:070
1861099210,20cyclictest0-21swapper/009:08:110
1861099210,20cyclictest0-21swapper/007:55:020
1861099210,1cyclictest5320-21apt-get08:58:100
1861099210,0cyclictest26274-21apt-get07:28:090
1861099210,0cyclictest0-21swapper/008:23:110
18620992020,0cyclictest0-21swapper/308:28:093
18620992020,0cyclictest0-21swapper/307:55:023
18620992019,0cyclictest424-21apt-get08:48:113
18620992018,1cyclictest9647-21perf09:05:013
18620992018,1cyclictest9647-21perf09:05:013
1862099200,0cyclictest0-21swapper/308:23:113
1862099200,0cyclictest0-21swapper/308:08:093
18618992020,0cyclictest0-21swapper/208:48:112
18618992020,0cyclictest0-21swapper/208:38:092
18618992020,0cyclictest0-21swapper/208:28:092
18618992020,0cyclictest0-21swapper/208:03:122
18618992018,1cyclictest4836-21munin-run08:55:002
18618992018,1cyclictest0-21swapper/207:48:102
1861899200,0cyclictest21466-21apt-get07:18:102
18614992020,0cyclictest28074-21apt-get08:38:091
18614992020,0cyclictest0-21swapper/108:08:091
18614992020,0cyclictest0-21swapper/107:48:101
18614992020,0cyclictest0-21swapper/107:33:091
18614992018,1cyclictest23283-21apt-get08:28:091
18614992016,3cyclictest10699-21cron08:00:001
18610992020,0cyclictest0-21swapper/008:13:100
18610992020,0cyclictest0-21swapper/007:13:100
1861099200,0cyclictest0-21swapper/009:03:090
1861099200,0cyclictest0-21swapper/009:03:090
18620991919,0cyclictest0-21swapper/307:28:093
18620991917,1cyclictest7908-21apt-get07:55:003
18618991919,0cyclictest0-21swapper/207:53:102
18614991919,0cyclictest2380-21perf08:50:001
18610991918,1cyclictest13626-21apt-get08:08:090
18620991818,0cyclictest0-21swapper/308:03:123
18618991818,0cyclictest0-21swapper/208:43:102
18618991818,0cyclictest0-21swapper/208:08:092
18618991818,0cyclictest0-21swapper/207:55:022
18618991814,3cyclictest9630-21turbostat09:05:012
18618991814,3cyclictest9630-21turbostat09:05:012
18614991818,0cyclictest0-21swapper/108:03:121
18610991818,0cyclictest2873-21apt-get08:53:110
18610991818,0cyclictest1165-21apt-get07:43:100
18610991818,0cyclictest0-21swapper/008:43:100
18620991717,0cyclictest0-21swapper/308:38:093
18620991715,1cyclictest17961-21wc08:15:013
18618991717,0cyclictest0-21swapper/208:18:072
18614991716,1cyclictest0-21swapper/107:23:111
18614991715,1cyclictest3072-21basename07:45:001
18614991714,2cyclictest20956-21cron07:15:001
18610991717,0cyclictest0-21swapper/008:38:090
18610991717,0cyclictest0-21swapper/007:38:070
1862099164,11cyclictest25680-21apt-get08:33:093
18620991616,0cyclictest19068-21apt-get07:13:103
1861899160,15cyclictest16069-21apt-get08:13:102
18614991614,1cyclictest0-21swapper/108:35:001
18610991616,0cyclictest3625-21apt-get07:48:100
18620991515,0cyclictest31063-21apt-get07:38:073
18620991515,0cyclictest0-21swapper/308:58:103
18620991515,0cyclictest0-21swapper/307:43:103
18618991515,0cyclictest0-21swapper/207:43:102
18618991515,0cyclictest0-21swapper/207:13:102
1861899150,1cyclictest0-21swapper/208:25:012
18614991515,0cyclictest0-21swapper/107:18:101
18614991514,0cyclictest0-21swapper/107:28:091
1862099140,14cyclictest0-21swapper/308:50:583
1862099140,14cyclictest0-21swapper/307:21:273
1862099140,14cyclictest0-21swapper/307:16:143
1862099140,0cyclictest0-21swapper/308:15:373
1861899140,14cyclictest0-21swapper/208:32:482
1861899140,14cyclictest0-21swapper/207:30:112
1861899140,14cyclictest0-21swapper/207:20:222
18614991414,0cyclictest0-21swapper/109:01:021
18614991414,0cyclictest0-21swapper/109:01:021
18610991414,0cyclictest0-21swapper/008:25:120
1861099140,14cyclictest0-21swapper/008:45:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional