You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 21:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Thu Sep 03, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
990098995148,2cyclictest75-21kswapd011:02:563
990090995047,2cyclictest75-21kswapd011:02:570
990093994235,5cyclictest1234409-21dpkg11:02:581
990090993730,5cyclictest1291730-21apt-get12:00:110
990098993629,5cyclictest1193220-21latency_hist10:25:013
990094993633,2cyclictest1323222-21apt-get12:30:162
990093993632,3cyclictest1146519-21apt-get09:40:121
990093993631,3cyclictest1312840-21apt-get12:20:101
990090993531,3cyclictest1306996-21apt-get12:15:030
990093993431,2cyclictest1286314-21kworker/u8:1+flush-259:012:05:241
990093993329,3cyclictest935599-21kworker/u8:1+flush-259:007:50:241
990093993329,3cyclictest1162076-21apt-get09:55:121
990093993228,3cyclictest935599-21kworker/u8:1+events_unbound07:55:201
990090993228,3cyclictest1094402-21apt-get08:50:110
990090993027,2cyclictest1245289-21kworker/u8:3+flush-259:011:30:000
990090993025,4cyclictest1083947-21cat08:40:010
990098992923,4cyclictest1301795-21latency_hist12:10:013
990093992925,3cyclictest1245289-21kworker/u8:3+events_unbound11:15:141
990093992923,4cyclictest1276246-21apt-get11:45:101
990094992822,4cyclictest1005533-21latency_hist07:25:002
990093992721,4cyclictest990053-21latency_hist07:10:011
990093992721,4cyclictest1104761-21apt-get09:00:111
990093992720,5cyclictest1062787-21latency_hist08:20:011
990093992720,5cyclictest1062787-21latency_hist08:20:001
99009099271,25cyclictest1-21systemd11:40:000
990098992619,5cyclictest335557-21systemd-journal11:25:003
990093992619,5cyclictest1057678-21cat08:15:011
990098992519,4cyclictest1296647-21latency_hist12:05:013
990093992521,3cyclictest935599-21kworker/u8:1+events_unbound08:40:251
990098992419,3cyclictest335557-21systemd-journal11:45:003
990098992319,3cyclictest1193255-21kworker/u8:1+flush-259:010:45:003
990093992318,3cyclictest935599-21kworker/u8:1+events_unbound09:50:221
990090992319,3cyclictest1234946-21apt-get11:05:100
990098992218,3cyclictest1161835-21kworker/u8:3+flush-259:010:40:003
990093992219,2cyclictest1245289-21kworker/u8:3+flush-259:011:20:211
990090992217,4cyclictest1332288-21ntpq12:35:220
990094992117,3cyclictest509-21rs:main2
990094992115,4cyclictest1125831-21/usr/sbin/munin09:20:192
990093992118,2cyclictest1198601-21kworker/u8:2+flush-259:012:00:161
990093992117,3cyclictest935599-21kworker/u8:1+flush-259:008:25:121
990093992117,3cyclictest1193255-21kworker/u8:1+events_unbound10:50:151
990093992117,3cyclictest1140795-21kworker/u8:2+flush-259:009:35:101
990093992117,2cyclictest990068-21kworker/u8:2+flush-259:008:20:141
990093992116,4cyclictest1161835-21kworker/u8:3+events_unbound10:10:241
990098992016,3cyclictest1177994-21apt-get10:10:163
990094992016,3cyclictest1291492-21kworker/u8:4+flush-259:012:25:232
990094992015,4cyclictest1245289-21kworker/u8:3+flush-259:011:25:112
990093992017,2cyclictest990068-21kworker/u8:2+events_unbound08:30:201
990093992017,2cyclictest1073134-21kworker/u8:3+events_unbound08:45:171
990093992016,3cyclictest935599-21kworker/u8:1+flush-259:009:30:281
990093992016,3cyclictest1291492-21kworker/u8:4+events_unbound12:30:201
990093992016,3cyclictest1286314-21kworker/u8:1+events_unbound11:55:151
990093992016,3cyclictest1193255-21kworker/u8:1+events_unbound10:55:181
990093992013,5cyclictest1281379-21/usr/sbin/munin11:50:171
990098991915,3cyclictest1031628-21apt-get07:50:113
990098991914,3cyclictest1307680-21apt-get12:15:113
990094991916,2cyclictest1006209-21irqcore07:25:172
990094991913,4cyclictest1036515-21latency_hist07:55:002
990093991916,2cyclictest990068-21kworker/u8:2+events_unbound08:00:251
990093991915,3cyclictest935599-21kworker/u8:1+flush-259:008:50:131
990093991915,3cyclictest935599-21kworker/u8:1+events_unbound09:20:011
990093991915,3cyclictest1193255-21kworker/u8:1+flush-259:010:45:161
990090991914,4cyclictest1120015-21latency_hist09:15:010
990090991913,4cyclictest335557-21systemd-journal12:07:320
990090991912,5cyclictest1244150-21ntpq11:10:200
990098991815,2cyclictest1188038-21latency_hist10:20:003
990094991813,4cyclictest335557-21systemd-journal12:19:322
990094991813,4cyclictest1083412-21apt-get08:40:002
990094991813,4cyclictest1073134-21kworker/u8:3+flush-259:008:55:232
990094991812,4cyclictest1125601-21cat09:20:012
990093991814,3cyclictest1302064-21apt-get12:10:151
990093991814,3cyclictest1198601-21kworker/u8:2+events_unbound12:15:151
990090991814,3cyclictest990068-21kworker/u8:2+flush-259:008:00:280
990090991813,4cyclictest0-21swapper/009:00:010
990098991714,2cyclictest1198601-21kworker/u8:2+flush-259:011:35:003
990098991713,3cyclictest1198601-21kworker/u8:2+flush-259:011:10:233
990094991714,2cyclictest1161835-21kworker/u8:3+events_unbound09:55:142
990094991714,1cyclictest0-21swapper/210:40:002
990094991713,3cyclictest935599-21kworker/u8:1+events_unbound09:35:012
990094991712,4cyclictest990068-21kworker/u8:2+flush-259:007:40:172
990094991712,4cyclictest1073134-21kworker/u8:3+flush-259:009:00:242
990094991712,3cyclictest0-21swapper/212:15:002
990094991710,5cyclictest1300914-21ntpq12:05:212
990093991714,3cyclictest990068-21kworker/u8:2+events_unbound07:10:151
990093991714,2cyclictest935599-21kworker/u8:1+events_unbound08:35:161
990093991714,2cyclictest1260755-21kworker/u8:1+events_unbound11:35:241
990093991714,2cyclictest1260755-21kworker/u8:1+events_unbound11:30:071
990093991713,3cyclictest935599-21kworker/u8:1+events_unbound09:15:151
990093991713,3cyclictest1198601-21kworker/u8:2+events_unbound11:15:001
990093991713,3cyclictest1140795-21kworker/u8:2+flush-259:010:05:161
990093991712,4cyclictest990068-21kworker/u8:2+events_unbound08:05:141
990093991712,4cyclictest1183117-21/usr/sbin/munin10:15:131
990093991710,5cyclictest335557-21systemd-journal10:35:321
99009399170,15cyclictest1134904-21/usr/sbin/munin09:25:191
990090991715,1cyclictest0-21swapper/007:55:000
990090991713,3cyclictest60350irq/132-enp0s29f1:rx-010:35:220
990090991712,3cyclictest1094141-21latency_hist08:50:010
99009099170,16cyclictest509-21rs:main0
990098991614,1cyclictest0-21swapper/307:50:003
990098991613,2cyclictest1313250-21irqcore12:20:153
990098991613,2cyclictest1173431-21kthreadcore10:05:163
99009499169,5cyclictest1177404-21cp10:10:002
99009499169,5cyclictest1083398-21latency_hist08:40:012
990094991613,2cyclictest335557-21systemd-journal10:55:002
990094991613,1cyclictest0-21swapper/210:45:002
990094991612,3cyclictest1073134-21kworker/u8:3+events_unbound09:10:012
990093991613,2cyclictest935599-21kworker/u8:1+flush-259:009:05:231
990093991613,2cyclictest1161835-21kworker/u8:3+events_unbound10:30:271
990093991612,3cyclictest1318440-21irqcore12:25:151
990093991612,3cyclictest1198601-21kworker/u8:2+events_unbound12:35:281
990090991614,1cyclictest60350irq/132-enp0s29f1:rx-011:20:170
990090991613,2cyclictest935599-21kworker/u8:1+flush-259:009:05:010
990090991613,2cyclictest60350irq/132-enp0s29f1:rx-011:53:080
990090991613,2cyclictest60350irq/132-enp0s29f1:rx-010:25:160
990098991513,1cyclictest1042083-21sh08:00:003
990098991512,2cyclictest0-21swapper/308:05:013
990098991510,4cyclictest1219281-21apt-get10:50:103
990098991510,3cyclictest335557-21systemd-journal09:45:293
99009499158,6cyclictest1275993-21idleruntime-cro11:45:002
99009499156,4cyclictest1078255-21munin-run08:35:002
990094991512,2cyclictest1156618-21cron09:50:012
990094991511,3cyclictest1270857-21kworker/u8:3+flush-259:011:50:012
990094991511,3cyclictest1176918-21kworker/u8:0+flush-259:010:20:172
990094991510,3cyclictest1270857-21kworker/u8:3+flush-259:011:50:192
990094991510,3cyclictest1193255-21kworker/u8:1+flush-259:010:55:212
99009399159,4cyclictest995480-21/usr/sbin/munin07:15:141
99009399159,4cyclictest1016315-21diskstats07:35:141
990093991512,2cyclictest1002945-21kthreadcore07:20:171
990090991513,2cyclictest61150irq/133-enp0s29f1:tx-007:35:240
990090991513,1cyclictest60350irq/132-enp0s29f1:rx-011:15:220
990090991513,1cyclictest60350irq/132-enp0s29f1:rx-010:20:200
990090991513,1cyclictest60350irq/132-enp0s29f1:rx-009:30:140
990090991513,1cyclictest60350irq/132-enp0s29f1:rx-008:35:150
990090991513,1cyclictest60350irq/132-enp0s29f1:rx-008:15:240
990090991513,1cyclictest60350irq/132-enp0s29f1:rx-008:15:230
990090991513,1cyclictest60350irq/132-enp0s29f1:rx-007:55:170
990090991513,1cyclictest1151461-21idleruntime-cro09:45:010
990090991512,2cyclictest60350irq/132-enp0s29f1:rx-010:10:280
990090991512,2cyclictest60350irq/132-enp0s29f1:rx-009:50:240
990090991512,2cyclictest60350irq/132-enp0s29f1:rx-009:26:280
990090991512,2cyclictest60350irq/132-enp0s29f1:rx-009:15:110
990090991512,2cyclictest60350irq/132-enp0s29f1:rx-008:25:120
990090991512,2cyclictest60350irq/132-enp0s29f1:rx-007:45:210
990090991512,2cyclictest60350irq/132-enp0s29f1:rx-007:40:210
990090991512,2cyclictest60350irq/132-enp0s29f1:rx-007:30:110
990090991512,2cyclictest60350irq/132-enp0s29f1:rx-007:25:250
99009899149,3cyclictest335557-21systemd-journal11:45:493
99009899147,5cyclictest1307150-21cat12:15:013
990098991412,1cyclictest0-21swapper/308:09:593
990098991411,2cyclictest1083390-21idleruntime-cro08:40:003
990094991411,2cyclictest1131175-21fschecks_count09:25:142
990094991410,3cyclictest1291492-21kworker/u8:4+flush-259:012:40:002
99009399149,3cyclictest935599-21kworker/u8:1+flush-259:007:25:281
99009399149,3cyclictest1115095-21/usr/sbin/munin09:10:151
990093991411,2cyclictest935599-21kworker/u8:1+events_unbound07:45:181
990093991411,2cyclictest1245289-21kworker/u8:3+flush-259:011:25:211
990093991410,3cyclictest935599-21kworker/u8:1+events_unbound07:30:151
990093991410,3cyclictest1161835-21kworker/u8:3+events_unbound10:27:341
990093991410,3cyclictest1161835-21kworker/u8:3+events_unbound10:23:341
99009099148,4cyclictest1218154-21ntpq10:45:220
990090991413,1cyclictest60350irq/132-enp0s29f1:rx-007:23:400
990090991412,2cyclictest60350irq/132-enp0s29f1:rx-010:50:470
990090991412,1cyclictest60350irq/132-enp0s29f1:rx-012:10:220
990090991412,1cyclictest60350irq/132-enp0s29f1:rx-009:45:140
990090991412,1cyclictest60350irq/132-enp0s29f1:rx-008:05:190
990090991412,1cyclictest0-21swapper/010:44:590
990090991412,1cyclictest0-21swapper/007:19:590
990090991411,2cyclictest60350irq/132-enp0s29f1:rx-012:25:100
990090991411,2cyclictest60350irq/132-enp0s29f1:rx-011:57:540
990090991411,2cyclictest60350irq/132-enp0s29f1:rx-010:55:110
990090991411,2cyclictest60350irq/132-enp0s29f1:rx-010:30:260
990090991411,2cyclictest60350irq/132-enp0s29f1:rx-008:12:370
99009899137,4cyclictest335557-21systemd-journal09:35:013
990098991310,2cyclictest935599-21kworker/u8:1+flush-259:008:55:013
990098991310,2cyclictest1093667-21unixbench_multi08:45:243
99009399139,3cyclictest1104510-21idleruntime-cro09:00:011
99009399138,3cyclictest1193255-21kworker/u8:1+events_unbound10:40:201
990093991310,2cyclictest935599-21kworker/u8:1+flush-259:007:40:251
990093991310,2cyclictest1234361-21kworker/u8:0+events_unbound11:07:211
99009099139,3cyclictest1198601-21kworker/u8:2+events_unbound12:20:170
99009099137,4cyclictest335557-21systemd-journal11:35:010
990090991312,1cyclictest60350irq/132-enp0s29f1:rx-010:15:130
990090991312,1cyclictest60350irq/132-enp0s29f1:rx-010:00:230
990090991312,1cyclictest60350irq/132-enp0s29f1:rx-008:20:140
990090991311,1cyclictest60350irq/132-enp0s29f1:rx-011:44:060
990090991311,1cyclictest60350irq/132-enp0s29f1:rx-009:35:140
990090991310,2cyclictest1110203-21fschecks_time09:05:150
99009899129,2cyclictest1245289-21kworker/u8:3+flush-259:011:15:153
99009899129,2cyclictest0-21swapper/308:44:593
99009899128,3cyclictest1318275-21fschecks_time12:25:133
99009899128,3cyclictest1286966-21irqcore11:55:133
990098991210,1cyclictest0-21swapper/309:00:003
99009499129,2cyclictest990068-21kworker/u8:2+flush-259:008:20:252
99009499129,2cyclictest507-21in:imuxsock10:20:002
99009499129,2cyclictest1053691-21kthreadcore08:10:162
99009499129,2cyclictest1042076-21cron08:00:002
99009499128,3cyclictest1073134-21kworker/u8:3+flush-259:009:10:162
990094991210,1cyclictest0-21swapper/211:10:002
99009499120,11cyclictest1-21systemd12:00:012
99009399129,2cyclictest1270857-21kworker/u8:3+events_unbound11:40:141
99009399129,2cyclictest1151819-21cpuspeed_turbos09:45:121
990093991210,1cyclictest1140795-21kworker/u8:2+events_unbound10:00:221
99009099129,2cyclictest60350irq/132-enp0s29f1:rx-012:34:250
99009099129,2cyclictest60350irq/132-enp0s29f1:rx-010:05:140
990090991210,1cyclictest60350irq/132-enp0s29f1:rx-008:30:220
99009899119,1cyclictest0-21swapper/310:55:233
99009899119,1cyclictest0-21swapper/307:15:133
99009899118,2cyclictest0-21swapper/309:15:003
99009899118,1cyclictest0-21swapper/309:40:013
99009899117,3cyclictest990068-21kworker/u8:2+flush-259:008:15:473
99009899117,3cyclictest990068-21kworker/u8:2+flush-259:008:15:463
99009499118,2cyclictest1042430-21cpuspeed_turbos08:00:132
99009499118,2cyclictest1011043-21cpuspeed_turbos07:30:132
99009499116,4cyclictest1193478-21apt-get10:25:112
99009099118,2cyclictest60350irq/132-enp0s29f1:rx-009:22:230
99009899100,2cyclictest1198368-21awk10:30:003
99009899100,1cyclictest1203560-21awk10:35:003
99009499108,1cyclictest0-21swapper/212:25:012
99009499108,1cyclictest0-21swapper/210:00:222
99009499108,1cyclictest0-21swapper/207:10:162
9900989997,1cyclictest0-21swapper/312:35:193
9900989995,3cyclictest491ktimers/308:10:113
9900989995,2cyclictest0-21swapper/309:20:163
9900989994,4cyclictest491ktimers/309:25:113
9900949996,2cyclictest1291817-21cpuspeed_turbos12:00:132
9900989985,2cyclictest1063145-21tr08:20:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional