You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 00:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Tue Jun 09, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30592993028,1cyclictest13-21ksoftirqd/010:35:010
30603992721,5cyclictest24339-21diskmemload11:25:563
30603992622,3cyclictest0-21swapper/312:39:293
30603992616,5cyclictest19652-21ssh10:36:323
3060399260,25cyclictest0-21swapper/311:24:173
30601992624,1cyclictest32462-21cron11:50:012
30592992624,1cyclictest13-21ksoftirqd/010:10:000
30603992523,1cyclictest18685-21sh12:08:073
30603992521,3cyclictest24339-21diskmemload11:19:573
30603992520,4cyclictest20148-21ssh11:09:043
3060399250,24cyclictest24339-21diskmemload10:57:543
3060399250,24cyclictest0-21swapper/311:50:073
3060399250,24cyclictest0-21swapper/310:43:403
3060399250,21cyclictest13867-21ssh11:33:343
3060399250,1cyclictest0-21swapper/312:01:133
3060399250,0cyclictest0-21swapper/309:42:343
3060199250,24cyclictest13518-21ssh11:02:032
3060199250,24cyclictest0-21swapper/211:55:022
30597992523,1cyclictest18537-21awk10:05:001
3059799250,21cyclictest151rcu_preempt11:04:271
3059799250,1cyclictest24962-21ssh11:44:171
30592992523,1cyclictest0-21swapper/010:28:430
3059299250,24cyclictest5377-21cron07:25:000
3059299250,24cyclictest24339-21diskmemload12:16:590
30603992424,0cyclictest0-21swapper/309:12:123
30603992422,2cyclictest0-21swapper/311:57:433
30603992422,2cyclictest0-21swapper/309:56:553
30603992422,1cyclictest0-21swapper/309:23:543
30603992421,3cyclictest0-21swapper/310:04:513
30603992421,2cyclictest0-21swapper/312:10:073
30603992420,3cyclictest0-21swapper/310:30:473
30603992417,6cyclictest7787-21ls07:30:003
3060399240,24cyclictest0-21swapper/310:24:533
3060399240,23cyclictest606-21dbus-daemon12:30:003
3060399240,23cyclictest24339-21diskmemload10:08:313
3060399240,23cyclictest24339-21diskmemload09:46:383
3060399240,23cyclictest0-21swapper/310:50:233
3060399240,20cyclictest0-21swapper/309:50:123
3060399240,1cyclictest24339-21diskmemload11:03:153
30601992422,1cyclictest9111-21sh10:55:582
30601992422,1cyclictest24339-21diskmemload09:29:162
30601992419,4cyclictest21257-21ssh10:08:412
3060199240,3cyclictest30722-21ssh09:46:232
3060199240,24cyclictest0-21swapper/209:18:472
3060199240,23cyclictest30366-21ssh10:46:002
3060199240,23cyclictest0-21swapper/211:53:182
3060199240,23cyclictest0-21swapper/210:38:392
3060199240,23cyclictest0-21swapper/210:27:372
30597992423,1cyclictest24339-21diskmemload09:25:061
3059799240,24cyclictest0-21swapper/112:04:561
3059799240,23cyclictest24339-21diskmemload11:52:191
3059799240,23cyclictest21179-21munin-run12:40:011
3059799240,23cyclictest0-21swapper/111:46:571
30592992424,0cyclictest0-21swapper/012:13:250
30592992423,1cyclictest13-21ksoftirqd/011:49:220
30592992422,1cyclictest0-21swapper/010:43:030
3059299240,23cyclictest24339-21diskmemload12:35:150
3059299240,23cyclictest24339-21diskmemload11:59:550
3059299240,23cyclictest24339-21diskmemload10:03:080
3059299240,1cyclictest32591-21apt-get10:49:170
3059299240,0cyclictest24339-21diskmemload09:38:270
3059299240,0cyclictest0-21swapper/010:53:090
30603992323,0cyclictest0-21swapper/311:40:143
30603992320,3cyclictest0-21swapper/310:45:323
30603992320,2cyclictest32605-21sh12:20:123
30603992319,4cyclictest0-21swapper/309:04:153
30603992319,3cyclictest0-21swapper/309:30:093
3060399230,2cyclictest30633-21sh10:16:513
3060399230,23cyclictest0-21swapper/312:34:473
3060399230,23cyclictest0-21swapper/311:35:463
3060399230,23cyclictest0-21swapper/310:12:153
3060399230,23cyclictest0-21swapper/309:37:483
3060399230,23cyclictest0-21swapper/309:15:113
3060399230,22cyclictest28605-21ssh11:46:453
3060399230,22cyclictest0-21swapper/312:17:563
30601992323,0cyclictest14950-21apt-get08:54:162
30601992323,0cyclictest0-21swapper/212:21:002
30601992323,0cyclictest0-21swapper/212:01:522
30601992323,0cyclictest0-21swapper/211:33:412
30601992323,0cyclictest0-21swapper/211:23:082
30601992323,0cyclictest0-21swapper/211:12:252
30601992323,0cyclictest0-21swapper/210:00:172
30601992323,0cyclictest0-21swapper/209:56:132
30601992321,1cyclictest2990-21perf07:20:012
30601992321,1cyclictest0-21swapper/212:16:432
30601992321,1cyclictest0-21swapper/210:16:242
30601992320,2cyclictest5347-21apt-get08:34:152
3060199230,23cyclictest0-21swapper/212:25:402
3060199230,23cyclictest0-21swapper/211:19:322
3060199230,23cyclictest0-21swapper/210:21:032
3060199230,23cyclictest0-21swapper/209:50:582
3060199230,23cyclictest0-21swapper/209:40:262
3060199230,22cyclictest9570-21idleruntime-cro08:40:002
3060199230,22cyclictest24339-21diskmemload09:10:232
3060199230,22cyclictest15355-21ssh10:33:032
3060199230,22cyclictest0-21swapper/211:43:132
3060199230,0cyclictest0-21swapper/212:35:392
3060199230,0cyclictest0-21swapper/209:30:172
30597992323,0cyclictest13303-21apt-get07:44:161
30597992323,0cyclictest0-21swapper/112:05:491
30597992323,0cyclictest0-21swapper/110:52:311
30597992323,0cyclictest0-21swapper/110:45:411
30597992323,0cyclictest0-21swapper/110:29:571
30597992323,0cyclictest0-21swapper/109:56:121
30597992323,0cyclictest0-21swapper/109:47:141
30597992323,0cyclictest0-21swapper/109:41:271
30597992323,0cyclictest0-21swapper/109:34:361
30597992322,1cyclictest24339-21diskmemload10:20:081
30597992321,1cyclictest0-21swapper/112:29:161
30597992320,2cyclictest3264-21ssh09:50:401
3059799230,2cyclictest23741-21sh10:09:491
3059799230,2cyclictest18104-21rm10:34:341
3059799230,23cyclictest24339-21diskmemload11:56:121
3059799230,23cyclictest24339-21diskmemload10:41:421
3059799230,23cyclictest0-21swapper/112:15:051
3059799230,23cyclictest0-21swapper/112:14:401
3059799230,23cyclictest0-21swapper/111:38:361
3059799230,23cyclictest0-21swapper/110:15:421
3059799230,23cyclictest0-21swapper/109:20:311
3059799230,22cyclictest31923-21munin-plugin-st08:20:001
3059799230,22cyclictest24298-21turbostat09:40:011
3059799230,22cyclictest1436-21ssh11:20:401
3059799230,1cyclictest18987-21ssh10:35:271
3059799230,1cyclictest0-21swapper/112:23:031
3059799230,0cyclictest0-21swapper/111:12:501
3059799230,0cyclictest0-21swapper/110:10:021
30592992323,0cyclictest24339-21diskmemload09:48:480
30592992323,0cyclictest141rcuc/010:55:020
30592992323,0cyclictest0-21swapper/011:50:520
30592992323,0cyclictest0-21swapper/011:43:330
30592992323,0cyclictest0-21swapper/010:14:150
30592992323,0cyclictest0-21swapper/009:25:530
30592992322,1cyclictest62550irq/127-eno109:17:230
30592992322,1cyclictest14078-21ssh11:33:520
30592992322,0cyclictest24339-21diskmemload11:26:350
30592992321,2cyclictest0-21swapper/011:37:590
30592992321,1cyclictest24339-21diskmemload12:09:240
30592992320,2cyclictest9549-21latency_hist08:40:000
30592992320,2cyclictest605-21avahi-daemon07:15:010
30592992320,2cyclictest19233-21sh10:35:470
30592992320,2cyclictest19151-21apt-get09:00:010
3059299230,2cyclictest1086-21ssh11:20:110
3059299230,23cyclictest0-21swapper/009:30:490
3059299230,22cyclictest24339-21diskmemload11:05:070
3059299230,22cyclictest24339-21diskmemload09:23:130
3059299230,22cyclictest20253-21kworker/0:210:20:020
3059299230,22cyclictest12695-21dump-pmu-power07:40:000
3059299230,22cyclictest0-21swapper/012:34:190
3059299230,22cyclictest0-21swapper/012:26:550
3059299230,22cyclictest0-21swapper/012:24:180
3059299230,22cyclictest0-21swapper/009:43:010
3059299230,22cyclictest0-21swapper/009:10:560
3059299230,21cyclictest0-21swapper/010:15:370
3059299230,1cyclictest141rcuc/011:10:370
3059299230,0cyclictest24339-21diskmemload09:55:310
30603992221,1cyclictest15698-21apt-get07:49:163
30603992221,1cyclictest0-21swapper/311:11:433
30603992220,1cyclictest29515-21munin-run08:15:013
30603992220,1cyclictest0-21swapper/308:50:013
3060399220,22cyclictest0-21swapper/310:28:403
3060399220,21cyclictest22296-21ls08:00:013
3060399220,21cyclictest0-21swapper/309:25:543
30601992222,0cyclictest24339-21diskmemload10:53:572
30601992222,0cyclictest0-21swapper/211:05:042
30601992221,0cyclictest0-21swapper/211:25:272
30601992220,2cyclictest10831-21sh12:30:122
30601992219,3cyclictest0-21swapper/211:38:532
3060199220,22cyclictest0-21swapper/210:40:122
3060199220,21cyclictest3302-21ssh09:20:052
3060199220,21cyclictest22537-21sh12:10:592
3060199220,21cyclictest15111-21cron07:45:002
3060199220,1cyclictest25198-21rm10:11:382
30597992222,0cyclictest6603-21ssh11:25:271
30597992222,0cyclictest24339-21diskmemload11:30:011
30597992222,0cyclictest0-21swapper/112:31:541
30597992221,0cyclictest0-21swapper/107:29:161
30597992220,2cyclictest1977-21apt08:25:001
30597992220,1cyclictest5375-21cron07:25:001
3059799220,22cyclictest0-21swapper/110:55:341
3059799220,0cyclictest0-21swapper/109:10:501
30592992220,1cyclictest19919-21munin-run07:55:010
30592992220,1cyclictest1956-21awk08:25:000
30592992220,1cyclictest14379-21munin-run08:50:010
3059299220,21cyclictest31902-21turbostat.cron08:20:000
3059299220,21cyclictest28578-21ssh11:15:460
3059299220,21cyclictest25297-21apt-get08:09:130
3059299220,21cyclictest13624-21ssh11:02:120
3059299220,21cyclictest0-21swapper/009:50:400
3059299220,1cyclictest0-21swapper/008:14:170
3060399210,1cyclictest0-21swapper/308:39:163
30601992121,0cyclictest12553-21apt-get08:49:162
3060199210,21cyclictest0-21swapper/209:36:282
3060199210,1cyclictest3592-21apt-get07:24:152
3060199210,1cyclictest27101-21awk08:10:012
30597992119,1cyclictest0-21swapper/108:35:001
3059799210,21cyclictest0-21swapper/111:05:241
3059799210,21cyclictest0-21swapper/108:59:151
3059799210,0cyclictest0-21swapper/108:14:171
3059799210,0cyclictest0-21swapper/108:10:011
30592992121,0cyclictest0-21swapper/009:09:170
30592992120,1cyclictest20155-21apt-get09:04:160
30592992118,2cyclictest13-21ksoftirqd/007:45:010
3059299210,21cyclictest0-21swapper/012:01:180
3059299210,20cyclictest0-21swapper/008:44:170
3059299210,20cyclictest0-21swapper/007:29:160
30603992020,0cyclictest0-21swapper/308:54:163
30603992020,0cyclictest0-21swapper/307:24:153
30603992018,1cyclictest10158-21apt-get08:44:173
3060399200,0cyclictest0-21swapper/307:44:163
30601992020,0cyclictest0-21swapper/209:09:172
30601992020,0cyclictest0-21swapper/208:44:172
3060199200,20cyclictest0-21swapper/207:39:172
30597992020,0cyclictest31137-21apt-get07:14:161
30597992020,0cyclictest0-21swapper/108:54:161
30597992020,0cyclictest0-21swapper/107:19:161
30597992018,1cyclictest0-21swapper/108:30:001
30592992018,1cyclictest141rcuc/008:30:020
30603991919,0cyclictest0-21swapper/308:59:153
30603991919,0cyclictest0-21swapper/308:29:163
30603991919,0cyclictest0-21swapper/307:34:153
3060399190,18cyclictest0-21swapper/308:34:153
30601991918,1cyclictest10193-21perf07:35:002
30601991918,0cyclictest0-21swapper/208:24:152
30597991919,0cyclictest0-21swapper/108:39:161
30597991919,0cyclictest0-21swapper/107:59:151
3059799190,1cyclictest24373-21munin-run09:10:001
30592991917,1cyclictest22321-21grep08:00:010
30603991818,0cyclictest0-21swapper/307:19:163
30603991817,0cyclictest0-21swapper/307:54:173
30601991816,1cyclictest17514-21wc07:50:002
3060199180,0cyclictest27694-21apt-get08:14:172
30597991818,0cyclictest0-21swapper/107:54:171
30597991816,1cyclictest12703-21latency_hist07:40:001
30592991818,0cyclictest0-21swapper/008:04:170
30592991818,0cyclictest0-21swapper/007:49:160
30592991817,1cyclictest1164-21apt-get07:19:160
30603991715,1cyclictest1955-21cron08:25:003
3060199170,0cyclictest0-21swapper/208:19:162
30597991717,0cyclictest0-21swapper/109:04:151
30601991616,0cyclictest0-21swapper/208:04:172
30601991616,0cyclictest0-21swapper/207:29:162
30597991616,0cyclictest22907-21apt-get08:04:171
30592991614,1cyclictest8385-21apt-get07:34:150
3059299160,0cyclictest0-21swapper/008:54:160
3060399150,15cyclictest0-21swapper/308:06:373
3060399150,14cyclictest31912-21awk08:20:003
3060399150,0cyclictest0-21swapper/307:12:443
30601991515,0cyclictest2552-21apt-get08:29:162
30601991515,0cyclictest17343-21apt-get08:59:152
3060199150,1cyclictest21874-21users09:04:252
30597991515,0cyclictest0-21swapper/108:49:161
30597991515,0cyclictest0-21swapper/108:44:171
30603991413,1cyclictest0-21swapper/308:00:333
3060399140,14cyclictest0-21swapper/309:07:383
3060199140,14cyclictest0-21swapper/207:55:262
3060199140,14cyclictest0-21swapper/207:53:132
3060199140,0cyclictest0-21swapper/207:11:212
3059299140,14cyclictest0-21swapper/008:26:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional