You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-24 - 02:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Mon Aug 24, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450390,0irq/25-eth10-21swapper/318:41:263
1191323521,0sleep00-21swapper/018:41:330
1200123425,0sleep10-21swapper/118:42:341
1198123223,0sleep20-21swapper/218:42:232
339960,0migration/33154-21sh00:01:443
339960,0migration/330805-21sh22:16:363
339960,0migration/322369-21sh22:31:443
339960,0migration/313869-21sh23:08:353
339960,0migration/311188-21munin-node23:46:193
29715060,0irq/26-eth0-rx-9516-21grep22:06:113
29715060,0irq/26-eth0-rx-26978-21ntp_states23:56:193
29715060,0irq/26-eth0-rx-24079-21sh22:15:123
29715060,0irq/26-eth0-rx-0-21swapper/321:55:343
149960,0migration/06848-21timerwakeupswit22:01:200
149960,0migration/031876-21sh21:57:420
149960,0migration/021477-21kthreadcore21:31:160
149960,0migration/020695-21taskset23:54:350
149960,0migration/017683-21kthreadcore22:31:170
149960,0migration/016231-21sh22:10:260
123649960,0cyclictest0-21swapper/121:59:521
8215050,0irq/24-0000:00:10548-21sa120:45:582
35150,0ktimersoftd/30-21swapper/323:40:543
339950,0migration/3982-21munin-node22:21:153
339950,0migration/39313-21latency_hist21:45:583
339950,0migration/39182-21kthreadcore19:06:163
339950,0migration/37248-21kthreadcore19:51:193
339950,0migration/35474-21kthreadcore22:01:153
339950,0migration/34319-21irqcore20:16:153
339950,0migration/33600-21kthreadcore21:21:153
339950,0migration/33343-21kthreadcore19:01:173
339950,0migration/332315-21taskset19:00:423
339950,0migration/330716-21kthreadcore21:36:163
339950,0migration/330410-21kthreadcore19:21:173
339950,0migration/329186-21munin-node20:11:113
339950,0migration/32692-21cpuspeed_turbos21:01:123
339950,0migration/326383-21kthreadcore20:06:163
339950,0migration/323606-21munin-node23:16:103
339950,0migration/321100-21diskmemload22:51:173
339950,0migration/32093-21kthreadcore23:41:173
339950,0migration/320915-21taskset19:40:413
339950,0migration/319057-21pmu-power19:11:203
339950,0migration/318870-21kthreadcore20:01:163
339950,0migration/318837-21munin-node21:31:143
339950,0migration/313936-21kthreadcore21:26:193
339950,0migration/312327-21unixbench-2d23:26:213
29725050,0irq/27-eth0-tx-29322-21munin-node00:01:222
29725050,0irq/27-eth0-tx-24442-21df_inode22:36:122
29725050,0irq/27-eth0-tx-19282-21perl21:11:122
29725050,0irq/27-eth0-tx-18933-21missed_timers23:51:162
29725050,0irq/27-eth0-tx-12400-21memory23:06:182
29725050,0irq/27-eth0-tx-0-21swapper/222:21:072
29725050,0irq/27-eth0-tx-0-21swapper/020:46:180
29725050,0irq/27-eth0-tx-0-21swapper/019:51:120
29725050,0irq/27-eth0-tx-0-21swapper/019:21:200
29715050,0irq/26-eth0-rx-8847-21taskset21:45:023
29715050,0irq/26-eth0-rx-8398-21munin-node22:46:123
29715050,0irq/26-eth0-rx-5053-21if_eth1.320:41:133
29715050,0irq/26-eth0-rx-3983-21date20:40:583
29715050,0irq/26-eth0-rx-28350-21kthreadcore20:56:163
29715050,0irq/26-eth0-rx-25002-21sort18:51:213
29715050,0irq/26-eth0-rx-24355-21if_err_eth122:56:133
29715050,0irq/26-eth0-rx-19395-21idleruntime21:11:133
29715050,0irq/26-eth0-rx-0-21swapper/323:31:313
29715050,0irq/26-eth0-rx-0-21swapper/323:21:153
29715050,0irq/26-eth0-rx-0-21swapper/323:11:143
29715050,0irq/26-eth0-rx-0-21swapper/322:45:293
29715050,0irq/26-eth0-rx-0-21swapper/322:36:163
29715050,0irq/26-eth0-rx-0-21swapper/322:26:143
29715050,0irq/26-eth0-rx-0-21swapper/321:16:133
29715050,0irq/26-eth0-rx-0-21swapper/321:06:163
29715050,0irq/26-eth0-rx-0-21swapper/300:13:373
259950,0migration/28386-21sh22:05:342
259950,0migration/223370-21unixbench-2d21:51:212
259950,0migration/22134-21sh21:00:542
259950,0migration/218710-21latency_hist20:50:582
259950,0migration/21848-21gltestperf19:26:122
249950,0watchdog/23047-21perl21:01:132
249950,0watchdog/20-21swapper/221:31:172
20126250,0sleep020247-21iostat_ios18:51:140
179950,0migration/125893-21kthreadcore23:16:131
169950,0watchdog/10-21swapper/119:31:171
149950,0migration/09576-21taskset20:20:330
149950,0migration/09006-21kthreadcore23:06:170
149950,0migration/08420-21runrttasks21:43:430
149950,0migration/08031-21kthreadcore20:41:150
149950,0migration/06725-21fschecks_count23:26:110
149950,0migration/04890-21kthreadcore22:41:160
149950,0migration/03156-21timerandwakeup20:36:200
149950,0migration/029716-21kthreadcore22:16:160
149950,0migration/029072-21munin-node22:56:190
149950,0migration/028499-21missed_timers20:31:170
149950,0migration/027872-21kthreadcore21:16:140
149950,0migration/02649-21kthreadcore19:26:150
149950,0migration/025067-21kthreadcore19:16:170
149950,0migration/02285-21kthreadcore19:01:170
149950,0migration/022063-21latency_hist20:05:580
149950,0migration/021152-21kthreadcore21:11:160
149950,0migration/020722-21taskset19:38:260
149950,0migration/020144-21kthreadcore20:51:160
149950,0migration/01789-21kthreadcore23:01:130
149950,0migration/017490-21kthreadcore23:31:160
149950,0migration/015719-21sh23:11:130
149950,0migration/015155-21missed_timers20:21:170
149950,0migration/014959-21sh22:50:020
149950,0migration/010608-21kthreadcore23:46:170
149950,0migration/010232-21sh21:05:410
123659955,0cyclictest0-21swapper/223:27:202
123659954,0cyclictest0-21swapper/221:27:212
123659950,0cyclictest0-21swapper/223:57:172
123659950,0cyclictest0-21swapper/221:59:122
123659950,0cyclictest0-21swapper/220:20:592
123649955,0cyclictest0-21swapper/122:02:051
123649955,0cyclictest0-21swapper/121:37:481
123649950,0cyclictest0-21swapper/122:59:471
123629954,0cyclictest0-21swapper/021:27:250
123629950,0cyclictest0-21swapper/000:12:580
339940,0migration/37236-21kthreadcore00:06:153
339940,0migration/328364-21kthreadcore21:56:163
339940,0migration/310477-21fschecks_time20:21:133
29725040,0irq/27-eth0-tx-8204-21ssh21:43:052
29725040,0irq/27-eth0-tx-3581-21kthreadcore23:21:162
29725040,0irq/27-eth0-tx-17339-21ssh20:47:442
29725040,0irq/27-eth0-tx-14997-21telnet23:11:102
29725040,0irq/27-eth0-tx-10641-21munin-node21:06:222
29725040,0irq/27-eth0-tx-0-21swapper/223:46:102
29725040,0irq/27-eth0-tx-0-21swapper/223:15:592
29725040,0irq/27-eth0-tx-0-21swapper/223:01:222
29725040,0irq/27-eth0-tx-0-21swapper/222:47:202
29725040,0irq/27-eth0-tx-0-21swapper/222:41:152
29725040,0irq/27-eth0-tx-0-21swapper/222:26:092
29725040,0irq/27-eth0-tx-0-21swapper/222:11:172
29725040,0irq/27-eth0-tx-0-21swapper/221:46:152
29725040,0irq/27-eth0-tx-0-21swapper/221:21:012
29725040,0irq/27-eth0-tx-0-21swapper/221:16:182
29725040,0irq/27-eth0-tx-0-21swapper/200:11:232
29725040,0irq/27-eth0-tx-0-21swapper/200:06:242
29725040,0irq/27-eth0-tx-0-21swapper/020:00:240
29725040,0irq/27-eth0-tx-0-21swapper/019:31:160
29715040,0irq/26-eth0-rx-21279-21irqcore19:16:153
29715040,0irq/26-eth0-rx-0-21swapper/323:52:283
29715040,0irq/26-eth0-rx-0-21swapper/323:01:143
29715040,0irq/26-eth0-rx-0-21swapper/320:51:013
29715040,0irq/26-eth0-rx-0-21swapper/320:47:203
29715040,0irq/26-eth0-rx-0-21swapper/320:31:143
29715040,0irq/26-eth0-rx-0-21swapper/319:58:383
259940,0migration/230213-21munin-node23:41:112
259940,0migration/22966-21kthreadcore19:01:172
259940,0migration/228735-21latency_hist20:10:582
259940,0migration/228095-21cpuspeed_turbos19:46:102
259940,0migration/226571-21fschecks_time21:36:112
259940,0migration/225653-21runrttasks18:55:532
259940,0migration/225365-21gltestperf22:16:122
259940,0migration/224030-21kthreadcore23:36:162
259940,0migration/21959-21kthreadcore20:36:152
259940,0migration/219515-21kthreadcore20:01:162
259940,0migration/218799-21kthreadcore22:31:172
259940,0migration/218318-21kthreadcore19:11:172
259940,0migration/217906-21kthreadcore23:31:162
259940,0migration/217409-21kthreadcore22:51:142
259940,0migration/216416-21latency_hist20:25:582
259940,0migration/212171-21munin-node19:06:172
259940,0migration/211516-21kthreadcore19:56:162
249940,0watchdog/20-21swapper/222:06:132
179940,0migration/15389-21kernelversion20:41:141
179940,0migration/1373-21kthreadcore23:21:151
179940,0migration/132351-21pmu-power19:21:201
179940,0migration/124658-21timerandwakeup20:51:221
179940,0migration/12074-21latency_hist19:50:591
179940,0migration/113119-21cpuspeed_turbos00:11:111
179940,0migration/110661-21irqrtprio21:46:141
169940,0watchdog/16592-21rm22:43:521
169940,0watchdog/14672-21cut19:01:171
169940,0watchdog/131577-21kthreadcore23:41:161
169940,0watchdog/129185-21taskset20:31:411
169940,0watchdog/123031-21if_err_eth120:06:131
169940,0watchdog/122745-21fschecks_time23:36:121
169940,0watchdog/11648-21ssh21:20:531
169940,0watchdog/116303-21hostname20:01:131
169940,0watchdog/10-21swapper/123:56:161
169940,0watchdog/10-21swapper/123:26:121
169940,0watchdog/10-21swapper/123:06:121
169940,0watchdog/10-21swapper/122:36:161
169940,0watchdog/10-21swapper/120:56:171
149940,0migration/028460-21kthreadcore18:56:160
149940,0migration/02283-21kthreadcore23:21:150
123659943,0cyclictest8734-21awk19:31:162
123659943,0cyclictest3556-21lldpd22:57:242
123659943,0cyclictest2990-21awk19:51:152
123659943,0cyclictest26858-21awk18:56:152
123649944,0cyclictest0-21swapper/123:53:521
123649944,0cyclictest0-21swapper/122:49:321
123649943,0cyclictest5739-21awk00:06:131
123649943,0cyclictest4015-21awk20:16:131
123649943,0cyclictest3556-21lldpd23:46:241
123649943,0cyclictest3556-21lldpd21:31:241
123649943,0cyclictest3556-21lldpd21:13:541
123649943,0cyclictest3556-21lldpd21:08:541
123649943,0cyclictest3556-21lldpd20:26:231
123649943,0cyclictest3556-21lldpd19:12:241
123649943,0cyclictest3556-21lldpd19:10:241
123649943,0cyclictest3514-21snmpd23:03:351
123649943,0cyclictest3514-21snmpd19:19:181
123649943,0cyclictest3514-21snmpd18:57:181
123649943,0cyclictest3514-21snmpd18:52:181
123649943,0cyclictest3241-21irqbalance22:31:171
123649943,0cyclictest2859-21awk21:21:131
123649943,0cyclictest25522-21awk22:16:131
123649943,0cyclictest18233-21awk21:51:131
123649943,0cyclictest17591-21awk22:11:131
123649943,0cyclictest16539-21awk22:51:131
123649943,0cyclictest16125-21sed23:11:151
123649943,0cyclictest15337-21awk19:36:131
123649943,0cyclictest13504-21awk18:46:131
123649943,0cyclictest10959-21awk21:26:161
123649943,0cyclictest1090-21awk22:21:161
123629944,0cyclictest0-21swapper/022:52:150
123629944,0cyclictest0-21swapper/022:36:480
123629943,0cyclictest9147-21awk22:26:110
123629943,0cyclictest3241-21irqbalance22:21:270
123629943,0cyclictest23063-21awk20:06:130
123629943,0cyclictest16486-21munin-node20:26:140
123629943,0cyclictest10317-21awk21:46:130
8215030,0irq/24-0000:00:0-21swapper/219:41:282
339930,0migration/315242-21kthreadcore18:46:153
29715030,0irq/26-eth0-rx-0-21swapper/320:26:113
29715030,0irq/26-eth0-rx-0-21swapper/319:46:193
29715030,0irq/26-eth0-rx-0-21swapper/319:42:493
29715030,0irq/26-eth0-rx-0-21swapper/319:31:133
29715030,0irq/26-eth0-rx-0-21swapper/319:26:273
249930,0watchdog/20-21swapper/220:16:212
249930,0watchdog/20-21swapper/219:16:172
179930,0migration/114104-21latency19:56:171
179930,0migration/110086-21cpuspeed_turbos20:21:111
169930,0watchdog/10-21swapper/122:26:081
169930,0watchdog/10-21swapper/122:06:131
169930,0watchdog/10-21swapper/121:01:131
169930,0watchdog/10-21swapper/119:46:211
169930,0watchdog/10-21swapper/100:02:201
123659932,0cyclictest32159-21wc19:21:182
123659932,0cyclictest13552-21awk18:46:132
123659931,0cyclictest24847-21cat20:31:152
123649932,0cyclictest3556-21lldpd20:36:241
123649932,0cyclictest29726-21awk20:11:141
123649932,0cyclictest26459-21latency19:41:171
123649932,0cyclictest2104-21irqcore19:26:151
123649932,0cyclictest14583-21grep23:31:111
123649930,0cyclictest16416-21pluginstate20:46:181
123649930,0cyclictest0-21swapper/121:41:131
123629933,0cyclictest31484-21kworker/0:123:56:090
123629933,0cyclictest31484-21kworker/0:123:40:590
123629933,0cyclictest31484-21kworker/0:123:36:030
123629933,0cyclictest31484-21kworker/0:100:06:050
123629933,0cyclictest31484-21kworker/0:100:01:030
123629933,0cyclictest28122-21kworker/0:019:46:080
123629933,0cyclictest28122-21kworker/0:019:41:040
123629933,0cyclictest28122-21kworker/0:019:11:000
123629933,0cyclictest28122-21kworker/0:019:06:020
123629933,0cyclictest28122-21kworker/0:018:46:070
123629933,0cyclictest22955-21kworker/0:223:16:010
123629933,0cyclictest22955-21kworker/0:222:11:100
123629933,0cyclictest22955-21kworker/0:221:36:140
123629933,0cyclictest22955-21kworker/0:221:21:060
123629933,0cyclictest22955-21kworker/0:221:06:040
123629933,0cyclictest22955-21kworker/0:220:11:040
123629932,0cyclictest18264-21awk21:51:130
123629930,0cyclictest31285-21tr20:56:170
249920,0watchdog/20-21swapper/220:11:092
249920,0watchdog/20-21swapper/219:36:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional