You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-03 - 16:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sat Jan 03, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450660,0irq/25-eth10-21swapper/307:04:553
1548223924,0sleep00-21swapper/007:07:280
1516823826,0sleep20-21swapper/207:03:502
1531323524,0sleep10-21swapper/107:05:291
155959983,0cyclictest17774-21awk07:33:141
29715070,0irq/26-eth0-rx-8765-21entropy11:58:133
155959973,0cyclictest3514-21snmpd09:36:011
155959973,0cyclictest10295-21awk12:18:121
155959970,0cyclictest1077-21ssh12:31:351
339960,0migration/39621-21sh10:01:163
339960,0migration/33413-21kthreadcore08:58:163
339960,0migration/330420-21taskset11:49:013
339960,0migration/327723-21sh10:32:023
339960,0migration/324161-21sh09:48:363
339960,0migration/321208-21sh11:06:193
339960,0migration/320188-21sh10:46:253
339960,0migration/314066-21sh09:24:123
29715060,0irq/26-eth0-rx-31688-21port_sshpriv12:28:193
155969966,0cyclictest8056-21sadc11:57:582
155969960,0cyclictest0-21swapper/211:36:432
155969960,0cyclictest0-21swapper/211:08:302
155959962,0cyclictest4328-21ethtool07:23:161
155959962,0cyclictest3514-21snmpd09:44:011
155959962,0cyclictest32385-21awk11:33:151
155959962,0cyclictest29250-21awk10:33:111
155959961,0cyclictest20672-21awk08:48:171
155959961,0cyclictest16426-21fschecks_time07:08:141
155959961,0cyclictest12088-21awk07:53:161
155959960,0cyclictest6341-21if_err_eth1.310:58:151
155959960,0cyclictest6341-21if_err_eth1.310:58:151
155959960,0cyclictest5594-21tr10:18:161
155959960,0cyclictest5462-21ls08:33:211
155959960,0cyclictest331-21kthreadcore07:43:171
155959960,0cyclictest31130-21kthreadcore10:53:171
155959960,0cyclictest30944-21tr08:53:171
155959960,0cyclictest30659-21ssh11:49:361
155959960,0cyclictest29928-21munin-node08:03:201
155959960,0cyclictest29727-21kthreadcore09:53:181
155959960,0cyclictest28523-21cat09:13:221
155959960,0cyclictest26922-21tr12:08:161
155959960,0cyclictest26603-21taskset10:12:041
155959960,0cyclictest25378-21kthreadcore10:48:191
155959960,0cyclictest25107-21chrt09:50:531
155959960,0cyclictest24985-21kthreadcore11:28:171
155959960,0cyclictest246481rm12:07:501
155959960,0cyclictest22943-21sh11:08:121
155959960,0cyclictest22361-21ssh09:28:241
155959960,0cyclictest22224-21tr12:23:171
155959960,0cyclictest22121-21ssh11:44:031
155959960,0cyclictest21844-21ssh11:25:411
155959960,0cyclictest21356-21kthreadcore08:23:171
155959960,0cyclictest20840-21sh10:48:001
155959960,0cyclictest20550-21ssh11:04:431
155959960,0cyclictest19397-21tr07:58:171
155959960,0cyclictest1873-21idleruntime09:38:121
155959960,0cyclictest1830-21cut12:32:591
155959960,0cyclictest13998-21sh11:21:461
155959960,0cyclictest12667-21ssh09:23:171
155959960,0cyclictest11708-21aten_r1power_cu10:23:121
155959960,0cyclictest10689-21perl07:28:131
155959960,0cyclictest10266-21cut11:58:161
155959960,0cyclictest0-21swapper/110:38:001
155959960,0cyclictest0-21swapper/108:43:161
155959960,0cyclictest0-21swapper/108:18:201
149960,0migration/03628-21kthreadcore09:58:180
149960,0migration/032350-21aten2.4-expect11:53:080
149960,0migration/030532-21sh11:31:340
4150,0ktimersoftd/00-21swapper/010:24:150
339950,0migration/38201-21hddtemp_smartct11:38:133
339950,0migration/37744-21kthreadcore08:38:173
339950,0migration/3391-21munin-node10:13:183
339950,0migration/332206-21aten_r1power_po08:33:103
339950,0migration/332102-21sh09:35:423
339950,0migration/332094-21kthreadcore07:18:173
339950,0migration/328897-21fschecks_count10:33:103
339950,0migration/328177-21runrttasks07:13:243
339950,0migration/327835-21kthreadcore12:08:163
339950,0migration/325166-21kthreadcore10:48:183
339950,0migration/321610-21kthreadcore12:03:173
339950,0migration/320205-21kthreadcore09:28:173
339950,0migration/319480-21kthreadcore12:23:163
339950,0migration/31862-21kthreadcore09:18:163
339950,0migration/318082-21df_abs07:58:123
339950,0migration/317354-21kthreadcore11:43:153
339950,0migration/316611-21kthreadcore09:08:203
339950,0migration/313478-21kthreadcore12:18:143
29725050,0irq/27-eth0-tx-9198-21ssh12:35:532
29725050,0irq/27-eth0-tx-5801-21kthreadcore12:13:182
29725050,0irq/27-eth0-tx-3396-21munin-node07:23:152
29725050,0irq/27-eth0-tx-24820-21munin-node09:33:142
29725050,0irq/27-eth0-tx-1442-21entropy09:38:112
29725050,0irq/27-eth0-tx-11695-21kthreadcore11:38:172
29725050,0irq/27-eth0-tx-0-21swapper/212:11:072
29725050,0irq/27-eth0-tx-0-21swapper/212:06:072
29725050,0irq/27-eth0-tx-0-21swapper/210:28:242
29725050,0irq/27-eth0-tx-0-21swapper/210:14:392
29715050,0irq/26-eth0-rx-4403-21kthreadcore09:38:153
29715050,0irq/26-eth0-rx-3734-21ssh10:54:363
29715050,0irq/26-eth0-rx-3112-21tr11:33:183
29715050,0irq/26-eth0-rx-26410-21kthreadcore11:08:153
29715050,0irq/26-eth0-rx-25102-21cut09:13:163
29715050,0irq/26-eth0-rx-12072-21df_abs10:23:143
29715050,0irq/26-eth0-rx-0-21swapper/312:33:093
29715050,0irq/26-eth0-rx-0-21swapper/311:28:573
29715050,0irq/26-eth0-rx-0-21swapper/311:23:053
29715050,0irq/26-eth0-rx-0-21swapper/311:18:033
29715050,0irq/26-eth0-rx-0-21swapper/311:18:003
29715050,0irq/26-eth0-rx-0-21swapper/310:39:573
29715050,0irq/26-eth0-rx-0-21swapper/310:21:593
29715050,0irq/26-eth0-rx-0-21swapper/310:03:173
29715050,0irq/26-eth0-rx-0-21swapper/309:55:083
29715050,0irq/26-eth0-rx-0-21swapper/309:43:533
29715050,0irq/26-eth0-rx-0-21swapper/308:23:193
29715050,0irq/26-eth0-rx-0-21swapper/307:48:203
259950,0migration/29428-21latency_hist09:43:002
259950,0migration/28815-21needreboot10:18:182
259950,0migration/27017-21fschecks_time11:18:122
259950,0migration/229637-21sh11:29:192
259950,0migration/227823-21kthreadcore08:53:162
259950,0migration/225542-21switchtime08:48:252
259950,0migration/22476-21timerandwakeup07:18:232
259950,0migration/223732-21kthreadcore10:48:182
259950,0migration/219850-21kthreadcore11:23:162
259950,0migration/217707-21kthreadcore09:08:212
259950,0migration/210932-21kthreadcore11:58:172
249950,0watchdog/23907-21ssh10:55:012
155969955,0cyclictest0-21swapper/209:49:032
155969950,0cyclictest0-21swapper/211:48:232
155959951,0cyclictest6324-21cat08:38:001
155959950,0cyclictest787-21aten2.4-expect08:58:111
155959950,0cyclictest7499-21cat09:03:001
155959950,0cyclictest7300-21grep11:37:591
155959950,0cyclictest709-21date12:12:581
155959950,0cyclictest5410-21munin-node08:13:111
155959950,0cyclictest4372-21sed07:48:001
155959950,0cyclictest32225-21date11:52:591
155959950,0cyclictest31083-21ls09:18:001
155959950,0cyclictest31021-21cut08:08:001
155959950,0cyclictest30376-21sh11:13:001
155959950,0cyclictest27137-21latency_hist10:13:001
155959950,0cyclictest25369-21cat08:28:001
155959950,0cyclictest23360-21cat07:38:001
155959950,0cyclictest22404-21sed07:13:001
155959950,0cyclictest2100-21rm09:58:011
155959950,0cyclictest19946-21cat10:28:001
155959950,0cyclictest14061-21latency_hist09:08:001
155959950,0cyclictest10526-21latency_hist10:03:001
155959950,0cyclictest0-21swapper/107:18:001
155949955,0cyclictest32427-21ssh09:53:310
155949955,0cyclictest0-21swapper/012:24:140
155949950,0cyclictest0-21swapper/012:00:450
155949950,0cyclictest0-21swapper/011:17:140
155949950,0cyclictest0-21swapper/009:27:210
149950,0migration/07111-21sh09:22:430
149950,0migration/06652-21cpuspeed_turbos11:18:100
149950,0migration/06338-21latency_hist08:38:000
149950,0migration/05201-21kthreadcore07:23:180
149950,0migration/032311-21irqrtprio08:08:170
149950,0migration/03042-21taskset07:21:580
149950,0migration/028138-21kthreadcore12:28:150
149950,0migration/02608-21taskset10:34:310
149950,0migration/024495-21sh09:49:240
149950,0migration/023956-21sh12:06:070
149950,0migration/022238-21irqcore10:48:170
149950,0migration/021709-21kthreadcore10:28:160
149950,0migration/021343-21pmu-power07:08:210
149950,0migration/020820-21sh11:05:210
149950,0migration/01939-21sh12:33:090
149950,0migration/019142-21munin-node08:43:230
149950,0migration/019047-21munin-node10:08:100
149950,0migration/017305-21sh12:22:410
149950,0migration/017012-21idleruntime09:28:140
149950,0migration/015898-21kthreadcore08:18:170
149950,0migration/015164-21kthreadcore10:43:160
339940,0migration/34049-21kthreadcore12:13:173
339940,0migration/331701-21taskset08:31:063
339940,0migration/322729-21kthreadcore10:08:163
339940,0migration/321907-21kthreadcore07:33:173
339940,0migration/319707-21kthreadcore07:08:183
29725040,0irq/27-eth0-tx-31092-21munin-node08:08:162
29725040,0irq/27-eth0-tx-23411-21munin-node07:38:122
29725040,0irq/27-eth0-tx-14729-21ssh11:03:152
29725040,0irq/27-eth0-tx-0-21swapper/212:28:352
29725040,0irq/27-eth0-tx-0-21swapper/212:17:592
29725040,0irq/27-eth0-tx-0-21swapper/211:13:002
29725040,0irq/27-eth0-tx-0-21swapper/210:58:322
29725040,0irq/27-eth0-tx-0-21swapper/210:58:322
29725040,0irq/27-eth0-tx-0-21swapper/210:33:082
29725040,0irq/27-eth0-tx-0-21swapper/209:58:062
29725040,0irq/27-eth0-tx-0-21swapper/209:54:312
29725040,0irq/27-eth0-tx-0-21swapper/209:28:062
29725040,0irq/27-eth0-tx-0-21swapper/209:23:122
29725040,0irq/27-eth0-tx-0-21swapper/209:18:082
29725040,0irq/27-eth0-tx-0-21swapper/209:13:282
29725040,0irq/27-eth0-tx-0-21swapper/208:58:192
29725040,0irq/27-eth0-tx-0-21swapper/208:23:132
29725040,0irq/27-eth0-tx-0-21swapper/207:58:232
29725040,0irq/27-eth0-tx-0-21swapper/207:48:122
29725040,0irq/27-eth0-tx-0-21swapper/207:13:152
29715040,0irq/26-eth0-rx-0-21swapper/311:53:133
29715040,0irq/26-eth0-rx-0-21swapper/310:58:263
29715040,0irq/26-eth0-rx-0-21swapper/310:58:263
29715040,0irq/26-eth0-rx-0-21swapper/308:53:213
29715040,0irq/26-eth0-rx-0-21swapper/308:18:113
29715040,0irq/26-eth0-rx-0-21swapper/308:03:223
259940,0migration/24153-21runrttasks07:47:462
259940,0migration/224427-21runrttasks08:03:072
259940,0migration/218874-21latency_hist10:08:002
259940,0migration/217672-21kthreadcore11:43:162
259940,0migration/217488-21fschecks_time07:33:122
259940,0migration/212781-21aten_r1power_cu10:43:102
249940,0watchdog/29479-21kthreadcore09:03:142
249940,0watchdog/221563-21kthreadcore12:23:172
249940,0watchdog/217840-21switchtime08:18:222
249940,0watchdog/20-21swapper/210:38:092
249940,0watchdog/20-21swapper/207:53:182
155969943,0cyclictest3514-21snmpd07:12:462
155969943,0cyclictest26417-21awk08:28:152
155969943,0cyclictest12701-21awk10:23:162
155969943,0cyclictest11870-21sadc08:18:002
155969943,0cyclictest11609-21awk10:03:162
155969940,0cyclictest0-21swapper/207:30:182
155949943,0cyclictest8369-21awk11:38:150
155949943,0cyclictest8355-21awk09:03:120
155949943,0cyclictest5303-21awk07:48:150
155949943,0cyclictest3556-21lldpd11:43:230
155949943,0cyclictest3556-21lldpd11:09:230
155949943,0cyclictest3514-21snmpd10:40:160
155949943,0cyclictest3514-21snmpd08:03:160
155949943,0cyclictest3241-21irqbalance10:19:180
155949943,0cyclictest32336-21awk11:33:150
155949943,0cyclictest28264-21awk10:13:130
155949943,0cyclictest25719-21awk09:33:160
155949943,0cyclictest23471-21awk09:13:140
155949943,0cyclictest11517-21awk10:03:150
155949940,0cyclictest0-21swapper/007:37:560
149940,0migration/022137-21kthreadcore08:23:180
149940,0migration/020649-21runrttasks09:09:210
149940,0migration/019526-21kthreadcore11:23:160
149940,0migration/01094-21kthreadcore07:43:170
29715030,0irq/26-eth0-rx-0-21swapper/309:03:113
29715030,0irq/26-eth0-rx-0-21swapper/308:48:143
29715030,0irq/26-eth0-rx-0-21swapper/308:43:113
29715030,0irq/26-eth0-rx-0-21swapper/308:15:113
29715030,0irq/26-eth0-rx-0-21swapper/308:08:033
29715030,0irq/26-eth0-rx-0-21swapper/307:53:103
29715030,0irq/26-eth0-rx-0-21swapper/307:43:113
29715030,0irq/26-eth0-rx-0-21swapper/307:40:293
29715030,0irq/26-eth0-rx-0-21swapper/307:31:283
29715030,0irq/26-eth0-rx-0-21swapper/307:23:123
155969932,0cyclictest7410-21awk08:38:162
155969932,0cyclictest14105-21awk08:43:152
155949933,0cyclictest3556-21lldpd12:17:220
155949933,0cyclictest1921-21awk09:38:130
155949933,0cyclictest0-21swapper/012:12:530
155949933,0cyclictest0-21swapper/008:14:210
155949932,0cyclictest411-21sadc08:58:000
155949932,0cyclictest30467-21ssh11:49:090
155949932,0cyclictest30404-21awk10:53:150
155949932,0cyclictest2728-21kthreadcore08:58:160
155949932,0cyclictest24372-21awk07:38:150
155949932,0cyclictest23472-21awk07:13:170
155949932,0cyclictest18676-21awk07:58:150
155949932,0cyclictest11674-21yum10:58:250
155949932,0cyclictest11674-21yum10:58:250
155949932,0cyclictest10966-21awk07:28:140
155949932,0cyclictest10396-21awk09:43:130
155969920,0cyclictest0-21swapper/208:33:002
155949921,0cyclictest32013-21latency_hist08:33:000
155949921,0cyclictest25396-21cat08:28:000
155949921,0cyclictest19687-21latency_hist08:48:000
155949921,0cyclictest0-21swapper/007:53:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional