You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 20:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Fri Nov 21, 2025 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2023824025,0sleep00-21swapper/006:16:070
2048523828,0sleep30-21swapper/306:18:593
2028023727,0sleep20-21swapper/206:16:332
2031423526,0sleep10-21swapper/106:17:011
329970,0watchdog/3296742sleep309:18:123
29935070,0irq/33-eth0-tx-3333-21munin-node08:00:110
29925070,0irq/32-eth0-rx-701-21ssh09:59:563
29925070,0irq/32-eth0-rx-0-21swapper/308:35:443
339960,0migration/38403-21sh09:45:093
339960,0migration/32562-21fschecks_count10:20:083
339960,0migration/32207-21sh10:36:553
339960,0migration/317908-21munin-node10:45:153
329960,0watchdog/34506-21if_eth108:45:123
329960,0watchdog/3299250irq/32-eth0-rx-09:09:443
329960,0watchdog/327266-21netstat07:50:163
329960,0watchdog/30-21swapper/311:45:003
329960,0watchdog/30-21swapper/311:30:523
329960,0watchdog/30-21swapper/311:27:323
329960,0watchdog/30-21swapper/311:20:363
329960,0watchdog/30-21swapper/311:09:563
329960,0watchdog/30-21swapper/310:52:083
329960,0watchdog/30-21swapper/310:43:243
329960,0watchdog/30-21swapper/310:15:123
329960,0watchdog/30-21swapper/310:08:003
329960,0watchdog/30-21swapper/309:35:523
329960,0watchdog/30-21swapper/309:31:523
329960,0watchdog/30-21swapper/309:29:123
329960,0watchdog/30-21swapper/309:00:043
329960,0watchdog/30-21swapper/308:50:163
329960,0watchdog/30-21swapper/308:41:523
329960,0watchdog/30-21swapper/308:32:203
329960,0watchdog/30-21swapper/308:26:523
329960,0watchdog/30-21swapper/307:36:323
329960,0watchdog/30-21swapper/307:10:163
329960,0watchdog/30-21swapper/307:00:323
329960,0watchdog/30-21swapper/306:40:083
29935060,0irq/33-eth0-tx-6935-21munin-node07:40:120
29935060,0irq/33-eth0-tx-20850-21munin-node06:20:110
29935060,0irq/33-eth0-tx-19141-21munin-node11:45:092
29935060,0irq/33-eth0-tx-0-21swapper/008:15:120
29935060,0irq/33-eth0-tx-0-21swapper/007:45:080
29925060,0irq/32-eth0-rx-5049-21aten_r1power_fr11:00:073
29925060,0irq/32-eth0-rx-2434-21missed_timers10:55:163
29925060,0irq/32-eth0-rx-10563-21interrupts11:40:153
29925060,0irq/32-eth0-rx-0-21swapper/311:35:133
29925060,0irq/32-eth0-rx-0-21swapper/311:16:093
29925060,0irq/32-eth0-rx-0-21swapper/310:30:503
29925060,0irq/32-eth0-rx-0-21swapper/310:29:223
29925060,0irq/32-eth0-rx-0-21swapper/309:50:333
29925060,0irq/32-eth0-rx-0-21swapper/309:21:173
29925060,0irq/32-eth0-rx-0-21swapper/309:11:433
29925060,0irq/32-eth0-rx-0-21swapper/308:21:503
259960,0migration/227891-21sh08:58:052
206389960,0cyclictest0-21swapper/211:44:262
206379960,0cyclictest0-21swapper/111:49:501
169960,0watchdog/13416-21kthreadcore08:20:121
149960,0migration/028744-21unixbench-2d11:10:220
149960,0migration/028354-21cpuspeed_turbos06:25:090
149960,0migration/021389-21kthreadcore11:45:120
8315050,0irq/26-0000:00:27187-21unixbench_singl10:50:222
8315050,0irq/26-0000:00:0-21swapper/306:35:023
4150,0ktimersoftd/00-21swapper/008:52:240
339950,0migration/38356-21kthreadcore06:55:123
339950,0migration/34607-21kthreadcore06:50:193
339950,0migration/33716-21df_abs08:00:093
339950,0migration/332478-21kthreadcore06:25:153
339950,0migration/322924-21kthreadcore06:20:153
339950,0migration/314162-21aten_r1power_cu07:45:073
339950,0migration/311984-21munin-node07:20:113
339950,0migration/310706-21aten_r1power_fr08:05:083
329950,0watchdog/324978-21aten2.4-expect09:55:083
329950,0watchdog/30-21swapper/311:05:083
329950,0watchdog/30-21swapper/310:10:163
329950,0watchdog/30-21swapper/309:40:163
329950,0watchdog/30-21swapper/308:54:563
329950,0watchdog/30-21swapper/308:15:003
329950,0watchdog/30-21swapper/307:55:083
329950,0watchdog/30-21swapper/307:41:323
329950,0watchdog/30-21swapper/307:30:363
329950,0watchdog/30-21swapper/307:25:123
329950,0watchdog/30-21swapper/307:15:003
329950,0watchdog/30-21swapper/306:45:363
329950,0watchdog/30-21swapper/306:45:363
329950,0watchdog/30-21swapper/306:32:083
29935050,0irq/33-eth0-tx-7298-21taskset09:43:102
29935050,0irq/33-eth0-tx-429-21ssh08:38:012
29935050,0irq/33-eth0-tx-19874-21ssh10:49:022
29935050,0irq/33-eth0-tx-17640-21munin-node07:25:160
29935050,0irq/33-eth0-tx-16390-21munin-node09:50:122
29935050,0irq/33-eth0-tx-13466-21kthreadcore08:25:142
29935050,0irq/33-eth0-tx-0-21swapper/211:39:302
29935050,0irq/33-eth0-tx-0-21swapper/211:34:182
29935050,0irq/33-eth0-tx-0-21swapper/211:06:272
29935050,0irq/33-eth0-tx-0-21swapper/209:47:122
29935050,0irq/33-eth0-tx-0-21swapper/209:28:282
29935050,0irq/33-eth0-tx-0-21swapper/008:07:260
29935050,0irq/33-eth0-tx-0-21swapper/007:57:240
29935050,0irq/33-eth0-tx-0-21swapper/007:50:090
29935050,0irq/33-eth0-tx-0-21swapper/007:02:130
29935050,0irq/33-eth0-tx-0-21swapper/006:30:160
29925050,0irq/32-eth0-rx-23031-21kthreadcore07:05:123
259950,0migration/214562-21fschecks_time07:00:272
259950,0migration/212095-21kthreadcore10:05:132
259950,0migration/21103-21kthreadcore06:25:152
249950,0watchdog/220860-21aten_r1power_cu06:20:082
249950,0watchdog/20-21swapper/208:45:122
206389955,0cyclictest0-21swapper/211:22:502
206389955,0cyclictest0-21swapper/209:07:062
206389955,0cyclictest0-21swapper/208:52:542
206389955,0cyclictest0-21swapper/208:15:232
206389954,0cyclictest26845-21tail10:15:112
206389950,0cyclictest0-21swapper/211:00:462
206389950,0cyclictest0-21swapper/210:31:172
206389950,0cyclictest0-21swapper/210:28:272
206389950,0cyclictest0-21swapper/209:17:212
206379955,0cyclictest0-21swapper/110:05:191
206379950,0cyclictest0-21swapper/110:10:591
206379950,0cyclictest0-21swapper/109:36:181
206369955,0cyclictest0-21swapper/009:26:370
206369955,0cyclictest0-21swapper/008:25:260
206369955,0cyclictest0-21swapper/007:20:100
206369950,0cyclictest6629-21munin-node06:55:170
206369950,0cyclictest0-21swapper/010:11:040
206369950,0cyclictest0-21swapper/008:10:090
179950,0migration/17318-21fschecks_time06:55:081
179950,0migration/15190-21kthreadcore06:50:191
179950,0migration/118805-21latency_hist10:29:551
179950,0migration/11600-21timerwakeupswit10:35:211
179950,0migration/115324-21sh11:24:301
169950,0watchdog/19666-21pmu-power10:40:161
169950,0watchdog/13255-21tr09:40:161
169950,0watchdog/130001-21kthreadcore11:30:161
169950,0watchdog/12752-21ssh09:00:201
169950,0watchdog/119457-21kthreadcore06:40:121
169950,0watchdog/115024-21cut09:10:121
149950,0migration/09929-21fschecks_count11:40:130
149950,0migration/09572-21kthreadcore11:00:130
149950,0migration/08338-21sh11:37:500
149950,0migration/07704-21sh10:00:360
149950,0migration/05755-21kthreadcore07:15:110
149950,0migration/05492-21sh09:22:190
149950,0migration/04490-21missed_timers11:15:170
149950,0migration/03514-21kthreadcore06:50:180
149950,0migration/030953-21timerwakeupswit06:45:230
149950,0migration/030953-21timerwakeupswit06:45:230
149950,0migration/030350-21irqrtprio09:00:130
149950,0migration/029068-21cpuspeed_turbos10:55:090
149950,0migration/028954-21kthreadcore10:15:140
149950,0migration/027610-21aten_r1power_vo10:35:080
149950,0migration/025705-21fschecks_time09:55:100
149950,0migration/02393-21sh08:43:020
149950,0migration/023844-21munin-node09:35:080
149950,0migration/022557-21kthreadcore06:40:130
149950,0migration/02158-21aten2.4-expect10:20:070
149950,0migration/021115-21kthreadcore08:30:130
149950,0migration/018700-21kthreadcore09:50:160
149950,0migration/017373-21kthreadcore11:05:120
149950,0migration/013659-21timerwakeupswit11:20:220
149950,0migration/011738-21latency_hist08:49:550
149950,0migration/011359-21kthreadcore10:05:130
329940,0watchdog/318178-21df_abs08:10:083
29935040,0irq/33-eth0-tx-3653-21ssh10:56:472
29935040,0irq/33-eth0-tx-28744-21ssh08:59:592
29935040,0irq/33-eth0-tx-23835-21ssh08:30:592
29935040,0irq/33-eth0-tx-0-21swapper/211:25:032
29935040,0irq/33-eth0-tx-0-21swapper/211:15:052
29935040,0irq/33-eth0-tx-0-21swapper/211:10:192
29935040,0irq/33-eth0-tx-0-21swapper/210:20:142
29935040,0irq/33-eth0-tx-0-21swapper/210:00:072
29935040,0irq/33-eth0-tx-0-21swapper/209:35:132
29935040,0irq/33-eth0-tx-0-21swapper/209:30:562
29935040,0irq/33-eth0-tx-0-21swapper/209:09:592
259940,0migration/27002-21munin-node07:40:082
259940,0migration/24313-21kthreadcore06:50:192
259940,0migration/232561-21kthreadcore09:20:132
259940,0migration/227776-21kthreadcore09:55:142
259940,0migration/222804-21kthreadcore07:25:172
259940,0migration/21773-21kthreadcore07:55:152
259940,0migration/216823-21munin-node08:05:192
249940,0watchdog/27604-21hddtemp_smartct06:55:082
249940,0watchdog/25048-21kthreadcore06:30:122
249940,0watchdog/231993-21diskmemload10:09:562
249940,0watchdog/20-21swapper/208:20:122
249940,0watchdog/20-21swapper/207:05:122
206389943,0cyclictest4551-21awk10:40:102
206389943,0cyclictest3599-21lldpd08:40:512
206389943,0cyclictest3599-21lldpd08:04:212
206389943,0cyclictest3599-21lldpd07:36:252
206389943,0cyclictest3599-21lldpd07:19:552
206389943,0cyclictest28549-21awk10:35:122
206389943,0cyclictest23871-21snmpd07:14:062
206389943,0cyclictest22509-21awk07:50:132
206379944,0cyclictest0-21swapper/111:06:391
206379944,0cyclictest0-21swapper/109:25:261
206379943,0cyclictest9101-21sadc11:39:551
206379943,0cyclictest3262-21irqbalance08:45:001
206379943,0cyclictest29889-21awk10:55:121
206379943,0cyclictest23871-21snmpd11:40:381
206379943,0cyclictest23871-21snmpd11:25:081
206379943,0cyclictest23871-21snmpd11:00:081
206379943,0cyclictest23871-21snmpd08:57:371
206379943,0cyclictest23871-21snmpd08:40:521
206379943,0cyclictest23871-21snmpd08:35:071
206379943,0cyclictest23871-21snmpd08:05:221
206379943,0cyclictest23871-21snmpd07:07:061
206379943,0cyclictest17543-21awk09:50:141
206379943,0cyclictest16142-21awk09:30:131
206379943,0cyclictest15230-21awk07:45:131
206379943,0cyclictest12979-21awk10:45:111
206369944,0cyclictest31754-21kworker/0:108:55:120
206369944,0cyclictest0-21swapper/009:14:380
206369944,0cyclictest0-21swapper/009:07:130
206369943,0cyclictest9118-21awk09:45:110
206369943,0cyclictest20052-21awk10:30:150
206369940,0cyclictest17136-21munin-node10:25:220
179940,0migration/16199-21kthreadcore07:15:121
179940,0migration/13503-21aten_r1power_vo08:00:081
179940,0migration/132012-21netstat10:15:161
179940,0migration/131832-21runrttasks08:18:151
179940,0migration/130897-21kthreadcore07:10:141
179940,0migration/13060-21kthreadcore10:00:151
179940,0migration/129966-21kthreadcore07:30:161
179940,0migration/128236-21taskset07:54:191
179940,0migration/126593-21kthreadcore11:10:141
179940,0migration/126063-21kthreadcore10:50:151
179940,0migration/125511-21kthreadcore09:15:151
179940,0migration/12317-21taskset06:26:371
179940,0migration/118551-21fschecks_time08:10:091
179940,0migration/118437-21fschecks_time07:25:121
179940,0migration/114334-21kthreadcore06:35:121
179940,0migration/113911-21kthreadcore08:25:141
179940,0migration/113703-21taskset07:42:351
179940,0migration/112461-21kthreadcore07:20:121
169940,0watchdog/131993-21diskmemload09:19:561
169940,0watchdog/125999-21if_eth1.209:55:121
169940,0watchdog/120861-21aten_r1power_cu06:20:081
169940,0watchdog/117296-21diskstats08:30:081
169940,0watchdog/116829-21tr08:50:161
169940,0watchdog/111101-21grep09:05:161
169940,0watchdog/10-21swapper/111:15:161
149940,0migration/0442-21kthreadcore07:10:150
149940,0migration/029880-21runrttasks09:18:520
149940,0migration/026420-21idleruntime08:35:100
149940,0migration/015493-21kthreadcore10:45:130
4130,0ktimersoftd/00-21swapper/007:29:590
29935030,0irq/33-eth0-tx-0-21swapper/007:35:140
249930,0watchdog/28870-21kthreadcore07:15:122
249930,0watchdog/20-21swapper/208:09:562
249930,0watchdog/20-21swapper/206:40:122
206389932,0cyclictest29743-21kthreadcore07:30:162
206389932,0cyclictest14286-21aten_r1power_vo07:45:092
206389932,0cyclictest11177-21awk06:35:092
206379932,0cyclictest9043-21sh09:45:101
206379932,0cyclictest31686-21grep07:55:141
206379932,0cyclictest3106-21awk10:20:101
206379932,0cyclictest25633-21awk06:45:131
206379932,0cyclictest25633-21awk06:45:131
206379932,0cyclictest20140-21awk10:30:151
206369933,0cyclictest1675-21kworker/0:011:30:080
206369933,0cyclictest1675-21kworker/0:010:40:060
206369932,0cyclictest6207-21sensors08:20:160
206369932,0cyclictest4920-21kworker/0:209:30:100
206369932,0cyclictest27671-21vmstat07:05:210
206369932,0cyclictest1675-21kworker/0:010:50:100
206369930,0cyclictest2025-21kthreadcore09:40:160
206369930,0cyclictest0-21swapper/011:25:100
206369930,0cyclictest0-21swapper/006:35:070
169930,0watchdog/10-21swapper/107:35:121
169930,0watchdog/10-21swapper/106:30:081
206389921,0cyclictest0-21swapper/206:44:562
206389921,0cyclictest0-21swapper/206:44:562
206379921,0cyclictest13610-21latency_hist06:59:561
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional