You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 23:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Mon Dec 08, 2025 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1810623928,0sleep20-21swapper/206:15:092
1818823828,0sleep30-21swapper/306:16:063
1806323524,0sleep10-21swapper/106:14:401
1805523228,0sleep00-21swapper/006:14:350
329970,0watchdog/35593-21ntpdc10:54:143
329970,0watchdog/30-21swapper/309:22:233
29925070,0irq/32-eth0-rx-14075-21diskstats10:24:073
29925070,0irq/32-eth0-rx-0-21swapper/310:22:043
185019976,0cyclictest2299-21munin-node11:34:090
8315060,0irq/26-0000:00:6250-21munin-run10:38:542
8315060,0irq/26-0000:00:10883-21open_inodes07:39:182
35160,0ktimersoftd/30-21swapper/308:41:173
339960,0migration/36021-21sh08:23:493
329960,0watchdog/325435-21cut07:29:153
329960,0watchdog/316708-21perl08:09:113
329960,0watchdog/30-21swapper/310:11:433
329960,0watchdog/30-21swapper/308:58:153
29935060,0irq/33-eth0-tx-8857-21munin-node09:04:142
29925060,0irq/32-eth0-rx-8169-21cat10:39:123
29925060,0irq/32-eth0-rx-7737-21sed08:24:143
29925060,0irq/32-eth0-rx-4709-21df_inode09:59:113
29925060,0irq/32-eth0-rx-25948-21cut11:09:123
29925060,0irq/32-eth0-rx-0-21swapper/311:41:113
29925060,0irq/32-eth0-rx-0-21swapper/311:28:193
29925060,0irq/32-eth0-rx-0-21swapper/311:15:523
29925060,0irq/32-eth0-rx-0-21swapper/311:03:543
29925060,0irq/32-eth0-rx-0-21swapper/310:38:163
29925060,0irq/32-eth0-rx-0-21swapper/310:04:343
29925060,0irq/32-eth0-rx-0-21swapper/309:40:033
29925060,0irq/32-eth0-rx-0-21swapper/309:24:213
29925060,0irq/32-eth0-rx-0-21swapper/309:16:193
29925060,0irq/32-eth0-rx-0-21swapper/308:59:123
185039966,0cyclictest83150irq/26-0000:00:07:34:092
185039960,0cyclictest0-21swapper/209:09:162
185019960,0cyclictest24943-21ssh09:12:340
35150,0ktimersoftd/30-21swapper/306:23:583
339950,0migration/38578-21cpuspeed_turbos07:19:083
339950,0migration/331835-21kthreadcore07:09:133
339950,0migration/329570-21cpuspeed_turbos10:14:073
339950,0migration/328692-21unixbench_singl10:29:213
339950,0migration/328538-21kthreadcore09:34:163
339950,0migration/328105-21taskset09:53:563
339950,0migration/327448-21kthreadcore10:49:143
339950,0migration/32627-21kthreadcore07:34:113
339950,0migration/320618-21munin-node11:44:103
339950,0migration/319686-21runrttasks06:19:103
339950,0migration/319464-21kthreadcore08:49:143
339950,0migration/318438-21aten_r1power_vo09:29:083
329950,0watchdog/3959-21aten2.4-expect07:14:073
329950,0watchdog/30-21swapper/309:09:113
329950,0watchdog/30-21swapper/307:04:233
329950,0watchdog/30-21swapper/307:04:233
329950,0watchdog/30-21swapper/306:54:153
29935050,0irq/33-eth0-tx-408-21munin-node11:14:212
29935050,0irq/33-eth0-tx-31733-21ssh11:11:022
29935050,0irq/33-eth0-tx-27694-21cat09:14:142
29935050,0irq/33-eth0-tx-25269-21ssh09:30:172
29935050,0irq/33-eth0-tx-22022-21munin-node10:29:112
29935050,0irq/33-eth0-tx-21136-21munin-node10:09:142
29935050,0irq/33-eth0-tx-11325-21munin-node09:44:122
29935050,0irq/33-eth0-tx-0-21swapper/211:30:172
29935050,0irq/33-eth0-tx-0-21swapper/211:02:162
29935050,0irq/33-eth0-tx-0-21swapper/210:54:142
29935050,0irq/33-eth0-tx-0-21swapper/210:20:492
29935050,0irq/33-eth0-tx-0-21swapper/208:39:522
29935050,0irq/33-eth0-tx-0-21swapper/007:44:180
29935050,0irq/33-eth0-tx-0-21swapper/006:49:140
29925050,0irq/32-eth0-rx-7756-21sh08:43:553
29925050,0irq/32-eth0-rx-0-21swapper/311:33:573
29925050,0irq/32-eth0-rx-0-21swapper/311:29:113
29925050,0irq/32-eth0-rx-0-21swapper/311:21:453
29925050,0irq/32-eth0-rx-0-21swapper/311:02:243
29925050,0irq/32-eth0-rx-0-21swapper/310:45:393
29925050,0irq/32-eth0-rx-0-21swapper/309:49:143
29925050,0irq/32-eth0-rx-0-21swapper/309:46:133
29925050,0irq/32-eth0-rx-0-21swapper/309:04:133
29925050,0irq/32-eth0-rx-0-21swapper/308:34:153
29925050,0irq/32-eth0-rx-0-21swapper/308:30:373
29925050,0irq/32-eth0-rx-0-21swapper/307:53:273
29925050,0irq/32-eth0-rx-0-21swapper/307:24:063
29925050,0irq/32-eth0-rx-0-21swapper/306:50:563
29925050,0irq/32-eth0-rx-0-21swapper/306:30:493
259950,0migration/26242-21kthreadcore08:59:132
259950,0migration/24665-21kthreadcore09:19:142
259950,0migration/2339-21kthreadcore10:14:132
259950,0migration/231761-21taskset08:56:572
259950,0migration/229291-21munin-node08:14:202
259950,0migration/228617-21kthreadcore06:24:112
259950,0migration/222564-21munin-node08:49:222
259950,0migration/219497-21latency10:24:132
259950,0migration/218776-21latency_hist07:03:552
259950,0migration/214708-21kthreadcore11:19:122
259950,0migration/214411-21kthreadcore09:24:162
259950,0migration/214152-21munin-node08:44:182
259950,0migration/212590-21sh08:24:182
185029955,0cyclictest0-21swapper/109:38:541
185019955,0cyclictest0-21swapper/011:43:270
185019955,0cyclictest0-21swapper/011:26:250
185019955,0cyclictest0-21swapper/009:51:310
185019955,0cyclictest0-21swapper/008:35:500
185019955,0cyclictest0-21swapper/007:09:070
185019950,0cyclictest0-21swapper/010:37:140
179950,0migration/18171-21kthreadcore10:19:131
179950,0migration/14202-21kthreadcore06:29:121
179950,0migration/13901-21sh10:14:581
179950,0migration/122812-21kthreadcore09:09:151
179950,0migration/121915-21kthreadcore06:19:141
179950,0migration/113894-21sh10:59:141
169950,0watchdog/14508-21cpu09:59:111
169950,0watchdog/123871-21snmpd07:41:431
169950,0watchdog/122420-21kthreadcore07:04:151
169950,0watchdog/122420-21kthreadcore07:04:151
169950,0watchdog/120789-21chrt10:08:431
169950,0watchdog/117522-21iostat_ios11:04:141
169950,0watchdog/115875-21ssh09:05:351
149950,0migration/04932-21sh10:18:320
149950,0migration/031548-21latency09:14:150
149950,0migration/024732-21cpu11:09:070
149950,0migration/02043-21df_abs09:19:090
149950,0migration/017658-21sh09:44:200
149950,0migration/015548-21sh11:02:340
149950,0migration/011669-21kthreadcore08:44:140
8315040,0irq/26-0000:00:15809-21cut08:08:542
8315040,0irq/26-0000:00:13818-21munin-node06:34:143
339940,0migration/328876-21missed_timers08:14:143
329940,0watchdog/38414-21kthreadcore07:39:153
329940,0watchdog/30-21swapper/307:46:513
329940,0watchdog/30-21swapper/306:59:233
29935040,0irq/33-eth0-tx-28080-21kthreadcore08:34:152
29935040,0irq/33-eth0-tx-18730-21ssh11:24:102
29935040,0irq/33-eth0-tx-0-21swapper/211:39:102
29935040,0irq/33-eth0-tx-0-21swapper/211:37:022
29935040,0irq/33-eth0-tx-0-21swapper/211:04:422
29935040,0irq/33-eth0-tx-0-21swapper/210:49:222
29935040,0irq/33-eth0-tx-0-21swapper/210:39:052
29935040,0irq/33-eth0-tx-0-21swapper/210:06:172
29935040,0irq/33-eth0-tx-0-21swapper/209:48:582
29935040,0irq/33-eth0-tx-0-21swapper/209:34:152
29935040,0irq/33-eth0-tx-0-21swapper/208:31:192
29935040,0irq/33-eth0-tx-0-21swapper/008:04:070
29935040,0irq/33-eth0-tx-0-21swapper/007:24:060
29935040,0irq/33-eth0-tx-0-21swapper/007:14:040
29935040,0irq/33-eth0-tx-0-21swapper/006:59:100
29935040,0irq/33-eth0-tx-0-21swapper/006:29:110
29925040,0irq/32-eth0-rx-23999-21runrttasks06:44:153
29925040,0irq/32-eth0-rx-0-21swapper/308:04:073
29925040,0irq/32-eth0-rx-0-21swapper/307:56:453
259940,0migration/25518-21kthreadcore09:39:142
259940,0migration/24988-21kthreadcore07:14:142
259940,0migration/24574-21cpuspeed_turbos09:59:112
259940,0migration/22954-21kthreadcore08:19:132
259940,0migration/228777-21kthreadcore07:09:122
259940,0migration/224286-21kthreadcore06:44:152
259940,0migration/224171-21kthreadcore11:44:132
259940,0migration/224070-21kthreadcore07:49:132
259940,0migration/223480-21kthreadcore07:04:152
259940,0migration/223480-21kthreadcore07:04:152
259940,0migration/218445-21kthreadcore06:39:122
259940,0migration/215382-21latency_hist07:23:552
249940,0watchdog/20-21swapper/210:44:072
249940,0watchdog/20-21swapper/209:54:112
249940,0watchdog/20-21swapper/207:29:072
185039943,0cyclictest3599-21lldpd07:57:062
185039943,0cyclictest3599-21lldpd07:45:352
185039943,0cyclictest3599-21lldpd06:54:032
185039943,0cyclictest3599-21lldpd06:33:582
185039943,0cyclictest3599-21lldpd06:30:582
185039943,0cyclictest30801-21awk06:49:112
185039943,0cyclictest23871-21snmpd07:59:192
185039943,0cyclictest23871-21snmpd07:24:042
185029944,0cyclictest0-21swapper/107:49:101
185029943,0cyclictest7494-21awk08:24:131
185029943,0cyclictest3599-21lldpd09:16:071
185029943,0cyclictest3599-21lldpd08:34:221
185029943,0cyclictest3599-21lldpd08:29:071
185029943,0cyclictest3599-21lldpd07:36:341
185029943,0cyclictest3406-21awk11:34:091
185029943,0cyclictest3262-21irqbalance08:49:091
185029943,0cyclictest3262-21irqbalance08:16:091
185029943,0cyclictest31336-21awk08:19:111
185029943,0cyclictest2811-21awk09:19:121
185029943,0cyclictest23871-21snmpd11:39:051
185029943,0cyclictest23871-21snmpd11:24:051
185029943,0cyclictest23871-21snmpd11:14:051
185029943,0cyclictest23871-21snmpd10:24:051
185029943,0cyclictest23245-21tail10:29:111
185029943,0cyclictest20929-21awk09:49:121
185029943,0cyclictest16961-21awk08:09:131
185029943,0cyclictest1427-21awk08:59:111
185029943,0cyclictest12799-21awk06:59:131
185019944,0cyclictest0-21swapper/010:47:100
185019944,0cyclictest0-21swapper/010:19:440
185019944,0cyclictest0-21swapper/009:01:410
185019944,0cyclictest0-21swapper/008:40:530
185019943,0cyclictest3599-21lldpd09:33:110
185019943,0cyclictest27293-21awk11:29:130
185019943,0cyclictest24109-21awk08:14:100
185019943,0cyclictest23871-21snmpd06:45:190
185019943,0cyclictest23192-21awk10:29:110
185019943,0cyclictest22229-21awk10:09:140
185019943,0cyclictest20750-21awk11:44:110
185019943,0cyclictest17471-21awk11:04:140
185019943,0cyclictest16867-21awk08:09:120
185019943,0cyclictest1646-21awk11:14:160
185019943,0cyclictest11143-21awk09:24:130
185019940,0cyclictest19298-21munin-node07:49:170
179940,0migration/19354-21fschecks_time08:04:091
179940,0migration/18694-21kthreadcore10:39:131
179940,0migration/15373-21kthreadcore10:54:131
179940,0migration/14297-21kthreadcore07:59:141
179940,0migration/132321-21kthreadcore06:49:121
179940,0migration/130828-21kthreadcore09:34:161
179940,0migration/130557-21kthreadcore09:54:151
179940,0migration/130357-21latency_hist10:33:541
179940,0migration/126440-21fschecks_count06:24:071
179940,0migration/125556-21latency11:44:141
179940,0migration/123604-21sh10:49:081
179940,0migration/123378-21kthreadcore10:09:161
179940,0migration/116883-21sh09:24:441
179940,0migration/114304-21kthreadcore07:44:201
179940,0migration/110374-21irqcore11:19:101
169940,0watchdog/128807-21timerwakeupswit06:44:231
169940,0watchdog/122735-21sh07:29:071
169940,0watchdog/118332-21munin-node09:29:071
169940,0watchdog/115334-21sh08:48:031
169940,0watchdog/10-21swapper/111:29:141
169940,0watchdog/10-21swapper/110:44:071
169940,0watchdog/10-21swapper/108:55:151
149940,0migration/07714-21kthreadcore06:54:150
149940,0migration/06511-21aten_r1power_vo08:24:090
149940,0migration/020227-21kthreadcore06:39:130
149940,0migration/018071-21kthreadcore10:24:120
149940,0migration/017547-21kthreadcore08:29:130
149940,0migration/015362-21sendmail_mailqu11:19:150
149940,0migration/014356-21runrttasks10:42:360
149940,0migration/01256-21sh09:35:130
149940,0migration/011555-21runrttasks10:01:000
339930,0migration/319684-21kthreadcore06:39:133
329930,0watchdog/30-21swapper/307:59:153
29935030,0irq/33-eth0-tx-0-21swapper/008:19:060
29935030,0irq/33-eth0-tx-0-21swapper/007:59:160
29935030,0irq/33-eth0-tx-0-21swapper/007:34:050
185039932,0cyclictest19052-21df_abs06:19:092
185039932,0cyclictest11903-21cut08:04:132
185029932,0cyclictest15123-21date06:38:551
185019933,0cyclictest0-21swapper/006:33:580
185019932,0cyclictest9914-21awk09:04:110
185019932,0cyclictest9166-21sensors09:39:190
185019932,0cyclictest5688-21grep07:39:110
185019932,0cyclictest30302-21head08:54:150
185019932,0cyclictest29295-21awk09:54:130
185019932,0cyclictest26511-21munin-node07:54:090
185019932,0cyclictest25070-21kthreadcore07:29:150
185019932,0cyclictest23871-21snmpd08:50:340
185019932,0cyclictest22349-21kthreadcore07:04:150
185019932,0cyclictest22349-21kthreadcore07:04:150
185019931,0cyclictest0-21swapper/006:19:060
185019930,0cyclictest32182-21sed10:54:070
185019930,0cyclictest0-21swapper/007:23:090
179930,0migration/17392-21kthreadcore06:54:151
169930,0watchdog/1961-21aten_r1power_cu07:14:071
169930,0watchdog/10-21swapper/111:09:061
169930,0watchdog/10-21swapper/109:44:151
169930,0watchdog/10-21swapper/108:39:031
169930,0watchdog/10-21swapper/107:53:551
169930,0watchdog/10-21swapper/107:23:551
169930,0watchdog/10-21swapper/107:23:511
169930,0watchdog/10-21swapper/107:09:191
169930,0watchdog/10-21swapper/106:35:151
185019921,0cyclictest12631-21latency_hist10:03:540
185019920,0cyclictest23391-21diskmemload10:48:570
185019920,0cyclictest0-21swapper/006:23:550
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional