You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-12 - 14:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Thu Jun 12, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2751429387,0sleep00-21swapper/006:25:170
2776924738,0sleep10-21swapper/106:28:141
2760923927,0sleep20-21swapper/206:26:232
2075023626,0sleep30-21swapper/306:24:483
279759999,0cyclictest83150irq/26-0000:00:09:59:472
8315070,0irq/26-0000:00:0-21swapper/307:49:473
4170,0ktimersoftd/020321-21uname08:20:140
329970,0watchdog/38740-21cut07:25:163
329970,0watchdog/3299250irq/32-eth0-rx-11:02:403
29925070,0irq/32-eth0-rx-2888-21kthreadcore09:45:063
29925070,0irq/32-eth0-rx-0-21swapper/310:35:023
29925070,0irq/32-eth0-rx-0-21swapper/310:34:463
29925070,0irq/32-eth0-rx-0-21swapper/308:00:073
339960,0migration/34060-21munin-node10:45:063
339960,0migration/32683-21sh09:06:313
339960,0migration/325514-21munin-node11:35:083
339960,0migration/318211-21irqrtprio10:15:053
329960,0watchdog/3176692sleep306:45:523
329960,0watchdog/30-21swapper/311:57:433
329960,0watchdog/30-21swapper/311:52:073
329960,0watchdog/30-21swapper/311:45:273
329960,0watchdog/30-21swapper/311:42:273
329960,0watchdog/30-21swapper/311:27:043
329960,0watchdog/30-21swapper/311:20:083
329960,0watchdog/30-21swapper/311:20:083
329960,0watchdog/30-21swapper/311:11:283
329960,0watchdog/30-21swapper/311:04:483
329960,0watchdog/30-21swapper/310:57:483
329960,0watchdog/30-21swapper/310:21:083
329960,0watchdog/30-21swapper/310:13:323
329960,0watchdog/30-21swapper/310:09:323
329960,0watchdog/30-21swapper/309:59:483
329960,0watchdog/30-21swapper/309:55:123
329960,0watchdog/30-21swapper/309:42:083
329960,0watchdog/30-21swapper/309:32:163
329960,0watchdog/30-21swapper/309:10:003
329960,0watchdog/30-21swapper/308:58:443
329960,0watchdog/30-21swapper/308:47:123
329960,0watchdog/30-21swapper/308:40:483
29935060,0irq/33-eth0-tx-21974-21munin-node07:15:050
29925060,0irq/32-eth0-rx-21922-21yum11:30:143
29925060,0irq/32-eth0-rx-20247-21python09:35:113
29925060,0irq/32-eth0-rx-0-21swapper/310:41:013
29925060,0irq/32-eth0-rx-0-21swapper/309:20:443
29925060,0irq/32-eth0-rx-0-21swapper/309:00:043
29925060,0irq/32-eth0-rx-0-21swapper/308:50:553
29925060,0irq/32-eth0-rx-0-21swapper/307:24:063
149960,0migration/09136-21sh10:29:260
149960,0migration/0687-21kthreadcore09:05:060
149960,0migration/016016-21sh10:30:130
8315050,0irq/26-0000:00:0-21swapper/307:39:473
8315050,0irq/26-0000:00:0-21swapper/306:49:473
339950,0migration/38836-21latency06:35:073
339950,0migration/312951-21munin-node09:15:043
329950,0watchdog/39807-21cut08:10:083
329950,0watchdog/33895-21kthreadcore07:00:043
329950,0watchdog/326330-21grep06:55:043
329950,0watchdog/316407-21kthreadcore07:30:083
329950,0watchdog/30-21swapper/311:14:483
329950,0watchdog/30-21swapper/310:50:283
329950,0watchdog/30-21swapper/310:24:483
329950,0watchdog/30-21swapper/309:50:243
329950,0watchdog/30-21swapper/309:24:483
329950,0watchdog/30-21swapper/308:35:043
329950,0watchdog/30-21swapper/308:29:523
329950,0watchdog/30-21swapper/308:27:523
329950,0watchdog/30-21swapper/308:21:123
329950,0watchdog/30-21swapper/308:16:163
329950,0watchdog/30-21swapper/308:04:483
329950,0watchdog/30-21swapper/307:56:083
329950,0watchdog/30-21swapper/307:45:043
329950,0watchdog/30-21swapper/307:37:403
329950,0watchdog/30-21swapper/307:17:043
329950,0watchdog/30-21swapper/307:10:043
329950,0watchdog/30-21swapper/307:05:123
329950,0watchdog/30-21swapper/306:30:003
29935050,0irq/33-eth0-tx-6797-21munin-node09:50:022
29935050,0irq/33-eth0-tx-6386-21runrttasks08:30:360
29935050,0irq/33-eth0-tx-5413-21munin-node09:30:072
29935050,0irq/33-eth0-tx-541-21diskmemload10:14:152
29935050,0irq/33-eth0-tx-4071-21ssh10:45:062
29935050,0irq/33-eth0-tx-3008-21munin-node06:35:080
29935050,0irq/33-eth0-tx-29888-21ssh09:42:592
29935050,0irq/33-eth0-tx-11564-21ssh11:06:452
29935050,0irq/33-eth0-tx-0-21swapper/211:25:522
29935050,0irq/33-eth0-tx-0-21swapper/211:02:272
29935050,0irq/33-eth0-tx-0-21swapper/209:18:132
29935050,0irq/33-eth0-tx-0-21swapper/208:40:002
29935050,0irq/33-eth0-tx-0-21swapper/007:29:070
29935050,0irq/33-eth0-tx-0-21swapper/007:20:150
29935050,0irq/33-eth0-tx-0-21swapper/007:05:240
29925050,0irq/32-eth0-rx-0-21swapper/306:39:593
279759955,0cyclictest83150irq/26-0000:00:11:35:392
279759955,0cyclictest0-21swapper/211:50:102
279759955,0cyclictest0-21swapper/210:20:092
279749955,0cyclictest0-21swapper/111:52:131
279749955,0cyclictest0-21swapper/108:54:421
279749955,0cyclictest0-21swapper/106:35:201
279749950,0cyclictest0-21swapper/111:45:171
279749950,0cyclictest0-21swapper/109:44:311
279739955,0cyclictest0-21swapper/008:53:180
279739954,0cyclictest0-21swapper/010:55:390
279739950,0cyclictest0-21swapper/010:39:340
259950,0migration/24913-21kthreadcore10:25:062
259950,0migration/24399-21munin-node09:45:082
259950,0migration/232066-21kthreadcore09:25:082
259950,0migration/229367-21kthreadcore08:45:072
259950,0migration/219013-21fschecks_count07:35:012
259950,0migration/218775-21kthreadcore10:15:062
259950,0migration/217704-21idleruntime-cro10:34:472
259950,0migration/217529-21timerwakeupswit08:55:142
259950,0migration/214615-21kthreadcore08:35:072
179950,0migration/18739-21munin-node07:05:151
179950,0migration/18716-21fschecks_time07:50:021
179950,0migration/13689-21taskset07:23:191
179950,0migration/132268-21sh10:22:051
179950,0migration/131748-21timerandwakeup06:55:151
179950,0migration/121893-21sh11:30:131
179950,0migration/118356-21kthreadcore09:55:101
179950,0migration/11813-21fschecks_time10:25:021
179950,0migration/117802-21kthreadcore07:55:141
179950,0migration/110943-21latency_hist08:54:471
169950,0watchdog/15473-21aten2.4-expect09:30:001
169950,0watchdog/11374-21ssh11:57:071
149950,0migration/09734-21kthreadcore09:50:080
149950,0migration/06073-21kthreadcore08:10:070
149950,0migration/031702-21kthreadcore09:25:080
149950,0migration/031449-21irqcore11:20:050
149950,0migration/031449-21irqcore11:20:050
149950,0migration/030410-21kthreadcore11:00:060
149950,0migration/027919-21kthreadcore09:40:070
149950,0migration/025973-21cpuspeed_turbos07:40:010
149950,0migration/024971-21taskset06:52:040
149950,0migration/024437-21fschecks_count11:35:040
149950,0migration/021170-21kthreadcore09:00:060
149950,0migration/02084-21kthreadcore11:40:060
149950,0migration/017815-21aten_r1power_po11:50:000
149950,0migration/017464-21missed_timers08:15:080
149950,0migration/016416-21irqcore07:55:130
149950,0migration/015960-21kthreadcore06:45:060
149950,0migration/015564-21kthreadcore09:15:090
149950,0migration/015153-21sh11:29:530
149950,0migration/01481-21irqcore07:00:030
149950,0migration/013206-21kthreadcore07:30:070
149950,0migration/010991-21sh08:54:560
29935040,0irq/33-eth0-tx-25999-21munin-node08:25:160
29935040,0irq/33-eth0-tx-16160-21ssh09:55:062
29935040,0irq/33-eth0-tx-14040-21ssh09:35:012
29935040,0irq/33-eth0-tx-0-21swapper/211:54:592
29935040,0irq/33-eth0-tx-0-21swapper/211:45:012
29935040,0irq/33-eth0-tx-0-21swapper/211:39:552
29935040,0irq/33-eth0-tx-0-21swapper/211:15:322
29935040,0irq/33-eth0-tx-0-21swapper/210:40:322
29935040,0irq/33-eth0-tx-0-21swapper/210:04:572
29935040,0irq/33-eth0-tx-0-21swapper/209:19:502
29935040,0irq/33-eth0-tx-0-21swapper/209:10:262
29935040,0irq/33-eth0-tx-0-21swapper/208:59:592
29935040,0irq/33-eth0-tx-0-21swapper/208:50:042
29935040,0irq/33-eth0-tx-0-21swapper/007:49:590
279759944,0cyclictest0-21swapper/208:00:002
279759943,0cyclictest5509-21awk08:10:052
279759943,0cyclictest3599-21lldpd10:50:042
279759943,0cyclictest23871-21snmpd08:26:502
279759943,0cyclictest23871-21snmpd08:09:202
279759943,0cyclictest23871-21snmpd07:56:202
279759943,0cyclictest23871-21snmpd07:49:502
279759943,0cyclictest23871-21snmpd07:46:202
279759943,0cyclictest23871-21snmpd07:19:502
279759943,0cyclictest23871-21snmpd07:14:202
279759943,0cyclictest23871-21snmpd07:01:502
279759943,0cyclictest23871-21snmpd06:51:202
279759943,0cyclictest23871-21snmpd06:44:502
279759943,0cyclictest23871-21snmpd06:44:352
279759943,0cyclictest23026-21awk07:15:072
279759943,0cyclictest2013-21awk08:30:072
279759943,0cyclictest19012-21awk10:35:032
279759940,0cyclictest0-21swapper/211:09:492
279749943,0cyclictest5388-21awk11:05:031
279749943,0cyclictest3662-21awk10:45:051
279749943,0cyclictest3599-21lldpd10:52:341
279749943,0cyclictest27287-21awk08:45:051
279749943,0cyclictest25038-21awk11:35:061
279749943,0cyclictest23871-21snmpd10:12:501
279749943,0cyclictest23871-21snmpd10:04:501
279749943,0cyclictest23871-21snmpd09:22:201
279749943,0cyclictest23871-21snmpd08:36:501
279749943,0cyclictest23871-21snmpd07:44:501
279749943,0cyclictest23871-21snmpd07:39:501
279749943,0cyclictest23871-21snmpd07:29:501
279749943,0cyclictest12687-21awk08:15:041
279739944,0cyclictest21954-21kworker/0:110:23:320
279739943,0cyclictest5519-21awk11:05:030
279739943,0cyclictest29796-21sadc11:19:470
279739943,0cyclictest27380-21awk10:40:020
279739943,0cyclictest26500-21awk06:55:060
279739943,0cyclictest23871-21snmpd11:25:060
279739943,0cyclictest23871-21snmpd10:06:200
279739943,0cyclictest19609-21awk07:35:040
279739943,0cyclictest17734-21awk10:15:040
279739943,0cyclictest17405-21sadc11:49:460
279739943,0cyclictest16365-21awk09:55:080
279739943,0cyclictest13901-21awk11:10:060
279739943,0cyclictest10768-21sadc10:49:470
259940,0migration/27099-21kthreadcore07:25:162
259940,0migration/2481-21kthreadcore06:30:062
259940,0migration/230407-21kthreadcore06:55:092
259940,0migration/229068-21kthreadcore07:40:062
259940,0migration/222001-21kthreadcore10:55:062
259940,0migration/221675-21kthreadcore08:20:142
259940,0migration/218310-21kthreadcore11:30:042
259940,0migration/211826-21cpuspeed_turbos08:15:012
249940,0watchdog/23631-21munin-node11:20:082
249940,0watchdog/23631-21munin-node11:20:082
249940,0watchdog/210897-21kthreadcore07:05:162
249940,0watchdog/20-21swapper/209:05:002
179940,0migration/18432-21taskset11:43:561
179940,0migration/17557-21sh08:30:221
179940,0migration/17180-21fschecks_time11:25:001
179940,0migration/17138-21df_abs09:50:031
179940,0migration/15859-21kthreadcore07:25:151
179940,0migration/14637-21cpuspeed_turbos08:10:021
179940,0migration/13285-21runrttasks09:25:141
179940,0migration/132679-21kthreadcore09:05:061
179940,0migration/131479-21fschecks_time09:45:021
179940,0migration/131279-21kthreadcore11:00:061
179940,0migration/130132-21fschecks_count08:05:021
179940,0migration/129176-21taskset08:03:411
179940,0migration/125895-21latency_hist08:24:471
179940,0migration/125489-21kthreadcore11:15:061
179940,0migration/124044-21latency06:50:081
179940,0migration/121387-21runrttasks09:37:311
179940,0migration/119950-21runrttasks09:17:331
179940,0migration/11614-21munin-node06:30:071
179940,0migration/113204-21kthreadcore10:30:061
179940,0migration/110560-21runrttasks06:41:571
169940,0watchdog/1541-21diskmemload09:13:361
169940,0watchdog/13894-21kthreadcore07:00:041
169940,0watchdog/128023-21munin-node07:15:121
169940,0watchdog/124178-21ssh08:40:121
169940,0watchdog/116682-21ssh10:15:001
169940,0watchdog/11639-21ssh10:43:201
169940,0watchdog/111213-21wc06:45:001
169940,0watchdog/10-21swapper/110:38:281
149940,0migration/05151-21kthreadcore07:45:060
149940,0migration/032178-21kthreadcore06:30:060
149940,0migration/027057-21runrttasks09:20:080
149940,0migration/026066-21kthreadcore08:00:030
149940,0migration/025825-21kthreadcore10:00:050
149940,0migration/015343-21diskmemload10:11:390
149940,0migration/012413-21sh09:31:080
29935030,0irq/33-eth0-tx-0-21swapper/008:05:000
279759933,0cyclictest3599-21lldpd06:34:592
279759932,0cyclictest12371-21awk07:30:052
279749932,0cyclictest31298-21awk11:20:051
279749932,0cyclictest31298-21awk11:20:051
279749932,0cyclictest23871-21snmpd07:34:501
279749932,0cyclictest23871-21snmpd07:10:201
279739933,0cyclictest32695-21kworker/0:008:34:560
279739933,0cyclictest21954-21kworker/0:110:50:040
279739933,0cyclictest21954-21kworker/0:109:45:020
279739933,0cyclictest21954-21kworker/0:109:34:520
279739933,0cyclictest18679-21kworker/0:011:55:000
279739933,0cyclictest15621-21kworker/0:209:10:220
279739932,0cyclictest26603-21fschecks_count08:45:030
279739932,0cyclictest19391-21kthreadcore08:40:070
279739932,0cyclictest14753-21date07:09:470
179930,0migration/126953-21runrttasks10:57:121
179930,0migration/126580-21diskmemload09:01:201
169930,0watchdog/114625-21kthreadcore11:10:081
169930,0watchdog/10-21swapper/109:59:521
279739920,0cyclictest0-21swapper/006:39:470
169920,0watchdog/10-21swapper/108:24:481
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional