You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-13 - 16:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Sun Jul 13, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
140023826,0sleep20-21swapper/206:27:442
128123728,0sleep30-21swapper/306:26:213
140423626,0sleep10-21swapper/106:27:471
112423523,0sleep00-21swapper/006:24:300
329970,0watchdog/3299250irq/32-eth0-rx-09:18:143
29925070,0irq/32-eth0-rx-0-21swapper/311:36:583
339960,0migration/37399-21kthreadcore06:28:153
339960,0migration/35213-21kthreadcore07:58:163
339960,0migration/311189-21irqrtprio09:03:123
329960,0watchdog/35761-21sed11:48:103
329960,0watchdog/312816-21rm10:57:583
329960,0watchdog/30-21swapper/311:53:143
329960,0watchdog/30-21swapper/311:37:583
329960,0watchdog/30-21swapper/311:18:143
329960,0watchdog/30-21swapper/311:12:143
329960,0watchdog/30-21swapper/310:48:543
329960,0watchdog/30-21swapper/310:38:143
329960,0watchdog/30-21swapper/310:35:463
329960,0watchdog/30-21swapper/310:13:263
329960,0watchdog/30-21swapper/309:58:143
329960,0watchdog/30-21swapper/309:50:303
329960,0watchdog/30-21swapper/309:37:463
329960,0watchdog/30-21swapper/309:28:103
329960,0watchdog/30-21swapper/309:24:063
329960,0watchdog/30-21swapper/309:08:223
329960,0watchdog/30-21swapper/308:41:103
329960,0watchdog/30-21swapper/308:36:183
329960,0watchdog/30-21swapper/307:38:023
329960,0watchdog/30-21swapper/306:58:103
329960,0watchdog/30-21swapper/306:53:143
29925060,0irq/32-eth0-rx-5083-21fschecks_count09:38:093
29925060,0irq/32-eth0-rx-302232sleep306:45:423
29925060,0irq/32-eth0-rx-27994-21tr08:53:133
29925060,0irq/32-eth0-rx-27930-21if_eth1.309:13:113
29925060,0irq/32-eth0-rx-2719-21irqstats11:28:133
29925060,0irq/32-eth0-rx-0-21swapper/311:13:113
29925060,0irq/32-eth0-rx-0-21swapper/310:54:163
29925060,0irq/32-eth0-rx-0-21swapper/310:47:223
29925060,0irq/32-eth0-rx-0-21swapper/310:29:213
29925060,0irq/32-eth0-rx-0-21swapper/310:19:173
29925060,0irq/32-eth0-rx-0-21swapper/310:04:093
29925060,0irq/32-eth0-rx-0-21swapper/309:56:283
29925060,0irq/32-eth0-rx-0-21swapper/308:48:343
29925060,0irq/32-eth0-rx-0-21swapper/308:46:013
29925060,0irq/32-eth0-rx-0-21swapper/308:30:233
14849966,0cyclictest0-21swapper/209:19:362
14849960,0cyclictest0-21swapper/209:08:152
8315050,0irq/26-0000:00:4189-21perf09:42:492
8315050,0irq/26-0000:00:21188-21if_eth1.207:03:132
339950,0migration/323140-21timerwakeupswit07:23:213
339950,0migration/321803-21kthreadcore10:23:123
329950,0watchdog/321696-21iostat07:48:103
329950,0watchdog/30-21swapper/311:43:063
329950,0watchdog/30-21swapper/311:23:023
329950,0watchdog/30-21swapper/311:03:423
329950,0watchdog/30-21swapper/308:24:423
329950,0watchdog/30-21swapper/308:20:183
329950,0watchdog/30-21swapper/308:13:063
329950,0watchdog/30-21swapper/308:10:103
329950,0watchdog/30-21swapper/308:04:103
329950,0watchdog/30-21swapper/307:53:463
329950,0watchdog/30-21swapper/307:45:023
329950,0watchdog/30-21swapper/307:34:583
329950,0watchdog/30-21swapper/307:32:183
329950,0watchdog/30-21swapper/307:18:063
329950,0watchdog/30-21swapper/307:14:183
329950,0watchdog/30-21swapper/307:08:143
329950,0watchdog/30-21swapper/306:48:063
329950,0watchdog/30-21swapper/306:39:143
329950,0watchdog/30-21swapper/306:33:103
29935050,0irq/33-eth0-tx-27524-21munin-node10:48:102
29935050,0irq/33-eth0-tx-2577-21munin-node07:58:190
29935050,0irq/33-eth0-tx-0-21swapper/008:25:110
29935050,0irq/33-eth0-tx-0-21swapper/008:19:420
29935050,0irq/33-eth0-tx-0-21swapper/008:03:210
29925050,0irq/32-eth0-rx-1368-21aten_r1power_po08:58:073
29925050,0irq/32-eth0-rx-0-21swapper/310:08:003
29925050,0irq/32-eth0-rx-0-21swapper/309:42:553
29925050,0irq/32-eth0-rx-0-21swapper/307:03:093
27150,0ktimersoftd/20-21swapper/206:33:262
259950,0migration/29668-21munin-node07:18:082
259950,0migration/27700-21latency_hist10:17:532
259950,0migration/231100-21munin-node08:53:162
259950,0migration/230337-21sh10:09:472
249950,0watchdog/24730-21kthreadcore11:28:142
249950,0watchdog/219460-21tune2fs10:43:102
249950,0watchdog/217552-21if_eth110:23:102
179950,0migration/19897-21latency_hist11:32:531
179950,0migration/19312-21kthreadcore08:43:151
179950,0migration/128260-21fschecks_time10:48:081
179950,0migration/127509-21kthreadcore07:28:121
179950,0migration/118859-21kthreadcore11:53:131
179950,0migration/114402-21munin-node07:43:111
169950,0watchdog/17947-21cut10:18:061
14849955,0cyclictest0-21swapper/211:54:162
14849955,0cyclictest0-21swapper/210:38:072
14849955,0cyclictest0-21swapper/210:34:492
14849955,0cyclictest0-21swapper/210:28:112
14849955,0cyclictest0-21swapper/209:35:512
14849955,0cyclictest0-21swapper/208:48:422
14849950,0cyclictest0-21swapper/208:39:242
14839955,0cyclictest13535-21diskmemload11:36:001
14839954,0cyclictest23871-21snmpd10:16:301
14829955,0cyclictest0-21swapper/009:12:150
14829955,0cyclictest0-21swapper/009:03:350
14829950,0cyclictest0-21swapper/009:46:570
14829950,0cyclictest0-21swapper/009:31:480
14829950,0cyclictest0-21swapper/009:22:020
149950,0migration/09330-21kthreadcore09:58:120
149950,0migration/09319-21sh09:02:280
149950,0migration/09056-21sh10:36:330
149950,0migration/0880-21taskset08:57:420
149950,0migration/08396-21sendmail_mailqu07:13:160
149950,0migration/08293-21kthreadcore06:53:130
149950,0migration/03367-21taskset09:34:550
149950,0migration/032477-21taskset10:30:560
149950,0migration/031771-21kthreadcore09:13:130
149950,0migration/031633-21taskset11:23:540
149950,0migration/03129-21runrttasks10:51:380
149950,0migration/030676-21kthreadcore07:53:140
149950,0migration/029933-21sh11:07:110
149950,0migration/025725-21kthreadcore07:03:150
149950,0migration/023462-21taskset10:08:070
149950,0migration/022741-21kthreadcore07:48:110
149950,0migration/021919-21kthreadcore08:08:150
149950,0migration/021849-21sh10:04:560
149950,0migration/018879-21kthreadcore08:28:140
149950,0migration/01867-21switchtime11:43:190
149950,0migration/017759-21kthreadcore11:18:120
149950,0migration/01774-21taskset07:11:540
149950,0migration/01666-21fschecks_count11:28:090
149950,0migration/013765-21kthreadcore07:18:130
149950,0migration/012877-21kthreadcore10:38:130
149950,0migration/012167-21kthreadcore10:18:130
149950,0migration/012110-21sh10:56:450
149950,0migration/011827-21cpuspeed_turbos09:23:090
149950,0migration/011633-21sh11:49:440
8315040,0irq/26-0000:00:0-21swapper/211:38:412
29935040,0irq/33-eth0-tx-6060-21munin-node07:38:060
29935040,0irq/33-eth0-tx-27068-21kthreadcore11:23:122
29935040,0irq/33-eth0-tx-17562-21kthreadcore08:28:142
29935040,0irq/33-eth0-tx-15893-21aten2.4-expect11:18:062
29935040,0irq/33-eth0-tx-11457-21ssh09:22:552
29935040,0irq/33-eth0-tx-0-21swapper/211:43:322
29935040,0irq/33-eth0-tx-0-21swapper/211:33:022
29935040,0irq/33-eth0-tx-0-21swapper/211:03:152
29935040,0irq/33-eth0-tx-0-21swapper/210:59:312
29935040,0irq/33-eth0-tx-0-21swapper/210:53:242
29935040,0irq/33-eth0-tx-0-21swapper/210:03:102
29935040,0irq/33-eth0-tx-0-21swapper/209:58:212
29935040,0irq/33-eth0-tx-0-21swapper/209:53:032
29935040,0irq/33-eth0-tx-0-21swapper/209:43:112
29935040,0irq/33-eth0-tx-0-21swapper/209:28:322
29935040,0irq/33-eth0-tx-0-21swapper/208:43:482
259940,0migration/28270-21kthreadcore08:23:122
259940,0migration/231662-21taskset10:13:032
259940,0migration/229817-21kthreadcore09:13:132
259940,0migration/220850-21kthreadcore08:08:152
259940,0migration/218611-21kthreadcore07:43:132
259940,0migration/217120-21taskset06:38:102
259940,0migration/214226-21runrttasks11:14:352
249940,0watchdog/27759-21python08:58:182
249940,0watchdog/24749-21df_abs11:48:062
249940,0watchdog/21126-21kthreadcore07:33:142
249940,0watchdog/20-21swapper/207:08:142
249940,0watchdog/20-21swapper/206:28:102
179940,0migration/19157-21kthreadcore09:58:121
179940,0migration/18856-21latency_hist06:32:541
179940,0migration/15042-21sh11:08:421
179940,0migration/14689-21kthreadcore07:13:121
179940,0migration/129692-21sh08:34:431
179940,0migration/129312-21kthreadcore08:53:141
179940,0migration/124634-21irqrtprio10:08:111
179940,0migration/12413-21kthreadcore08:38:131
179940,0migration/121276-21taskset11:02:371
179940,0migration/118465-21cpuspeed_turbos09:08:131
179940,0migration/118367-21kthreadcore08:28:141
179940,0migration/117716-21fschecks_count08:08:111
179940,0migration/116192-21latency_hist06:37:541
179940,0migration/115577-21proc_pri07:18:161
179940,0migration/112945-21kthreadcore10:38:131
179940,0migration/111543-21kthreadcore07:38:151
169940,0watchdog/17630-21iwlist08:23:101
169940,0watchdog/15758-21irqrtprio11:48:101
169940,0watchdog/13249-21df_abs09:18:101
169940,0watchdog/131600-21fschecks_count07:33:101
169940,0watchdog/127990-21kthreadcore06:43:141
169940,0watchdog/116875-21ssh09:04:381
169940,0watchdog/10-21swapper/110:43:101
169940,0watchdog/10-21swapper/110:23:061
169940,0watchdog/10-21swapper/108:48:221
169940,0watchdog/10-21swapper/107:53:141
169940,0watchdog/10-21swapper/107:08:141
14849943,0cyclictest7145-21awk07:38:122
14849943,0cyclictest6654-21awk06:53:112
14849943,0cyclictest3787-21awk07:58:142
14849943,0cyclictest3599-21lldpd08:15:122
14849943,0cyclictest3599-21lldpd07:55:042
14849943,0cyclictest3599-21lldpd06:43:282
14849943,0cyclictest3262-21irqbalance08:33:082
14849943,0cyclictest31584-21awk11:08:092
14849943,0cyclictest23871-21snmpd07:29:592
14849943,0cyclictest23871-21snmpd07:23:592
14849943,0cyclictest23871-21snmpd06:59:582
14849943,0cyclictest23871-21snmpd06:47:582
14849943,0cyclictest22615-21awk09:48:102
14849943,0cyclictest11044-21awk08:03:112
14849943,0cyclictest10827-21awk09:03:102
14839944,0cyclictest0-21swapper/109:54:371
14839944,0cyclictest0-21swapper/109:49:351
14839944,0cyclictest0-21swapper/107:23:161
14839943,0cyclictest5619-21awk09:38:111
14839943,0cyclictest3599-21lldpd10:55:371
14839943,0cyclictest3599-21lldpd07:48:041
14839943,0cyclictest3599-21lldpd07:03:011
14839943,0cyclictest32690-21awk08:18:101
14839943,0cyclictest25767-21awk11:23:091
14839943,0cyclictest2398-21awk08:58:111
14839943,0cyclictest23871-21snmpd08:14:291
14839943,0cyclictest23109-21sed11:03:111
14839943,0cyclictest2147-21awk10:33:091
14839943,0cyclictest21176-21sadc09:47:541
14839943,0cyclictest19997-21awk11:38:101
14839943,0cyclictest12603-21awk09:23:121
14829944,0cyclictest22945-21kworker/0:008:50:440
14829944,0cyclictest0-21swapper/011:15:040
14829943,0cyclictest5537-21awk09:38:100
14829943,0cyclictest32334-21awk08:38:110
14829943,0cyclictest32311-21awk07:33:130
14829943,0cyclictest31347-21sadc08:17:540
149940,0migration/023075-21kthreadcore09:48:110
149940,0migration/020770-21kthreadcore11:38:120
149940,0migration/020005-21irqcore10:43:130
149940,0migration/014529-21sh08:43:520
29935030,0irq/33-eth0-tx-0-21swapper/006:38:080
259930,0migration/22964-21fschecks_time07:13:082
249930,0watchdog/20-21swapper/208:18:062
169930,0watchdog/10-21swapper/111:15:021
169930,0watchdog/10-21swapper/110:03:101
169930,0watchdog/10-21swapper/109:33:141
169930,0watchdog/10-21swapper/109:28:061
14849932,0cyclictest26727-21sensors07:48:162
14839932,0cyclictest8521-21cat07:58:171
14839932,0cyclictest6671-21awk06:53:111
14839932,0cyclictest31695-21awk06:48:101
14839932,0cyclictest27823-21awk09:13:101
14839932,0cyclictest25341-21sh10:28:081
14839932,0cyclictest23871-21snmpd08:07:291
14839932,0cyclictest1765-21which11:43:161
14839932,0cyclictest13952-21awk06:58:111
14839932,0cyclictest10171-21awk06:33:121
14839930,0cyclictest16612-21perl11:18:081
14829933,0cyclictest22945-21kworker/0:007:43:300
14829933,0cyclictest22945-21kworker/0:007:28:020
14829933,0cyclictest2260-21kworker/0:111:08:140
14829933,0cyclictest2260-21kworker/0:109:52:560
14829933,0cyclictest22244-21kworker/0:211:33:140
14829933,0cyclictest16490-21kworker/0:011:52:580
14829933,0cyclictest1217-21kworker/0:107:23:060
14829933,0cyclictest1217-21kworker/0:106:58:070
14829933,0cyclictest1217-21kworker/0:106:33:130
14829933,0cyclictest1217-21kworker/0:106:28:050
14829932,0cyclictest3599-21lldpd10:13:050
14829932,0cyclictest24585-21awk06:43:120
14829932,0cyclictest22629-21basename08:33:090
14829932,0cyclictest19210-21sensors10:58:170
14829932,0cyclictest17618-21awk10:23:100
14829930,0cyclictest30655-21munin-node06:48:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional