You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-25 - 20:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Tue Aug 25, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2866425544,0sleep00-21swapper/007:26:400
29131994848,0cyclictest5691-21md0_resync09:46:100
2866224132,0sleep30-21swapper/307:26:393
29144993838,0cyclictest83050irq/26-0000:00:09:46:102
2893223726,0sleep20-21swapper/207:29:422
2894723329,0sleep10-21swapper/107:29:531
27170,0ktimersoftd/22028-21md1_raid107:34:382
8305060,0irq/26-0000:00:30137-21users08:11:323
8305060,0irq/26-0000:00:17331-21seq08:49:433
8305060,0irq/26-0000:00:15971-21iostat_ios09:11:233
8305060,0irq/26-0000:00:1007-21if_err_eth109:01:203
35160,0ktimersoftd/30-21swapper/307:34:383
339960,0migration/37134-21sh12:12:243
339960,0migration/322719-21sh09:54:233
339960,0migration/316638-21switchtime11:21:333
29805060,0irq/28-eth0-rx-8047-21diskstats11:01:203
29805060,0irq/28-eth0-rx-15212-21wc12:01:193
29805060,0irq/28-eth0-rx-0-21swapper/310:32:233
291449966,0cyclictest11565-21diskmemload10:52:252
291449966,0cyclictest0-21swapper/212:59:582
291449966,0cyclictest0-21swapper/210:59:122
291449960,0cyclictest0-21swapper/212:14:052
291449960,0cyclictest0-21swapper/209:36:072
291449960,0cyclictest0-21swapper/208:45:592
291319960,0cyclictest0-21swapper/012:45:570
27160,0ktimersoftd/20-21swapper/208:19:202
259960,0migration/23985-21sh10:38:512
259960,0migration/213157-21munin-node11:56:332
169960,0watchdog/119241-21grep08:06:241
149960,0migration/08141-21sh10:05:000
149960,0migration/032425-21munin-node09:01:160
149960,0migration/022294-21kthreadcore08:31:230
149960,0migration/021168-21sh12:58:220
149960,0migration/021165-21munin-node09:51:280
149960,0migration/020004-21kthreadcore11:06:230
149960,0migration/01903-21sh11:31:350
149960,0migration/013942-21kthreadcore07:41:230
149960,0migration/010896-21timerandwakeup09:26:330
8305050,0irq/26-0000:00:9443-21fschecks_time08:01:213
8305050,0irq/26-0000:00:890-21kthreadcore08:16:243
8305050,0irq/26-0000:00:88922sleep211:18:262
8305050,0irq/26-0000:00:8614-21interrupts09:06:223
8305050,0irq/26-0000:00:8518-21kthreadcore12:31:252
8305050,0irq/26-0000:00:6670-21switchtime10:01:332
8305050,0irq/26-0000:00:3695-21sed09:41:322
8305050,0irq/26-0000:00:32409-21ntp_states12:26:282
8305050,0irq/26-0000:00:31498-21rm11:51:232
8305050,0irq/26-0000:00:28099-21fschecks_count11:31:202
8305050,0irq/26-0000:00:27515-21if_eth107:51:213
8305050,0irq/26-0000:00:26121-21ssh11:27:542
8305050,0irq/26-0000:00:25137-21aten2.4-expect08:56:173
8305050,0irq/26-0000:00:22104-21kthreadcore12:41:252
8305050,0irq/26-0000:00:21444-21ps10:31:232
8305050,0irq/26-0000:00:19201-21ssh09:33:332
8305050,0irq/26-0000:00:19063-21switchtime11:41:322
8305050,0irq/26-0000:00:18373-21cat12:01:252
8305050,0irq/26-0000:00:17978-21ssh11:24:292
8305050,0irq/26-0000:00:17917-21sed10:11:192
8305050,0irq/26-0000:00:1746-21tr12:46:252
8305050,0irq/26-0000:00:15272-21ssh11:03:522
8305050,0irq/26-0000:00:11819-21users12:51:342
8305050,0irq/26-0000:00:0-21swapper/309:26:193
8305050,0irq/26-0000:00:0-21swapper/309:21:193
8305050,0irq/26-0000:00:0-21swapper/308:06:243
4150,0ktimersoftd/00-21swapper/010:11:490
339950,0migration/37422-21taskset10:02:523
339950,0migration/37351-21latency07:56:243
339950,0migration/329838-21munin-node10:36:223
339950,0migration/324009-21munin-node08:51:313
339950,0migration/318722-21taskset07:44:453
339950,0migration/317941-21munin-node10:11:203
339950,0migration/316077-21kthreadcore08:26:243
339950,0migration/315508-21kthreadcore12:36:253
339950,0migration/312812-21taskset09:31:203
339950,0migration/310753-21taskset11:36:513
329950,0watchdog/38744-21kthreadcore07:36:243
329950,0watchdog/332338-21grep11:31:253
329950,0watchdog/330641-21sh10:55:253
329950,0watchdog/32495-21kthreadcore09:41:253
329950,0watchdog/32325-21sshd08:38:053
329950,0watchdog/321318-21ssh12:58:493
329950,0watchdog/312609-21unixbench_multi09:46:333
329950,0watchdog/30-21swapper/312:26:213
329950,0watchdog/30-21swapper/311:16:293
329950,0watchdog/30-21swapper/308:31:173
29815050,0irq/29-eth0-tx-3524-21snmpd09:13:350
29815050,0irq/29-eth0-tx-31991-21ssh11:11:512
29815050,0irq/29-eth0-tx-23458-21munin-node08:11:220
29815050,0irq/29-eth0-tx-17408-21munin-node12:21:192
29815050,0irq/29-eth0-tx-16120-21munin-node08:06:260
29815050,0irq/29-eth0-tx-0-21swapper/212:06:242
29815050,0irq/29-eth0-tx-0-21swapper/210:24:022
29815050,0irq/29-eth0-tx-0-21swapper/209:57:392
29815050,0irq/29-eth0-tx-0-21swapper/009:31:320
29815050,0irq/29-eth0-tx-0-21swapper/008:56:190
29805050,0irq/28-eth0-rx-3295-21ssh12:47:123
29805050,0irq/28-eth0-rx-24045-21sed12:06:193
29805050,0irq/28-eth0-rx-20354-21cut12:21:243
29805050,0irq/28-eth0-rx-10796-21kthreadcore08:21:223
29805050,0irq/28-eth0-rx-0-21swapper/312:33:593
29805050,0irq/28-eth0-rx-0-21swapper/311:46:223
29805050,0irq/28-eth0-rx-0-21swapper/311:14:133
29805050,0irq/28-eth0-rx-0-21swapper/310:46:093
29805050,0irq/28-eth0-rx-0-21swapper/310:41:113
29805050,0irq/28-eth0-rx-0-21swapper/310:16:243
29805050,0irq/28-eth0-rx-0-21swapper/309:56:213
29805050,0irq/28-eth0-rx-0-21swapper/309:36:163
291449955,0cyclictest0-21swapper/208:56:142
291449955,0cyclictest0-21swapper/208:36:122
291449950,0cyclictest0-21swapper/210:30:212
291449950,0cyclictest0-21swapper/207:48:452
291449950,0cyclictest0-21swapper/207:42:362
291319955,0cyclictest0-21swapper/012:33:400
291319950,0cyclictest0-21swapper/012:07:200
291319950,0cyclictest0-21swapper/011:49:400
291319950,0cyclictest0-21swapper/011:42:250
291319950,0cyclictest0-21swapper/011:13:060
27150,0ktimersoftd/20-21swapper/208:34:092
259950,0migration/23836-210anacron09:22:062
259950,0migration/23796-21sh11:36:132
259950,0migration/226122-21latency_hist10:16:062
249950,0watchdog/228354-21ssh11:47:212
19150,0ktimersoftd/10-21swapper/112:11:071
19150,0ktimersoftd/10-21swapper/110:11:491
179950,0migration/18363-21fschecks_time11:01:211
179950,0migration/16691-21kthreadcore07:36:241
179950,0migration/131082-21if_eth111:51:211
179950,0migration/127774-21kthreadcore08:56:231
179950,0migration/120056-21taskset11:43:331
179950,0migration/116157-21irqcore09:51:241
179950,0migration/113352-21latency09:06:241
169950,0watchdog/19888-21ssh10:06:211
169950,0watchdog/114784-21kthreadcore10:26:251
169950,0watchdog/10-21swapper/110:21:251
149950,0migration/04607-21kthreadcore08:41:210
149950,0migration/0373-21kthreadcore09:41:240
149950,0migration/0352-21switchtime07:51:300
149950,0migration/032337-21needreboot12:26:270
149950,0migration/032315-21munin-node10:56:220
149950,0migration/030935-21kthreadcore08:36:230
149950,0migration/030909-21hddtemp_smartct11:51:190
149950,0migration/025360-21kthreadcore10:51:220
149950,0migration/023005-21kthreadcore07:46:230
149950,0migration/022233-21kthreadcore12:21:250
149950,0migration/020850-21kthreadcore08:51:260
149950,0migration/018687-21taskset10:28:040
149950,0migration/014526-21kthreadcore11:21:260
149950,0migration/013759-21kthreadcore08:01:250
149950,0migration/013711-21processes09:06:270
149950,0migration/012282-21ksmtuned12:36:220
149950,0migration/01202-21kthreadcore12:46:250
149950,0migration/011581-21timerandwakeup12:51:330
149950,0migration/010602-21kthreadcore10:41:220
149950,0migration/010372-21missed_timers07:36:250
8305040,0irq/26-0000:00:20301-21munin-node07:46:223
8305040,0irq/26-0000:00:0-21swapper/308:41:173
8305040,0irq/26-0000:00:0-21swapper/210:41:212
339940,0migration/33849-21irqcore10:21:243
329940,0watchdog/30-21swapper/312:41:253
329940,0watchdog/30-21swapper/312:16:173
29815040,0irq/29-eth0-tx-0-21swapper/211:06:072
29815040,0irq/29-eth0-tx-0-21swapper/210:46:212
29815040,0irq/29-eth0-tx-0-21swapper/209:51:152
29815040,0irq/29-eth0-tx-0-21swapper/007:31:210
29805040,0irq/28-eth0-rx-0-21swapper/312:51:133
29805040,0irq/28-eth0-rx-0-21swapper/311:56:273
29805040,0irq/28-eth0-rx-0-21swapper/311:51:163
29805040,0irq/28-eth0-rx-0-21swapper/311:41:173
29805040,0irq/28-eth0-rx-0-21swapper/311:26:323
29805040,0irq/28-eth0-rx-0-21swapper/311:06:253
29805040,0irq/28-eth0-rx-0-21swapper/310:56:333
29805040,0irq/28-eth0-rx-0-21swapper/310:26:183
29805040,0irq/28-eth0-rx-0-21swapper/310:06:173
29805040,0irq/28-eth0-rx-0-21swapper/309:19:073
291449944,0cyclictest0-21swapper/207:52:222
291449943,0cyclictest3571-21lldpd08:21:192
291449943,0cyclictest3524-21snmpd09:11:082
291449943,0cyclictest3524-21snmpd08:03:372
291449943,0cyclictest3250-21irqbalance09:26:422
291449943,0cyclictest3250-21irqbalance09:18:222
291449943,0cyclictest3250-21irqbalance08:51:222
291449943,0cyclictest3250-21irqbalance08:11:122
291449943,0cyclictest11012-21sort08:46:202
291379943,0cyclictest7006-21awk09:46:221
291379943,0cyclictest6994-21awk08:21:201
291379943,0cyclictest5640-21awk09:26:231
291379943,0cyclictest3571-21lldpd12:42:241
291379943,0cyclictest3524-21snmpd11:36:101
291379943,0cyclictest3524-21snmpd09:56:091
291379943,0cyclictest3524-21snmpd08:54:231
291379943,0cyclictest3524-21snmpd07:43:371
291379943,0cyclictest30379-21awk09:41:221
291379943,0cyclictest28958-21awk08:36:211
291379943,0cyclictest26225-21awk11:11:241
291379943,0cyclictest20216-21awk07:46:211
291379943,0cyclictest17517-21awk11:06:211
291379943,0cyclictest15851-21awk09:11:221
291379942,0cyclictest3524-21snmpd11:26:401
291319944,0cyclictest0-21swapper/011:37:130
291319944,0cyclictest0-21swapper/010:25:100
291319944,0cyclictest0-21swapper/009:39:270
291319943,0cyclictest3571-21lldpd09:56:500
291319943,0cyclictest3524-21snmpd10:20:540
291319943,0cyclictest3524-21snmpd10:09:390
291319943,0cyclictest3524-21snmpd08:48:230
291319943,0cyclictest3524-21snmpd08:00:070
291319943,0cyclictest3250-21irqbalance12:01:230
291319943,0cyclictest31885-21awk08:16:220
291319943,0cyclictest30555-21awk09:21:230
291319943,0cyclictest23209-21awk09:16:220
291319943,0cyclictest14751-21sadc12:01:060
259940,0migration/29500-21fschecks_time12:16:202
259940,0migration/28909-21aten_r1power_po10:06:172
259940,0migration/25079-21kthreadcore07:56:232
259940,0migration/25049-21fschecks_time07:36:202
259940,0migration/222116-21missed_timers08:06:262
259940,0migration/216666-21kthreadcore08:26:242
259940,0migration/211754-21fschecks_count12:36:202
249940,0watchdog/232379-21munin-node09:01:212
179940,0migration/17759-21sendmail_mailst07:56:271
179940,0migration/17091-21taskset10:01:541
179940,0migration/14289-21kthreadcore12:31:241
179940,0migration/131625-21kthreadcore07:51:231
179940,0migration/131163-21kthreadcore09:21:241
179940,0migration/129227-21unixbench_multi10:51:301
179940,0migration/125480-21kthreadcore12:06:231
179940,0migration/121349-21aten_r1power_vo11:46:181
179940,0migration/118655-21taskset09:31:381
179940,0migration/112054-21kthreadcore12:16:241
179940,0migration/111278-21aten_r1power_en12:36:181
169940,0watchdog/19152-21ntpq08:41:251
169940,0watchdog/16461-21sh10:58:371
169940,0watchdog/16314-21runrttasks09:37:331
169940,0watchdog/15469-21df_inode10:41:171
169940,0watchdog/1429-21tr07:31:281
169940,0watchdog/123508-21latency12:21:251
169940,0watchdog/12097-21ssh11:32:091
169940,0watchdog/12075-21ssh10:20:491
169940,0watchdog/116082-21kthreadcore10:46:251
169940,0watchdog/111878-21ssh12:51:411
169940,0watchdog/110653-21munin-node11:21:211
169940,0watchdog/110362-21kthreadcore08:01:241
169940,0watchdog/10-21swapper/112:46:211
169940,0watchdog/10-21swapper/112:01:251
169940,0watchdog/10-21swapper/111:16:251
169940,0watchdog/10-21swapper/110:33:491
169940,0watchdog/10-21swapper/108:16:241
149940,0migration/08762-21kthreadcore08:21:210
149940,0migration/02940-21kernelversion11:16:240
291379932,0cyclictest3524-21snmpd10:36:091
291379932,0cyclictest13241-21basename08:26:181
291379931,0cyclictest0-21swapper/109:16:251
291379930,0cyclictest24226-21perl08:11:191
291319933,0cyclictest6317-21kworker/0:011:26:110
291319933,0cyclictest6317-21kworker/0:011:01:410
291319933,0cyclictest6317-21kworker/0:010:46:070
291319933,0cyclictest6317-21kworker/0:010:36:090
291319933,0cyclictest6317-21kworker/0:010:31:090
291319933,0cyclictest6317-21kworker/0:008:26:150
291319933,0cyclictest4052-21kworker/0:212:16:180
291319933,0cyclictest4052-21kworker/0:212:11:070
169930,0watchdog/126682-21tune2fs12:26:211
169930,0watchdog/10-21swapper/112:56:091
169930,0watchdog/10-21swapper/111:56:131
169930,0watchdog/10-21swapper/109:01:211
169930,0watchdog/10-21swapper/108:46:251
169930,0watchdog/10-21swapper/108:31:171
291449920,0cyclictest0-21swapper/209:06:062
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional