You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-04 - 01:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Mon Aug 03, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2818225655,0sleep00-21swapper/007:26:060
2820624536,0sleep10-21swapper/107:26:231
2817924536,0sleep20-21swapper/207:26:042
2837523929,0sleep30-21swapper/307:28:213
339960,0migration/324105-21sh11:10:223
339960,0migration/32259-21sh11:36:093
339960,0migration/317027-21sh12:43:233
29805060,0irq/28-eth0-rx-9143-21grep10:04:363
29805060,0irq/28-eth0-rx-32263-21ssh12:33:253
29805060,0irq/28-eth0-rx-19341-21entropy11:29:323
29805060,0irq/28-eth0-rx-19244-21iostat_ios07:44:353
29805060,0irq/28-eth0-rx-13837-21df10:29:303
29805060,0irq/28-eth0-rx-12071-21diskstats10:09:313
285299966,0cyclictest7511-21diskmemload10:12:342
285299960,0cyclictest0-21swapper/209:04:182
285279965,0cyclictest17064-21cut12:24:350
285279963,0cyclictest0-21swapper/008:34:170
8305050,0irq/26-0000:00:15902-21munin-run09:34:172
8305050,0irq/26-0000:00:0-21swapper/211:04:182
339950,0migration/39305-21kthreadcore11:39:363
339950,0migration/38469-21if_eth112:19:353
339950,0migration/35023-21kthreadcore12:54:363
339950,0migration/33892-21latency_hist09:04:173
339950,0migration/332515-21aten_r1power_fr07:54:293
339950,0migration/332236-21munin-node12:49:383
339950,0migration/332183-21taskset08:37:023
339950,0migration/330559-21kthreadcore07:29:353
339950,0migration/330289-21munin-node10:19:343
339950,0migration/328691-21taskset08:56:493
339950,0migration/328405-21sh11:52:423
339950,0migration/326191-21kthreadcore10:34:363
339950,0migration/324393-21munin-node09:14:383
339950,0migration/322196-21taskset10:50:163
339950,0migration/321085-21gltestperf10:14:323
339950,0migration/319120-21fschecks_time09:54:313
339950,0migration/318862-21kthreadcore12:24:363
339950,0migration/317546-21latency_hist12:44:183
339950,0migration/317032-21latency09:09:353
339950,0migration/316697-21sendmail_mailst11:24:413
339950,0migration/316138-21kthreadcore08:24:363
339950,0migration/315028-21munin-node12:04:333
339950,0migration/312611-21kthreadcore11:04:353
329950,0watchdog/329791-21kthreadcore09:19:363
329950,0watchdog/329262-21df_abs08:14:323
329950,0watchdog/328071-21kthreadcore07:49:363
329950,0watchdog/325762-21kthreadcore08:09:363
329950,0watchdog/310246-21python09:04:443
29815050,0irq/29-eth0-tx-3612-21munin-node07:34:320
29815050,0irq/29-eth0-tx-30521-21kthreadcore10:19:352
29815050,0irq/29-eth0-tx-29145-21munin-node08:59:420
29815050,0irq/29-eth0-tx-21108-21gltestperf10:14:322
29815050,0irq/29-eth0-tx-20139-21cut11:09:362
29815050,0irq/29-eth0-tx-0-21swapper/212:59:092
29815050,0irq/29-eth0-tx-0-21swapper/211:58:232
29815050,0irq/29-eth0-tx-0-21swapper/211:39:562
29815050,0irq/29-eth0-tx-0-21swapper/211:35:182
29815050,0irq/29-eth0-tx-0-21swapper/210:46:272
29815050,0irq/29-eth0-tx-0-21swapper/210:37:512
29815050,0irq/29-eth0-tx-0-21swapper/008:54:290
29815050,0irq/29-eth0-tx-0-21swapper/008:46:570
29815050,0irq/29-eth0-tx-0-21swapper/008:19:410
29815050,0irq/29-eth0-tx-0-21swapper/008:04:290
29815050,0irq/29-eth0-tx-0-21swapper/007:59:300
29815050,0irq/29-eth0-tx-0-21swapper/007:54:340
29805050,0irq/28-eth0-rx-5238-21cut08:19:363
29805050,0irq/28-eth0-rx-5133-21kthreadcore09:24:373
29805050,0irq/28-eth0-rx-3763-21kthreadcore09:44:353
29805050,0irq/28-eth0-rx-3403-21cut10:39:373
29805050,0irq/28-eth0-rx-18293-21munin-node08:29:283
29805050,0irq/28-eth0-rx-14804-21ssh09:31:143
29805050,0irq/28-eth0-rx-0-21swapper/312:37:523
29805050,0irq/28-eth0-rx-0-21swapper/311:59:453
29805050,0irq/28-eth0-rx-0-21swapper/311:54:283
29805050,0irq/28-eth0-rx-0-21swapper/311:44:313
29805050,0irq/28-eth0-rx-0-21swapper/311:14:433
29805050,0irq/28-eth0-rx-0-21swapper/310:57:523
29805050,0irq/28-eth0-rx-0-21swapper/310:44:363
29805050,0irq/28-eth0-rx-0-21swapper/310:24:453
29805050,0irq/28-eth0-rx-0-21swapper/309:59:293
29805050,0irq/28-eth0-rx-0-21swapper/308:54:173
285299955,0cyclictest0-21swapper/211:52:502
285299950,0cyclictest0-21swapper/212:49:262
285299950,0cyclictest0-21swapper/212:44:232
285299950,0cyclictest0-21swapper/212:41:522
285299950,0cyclictest0-21swapper/209:46:522
285289955,0cyclictest0-21swapper/112:42:081
285289955,0cyclictest0-21swapper/110:29:231
285289950,0cyclictest0-21swapper/112:44:391
285289950,0cyclictest0-21swapper/112:11:231
285289950,0cyclictest0-21swapper/111:27:521
285289950,0cyclictest0-21swapper/110:38:131
285279955,0cyclictest0-21swapper/011:16:290
285279955,0cyclictest0-21swapper/010:06:190
285279950,0cyclictest0-21swapper/012:35:000
285279950,0cyclictest0-21swapper/012:05:310
285279950,0cyclictest0-21swapper/011:55:350
285279950,0cyclictest0-21swapper/011:19:190
259950,0migration/230402-21munin-node12:29:382
259950,0migration/229289-21fschecks_count07:29:312
259950,0migration/227199-21kthreadcore08:54:342
259950,0migration/225492-21sh09:55:592
259950,0migration/220378-21missed_timers08:04:372
259950,0migration/21894-21kthreadcore12:14:352
259950,0migration/215210-21latency_hist10:49:182
249950,0watchdog/24969-21aten_r1power_fr10:24:292
249950,0watchdog/22550-21perl11:19:332
179950,0migration/18402-21kthreadcore10:04:351
179950,0migration/13607-21kthreadcore09:44:351
179950,0migration/129403-21munin-node11:54:301
179950,0migration/122626-21gltestperf08:09:321
179950,0migration/121543-21munin-node10:49:401
179950,0migration/113190-21latency12:19:381
179950,0migration/112964-21kthreadcore11:04:351
179950,0migration/11078-21if_eth010:59:331
169950,0watchdog/10-21swapper/107:39:321
149950,0migration/0970-21idleruntime10:59:330
149950,0migration/028479-21kthreadcore07:49:360
149950,0migration/025051-21kthreadcore12:09:350
149950,0migration/012714-21sh10:27:480
149950,0migration/012061-21fschecks_time09:09:310
149950,0migration/011762-21munin-node11:59:400
8305040,0irq/26-0000:00:0-21swapper/211:14:182
339940,0migration/33283-21kthreadcore08:39:343
339940,0migration/326543-21kthreadcore12:09:363
339940,0migration/32346-21kthreadcore10:59:353
339940,0migration/310261-21taskset07:35:233
329940,0watchdog/30-21swapper/309:34:403
329940,0watchdog/30-21swapper/307:39:323
29815040,0irq/29-eth0-tx-7814-21ssh11:02:372
29815040,0irq/29-eth0-tx-384-21ssh09:59:372
29815040,0irq/29-eth0-tx-24881-21ssh09:39:282
29815040,0irq/29-eth0-tx-19815-21sendmail_mailtr10:29:402
29815040,0irq/29-eth0-tx-16861-21ssh12:24:332
29815040,0irq/29-eth0-tx-0-21swapper/212:09:252
29815040,0irq/29-eth0-tx-0-21swapper/211:44:502
29815040,0irq/29-eth0-tx-0-21swapper/210:54:402
29815040,0irq/29-eth0-tx-0-21swapper/210:39:322
29815040,0irq/29-eth0-tx-0-21swapper/210:05:392
29815040,0irq/29-eth0-tx-0-21swapper/209:34:262
29815040,0irq/29-eth0-tx-0-21swapper/008:34:310
29805040,0irq/28-eth0-rx-0-21swapper/312:14:193
29805040,0irq/28-eth0-rx-0-21swapper/311:19:223
29805040,0irq/28-eth0-rx-0-21swapper/309:50:253
29805040,0irq/28-eth0-rx-0-21swapper/309:40:043
29805040,0irq/28-eth0-rx-0-21swapper/308:04:363
29805040,0irq/28-eth0-rx-0-21swapper/307:59:323
285299943,0cyclictest8559-21awk08:44:322
285299943,0cyclictest3571-21lldpd09:18:452
285299943,0cyclictest26299-21awk07:49:342
285299943,0cyclictest12274-21awk09:09:322
285299943,0cyclictest11520-21awk11:24:342
285299940,0cyclictest9849-21munin-node09:49:332
285289944,0cyclictest0-21swapper/111:35:451
285289944,0cyclictest0-21swapper/110:03:411
285289943,0cyclictest6618-21awk11:59:351
285289943,0cyclictest4980-21awk08:19:351
285289943,0cyclictest3524-21snmpd12:28:401
285289943,0cyclictest3524-21snmpd11:47:091
285289943,0cyclictest3524-21snmpd11:19:391
285289943,0cyclictest3524-21snmpd11:15:241
285289943,0cyclictest3524-21snmpd10:24:381
285289943,0cyclictest3524-21snmpd10:16:381
285289943,0cyclictest31766-21awk10:39:351
285289943,0cyclictest29865-21awk10:19:331
285289943,0cyclictest27238-21awk12:49:341
285289943,0cyclictest26568-21awk08:34:331
285289943,0cyclictest15723-21awk08:04:341
285289943,0cyclictest12328-21awk09:09:321
285279944,0cyclictest0-21swapper/011:07:580
285279944,0cyclictest0-21swapper/010:51:440
285279943,0cyclictest3571-21lldpd12:50:470
285279943,0cyclictest3571-21lldpd09:08:440
285279943,0cyclictest3571-21lldpd08:27:140
285279943,0cyclictest3524-21snmpd12:29:400
285279943,0cyclictest3524-21snmpd10:44:230
285279943,0cyclictest3524-21snmpd08:50:370
285279943,0cyclictest3380-21awk12:54:340
285279943,0cyclictest3250-21irqbalance11:13:040
285279943,0cyclictest3250-21irqbalance09:44:440
285279943,0cyclictest26127-21wc10:14:380
285279940,0cyclictest7768-21munin-node09:29:310
259940,0migration/2629-21cpuspeed_turbos12:34:322
259940,0migration/24302-21fschecks_count08:19:332
259940,0migration/232295-21kthreadcore08:59:352
259940,0migration/227965-21kthreadcore09:19:362
259940,0migration/227838-21kthreadcore08:34:352
259940,0migration/224019-21kthreadcore08:09:362
259940,0migration/220730-21ntp_kernel_pll_08:49:382
259940,0migration/219704-21irqrtprio08:29:342
249940,0watchdog/229261-21df_abs08:14:322
249940,0watchdog/22695-21kthreadcore09:24:362
249940,0watchdog/219398-21kthreadcore12:04:372
249940,0watchdog/211493-21fschecks_time07:39:322
249940,0watchdog/20-21swapper/212:19:332
249940,0watchdog/20-21swapper/211:59:372
249940,0watchdog/20-21swapper/211:29:372
179940,0migration/16222-21needreboot08:39:361
179940,0migration/16033-21kthreadcore09:24:371
179940,0migration/13459-21if_eth012:54:341
179940,0migration/129289-21aten_r1power_vo08:59:291
179940,0migration/126071-21kthreadcore12:29:361
179940,0migration/125750-21gltestperf09:39:311
179940,0migration/125310-21taskset09:18:481
179940,0migration/122283-21df_abs08:54:281
179940,0migration/122107-21kthreadcore11:29:361
179940,0migration/121443-21kthreadcore08:29:351
179940,0migration/118122-21kthreadcore08:49:361
179940,0migration/117191-21idleruntime09:34:311
179940,0migration/113888-21kthreadcore08:24:351
179940,0migration/111386-21kthreadcore08:44:351
169940,0watchdog/16314-21runrttasks10:57:131
169940,0watchdog/16314-21runrttasks07:54:521
169940,0watchdog/15618-21ssh12:15:091
169940,0watchdog/14046-21grep12:34:371
169940,0watchdog/129790-21kthreadcore09:19:361
169940,0watchdog/121019-21grep07:44:361
169940,0watchdog/112667-21idleruntime10:09:331
169940,0watchdog/10-21swapper/112:04:371
169940,0watchdog/10-21swapper/111:52:531
169940,0watchdog/10-21swapper/108:14:321
169940,0watchdog/10-21swapper/107:49:361
149940,0migration/05642-21kthreadcore09:24:370
149940,0migration/04668-21diskmemload12:14:360
149940,0migration/04412-21fschecks_time11:39:310
149940,0migration/032133-21runrttasks09:41:120
149940,0migration/029513-21kthreadcore09:19:360
149940,0migration/029445-21fschecks_time10:19:310
149940,0migration/026340-21kthreadcore10:34:360
149940,0migration/024414-21kthreadcore08:09:360
149940,0migration/022355-21kthreadcore11:29:360
149940,0migration/021499-21kthreadcore12:44:370
149940,0migration/019755-21sh11:47:180
149940,0migration/019054-21kthreadcore09:34:350
149940,0migration/017072-21sh12:43:320
149940,0migration/016419-21kthreadcore10:09:360
149940,0migration/015846-21diskmemload09:49:370
149940,0migration/01428-21kthreadcore08:14:380
149940,0migration/010666-21cpuspeed_turbos11:24:310
149940,0migration/01017-21fschecks_time08:39:310
4130,0ktimersoftd/021510-21runrttasks10:33:350
29805030,0irq/28-eth0-rx-0-21swapper/308:46:423
285299932,0cyclictest565-21grep07:54:312
285299932,0cyclictest3524-21snmpd08:39:222
285299932,0cyclictest3524-21snmpd08:01:482
285299932,0cyclictest3514-21ls07:34:172
285289932,0cyclictest4968-21expr09:04:341
285289932,0cyclictest4726-21awk07:34:341
285289932,0cyclictest3524-21snmpd11:39:391
285289932,0cyclictest14267-21cut09:49:361
285289932,0cyclictest11358-21cut09:29:351
285289930,0cyclictest8087-21perl07:59:291
285289930,0cyclictest6660-21date10:44:181
285289930,0cyclictest30840-21tr07:29:351
285279933,0cyclictest0-21swapper/007:39:350
285279932,0cyclictest3571-21lldpd10:01:140
285279932,0cyclictest3524-21snmpd10:41:080
285279932,0cyclictest3250-21irqbalance10:54:340
285279932,0cyclictest22869-21sh11:49:340
285279932,0cyclictest22742-21grep09:54:360
285279930,0cyclictest8549-21iostat_ios12:19:360
285279930,0cyclictest29167-21diskstats07:29:300
285279930,0cyclictest21433-21cat09:14:350
249930,0watchdog/212044-21hwlatdetect08:24:322
249930,0watchdog/20-21swapper/207:44:402
179930,0migration/125375-21sh09:55:371
169930,0watchdog/10-21swapper/111:11:571
149930,0migration/024637-21runrttasks07:45:250
285279920,0cyclictest0-21swapper/011:34:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional