You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-22 - 07:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Tue Sep 22, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1860423928,0sleep00-21swapper/019:31:540
1859423728,0sleep30-21swapper/319:31:493
1865323525,0sleep10-21swapper/119:32:271
1844723525,0sleep20-21swapper/219:30:032
339970,0migration/35385-21munin-node20:53:353
339970,0migration/329103-21sh00:19:123
339960,0migration/39360-21sh23:32:133
339960,0migration/36737-21sh00:28:093
339960,0migration/34714-21sh22:49:283
339960,0migration/328372-21sh22:44:063
339960,0migration/327111-21aten_r1power_cu23:43:343
329960,0watchdog/36314-21runrttasks23:18:213
329960,0watchdog/317065-21sh22:01:563
29805060,0irq/28-eth0-rx-25723-21sed21:48:383
29805060,0irq/28-eth0-rx-0-21swapper/322:55:293
29805060,0irq/28-eth0-rx-0-21swapper/322:13:423
188079960,0cyclictest0-21swapper/220:28:542
188039965,0cyclictest0-21swapper/122:13:391
188029965,0cyclictest30183-21diskmemload23:53:170
149960,0migration/08918-21kthreadcore22:53:430
149960,0migration/011122-21kthreadcore20:33:380
339950,0migration/37659-21kthreadcore00:08:393
339950,0migration/36683-21sh23:09:463
339950,0migration/35749-21kthreadcore00:43:413
339950,0migration/331576-21sh00:40:383
339950,0migration/331012-21kthreadcore21:08:403
339950,0migration/330373-21munin-node00:03:373
339950,0migration/329229-21sh22:28:353
339950,0migration/328940-21munin-node20:43:413
339950,0migration/328593-21kthreadcore22:08:393
339950,0migration/326041-21fschecks_time23:23:343
339950,0migration/325582-21sh22:06:453
339950,0migration/323458-21kthreadcore19:33:413
339950,0migration/321621-21kthreadcore23:18:413
339950,0migration/321315-21kthreadcore21:03:393
339950,0migration/312856-21hddtemp_smartct23:53:373
339950,0migration/312264-21latency_hist20:58:213
339950,0migration/31114-21latency_hist20:28:213
329950,0watchdog/35245-21fschecks_time22:33:363
329950,0watchdog/332295-21missed_timers20:23:443
329950,0watchdog/3298050irq/28-eth0-rx-00:37:413
329950,0watchdog/329184-21nfs_client21:28:403
329950,0watchdog/321327-21kthreadcore20:38:403
329950,0watchdog/30-21swapper/321:23:363
329950,0watchdog/30-21swapper/319:58:403
29815050,0irq/29-eth0-tx-7632-21ssh23:12:322
29815050,0irq/29-eth0-tx-6663-21munin-node21:38:372
29815050,0irq/29-eth0-tx-3524-21snmpd21:28:500
29815050,0irq/29-eth0-tx-30830-21kthreadcore22:28:392
29815050,0irq/29-eth0-tx-28768-21kthreadcore23:23:382
29815050,0irq/29-eth0-tx-20102-21ssh22:39:552
29815050,0irq/29-eth0-tx-0-21swapper/223:50:032
29815050,0irq/29-eth0-tx-0-21swapper/222:25:192
29815050,0irq/29-eth0-tx-0-21swapper/200:43:382
29815050,0irq/29-eth0-tx-0-21swapper/200:33:262
29805050,0irq/28-eth0-rx-6314-21runrttasks00:28:323
29805050,0irq/28-eth0-rx-5645-40yum-updatesd-he21:36:293
29805050,0irq/28-eth0-rx-4270-21kthreadcore21:53:443
29805050,0irq/28-eth0-rx-18100-21fschecks_count00:53:383
29805050,0irq/28-eth0-rx-14916-21munin-node00:13:403
29805050,0irq/28-eth0-rx-1173-21ssh01:00:513
29805050,0irq/28-eth0-rx-0-21swapper/323:48:343
29805050,0irq/28-eth0-rx-0-21swapper/323:39:053
29805050,0irq/28-eth0-rx-0-21swapper/323:33:353
29805050,0irq/28-eth0-rx-0-21swapper/323:03:333
29805050,0irq/28-eth0-rx-0-21swapper/322:23:383
29805050,0irq/28-eth0-rx-0-21swapper/322:21:103
29805050,0irq/28-eth0-rx-0-21swapper/321:43:403
27150,0ktimersoftd/20-21swapper/200:24:362
259950,0migration/25840-21kthreadcore21:53:442
259950,0migration/23321-21kthreadcore19:43:372
259950,0migration/222349-21kthreadcore22:03:392
249950,0watchdog/20-21swapper/200:58:412
22485250,0sleep20-21swapper/223:01:312
188079955,0cyclictest0-21swapper/222:21:372
188079955,0cyclictest0-21swapper/222:09:482
188079953,0cyclictest3571-21lldpd20:35:462
188079950,0cyclictest0-21swapper/222:15:282
188079950,0cyclictest0-21swapper/200:04:342
188039955,0cyclictest0-21swapper/123:49:501
188029950,0cyclictest0-21swapper/021:46:220
179950,0migration/15756-21ntp_offset23:08:431
179950,0migration/13639-21sh00:04:441
179950,0migration/13008-21latency_hist23:48:221
179950,0migration/123035-21kthreadcore22:23:401
179950,0migration/120820-21kthreadcore21:43:401
179950,0migration/117199-21kthreadcore20:58:401
179950,0migration/114767-21taskset21:42:291
179950,0migration/114502-21rt-features19:48:431
179950,0migration/110183-21gltestperf21:58:341
179950,0migration/110143-21kthreadcore20:53:401
169950,0watchdog/1693-21kthreadcore00:23:411
169950,0watchdog/118831-21iostat_ios00:53:411
149950,0migration/05006-21latency_hist20:53:220
149950,0migration/04208-21kthreadcore00:23:420
149950,0migration/04151-21munin-node22:13:380
149950,0migration/031324-21sh23:23:400
149950,0migration/029068-21kthreadcore00:58:400
149950,0migration/027800-21kthreadcore23:03:400
149950,0migration/027387-21hddtemp_smartct20:23:390
149950,0migration/026168-21latency_hist22:08:210
149950,0migration/023029-21kthreadcore19:33:410
149950,0migration/022119-21kthreadcore23:58:390
149950,0migration/021571-21kthreadcore21:03:390
149950,0migration/018870-21kthreadcore19:53:400
149950,0migration/016580-21kthreadcore20:58:400
149950,0migration/015001-21kthreadcore20:13:370
339940,0migration/34983-21kthreadcore19:43:383
339940,0migration/33508-21kthreadcore21:13:383
339940,0migration/32504-21kthreadcore20:48:393
339940,0migration/322917-21kthreadcore23:58:393
339940,0migration/322651-21kthreadcore20:18:373
339940,0migration/322651-21kthreadcore20:18:373
339940,0migration/312602-21kthreadcore20:33:393
329940,0watchdog/30-21swapper/321:18:403
329940,0watchdog/30-21swapper/320:08:323
329940,0watchdog/30-21swapper/319:53:403
329940,0watchdog/30-21swapper/319:48:403
329940,0watchdog/30-21swapper/300:48:413
29815040,0irq/29-eth0-tx-8143-21ssh23:13:222
29815040,0irq/29-eth0-tx-4966-21telnet20:08:330
29815040,0irq/29-eth0-tx-30049-21ssh22:48:262
29815040,0irq/29-eth0-tx-26237-21munin-node19:38:400
29815040,0irq/29-eth0-tx-20187-21grep00:53:422
29815040,0irq/29-eth0-tx-16692-21ssh23:18:312
29815040,0irq/29-eth0-tx-0-21swapper/223:59:222
29815040,0irq/29-eth0-tx-0-21swapper/223:43:232
29815040,0irq/29-eth0-tx-0-21swapper/223:33:472
29815040,0irq/29-eth0-tx-0-21swapper/223:03:402
29815040,0irq/29-eth0-tx-0-21swapper/200:29:092
29815040,0irq/29-eth0-tx-0-21swapper/200:18:242
29815040,0irq/29-eth0-tx-0-21swapper/200:13:322
29815040,0irq/29-eth0-tx-0-21swapper/200:08:342
29815040,0irq/29-eth0-tx-0-21swapper/021:33:270
29815040,0irq/29-eth0-tx-0-21swapper/020:43:380
29815040,0irq/29-eth0-tx-0-21swapper/020:18:350
29815040,0irq/29-eth0-tx-0-21swapper/020:18:350
29805040,0irq/28-eth0-rx-0-21swapper/322:58:393
29805040,0irq/28-eth0-rx-0-21swapper/322:38:273
29805040,0irq/28-eth0-rx-0-21swapper/321:38:313
259940,0migration/29136-21aten_r1power_po00:48:352
259940,0migration/28346-21runrttasks21:16:042
259940,0migration/26788-21munin-node22:53:382
259940,0migration/26238-21kthreadcore23:28:432
259940,0migration/228669-21kthreadcore19:38:382
259940,0migration/22469-21kthreadcore21:33:412
259940,0migration/224222-21aten_r1power_po21:48:322
259940,0migration/222017-21kthreadcore19:33:402
259940,0migration/210181-21gltestperf21:58:342
249940,0watchdog/225084-21perl00:38:372
249940,0watchdog/221292-21latency21:43:402
249940,0watchdog/217556-21kthreadcore21:23:402
188079944,0cyclictest0-21swapper/223:53:322
188079943,0cyclictest6131-21awk20:53:382
188079943,0cyclictest3571-21lldpd21:32:492
188079943,0cyclictest3571-21lldpd20:21:162
188079943,0cyclictest3571-21lldpd20:21:162
188079943,0cyclictest3571-21lldpd20:13:452
188079943,0cyclictest3524-21snmpd19:53:342
188079943,0cyclictest3250-21irqbalance22:33:382
188079943,0cyclictest3250-21irqbalance20:08:272
188079943,0cyclictest3250-21irqbalance20:06:072
188079943,0cyclictest3250-21irqbalance19:58:272
188079943,0cyclictest3250-21irqbalance19:48:472
188079943,0cyclictest27813-21awk21:08:382
188079943,0cyclictest24008-21awk20:43:372
188079943,0cyclictest22624-21awk22:43:352
188079943,0cyclictest20615-21awk21:03:372
188079943,0cyclictest19633-21awk23:38:382
188079943,0cyclictest16864-21awk20:38:382
188079943,0cyclictest13317-21awk20:58:372
188039944,0cyclictest31690-21kthreadcore22:48:391
188039943,0cyclictest3571-21lldpd23:24:191
188039943,0cyclictest3571-21lldpd22:34:181
188039943,0cyclictest3571-21lldpd00:20:501
188039943,0cyclictest31486-21awk21:33:381
188039943,0cyclictest27741-21awk21:08:371
188039943,0cyclictest27218-21awk00:58:381
188039943,0cyclictest2490-21awk23:28:401
188039943,0cyclictest12288-21awk22:18:381
188029944,0cyclictest0-21swapper/022:35:050
188029943,0cyclictest7826-21awk21:38:370
188029943,0cyclictest3524-21snmpd20:02:490
188029943,0cyclictest3524-21snmpd19:49:340
188029943,0cyclictest3524-21snmpd00:48:370
188029943,0cyclictest3250-21irqbalance23:43:280
188029943,0cyclictest3250-21irqbalance23:28:380
188029943,0cyclictest3250-21irqbalance22:38:280
188029943,0cyclictest3250-21irqbalance22:02:180
188029943,0cyclictest3250-21irqbalance21:24:480
188029943,0cyclictest3250-21irqbalance21:18:380
188029943,0cyclictest3250-21irqbalance21:08:270
188029943,0cyclictest3250-21irqbalance20:38:270
188029943,0cyclictest3250-21irqbalance20:28:270
188029943,0cyclictest3250-21irqbalance19:43:270
188029943,0cyclictest3250-21irqbalance00:53:380
188029943,0cyclictest3250-21irqbalance00:18:580
188029943,0cyclictest3250-21irqbalance00:03:480
188029943,0cyclictest31267-21awk20:48:370
188029943,0cyclictest30996-21awk20:03:370
188029943,0cyclictest25291-21awk21:48:360
188029943,0cyclictest19667-21awk23:38:380
188029943,0cyclictest16807-21awk00:33:400
188029943,0cyclictest15952-21awk22:58:370
188029943,0cyclictest12927-21awk23:53:380
179940,0migration/18958-21turbostat.cron21:58:161
179940,0migration/129654-21irqcore22:28:381
179940,0migration/12673-21kthreadcore00:43:401
179940,0migration/126508-21cpuspeed_turbos19:38:331
179940,0migration/126392-21kthreadcore21:48:381
179940,0migration/125602-21runrttasks19:33:491
179940,0migration/122020-21kthreadcore21:03:391
179940,0migration/118182-21kthreadcore19:53:401
179940,0migration/115119-21cpuspeed_turbos22:58:341
179940,0migration/114487-21fschecks_time00:13:371
179940,0migration/11313-21aten_r1power_po20:28:341
179940,0migration/113093-21aten_r1power_en22:38:341
179940,0migration/111157-21kthreadcore20:33:381
179940,0migration/110360-21kthreadcore22:53:431
169940,0watchdog/17186-21sh00:28:331
169940,0watchdog/128665-21ssh00:03:211
169940,0watchdog/126587-21cut19:58:401
169940,0watchdog/125477-21switchtime20:18:441
169940,0watchdog/125477-21switchtime20:18:441
169940,0watchdog/119370-21ssh23:56:051
169940,0watchdog/117823-21ssh22:03:281
169940,0watchdog/116771-21tune2fs21:23:361
169940,0watchdog/113422-21kthreadcore21:18:401
169940,0watchdog/10-21swapper/122:43:321
169940,0watchdog/10-21swapper/120:23:441
169940,0watchdog/10-21swapper/100:48:411
149940,0migration/07762-21fschecks_time00:28:350
149940,0migration/05527-21kthreadcore00:43:410
149940,0migration/0353-21runrttasks21:53:270
149940,0migration/032570-21fschecks_count23:08:360
149940,0migration/030011-21latency_hist22:48:210
149940,0migration/029267-21idleruntime22:28:360
149940,0migration/028413-21kthreadcore00:38:410
149940,0migration/02773-21irqcore21:13:370
149940,0migration/024284-21kthreadcore22:43:380
149940,0migration/023205-21timerwakeupswit23:18:480
149940,0migration/020864-21if_eth022:23:380
149940,0migration/017076-21latency22:18:410
149940,0migration/015885-21taskset23:16:460
149940,0migration/014092-21df_abs00:13:360
149940,0migration/011874-21kthreadcore23:33:380
8305030,0irq/26-0000:00:0-21swapper/319:38:263
329930,0watchdog/30-21swapper/320:03:403
29805030,0irq/28-eth0-rx-0-21swapper/320:17:373
259930,0migration/210005-21irqcore21:18:392
249930,0watchdog/20-21swapper/220:23:442
188079932,0cyclictest31228-21awk20:48:372
188039933,0cyclictest2092-21awk19:43:351
188039932,0cyclictest31243-21awk20:48:371
188039932,0cyclictest29362-21memory23:03:411
188039932,0cyclictest27614-21awk22:08:381
188039932,0cyclictest24164-21irqcore20:43:381
188039932,0cyclictest19682-21awk23:38:381
188039932,0cyclictest17138-21diskstats23:18:361
188039930,0cyclictest25062-21tune2fs00:38:371
188039930,0cyclictest10757-21perl23:33:351
188029930,0cyclictest5610-21diskstats00:08:350
188029930,0cyclictest27129-21perl22:08:350
179930,0migration/115527-21latency_hist00:33:221
169930,0watchdog/14816-21basename20:08:321
169930,0watchdog/114896-21ssh23:13:531
169930,0watchdog/10-21swapper/121:28:401
169930,0watchdog/10-21swapper/120:38:401
169930,0watchdog/10-21swapper/100:08:331
188039921,0cyclictest29865-21latency_hist20:03:211
188039921,0cyclictest11783-21latency_hist20:13:211
188039920,0cyclictest0-21swapper/121:13:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional