You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-12 - 11:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Thu Mar 12, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
66627372,0sleep20-21swapper/219:12:352
735823526,0sleep30-21swapper/319:13:083
767023423,0sleep00-21swapper/019:16:500
756323324,0sleep10-21swapper/119:15:351
77949970,0cyclictest4874-21munin-node22:57:441
77939976,0cyclictest13065-21tr22:27:420
77949960,0cyclictest0-21swapper/100:32:291
77939966,0cyclictest0-21swapper/021:38:190
77939960,0cyclictest0-21swapper/022:34:550
339960,0migration/329411-21irqrtprio21:22:423
339960,0migration/322907-21sh23:07:563
329960,0watchdog/322873-21munin-node19:27:353
29805060,0irq/28-eth0-rx-23465-21grep19:47:413
149960,0migration/027014-21kthreadcore20:12:420
149960,0migration/012505-21fschecks_time19:42:360
8305050,0irq/26-0000:00:3222-17sedispatch00:17:252
8305050,0irq/26-0000:00:25861-21if_eth1.300:27:402
8305050,0irq/26-0000:00:15295-21latency_hist20:07:242
77959955,0cyclictest0-21swapper/223:02:402
77949955,0cyclictest0-21swapper/123:17:081
77949955,0cyclictest0-21swapper/100:30:361
77949950,0cyclictest0-21swapper/123:50:141
77949950,0cyclictest0-21swapper/123:42:591
77949950,0cyclictest0-21swapper/123:24:421
77949950,0cyclictest0-21swapper/122:45:451
77949950,0cyclictest0-21swapper/100:11:121
77939955,0cyclictest17777-21kworker/0:123:08:560
77939955,0cyclictest17777-21kworker/0:121:47:480
77939955,0cyclictest17777-21kworker/0:121:42:260
77939955,0cyclictest17777-21kworker/0:100:29:430
77939955,0cyclictest17777-21kworker/0:100:07:210
77939955,0cyclictest0-21swapper/023:28:500
77939954,0cyclictest17777-21kworker/0:122:07:420
77939950,0cyclictest0-21swapper/023:45:140
4150,0ktimersoftd/00-21swapper/021:29:290
35150,0ktimersoftd/30-21swapper/321:57:163
339950,0migration/37368-21munin-node21:47:373
339950,0migration/37210-21munin-node23:17:443
339950,0migration/33761-21kthreadcore22:57:433
339950,0migration/33629-21kthreadcore20:42:413
339950,0migration/330217-21munin-node20:17:383
339950,0migration/329972-21kthreadcore20:37:413
339950,0migration/329517-21cpuspeed_turbos23:52:393
339950,0migration/32601-21kthreadcore00:12:423
339950,0migration/32381-21kthreadcore21:42:413
339950,0migration/322941-21kthreadcore21:17:423
339950,0migration/320346-21latency_hist22:32:253
339950,0migration/319749-21sh22:31:193
339950,0migration/319399-21munin-node20:32:373
339950,0migration/319212-21kthreadcore00:22:443
339950,0migration/319184-21gltestperf22:12:383
339950,0migration/317386-21kthreadcore19:42:413
339950,0migration/312307-21kthreadcore00:37:423
339950,0migration/310642-21munin-node19:37:453
329950,0watchdog/38742-21cpuspeed_turbos20:47:363
329950,0watchdog/346012sleep321:06:123
329950,0watchdog/320673-21aten_r1power_en23:47:363
329950,0watchdog/31450-21ssh22:18:443
329950,0watchdog/314022-21ssh00:02:283
329950,0watchdog/31301-21munin-node00:32:403
329950,0watchdog/312994-21wc23:42:403
329950,0watchdog/310604-21munin-node22:07:403
329950,0watchdog/30-21swapper/300:00:043
29815050,0irq/29-eth0-tx-7030-21nfs_client22:02:472
29815050,0irq/29-eth0-tx-29040-21munin-node22:37:502
29815050,0irq/29-eth0-tx-27026-21munin-node23:32:502
29815050,0irq/29-eth0-tx-27026-21munin-node23:32:502
29815050,0irq/29-eth0-tx-26667-21ntpdc23:47:452
29815050,0irq/29-eth0-tx-25858-21ssh23:29:562
29815050,0irq/29-eth0-tx-20328-21sendmail_mailqu00:02:462
29815050,0irq/29-eth0-tx-19222-21diskmemload21:51:242
29815050,0irq/29-eth0-tx-18839-21tune2fs00:42:392
29815050,0irq/29-eth0-tx-16608-21cat22:47:432
29815050,0irq/29-eth0-tx-16156-21munin-node23:07:402
29815050,0irq/29-eth0-tx-13464-21munin-node21:32:372
29815050,0irq/29-eth0-tx-0-21swapper/223:14:322
29815050,0irq/29-eth0-tx-0-21swapper/200:19:232
29815050,0irq/29-eth0-tx-0-21swapper/020:22:460
29815050,0irq/29-eth0-tx-0-21swapper/019:52:370
29805050,0irq/28-eth0-rx-5122-21cpu21:07:353
29805050,0irq/28-eth0-rx-4492-21ssh21:27:343
29805050,0irq/28-eth0-rx-31666-21ssh23:13:143
29805050,0irq/28-eth0-rx-24742-21python23:27:473
29805050,0irq/28-eth0-rx-23836-21sh22:52:413
29805050,0irq/28-eth0-rx-15477-21kthreadcore23:22:443
29805050,0irq/28-eth0-rx-0-21swapper/323:37:363
29805050,0irq/28-eth0-rx-0-21swapper/323:32:273
29805050,0irq/28-eth0-rx-0-21swapper/323:32:273
29805050,0irq/28-eth0-rx-0-21swapper/321:57:443
29805050,0irq/28-eth0-rx-0-21swapper/321:32:423
29805050,0irq/28-eth0-rx-0-21swapper/300:18:553
259950,0migration/26547-21munin-node22:42:402
259950,0migration/26496-21kthreadcore20:42:422
259950,0migration/232624-21sh22:01:332
259950,0migration/229320-21sh22:52:552
259950,0migration/224128-21kthreadcore19:27:392
259950,0migration/223242-21sh21:54:232
259950,0migration/220069-21fschecks_count21:17:372
259950,0migration/218568-21taskset22:28:022
259950,0migration/212472-21kthreadcore00:37:422
259950,0migration/210669-21missed_timers20:22:462
259950,0migration/210656-21munin-node21:27:442
249950,0watchdog/28740-21tr20:47:362
249950,0watchdog/219603-21grep20:07:432
249950,0watchdog/212995-21grep23:42:402
179950,0migration/19646-21timerandwakeup22:22:501
179950,0migration/17981-21kthreadcore20:22:441
179950,0migration/16703-21kthreadcore23:37:421
179950,0migration/15521-21kthreadcore19:57:421
179950,0migration/14336-21sh23:55:071
179950,0migration/130994-21latency_hist22:57:251
179950,0migration/129188-21kthreadcore21:57:441
179950,0migration/12911-21kthreadcore21:42:421
179950,0migration/124375-21latency_hist21:57:251
179950,0migration/122378-21kthreadcore22:12:421
179950,0migration/120478-21timerandwakeup22:47:501
179950,0migration/120420-21gltestperf21:17:381
179950,0migration/119470-21cpuspeed_turbos20:32:371
179950,0migration/113571-21munin-node21:47:471
179950,0migration/113451-21kthreadcore19:42:391
179950,0migration/113394-21munin-node22:27:431
149950,0migration/09808-21timerandwakeup23:37:490
149950,0migration/08675-21kthreadcore22:42:430
149950,0migration/0734-21latency_hist00:32:250
149950,0migration/06326-21kthreadcore23:17:430
149950,0migration/06144-21kthreadcore22:02:460
149950,0migration/05893-21taskset22:58:390
149950,0migration/05760-21taskset00:13:080
149950,0migration/05245-21kthreadcore22:22:420
149950,0migration/04330-21taskset23:55:060
149950,0migration/028746-21kthreadcore23:32:420
149950,0migration/028746-21kthreadcore23:32:420
149950,0migration/02763-21kthreadcore19:57:420
149950,0migration/024996-21taskset00:43:060
149950,0migration/024358-21kthreadcore19:27:390
149950,0migration/022790-21kthreadcore22:12:420
149950,0migration/022766-21aten_r1power_vo22:52:370
149950,0migration/014647-21kthreadcore00:37:430
149950,0migration/013524-21sh00:01:410
149950,0migration/012004-21kthreadcore23:22:430
149950,0migration/010437-21kthreadcore20:47:400
77959943,0cyclictest4336-21sort23:37:392
77959943,0cyclictest3524-21snmpd20:59:292
77959943,0cyclictest3524-21snmpd20:27:292
77959943,0cyclictest3524-21snmpd20:18:442
77959943,0cyclictest3524-21snmpd20:14:292
77959943,0cyclictest3524-21snmpd19:42:582
77959943,0cyclictest27525-21awk20:37:392
77959943,0cyclictest21580-21awk22:32:412
77959943,0cyclictest2102-21awk23:17:402
77949943,0cyclictest8703-21awk23:02:391
77949943,0cyclictest6628-21awk23:57:411
77949943,0cyclictest3571-21lldpd21:37:351
77949943,0cyclictest3571-21lldpd20:59:341
77949943,0cyclictest3571-21lldpd20:27:341
77949943,0cyclictest3571-21lldpd20:12:341
77949943,0cyclictest3571-21lldpd00:12:381
77949943,0cyclictest19998-21awk19:47:381
77949943,0cyclictest16587-21awk20:07:421
77949941,0cyclictest0-21swapper/123:27:261
77939944,0cyclictest17777-21kworker/0:123:12:460
77939944,0cyclictest17777-21kworker/0:123:02:340
77939944,0cyclictest17777-21kworker/0:121:52:440
77939944,0cyclictest17777-21kworker/0:121:32:300
77939944,0cyclictest17777-21kworker/0:120:17:380
77939944,0cyclictest0-21swapper/000:23:420
77939944,0cyclictest0-21swapper/000:10:460
77939943,0cyclictest8694-21awk00:17:410
77939943,0cyclictest8200-21sadc20:47:240
77939943,0cyclictest3571-21lldpd21:04:050
77939943,0cyclictest3571-21lldpd19:33:040
77939943,0cyclictest3250-21irqbalance22:00:010
77939943,0cyclictest3250-21irqbalance19:37:510
77939943,0cyclictest3250-21irqbalance19:17:310
77939943,0cyclictest30092-21awk22:37:390
77939943,0cyclictest27868-21awk22:17:400
77939943,0cyclictest21773-21awk23:47:410
77939943,0cyclictest16287-21awk19:22:390
77939943,0cyclictest15058-21awk22:47:400
77939940,0cyclictest0-21swapper/021:02:240
77939940,0cyclictest0-21swapper/020:07:390
339940,0migration/39750-21kthreadcore19:17:413
339940,0migration/332552-21kthreadcore19:32:433
339940,0migration/330274-21kthreadcore19:52:433
339940,0migration/322198-21diskmemload21:37:283
339940,0migration/316816-21irqcore20:07:423
329940,0watchdog/315733-21aten_r1power_fr20:52:363
329940,0watchdog/30-21swapper/322:42:363
329940,0watchdog/30-21swapper/321:00:483
329940,0watchdog/30-21swapper/320:27:443
329940,0watchdog/30-21swapper/320:22:483
329940,0watchdog/30-21swapper/319:57:353
29815040,0irq/29-eth0-tx-29152-21ssh23:52:282
29815040,0irq/29-eth0-tx-24683-21grep21:37:422
29815040,0irq/29-eth0-tx-22641-21munin-node00:07:372
29815040,0irq/29-eth0-tx-0-21swapper/222:22:422
29815040,0irq/29-eth0-tx-0-21swapper/222:17:532
29815040,0irq/29-eth0-tx-0-21swapper/221:23:242
29815040,0irq/29-eth0-tx-0-21swapper/021:18:380
29815040,0irq/29-eth0-tx-0-21swapper/021:07:460
29815040,0irq/29-eth0-tx-0-21swapper/019:47:360
29805040,0irq/28-eth0-rx-8275-21aten2.4-expect20:02:353
29805040,0irq/28-eth0-rx-0-21swapper/323:02:413
29805040,0irq/28-eth0-rx-0-21swapper/322:47:373
29805040,0irq/28-eth0-rx-0-21swapper/322:38:293
29805040,0irq/28-eth0-rx-0-21swapper/322:25:523
29805040,0irq/28-eth0-rx-0-21swapper/322:02:383
29805040,0irq/28-eth0-rx-0-21swapper/300:44:513
29805040,0irq/28-eth0-rx-0-21swapper/300:29:293
29805040,0irq/28-eth0-rx-0-21swapper/300:08:083
259940,0migration/29715-21kthreadcore23:57:432
259940,0migration/26514-21kthreadcore19:37:412
259940,0migration/24311-21kthreadcore21:42:422
259940,0migration/23316-21kthreadcore21:02:412
259940,0migration/217168-21idleruntime00:22:412
259940,0migration/215902-21fschecks_time19:22:382
259940,0migration/214432-21kthreadcore21:12:422
259940,0migration/213531-21kthreadcore22:07:432
259940,0migration/213207-21kthreadcore19:17:422
249940,0watchdog/27613-21yum19:57:512
249940,0watchdog/22154-21irqcore00:32:442
249940,0watchdog/215734-21aten_r1power_fr20:52:362
249940,0watchdog/20-21swapper/223:22:402
249940,0watchdog/20-21swapper/222:57:402
249940,0watchdog/20-21swapper/222:12:402
249940,0watchdog/20-21swapper/219:52:432
249940,0watchdog/20-21swapper/219:32:432
179940,0migration/16895-21kthreadcore21:07:411
179940,0migration/131502-21kthreadcore19:32:421
179940,0migration/130750-21kthreadcore20:37:411
179940,0migration/127327-21cpuspeed_turbos23:32:371
179940,0migration/127327-21cpuspeed_turbos23:32:371
179940,0migration/122480-21latency_hist00:07:251
179940,0migration/119773-21kernelversion00:42:431
179940,0migration/115949-21kthreadcore21:32:411
179940,0migration/11124-21kthreadcore21:22:431
179940,0migration/111222-21taskset19:39:051
179940,0migration/111004-21kthreadcore19:17:411
179940,0migration/110584-21kthreadcore20:02:411
169940,0watchdog/18842-21ssh23:20:361
169940,0watchdog/18739-21grep20:47:361
169940,0watchdog/124145-21kthreadcore19:27:391
169940,0watchdog/116929-21kthreadcore21:12:441
169940,0watchdog/10-21swapper/122:39:481
169940,0watchdog/10-21swapper/122:07:481
149940,0migration/032558-21kthreadcore21:22:430
149940,0migration/031531-21kthreadcore20:37:410
149940,0migration/023809-21kthreadcore20:32:420
149940,0migration/018194-21python20:27:470
149940,0migration/012208-21latency_hist21:12:250
77959932,0cyclictest3524-21snmpd21:11:292
77959932,0cyclictest20077-21awk19:47:382
77949932,0cyclictest3571-21lldpd20:43:041
77949932,0cyclictest30974-21awk20:17:411
77949932,0cyclictest20949-21grep19:22:431
77949932,0cyclictest10695-21awk00:37:401
77949930,0cyclictest8398-21perl00:17:391
77949930,0cyclictest30653-21grep19:52:431
77949930,0cyclictest1952-21kthreadcore21:02:411
77949930,0cyclictest16451-21expr00:22:381
77949930,0cyclictest16082-21latency_hist23:07:251
77949930,0cyclictest1389-21fschecks_count22:02:401
77939933,0cyclictest17777-21kworker/0:120:52:420
329930,0watchdog/30-21swapper/321:12:443
329930,0watchdog/30-21swapper/320:12:283
329930,0watchdog/30-21swapper/319:22:353
29815030,0irq/29-eth0-tx-0-21swapper/020:02:460
249930,0watchdog/20-21swapper/220:32:442
179930,0migration/121654-21diskmemload22:32:411
169930,0watchdog/10-21swapper/122:17:401
169930,0watchdog/10-21swapper/121:27:481
169930,0watchdog/10-21swapper/120:52:361
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional