You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 08:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Tue Mar 24, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1648123727,0sleep30-21swapper/319:17:373
1634723727,0sleep10-21swapper/119:16:031
963223625,0sleep00-21swapper/019:13:340
962923425,0sleep20-21swapper/219:13:322
339970,0migration/318779-21kthreadcore00:18:443
339960,0migration/3639-21sh23:12:513
339960,0migration/34189-21sh22:34:583
339960,0migration/313309-21sh23:57:213
339960,0migration/313298-21latency00:13:463
329960,0watchdog/310381-21kthreadcore20:18:433
29815060,0irq/29-eth0-tx-2829-21munin-node20:38:480
29805060,0irq/28-eth0-rx-5508-21munin-node21:38:503
166409960,0cyclictest0-21swapper/200:44:082
166359960,0cyclictest18457-21kthreadcore21:08:441
149960,0migration/07822-21sh00:29:330
149960,0migration/028462-21sh23:47:270
149960,0migration/027551-21kthreadcore21:33:430
149960,0migration/018515-21irqcore20:48:390
149960,0migration/015753-21sh23:02:230
8305050,0irq/26-0000:00:22831-21date22:48:252
8305050,0irq/26-0000:00:21485-21ssh00:01:132
8305050,0irq/26-0000:00:18402-21crond22:08:252
339950,0migration/35736-21taskset19:31:393
339950,0migration/35178-21timerandwakeup00:08:503
339950,0migration/34394-21munin-node23:33:403
339950,0migration/33162-21kthreadcore20:13:423
339950,0migration/330518-21irqrtprio23:48:423
339950,0migration/329739-21kthreadcore23:28:443
339950,0migration/329301-21kthreadcore22:13:413
339950,0migration/328528-21kthreadcore20:08:433
339950,0migration/32680-21kthreadcore20:58:443
339950,0migration/326588-21kthreadcore19:23:423
339950,0migration/323459-21fschecks_count22:48:383
339950,0migration/321640-21kthreadcore20:03:423
339950,0migration/321502-21taskset22:45:083
339950,0migration/321048-21aten_r1power_en21:13:363
339950,0migration/320597-21taskset21:11:353
339950,0migration/319212-21kthreadcore21:48:423
339950,0migration/317300-21taskset23:20:563
339950,0migration/312760-21runrttasks22:39:483
339950,0migration/31188-21taskset00:44:423
339950,0migration/31103-21kthreadcore20:33:443
339950,0migration/310475-21kthreadcore21:43:413
339950,0migration/310413-21kthreadcore21:23:433
329950,0watchdog/37200-21python00:28:483
329950,0watchdog/33752-21perl20:38:393
329950,0watchdog/328144-21cut00:03:443
329950,0watchdog/323847-21kthreadcore20:28:433
329950,0watchdog/323759-21grep00:38:443
329950,0watchdog/318496-21tr21:28:443
329950,0watchdog/318492-21tr23:03:403
329950,0watchdog/313142-21gltestperf22:23:403
329950,0watchdog/30-21swapper/319:58:393
29815050,0irq/29-eth0-tx-9336-21irqrtprio22:58:422
29815050,0irq/29-eth0-tx-5990-21taskset21:39:162
29815050,0irq/29-eth0-tx-3566-21munin-node22:18:482
29815050,0irq/29-eth0-tx-27795-21munin-node19:48:450
29815050,0irq/29-eth0-tx-27711-21ssh23:45:192
29815050,0irq/29-eth0-tx-18053-21munin-node00:38:402
29815050,0irq/29-eth0-tx-1415-21munin-node21:58:382
29815050,0irq/29-eth0-tx-0-21swapper/222:53:322
29815050,0irq/29-eth0-tx-0-21swapper/222:38:542
29815050,0irq/29-eth0-tx-0-21swapper/221:44:402
29815050,0irq/29-eth0-tx-0-21swapper/221:25:102
29815050,0irq/29-eth0-tx-0-21swapper/200:27:062
29815050,0irq/29-eth0-tx-0-21swapper/021:18:430
29815050,0irq/29-eth0-tx-0-21swapper/020:53:480
29805050,0irq/28-eth0-rx-8168-21munin-node22:58:383
29805050,0irq/28-eth0-rx-4508-21kthreadcore21:58:423
29805050,0irq/28-eth0-rx-30686-21cut19:48:413
29805050,0irq/28-eth0-rx-24658-21grep22:08:443
29805050,0irq/28-eth0-rx-21392-21perl23:43:383
29805050,0irq/28-eth0-rx-16179-21users00:33:533
29805050,0irq/28-eth0-rx-0-21swapper/323:24:003
29805050,0irq/28-eth0-rx-0-21swapper/323:14:173
29805050,0irq/28-eth0-rx-0-21swapper/322:20:533
29805050,0irq/28-eth0-rx-0-21swapper/322:07:153
29805050,0irq/28-eth0-rx-0-21swapper/321:53:423
29805050,0irq/28-eth0-rx-0-21swapper/321:33:373
29805050,0irq/28-eth0-rx-0-21swapper/300:01:333
27150,0ktimersoftd/20-21swapper/222:09:472
259950,0migration/29831-21latency_hist19:58:242
259950,0migration/231356-21taskset20:57:252
259950,0migration/223804-21sh23:05:492
259950,0migration/223255-21munin-node20:03:462
259950,0migration/219596-21munin-node20:23:462
259950,0migration/217321-21fschecks_time21:48:382
259950,0migration/210714-21munin-node00:33:442
249950,0watchdog/213141-21gltestperf22:23:402
179950,0migration/125687-21munin-node20:53:431
166409955,0cyclictest0-21swapper/223:41:422
166409955,0cyclictest0-21swapper/223:41:422
166409954,0cyclictest30188-21perl22:33:392
166409950,0cyclictest0-21swapper/221:34:372
166359955,0cyclictest0-21swapper/123:03:401
166359955,0cyclictest0-21swapper/122:08:481
166359950,0cyclictest0-21swapper/121:49:241
166279955,0cyclictest0-21swapper/023:28:110
166279955,0cyclictest0-21swapper/022:20:140
166279953,0cyclictest25056-21kworker/0:222:10:380
166279953,0cyclictest19566-21kworker/0:021:58:420
166279950,0cyclictest0-21swapper/023:33:140
169950,0watchdog/129836-21kernelversion21:18:441
169950,0watchdog/125907-21grep19:43:431
169950,0watchdog/125793-21kthreadcore21:13:431
149950,0migration/09299-21irqcore21:43:400
149950,0migration/08994-21timerandwakeup19:53:510
149950,0migration/08976-21kernelversion00:13:440
149950,0migration/06552-21if_eth1.223:53:410
149950,0migration/04317-21kthreadcore23:13:430
149950,0migration/04112-21kthreadcore21:38:430
149950,0migration/029930-21kthreadcore21:53:440
149950,0migration/027650-21df_abs22:13:360
149950,0migration/023097-21timerwakeupswit21:48:500
149950,0migration/022824-21kthreadcore19:43:420
149950,0migration/022562-21kthreadcore22:28:430
149950,0migration/021551-21fschecks_count21:13:390
149950,0migration/020994-21kthreadcore00:38:420
149950,0migration/020855-21taskset21:30:020
149950,0migration/020238-21taskset19:42:330
149950,0migration/020067-21sh23:58:460
149950,0migration/020018-21runrttasks22:26:560
149950,0migration/018829-21kthreadcore20:03:410
149950,0migration/017366-21kthreadcore21:08:430
149950,0migration/015889-21latency_hist00:18:250
149950,0migration/014614-21kthreadcore00:33:460
149950,0migration/012754-21taskset19:34:050
149950,0migration/012718-21taskset22:39:410
149950,0migration/011734-21kthreadcore20:43:440
339940,0migration/329246-21hddtemp_smartct21:18:403
339940,0migration/320738-21kthreadcore19:18:393
339940,0migration/315661-21kthreadcore20:43:453
329940,0watchdog/34669-21kthreadcore19:53:433
329940,0watchdog/325256-21tr22:28:443
329940,0watchdog/325079-21fschecks_count00:23:403
329940,0watchdog/30-21swapper/322:53:443
329940,0watchdog/30-21swapper/320:53:473
329940,0watchdog/30-21swapper/320:23:433
329940,0watchdog/30-21swapper/319:43:433
329940,0watchdog/30-21swapper/319:38:393
29815040,0irq/29-eth0-tx-0-21swapper/223:53:302
29815040,0irq/29-eth0-tx-0-21swapper/223:23:322
29815040,0irq/29-eth0-tx-0-21swapper/223:13:412
29815040,0irq/29-eth0-tx-0-21swapper/222:43:282
29815040,0irq/29-eth0-tx-0-21swapper/222:14:022
29815040,0irq/29-eth0-tx-0-21swapper/221:28:542
29815040,0irq/29-eth0-tx-0-21swapper/200:03:272
29815040,0irq/29-eth0-tx-0-21swapper/021:03:390
29815040,0irq/29-eth0-tx-0-21swapper/020:08:510
29815040,0irq/29-eth0-tx-0-21swapper/019:58:450
29815040,0irq/29-eth0-tx-0-21swapper/019:23:410
29805040,0irq/28-eth0-rx-0-21swapper/323:38:523
29805040,0irq/28-eth0-rx-0-21swapper/323:38:523
29805040,0irq/28-eth0-rx-0-21swapper/319:33:363
259940,0migration/24108-21fschecks_time23:33:382
259940,0migration/23430-21kthreadcore20:58:452
259940,0migration/232738-21kthreadcore00:08:422
259940,0migration/232631-21kthreadcore21:18:442
259940,0migration/23049-21kthreadcore20:13:422
259940,0migration/224133-21aten_r1power_po19:23:372
259940,0migration/216789-21runrttasks20:45:122
259940,0migration/212295-21kthreadcore23:18:412
249940,0watchdog/26166-21aten_r1power_en19:33:352
249940,0watchdog/229802-21tr21:53:442
249940,0watchdog/225252-21ssh22:28:442
249940,0watchdog/217625-21kthreadcore21:08:432
249940,0watchdog/215936-21ssh00:18:282
249940,0watchdog/211118-21cut21:03:432
249940,0watchdog/20-21swapper/223:48:442
249940,0watchdog/20-21swapper/221:13:432
19140,0ktimersoftd/10-21swapper/122:37:581
17307240,0sleep117428-21aten2.4-expect20:48:341
179940,0migration/18702-21fschecks_time21:43:371
179940,0migration/18513-21fschecks_time22:58:391
179940,0migration/17559-21needreboot21:58:441
179940,0migration/131419-21latency_hist20:13:241
179940,0migration/125046-21fschecks_time20:08:391
179940,0migration/123589-21idleruntime21:33:401
179940,0migration/121731-21munin-node23:43:401
179940,0migration/121447-21fschecks_time20:28:391
179940,0migration/121376-21kthreadcore20:03:421
179940,0migration/120078-21taskset19:40:421
179940,0migration/112829-21taskset23:55:591
166409944,0cyclictest305350irq/27-eth120:36:402
166409944,0cyclictest305350irq/27-eth120:31:242
166409944,0cyclictest305350irq/27-eth120:20:042
166409944,0cyclictest305350irq/27-eth119:30:272
166409944,0cyclictest20327-21kthreadcore19:18:392
166409944,0cyclictest0-21swapper/220:48:352
166409943,0cyclictest8569-21awk00:13:432
166409943,0cyclictest3571-21lldpd19:53:252
166409943,0cyclictest3524-21snmpd20:08:432
166409943,0cyclictest26178-21awk23:08:422
166409943,0cyclictest1864-21awk00:28:412
166409940,0cyclictest27823-21tune2fs23:28:402
166359944,0cyclictest0-21swapper/121:28:451
166359944,0cyclictest0-21swapper/121:27:201
166359943,0cyclictest3571-21lldpd23:48:281
166359943,0cyclictest3571-21lldpd23:38:571
166359943,0cyclictest3571-21lldpd23:38:571
166359943,0cyclictest3571-21lldpd23:21:271
166359943,0cyclictest3571-21lldpd22:38:271
166359943,0cyclictest3571-21lldpd22:22:571
166359943,0cyclictest3571-21lldpd21:03:251
166359943,0cyclictest3571-21lldpd20:18:251
166359943,0cyclictest3571-21lldpd19:28:251
166359943,0cyclictest3571-21lldpd00:24:281
166359943,0cyclictest3524-21snmpd22:03:301
166359943,0cyclictest3524-21snmpd19:53:281
166359943,0cyclictest3524-21snmpd00:03:311
166359943,0cyclictest32649-21awk22:53:431
166359943,0cyclictest3250-21irqbalance23:23:311
166359943,0cyclictest3250-21irqbalance22:28:411
166359943,0cyclictest3250-21irqbalance22:14:211
166359943,0cyclictest3250-21irqbalance20:59:011
166359943,0cyclictest3250-21irqbalance20:38:411
166359943,0cyclictest3250-21irqbalance20:33:311
166359943,0cyclictest3250-21irqbalance00:38:421
166359943,0cyclictest3250-21irqbalance00:37:121
166359943,0cyclictest27670-21awk00:43:431
166359943,0cyclictest26272-21awk21:53:411
166359943,0cyclictest24016-21awk22:48:401
166359943,0cyclictest2280-21awk23:13:401
166359943,0cyclictest15458-21awk22:43:411
166359942,0cyclictest3571-21lldpd00:31:281
166279944,0cyclictest0-21swapper/023:49:370
166279943,0cyclictest5791-21awk21:23:410
166279943,0cyclictest3524-21snmpd23:09:000
166279943,0cyclictest32767-21awk20:58:420
166279943,0cyclictest29410-21ps20:33:420
166279943,0cyclictest25653-21awk00:23:430
166279943,0cyclictest24031-21awk22:48:400
166279943,0cyclictest23649-21awk00:03:410
166279943,0cyclictest17907-21awk19:18:370
166279943,0cyclictest14721-21awk20:23:400
166279942,0cyclictest22739-21kworker/0:123:33:400
169940,0watchdog/17836-21entropy00:13:401
169940,0watchdog/14453-21cut21:38:441
169940,0watchdog/117732-21cut00:18:441
169940,0watchdog/110551-21diskstats20:43:391
169940,0watchdog/110482-21ssh23:35:081
169940,0watchdog/10-21swapper/122:23:401
169940,0watchdog/10-21swapper/119:23:431
169940,0watchdog/10-21swapper/119:18:391
149940,0migration/08824-21kthreadcore20:18:430
149940,0migration/04889-21sh22:36:570
149940,0migration/024287-21kthreadcore20:28:430
329930,0watchdog/30-21swapper/321:03:433
329930,0watchdog/30-21swapper/320:48:353
29815030,0irq/29-eth0-tx-0-21swapper/019:28:380
249930,0watchdog/20-21swapper/219:38:392
166409933,0cyclictest305350irq/27-eth119:48:352
166409932,0cyclictest21621-21awk19:43:402
166409930,0cyclictest2754-21sed20:38:242
166359932,0cyclictest6133-21munin-node19:33:361
166359932,0cyclictest3571-21lldpd19:58:251
166359932,0cyclictest3571-21lldpd19:51:251
166359932,0cyclictest27527-21rm23:28:391
166359932,0cyclictest26105-21awk23:08:411
166359932,0cyclictest15031-21awk23:58:411
166359930,0cyclictest13917-21df20:23:371
166279933,0cyclictest25056-21kworker/0:222:56:560
166279933,0cyclictest25056-21kworker/0:222:43:520
166279933,0cyclictest22739-21kworker/0:123:18:420
166279933,0cyclictest22739-21kworker/0:123:04:440
166279933,0cyclictest22739-21kworker/0:100:43:280
166279933,0cyclictest22739-21kworker/0:100:08:400
166279933,0cyclictest19566-21kworker/0:022:03:280
166279933,0cyclictest19566-21kworker/0:020:13:290
166279933,0cyclictest13070-21awk23:38:410
166279933,0cyclictest13070-21awk23:38:410
169930,0watchdog/10-21swapper/100:08:561
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional