You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 03:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Tue May 12, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1095325251,0sleep00-21swapper/019:21:210
1069023728,0sleep30-21swapper/319:18:193
1087923324,0sleep20-21swapper/219:20:312
1091423026,0sleep10-21swapper/119:20:541
339960,0migration/33257-21sh23:02:453
339960,0migration/326099-21sh21:58:023
339960,0migration/316350-21sh00:04:363
29805060,0irq/28-eth0-rx-17833-21hddtemp_smartct21:37:423
29805060,0irq/28-eth0-rx-16290-21kthreadcore23:27:453
27160,0ktimersoftd/20-21swapper/222:24:352
27160,0ktimersoftd/20-21swapper/200:17:282
179960,0migration/130190-21ntp_offset23:52:481
149960,0migration/013611-21sh22:29:020
149960,0migration/013048-21latency_hist23:27:270
111169960,0cyclictest18467-21kthreadcore20:32:450
111169960,0cyclictest0-21swapper/023:12:470
8305050,0irq/26-0000:00:13929-21kthreadcore00:22:452
4150,0ktimersoftd/00-21swapper/020:57:300
339950,0migration/39921-21kthreadcore19:42:433
339950,0migration/332643-21taskset19:37:173
339950,0migration/330872-21kthreadcore20:17:453
339950,0migration/330558-21munin-node19:57:443
339950,0migration/327048-21idleruntime22:57:433
339950,0migration/327002-21kthreadcore00:47:463
339950,0migration/325628-21aten_r1power_fr21:42:393
339950,0migration/325469-21kthreadcore19:52:453
339950,0migration/324949-21kthreadcore22:17:463
339950,0migration/324610-21fschecks_count23:52:423
339950,0migration/32367-21timerandwakeup23:17:533
339950,0migration/323457-21kthreadcore23:12:473
339950,0migration/319801-21kthreadcore19:47:453
339950,0migration/318367-21taskset20:54:143
339950,0migration/317482-21taskset21:52:573
339950,0migration/316266-21kthreadcore00:42:473
339950,0migration/316187-21kthreadcore00:22:463
339950,0migration/315126-21latency_hist20:32:273
339950,0migration/31271-21munin-node22:42:443
339950,0migration/312612-21taskset00:40:363
339950,0migration/31024-21runrttasks19:37:413
329950,0watchdog/39605-21fschecks_time22:47:433
329950,0watchdog/33289-21kthreadcore23:37:473
329950,0watchdog/329611-21taskset23:35:513
329950,0watchdog/329510-21irqstats22:02:433
329950,0watchdog/327924-21cut20:37:463
329950,0watchdog/320474-21kthreadcore21:17:463
329950,0watchdog/314055-21pmu-power20:27:503
329950,0watchdog/312375-21kthreadcore21:32:463
329950,0watchdog/311457-21ssh23:23:153
329950,0watchdog/30-21swapper/323:42:473
329950,0watchdog/30-21swapper/300:14:273
29815050,0irq/29-eth0-tx-7742-21kthreadcore00:37:472
29815050,0irq/29-eth0-tx-29578-21munin-node20:42:390
29815050,0irq/29-eth0-tx-28366-21ssh22:18:102
29815050,0irq/29-eth0-tx-24537-21diskstats23:52:412
29815050,0irq/29-eth0-tx-15572-21ssh21:35:032
29815050,0irq/29-eth0-tx-14258-21tune2fs00:42:432
29815050,0irq/29-eth0-tx-0-21swapper/222:34:282
29815050,0irq/29-eth0-tx-0-21swapper/221:27:532
29815050,0irq/29-eth0-tx-0-21swapper/019:42:090
29805050,0irq/28-eth0-rx-5923-21tr22:07:453
29805050,0irq/28-eth0-rx-32509-21basename21:27:443
29805050,0irq/28-eth0-rx-30015-21cut00:32:463
29805050,0irq/28-eth0-rx-23768-21switchtime22:52:533
29805050,0irq/28-eth0-rx-2286-21df21:47:413
29805050,0irq/28-eth0-rx-19698-21tr00:07:463
29805050,0irq/28-eth0-rx-0-21swapper/323:07:463
29805050,0irq/28-eth0-rx-0-21swapper/322:37:483
29805050,0irq/28-eth0-rx-0-21swapper/322:33:223
29805050,0irq/28-eth0-rx-0-21swapper/322:30:033
29805050,0irq/28-eth0-rx-0-21swapper/300:27:463
29805050,0irq/28-eth0-rx-0-21swapper/300:17:403
259950,0migration/227525-21irqrtprio22:57:442
249950,0watchdog/224489-21cut20:57:462
249950,0watchdog/210849-21cut23:42:472
179950,0migration/128377-21kthreadcore00:12:461
179950,0migration/126328-21kthreadcore23:32:451
179950,0migration/125956-21munin-node23:12:511
179950,0migration/123320-21taskset22:37:001
179950,0migration/118507-21sh23:10:121
179950,0migration/118209-21fschecks_count00:07:421
179950,0migration/11461-21munin-node19:37:421
169950,0watchdog/123317-21ssh22:52:471
149950,0migration/09231-21kthreadcore20:47:460
149950,0migration/08805-21aten_r1power_cu22:47:390
149950,0migration/07932-21sh22:45:510
149950,0migration/07795-21taskset19:42:310
149950,0migration/07566-21kthreadcore20:02:460
149950,0migration/0653-21aten_r1power_cu20:22:390
149950,0migration/06202-21kthreadcore21:47:460
149950,0migration/0609-21kthreadcore23:17:460
149950,0migration/04902-21kthreadcore23:02:480
149950,0migration/032235-21kthreadcore19:57:450
149950,0migration/032064-21munin-node22:57:470
149950,0migration/031902-21kthreadcore22:02:440
149950,0migration/03158-21kthreadcore22:22:470
149950,0migration/031542-21munin-node23:37:440
149950,0migration/029777-21kthreadcore23:52:470
149950,0migration/027806-21kthreadcore21:02:460
149950,0migration/027722-21sh22:17:490
149950,0migration/027199-21kthreadcore21:42:450
149950,0migration/026918-21kthreadcore22:37:480
149950,0migration/026826-21kthreadcore00:47:460
149950,0migration/025626-21sh22:57:100
149950,0migration/025166-21kthreadcore21:22:480
149950,0migration/024601-21taskset00:08:340
149950,0migration/022555-21kthreadcore21:57:460
149950,0migration/021328-21timerandwakeup19:47:530
149950,0migration/019604-21gltestperf20:12:410
149950,0migration/019540-21sendmail_mailqu23:27:490
149950,0migration/019449-21latency_hist23:12:270
149950,0migration/019091-21taskset21:57:270
149950,0migration/018996-21kthreadcore21:17:460
149950,0migration/018672-21sh00:24:500
149950,0migration/018664-21idleruntime-cro20:57:270
149950,0migration/016531-21taskset21:37:240
149950,0migration/016293-21kthreadcore22:12:470
149950,0migration/01367-21munin-node23:57:440
149950,0migration/012129-21kthreadcore21:12:460
149950,0migration/010157-21kthreadcore23:42:470
111189953,0cyclictest3250-21irqbalance23:03:242
111189950,0cyclictest0-21swapper/221:56:502
111179955,0cyclictest0-21swapper/123:22:291
111179955,0cyclictest0-21swapper/121:47:061
111179955,0cyclictest0-21swapper/121:35:071
111179950,0cyclictest0-21swapper/123:47:141
111179950,0cyclictest0-21swapper/122:44:011
111179950,0cyclictest0-21swapper/121:05:481
111179950,0cyclictest0-21swapper/100:41:561
111169955,0cyclictest0-21swapper/023:49:400
111169955,0cyclictest0-21swapper/000:14:350
8305040,0irq/26-0000:00:3222-17sedispatch19:52:272
339940,0migration/36263-21kthreadcore20:02:453
339940,0migration/325416-21taskset20:14:373
339940,0migration/321393-21kthreadcore19:27:443
339940,0migration/31834-21if_eth1.220:22:443
339940,0migration/313214-21kthreadcore20:07:453
329940,0watchdog/3839-21chrt21:07:383
329940,0watchdog/34467-21cut23:57:473
329940,0watchdog/325093-21python20:57:503
329940,0watchdog/31466-21kthreadcore22:22:473
329940,0watchdog/30-21swapper/323:47:553
329940,0watchdog/30-21swapper/321:02:463
29815040,0irq/29-eth0-tx-22405-21diskmemload21:38:012
29815040,0irq/29-eth0-tx-13113-21ssh22:12:422
29815040,0irq/29-eth0-tx-0-21swapper/223:47:532
29815040,0irq/29-eth0-tx-0-21swapper/223:32:402
29815040,0irq/29-eth0-tx-0-21swapper/223:27:342
29815040,0irq/29-eth0-tx-0-21swapper/223:22:432
29815040,0irq/29-eth0-tx-0-21swapper/223:07:292
29815040,0irq/29-eth0-tx-0-21swapper/222:47:292
29815040,0irq/29-eth0-tx-0-21swapper/222:37:452
29815040,0irq/29-eth0-tx-0-21swapper/222:07:392
29815040,0irq/29-eth0-tx-0-21swapper/222:02:292
29815040,0irq/29-eth0-tx-0-21swapper/221:57:442
29815040,0irq/29-eth0-tx-0-21swapper/221:23:362
29815040,0irq/29-eth0-tx-0-21swapper/200:17:402
29815040,0irq/29-eth0-tx-0-21swapper/019:52:530
29815040,0irq/29-eth0-tx-0-21swapper/019:32:440
29805040,0irq/28-eth0-rx-0-21swapper/322:15:083
29805040,0irq/28-eth0-rx-0-21swapper/321:24:493
29805040,0irq/28-eth0-rx-0-21swapper/319:22:473
259940,0migration/231848-21irqcore23:37:452
259940,0migration/230297-21gltestperf19:57:412
259940,0migration/230144-21kthreadcore20:17:452
259940,0migration/229476-21gltestperf00:32:432
259940,0migration/229106-21fschecks_time23:17:422
259940,0migration/222804-21kthreadcore20:12:452
259940,0migration/221707-21kthreadcore00:27:462
259940,0migration/217720-21kthreadcore21:17:462
259940,0migration/217663-21timerandwakeup19:22:522
249940,0watchdog/25984-21kthreadcore20:22:462
249940,0watchdog/225787-21aten_r1power_fr19:32:382
249940,0watchdog/214054-21pmu-power20:27:502
249940,0watchdog/20-21swapper/223:57:472
249940,0watchdog/20-21swapper/221:02:462
249940,0watchdog/20-21swapper/200:07:472
179940,0migration/19459-21kthreadcore19:42:431
179940,0migration/19207-21aten2.4-expect00:02:401
179940,0migration/18674-21munin-node23:02:531
179940,0migration/17971-21runrttasks20:27:321
179940,0migration/15272-21idleruntime22:07:421
179940,0migration/14107-21taskset20:46:011
179940,0migration/132566-21kthreadcore23:37:461
179940,0migration/129676-21irqcore23:17:451
179940,0migration/12866-21df_abs00:17:411
179940,0migration/128520-21timerandwakeup19:52:531
179940,0migration/128448-21fschecks_count22:02:391
179940,0migration/125476-21taskset20:58:141
179940,0migration/125451-21kthreadcore22:17:461
179940,0migration/123146-21kthreadcore19:27:441
179940,0migration/122337-21latency_hist20:37:271
179940,0migration/120857-21missed_timers19:47:471
179940,0migration/113175-21kthreadcore19:22:441
179940,0migration/110789-21kthreadcore22:47:461
169940,0watchdog/17997-21kthreadcore20:47:461
169940,0watchdog/126763-21rm00:28:231
169940,0watchdog/120473-21kthreadcore21:17:461
169940,0watchdog/120451-21ssh23:29:191
169940,0watchdog/117631-21ssh21:53:231
169940,0watchdog/113232-21ssh22:27:591
169940,0watchdog/10-21swapper/121:57:471
149940,0migration/09521-21kthreadcore22:07:460
149940,0migration/029941-21irqcore00:32:460
149940,0migration/022877-21sh22:35:460
149940,0migration/016425-21kthreadcore20:07:460
149940,0migration/014989-21kthreadcore19:22:450
111189943,0cyclictest5383-21awk20:02:442
111189943,0cyclictest3571-21lldpd22:27:322
111189943,0cyclictest3571-21lldpd19:49:022
111189943,0cyclictest3571-21lldpd19:38:022
111189943,0cyclictest3571-21lldpd00:02:332
111189943,0cyclictest3524-21snmpd20:38:182
111189943,0cyclictest3524-21snmpd19:30:332
111189943,0cyclictest3250-21irqbalance21:47:442
111189943,0cyclictest3250-21irqbalance21:12:442
111189943,0cyclictest3250-21irqbalance21:07:542
111189943,0cyclictest3250-21irqbalance20:53:142
111189943,0cyclictest3250-21irqbalance20:47:542
111189943,0cyclictest3250-21irqbalance20:43:042
111189943,0cyclictest3250-21irqbalance20:33:042
111189943,0cyclictest3250-21irqbalance20:09:042
111189943,0cyclictest26706-21awk21:42:432
111189943,0cyclictest23644-21irqrtprio00:47:452
111189943,0cyclictest20771-21awk23:12:452
111189943,0cyclictest18330-21gltestperf22:52:422
111189943,0cyclictest1183-21awk22:42:442
111179943,0cyclictest9332-21awk21:12:431
111179943,0cyclictest8760-21sadc00:02:281
111179943,0cyclictest7642-21sadc21:32:271
111179943,0cyclictest5304-21awk20:02:431
111179943,0cyclictest3571-21lldpd22:22:331
111179943,0cyclictest3524-21snmpd22:41:051
111179943,0cyclictest3524-21snmpd22:16:341
111179943,0cyclictest3524-21snmpd21:25:491
111179943,0cyclictest3524-21snmpd19:57:331
111179943,0cyclictest3524-21snmpd00:46:061
111179943,0cyclictest3524-21snmpd00:23:061
111179943,0cyclictest23412-21awk00:47:441
111179943,0cyclictest17961-21awk21:37:441
111179943,0cyclictest1788-21awk20:22:441
111179943,0cyclictest16526-21awk23:47:421
111179943,0cyclictest12615-21awk20:07:441
111169944,0cyclictest0-21swapper/021:29:020
111169943,0cyclictest7948-21sadc21:12:270
111169943,0cyclictest5942-21awk00:37:450
111169943,0cyclictest3524-21snmpd20:31:330
111169943,0cyclictest23532-21awk20:37:440
111169943,0cyclictest22930-21awk23:32:420
111169943,0cyclictest19628-21awk19:27:420
111169943,0cyclictest10960-21sadc00:22:280
329930,0watchdog/30-21swapper/320:42:423
29805030,0irq/28-eth0-rx-0-21swapper/321:12:393
29805030,0irq/28-eth0-rx-0-21swapper/320:47:393
259930,0migration/27917-21aten_r1power_po19:42:382
179930,0migration/129115-21fschecks_count00:32:421
169930,0watchdog/10-21swapper/121:47:511
169930,0watchdog/10-21swapper/121:07:381
169930,0watchdog/10-21swapper/119:32:381
111179932,0cyclictest3524-21snmpd20:35:031
111179932,0cyclictest3524-21snmpd20:17:331
111179932,0cyclictest27101-21awk22:57:431
111179932,0cyclictest11827-21aten_r1power_vo20:52:391
111179930,0cyclictest19395-21perl20:12:411
111169933,0cyclictest21102-21awk00:27:440
111169932,0cyclictest3524-21snmpd21:37:290
111169932,0cyclictest3524-21snmpd00:43:030
111169932,0cyclictest25900-21munin-node20:17:410
111169930,0cyclictest10270-21munin-node00:02:450
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional