You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-21 - 19:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Tue Apr 21, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
537625958,0sleep20-21swapper/207:17:502
5716995050,0cyclictest27274-21md0_resync09:45:022
561824637,0sleep10-21swapper/107:20:251
531923727,0sleep30-21swapper/307:17:113
542223524,0sleep00-21swapper/007:18:200
5714991918,0cyclictest32633-21ssh09:45:020
5714991111,0cyclictest3524-21snmpd11:23:140
29805070,0irq/28-eth0-rx-0-21swapper/311:57:463
8305060,0irq/26-0000:00:32672-21df08:00:583
8305060,0irq/26-0000:00:18066-21diskstats07:51:003
8305060,0irq/26-0000:00:1142-21munin-run08:45:453
8305060,0irq/26-0000:00:0-21swapper/309:02:333
57169965,0cyclictest11203-21sed09:51:022
57169960,0cyclictest0-21swapper/211:25:502
57159960,0cyclictest0-21swapper/112:24:351
57149966,0cyclictest0-21swapper/011:57:440
57149965,0cyclictest0-21swapper/007:41:040
35160,0ktimersoftd/30-21swapper/310:48:213
339960,0migration/36097-21sh12:15:333
339960,0migration/34434-21munin-node10:21:113
339960,0migration/332109-21taskset11:33:593
339960,0migration/331321-21sh09:41:453
339960,0migration/328563-21runrttasks10:16:533
29805060,0irq/28-eth0-rx-0-21swapper/310:44:573
149960,0migration/06052-21sh10:24:430
149960,0migration/03192-21sh10:05:020
149960,0migration/017641-21sh10:49:230
149960,0migration/015711-21ntp_offset12:36:090
149960,0migration/011939-21munin-node09:11:070
149960,0migration/010711-21smart_nvme0n108:26:080
8305050,0irq/26-0000:00:8904-21ssh11:39:522
8305050,0irq/26-0000:00:8812-21chrt08:50:473
8305050,0irq/26-0000:00:30987-21kthreadcore08:21:023
8305050,0irq/26-0000:00:25682-21kthreadcore08:16:033
8305050,0irq/26-0000:00:21213-21dump-pmu-power10:15:462
8305050,0irq/26-0000:00:20159-21if_err_eth1.308:36:033
8305050,0irq/26-0000:00:16205-21awk08:55:563
8305050,0irq/26-0000:00:13963-21sh12:17:552
8305050,0irq/26-0000:00:13809-21cat08:06:113
8305050,0irq/26-0000:00:0-21swapper/309:06:033
8305050,0irq/26-0000:00:0-21swapper/308:46:003
8305050,0irq/26-0000:00:0-21swapper/307:41:023
8305050,0irq/26-0000:00:0-21swapper/307:26:033
8305050,0irq/26-0000:00:0-21swapper/307:20:553
8305050,0irq/26-0000:00:0-21swapper/209:31:112
57169955,0cyclictest0-21swapper/211:59:062
57169955,0cyclictest0-21swapper/211:50:162
57169955,0cyclictest0-21swapper/211:06:362
57169955,0cyclictest0-21swapper/210:32:422
57169955,0cyclictest0-21swapper/208:45:292
57169955,0cyclictest0-21swapper/208:33:312
57169950,0cyclictest0-21swapper/211:43:012
57169950,0cyclictest0-21swapper/209:29:102
57159955,0cyclictest0-21swapper/111:32:331
57159955,0cyclictest0-21swapper/111:24:211
57159955,0cyclictest0-21swapper/110:10:151
57159955,0cyclictest0-21swapper/109:48:391
57159955,0cyclictest0-21swapper/109:24:411
57159950,0cyclictest0-21swapper/109:52:451
57149955,0cyclictest0-21swapper/009:46:520
57149955,0cyclictest0-21swapper/007:36:010
57149950,0cyclictest0-21swapper/011:33:360
35150,0ktimersoftd/327274-21md0_resync09:49:533
339950,0migration/37064-21fschecks_count11:21:003
339950,0migration/36429-21fschecks_count09:11:003
339950,0migration/36086-21aten_r1power_cu09:30:573
339950,0migration/35650-21kthreadcore11:36:053
339950,0migration/331019-21missed_timers07:56:063
339950,0migration/329089-21if_eth107:36:013
339950,0migration/327945-21munin-node12:46:023
339950,0migration/32531-21taskset11:53:573
339950,0migration/322014-21kthreadcore10:51:063
339950,0migration/319103-21kthreadcore12:21:043
339950,0migration/317964-21proc_pri08:31:063
339950,0migration/316255-21kthreadcore09:16:033
339950,0migration/315060-21kthreadcore12:01:053
339950,0migration/312515-21latency_hist10:10:463
329950,0watchdog/324556-21cut09:21:053
329950,0watchdog/312985-21python12:16:103
29815050,0irq/29-eth0-tx-15920-21fschecks_count12:21:002
29805050,0irq/28-eth0-rx-9401-21seq12:35:543
29805050,0irq/28-eth0-rx-4670-21ssh11:16:213
29805050,0irq/28-eth0-rx-4268-21cut11:01:003
29805050,0irq/28-eth0-rx-31506-21ssh10:37:063
29805050,0irq/28-eth0-rx-26858-21kthreadcore12:26:043
29805050,0irq/28-eth0-rx-23374-21kthreadcore11:46:063
29805050,0irq/28-eth0-rx-22877-21ssh11:27:423
29805050,0irq/28-eth0-rx-14771-21aten2.4-expect08:10:573
29805050,0irq/28-eth0-rx-14139-21kthreadcore11:06:053
29805050,0irq/28-eth0-rx-0-21swapper/312:41:063
29805050,0irq/28-eth0-rx-0-21swapper/312:31:053
29805050,0irq/28-eth0-rx-0-21swapper/310:31:113
29805050,0irq/28-eth0-rx-0-21swapper/310:06:423
29805050,0irq/28-eth0-rx-0-21swapper/310:03:143
259950,0migration/230921-21fschecks_time11:16:012
259950,0migration/21943-21sh10:57:072
249950,0watchdog/220105-21kthreadcore07:51:052
249950,0watchdog/20-21swapper/210:36:052
19150,0ktimersoftd/10-21swapper/112:06:271
19150,0ktimersoftd/10-21swapper/108:01:081
179950,0migration/132551-21munin-node08:41:071
179950,0migration/129505-21kthreadcore10:36:051
179950,0migration/122633-21runrttasks09:37:451
179950,0migration/117403-21sh10:48:421
179950,0migration/112134-21munin-node08:30:571
179950,0migration/11080-21munin-node12:46:141
179950,0migration/110200-21timerandwakeup11:56:121
169950,0watchdog/120104-21kthreadcore07:51:051
169950,0watchdog/117235-21kthreadcore12:01:061
169950,0watchdog/1151342sleep108:51:091
149950,0migration/08336-21taskset08:47:570
149950,0migration/0442-21kthreadcore09:06:040
149950,0migration/04208-21sendmail_mailqu11:16:090
149950,0migration/03860-21munin-node12:11:050
149950,0migration/03727-21munin-node11:00:580
149950,0migration/031667-21kthreadcore08:21:030
149950,0migration/03130-21latency_hist12:50:460
149950,0migration/030149-21taskset09:01:270
149950,0migration/029419-21sh12:10:100
149950,0migration/028911-21kthreadcore10:56:040
149950,0migration/027433-21kthreadcore10:36:040
149950,0migration/027375-21gltestperf08:41:010
149950,0migration/025452-21kthreadcore10:16:030
149950,0migration/022702-21kthreadcore09:21:040
149950,0migration/022445-21kthreadcore11:46:060
149950,0migration/021327-21aten_r1power_fr11:10:570
149950,0migration/020698-21kthreadcore08:56:030
149950,0migration/020506-21latency_hist07:30:450
149950,0migration/020101-21taskset09:19:090
149950,0migration/019448-21kthreadcore10:31:040
149950,0migration/018666-21kthreadcore11:26:040
149950,0migration/018170-21timerandwakeup08:31:100
149950,0migration/015114-21kthreadcore10:11:030
149950,0migration/014576-21kthreadcore11:41:040
149950,0migration/013933-21sh10:27:090
149950,0migration/012973-21taskset07:24:540
149950,0migration/012099-21kthreadcore08:51:040
8305040,0irq/26-0000:00:7141-21open_files10:41:072
8305040,0irq/26-0000:00:436-21ssh12:30:552
8305040,0irq/26-0000:00:31058-21perl10:20:592
8305040,0irq/26-0000:00:30715-21kthreadcore12:46:072
8305040,0irq/26-0000:00:27296-21cat11:50:582
8305040,0irq/26-0000:00:21462-21chrt10:15:512
8305040,0irq/26-0000:00:19876-21ssh12:03:052
8305040,0irq/26-0000:00:1712-21perl09:46:002
8305040,0irq/26-0000:00:10716-21ssh10:06:162
8305040,0irq/26-0000:00:0-21swapper/308:25:593
8305040,0irq/26-0000:00:0-21swapper/307:30:573
8305040,0irq/26-0000:00:0-21swapper/212:05:562
8305040,0irq/26-0000:00:0-21swapper/211:10:572
8305040,0irq/26-0000:00:0-21swapper/209:22:152
57169944,0cyclictest0-21swapper/209:00:002
57169944,0cyclictest0-21swapper/207:37:512
57169943,0cyclictest3571-21lldpd09:13:062
57169943,0cyclictest3571-21lldpd08:54:052
57169943,0cyclictest3571-21lldpd08:11:052
57169943,0cyclictest3571-21lldpd07:48:052
57169943,0cyclictest3571-21lldpd07:22:352
57169943,0cyclictest3524-21snmpd09:07:422
57169943,0cyclictest3524-21snmpd08:26:262
57169943,0cyclictest3524-21snmpd08:22:412
57169943,0cyclictest3250-21irqbalance09:18:022
57169943,0cyclictest3250-21irqbalance08:10:122
57169943,0cyclictest3250-21irqbalance07:55:522
57169943,0cyclictest25463-21awk11:31:022
57169943,0cyclictest24560-21awk09:01:012
57169943,0cyclictest2431-21awk08:46:022
57169943,0cyclictest21658-21awk07:31:002
57169943,0cyclictest14370-21awk07:26:022
57169943,0cyclictest1061-21awk08:01:022
57169940,0cyclictest0-21swapper/209:56:042
57159944,0cyclictest0-21swapper/109:18:511
57159944,0cyclictest0-21swapper/108:56:001
57159944,0cyclictest0-21swapper/108:20:131
57159943,0cyclictest3571-21lldpd08:23:041
57159943,0cyclictest3571-21lldpd07:50:051
57159943,0cyclictest3524-21snmpd10:41:121
57159943,0cyclictest3524-21snmpd10:26:421
57159943,0cyclictest3524-21snmpd09:11:421
57159943,0cyclictest3524-21snmpd09:09:271
57159943,0cyclictest3524-21snmpd08:36:111
57159943,0cyclictest3250-21irqbalance12:27:131
57159943,0cyclictest31192-21awk11:16:021
57159943,0cyclictest22697-21awk10:16:011
57159943,0cyclictest22295-21awk11:11:011
57149944,0cyclictest0-21swapper/012:44:140
57149943,0cyclictest3524-21snmpd08:36:410
57149943,0cyclictest30447-21awk09:26:020
57149943,0cyclictest23117-21awk08:16:010
57149943,0cyclictest19537-21awk10:51:030
57149940,0cyclictest9153-21idleruntime-cro12:35:460
339940,0migration/317941-21kthreadcore09:36:043
339940,0migration/314028-21sh10:27:253
339940,0migration/311232-21irqrtprio09:51:023
329940,0watchdog/30-21swapper/312:06:063
329940,0watchdog/30-21swapper/309:56:053
29815040,0irq/29-eth0-tx-6585-21munin-node11:20:592
29815040,0irq/29-eth0-tx-27314-21ssh10:00:512
29815040,0irq/29-eth0-tx-24005-21ssh12:25:482
29815040,0irq/29-eth0-tx-20258-21diskmemload12:40:472
29815040,0irq/29-eth0-tx-17631-21sshd07:50:510
29815040,0irq/29-eth0-tx-11057-21grep10:26:042
29815040,0irq/29-eth0-tx-0-21swapper/211:01:002
29815040,0irq/29-eth0-tx-0-21swapper/209:35:572
29815040,0irq/29-eth0-tx-0-21swapper/008:05:580
29815040,0irq/29-eth0-tx-0-21swapper/008:01:050
29815040,0irq/29-eth0-tx-0-21swapper/007:30:580
29805040,0irq/28-eth0-rx-0-21swapper/311:40:553
29805040,0irq/28-eth0-rx-0-21swapper/311:10:573
29805040,0irq/28-eth0-rx-0-21swapper/310:56:593
29805040,0irq/28-eth0-rx-0-21swapper/309:27:223
259940,0migration/230918-21hwlatdetect12:11:002
259940,0migration/223833-21kthreadcore08:16:032
249940,0watchdog/29958-21fschecks_count12:36:022
249940,0watchdog/218983-21fschecks_count10:51:012
249940,0watchdog/20-21swapper/210:46:052
179940,0migration/17111-21fschecks_count12:16:001
179940,0migration/15824-21kthreadcore07:41:031
179940,0migration/14303-21kthreadcore11:36:051
179940,0migration/127277-21kthreadcore09:41:021
179940,0migration/124773-21kthreadcore07:31:031
179940,0migration/123473-21kthreadcore10:51:061
179940,0migration/122258-21timerwakeupswit10:31:121
179940,0migration/120607-21kthreadcore11:26:051
179940,0migration/114673-21kthreadcore11:06:051
179940,0migration/113095-21fschecks_count10:10:591
169940,0watchdog/19957-21fschecks_count12:36:021
169940,0watchdog/1832-21mdstat10:56:051
169940,0watchdog/14947-21ssh09:28:451
169940,0watchdog/130068-21kthreadcore07:56:051
169940,0watchdog/12967-21ssh11:55:051
169940,0watchdog/12336-21ksmtuned07:37:251
169940,0watchdog/122627-21cut12:41:061
169940,0watchdog/122146-21tr11:46:051
169940,0watchdog/120626-21memory08:11:051
169940,0watchdog/118343-21kthreadcore07:26:051
169940,0watchdog/116355-21yum11:41:131
169940,0watchdog/113775-21ssh09:33:131
169940,0watchdog/11372-21munin-node08:46:131
169940,0watchdog/111965-21cat07:21:051
149940,0migration/029457-21kthreadcore12:26:050
149940,0migration/028782-21kthreadcore11:51:030
149940,0migration/025253-21cpuspeed_turbos07:55:590
149940,0migration/020409-21taskset11:09:190
149940,0migration/012654-21kthreadcore09:51:030
149940,0migration/012335-21runrttasks12:00:530
8305030,0irq/26-0000:00:0-21swapper/307:45:503
57159932,0cyclictest3524-21snmpd10:23:271
57159932,0cyclictest31003-21awk12:11:001
57159932,0cyclictest29537-21kthreadcore10:01:031
57159932,0cyclictest24521-21awk09:01:011
57159932,0cyclictest19642-21awk09:56:011
57159932,0cyclictest1612-21awk12:31:031
57149932,0cyclictest23582-21sh09:39:550
57149932,0cyclictest20258-21diskmemload10:06:500
57149932,0cyclictest19740-21awk09:56:020
57149932,0cyclictest1731-21awk11:36:030
57149932,0cyclictest15857-21awk08:11:020
57149932,0cyclictest14997-21sadc12:20:460
57149930,0cyclictest23154-21diskmemload12:24:040
57149930,0cyclictest11121-21perl07:45:590
259930,0migration/25054-21kthreadcore07:41:032
249930,0watchdog/20-21swapper/208:36:052
169930,0watchdog/10-21swapper/111:01:051
169930,0watchdog/10-21swapper/108:28:171
169930,0watchdog/10-21swapper/108:05:491
57149921,0cyclictest569-21cat10:40:460
57149920,0cyclictest0-21swapper/009:30:460
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional