You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 10:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Sun Mar 29, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3227025553,0sleep10-21swapper/119:14:141
3268724029,0sleep00-21swapper/019:15:050
3261323929,0sleep30-21swapper/319:14:163
3275423728,0sleep20-21swapper/219:15:552
6189960,0cyclictest0-21swapper/021:45:380
339960,0migration/34960-21sh23:43:513
339960,0migration/328639-21sh23:38:563
339960,0migration/316363-21sh00:24:453
339960,0migration/316051-21fschecks_time21:39:033
329960,0watchdog/331330-21sh00:14:293
29805060,0irq/28-eth0-rx-29580-21iostat_ios22:24:063
29805060,0irq/28-eth0-rx-0-21swapper/323:54:383
149960,0migration/01929-21sh22:08:320
149960,0migration/01877-21sh23:22:490
149960,0migration/014524-21sh22:52:070
149960,0migration/010082-21sh22:11:510
8305050,0irq/26-0000:00:30814-21latency_hist23:58:502
8305050,0irq/26-0000:00:17765-21vmstat22:14:162
8305050,0irq/26-0000:00:0-21swapper/223:19:052
6319955,0cyclictest0-21swapper/223:38:522
6319955,0cyclictest0-21swapper/223:14:072
6319955,0cyclictest0-21swapper/223:04:112
6319955,0cyclictest0-21swapper/221:54:492
6319955,0cyclictest0-21swapper/200:04:242
6319950,0cyclictest0-21swapper/223:27:022
6319950,0cyclictest0-21swapper/223:00:522
6319950,0cyclictest0-21swapper/222:08:412
6259955,0cyclictest0-21swapper/120:38:501
6259950,0cyclictest0-21swapper/123:48:201
6259950,0cyclictest0-21swapper/123:07:591
6259950,0cyclictest0-21swapper/122:43:231
6259950,0cyclictest0-21swapper/121:49:371
6189955,0cyclictest0-21swapper/022:34:110
6189955,0cyclictest0-21swapper/000:10:120
6189955,0cyclictest0-21swapper/000:02:000
6189954,0cyclictest0-21swapper/021:53:500
6189950,0cyclictest0-21swapper/023:26:510
6189950,0cyclictest0-21swapper/000:25:390
4150,0ktimersoftd/00-21swapper/000:41:250
339950,0migration/3792-21kthreadcore23:59:063
339950,0migration/37370-21runrttasks21:50:263
339950,0migration/37118-21latency_hist00:03:503
339950,0migration/35360-21fschecks_count20:29:023
339950,0migration/34469-21irqrtprio00:39:073
339950,0migration/330971-21kthreadcore20:44:073
339950,0migration/328738-21sh21:26:463
339950,0migration/328538-21unixbench_multi22:39:153
339950,0migration/325570-21kthreadcore21:44:073
339950,0migration/324161-21kernelversion19:34:073
339950,0migration/323719-21runrttasks21:59:113
339950,0migration/323030-21aten_r1power_cu21:04:013
339950,0migration/31846-21kthreadcore19:39:063
339950,0migration/314293-21fschecks_count23:49:023
339950,0migration/31360-21kthreadcore21:09:073
339950,0migration/313277-21irqcore19:49:053
339950,0migration/312739-21idleruntime00:44:073
339950,0migration/31253-21latency_hist20:48:493
339950,0migration/311992-21fschecks_time23:29:063
329950,0watchdog/324417-21sendmail_mailtr00:29:133
329950,0watchdog/324074-21head22:59:013
329950,0watchdog/320705-21grep22:19:053
329950,0watchdog/30-21swapper/322:36:093
329950,0watchdog/30-21swapper/300:09:093
29815050,0irq/29-eth0-tx-23290-21hostname23:54:062
29815050,0irq/29-eth0-tx-22182-21ssh22:54:322
29815050,0irq/29-eth0-tx-16942-21ssh23:12:402
29815050,0irq/29-eth0-tx-1074-21munin-node20:04:050
29815050,0irq/29-eth0-tx-0-21swapper/223:34:152
29815050,0irq/29-eth0-tx-0-21swapper/222:44:132
29815050,0irq/29-eth0-tx-0-21swapper/222:02:262
29815050,0irq/29-eth0-tx-0-21swapper/221:36:322
29815050,0irq/29-eth0-tx-0-21swapper/221:31:452
29815050,0irq/29-eth0-tx-0-21swapper/200:44:042
29815050,0irq/29-eth0-tx-0-21swapper/200:33:482
29815050,0irq/29-eth0-tx-0-21swapper/021:14:170
29815050,0irq/29-eth0-tx-0-21swapper/019:59:030
29805050,0irq/28-eth0-rx-4971-21ssh22:44:313
29805050,0irq/28-eth0-rx-26805-21ssh23:34:283
29805050,0irq/28-eth0-rx-23399-21kthreadcore19:54:073
29805050,0irq/28-eth0-rx-20898-21tr19:29:073
29805050,0irq/28-eth0-rx-17970-40yum-updatesd-he22:14:513
29805050,0irq/28-eth0-rx-0-21swapper/323:21:263
29805050,0irq/28-eth0-rx-0-21swapper/323:09:263
29805050,0irq/28-eth0-rx-0-21swapper/323:04:453
29805050,0irq/28-eth0-rx-0-21swapper/322:54:123
29805050,0irq/28-eth0-rx-0-21swapper/322:49:183
29805050,0irq/28-eth0-rx-0-21swapper/322:13:203
29805050,0irq/28-eth0-rx-0-21swapper/321:57:103
27150,0ktimersoftd/20-21swapper/222:52:022
27150,0ktimersoftd/20-21swapper/222:33:542
259950,0migration/28234-21kthreadcore21:14:072
259950,0migration/27981-21munin-node20:49:162
259950,0migration/24037-21sh22:27:502
259950,0migration/23846-21rt-features20:24:122
259950,0migration/231716-21sh21:47:172
259950,0migration/216334-21fschecks_count20:59:022
249950,0watchdog/25014-21ssh23:44:012
249950,0watchdog/221563-21sh23:52:332
249950,0watchdog/220703-21hwlatdetect22:19:052
19150,0ktimersoftd/10-21swapper/123:26:531
179950,0migration/15899-21fschecks_time21:14:031
179950,0migration/13760-21kthreadcore23:59:071
179950,0migration/130539-21aten_r1power_cu22:44:001
179950,0migration/127886-21kernelversion23:19:061
179950,0migration/123789-21latency_hist22:58:501
179950,0migration/121581-21kthreadcore21:59:081
179950,0migration/118061-21sh00:28:531
179950,0migration/117237-21irqcore00:09:081
179950,0migration/110059-21kthreadcore22:49:071
169950,0watchdog/118226-21ls21:19:081
149950,0migration/06039-21idleruntime23:44:050
149950,0migration/05244-21sh22:45:180
149950,0migration/04606-21latency_hist19:43:490
149950,0migration/04075-21taskset22:27:560
149950,0migration/03945-21pmu-power21:09:100
149950,0migration/029828-21kthreadcore20:44:070
149950,0migration/029245-21kthreadcore00:14:080
149950,0migration/026660-21kthreadcore21:24:090
149950,0migration/025437-21kthreadcore22:39:070
149950,0migration/023970-21sh22:58:530
149950,0migration/022624-21cpuspeed_turbos23:54:030
149950,0migration/022495-21sh22:55:240
149950,0migration/021232-21irqcore23:34:060
149950,0migration/020994-21irqcore22:19:070
149950,0migration/018845-21irqcore21:59:060
149950,0migration/017220-21sh23:13:270
149950,0migration/017084-21kthreadcore23:49:070
149950,0migration/016152-21taskset21:55:560
149950,0migration/01569-21cpuspeed_turbos20:49:020
149950,0migration/015510-21aten_r1power_po19:29:000
149950,0migration/015335-21kthreadcore19:49:060
149950,0migration/014992-21timerwakeupswit20:54:150
149950,0migration/014441-21kthreadcore22:14:070
149950,0migration/013799-21kthreadcore19:24:080
149950,0migration/011237-21kthreadcore21:34:070
6319943,0cyclictest5867-21awk19:44:052
6319943,0cyclictest3524-21snmpd20:58:432
6319943,0cyclictest3524-21snmpd19:49:272
6319943,0cyclictest3250-21irqbalance21:38:562
6319943,0cyclictest31345-21awk21:09:052
6319943,0cyclictest24093-21awk21:04:062
6319943,0cyclictest23044-21awk22:39:052
6319943,0cyclictest16492-21awk19:29:042
6259944,0cyclictest0-21swapper/120:09:021
6259943,0cyclictest5770-21awk22:29:041
6259943,0cyclictest3571-21lldpd20:37:091
6259943,0cyclictest3571-21lldpd20:01:391
6259943,0cyclictest3524-21snmpd21:39:441
6259943,0cyclictest3524-21snmpd00:40:451
6259943,0cyclictest3524-21snmpd00:19:001
6259943,0cyclictest3250-21irqbalance22:23:561
6259943,0cyclictest3250-21irqbalance22:09:061
6259943,0cyclictest3250-21irqbalance21:08:561
6259943,0cyclictest3250-21irqbalance20:58:561
6259943,0cyclictest3250-21irqbalance20:53:561
6259943,0cyclictest3250-21irqbalance20:50:061
6259943,0cyclictest3250-21irqbalance20:44:261
6259943,0cyclictest3250-21irqbalance19:43:561
6259943,0cyclictest3250-21irqbalance19:23:551
6259943,0cyclictest3250-21irqbalance19:19:451
6259943,0cyclictest31073-21awk21:29:061
6259943,0cyclictest29722-21awk23:39:061
6259943,0cyclictest23424-21awk23:54:071
6259943,0cyclictest14416-21awk22:34:051
6259943,0cyclictest12159-21awk22:14:051
6259943,0cyclictest10120-21awk23:09:061
6189944,0cyclictest0-21swapper/000:38:060
6189943,0cyclictest3524-21snmpd23:39:000
6189943,0cyclictest1980-21awk00:19:060
6189943,0cyclictest15583-21sadc00:08:500
6189943,0cyclictest13158-21awk20:34:040
6189941,0cyclictest0-21swapper/021:04:020
339940,0migration/39038-21fschecks_time19:24:033
339940,0migration/38599-21latency_hist20:53:493
339940,0migration/38309-21kthreadcore19:44:073
339940,0migration/37843-21taskset19:22:373
339940,0migration/34452-21kthreadcore00:19:083
339940,0migration/331956-21kthreadcore20:24:073
339940,0migration/329827-21diskmemload21:28:563
339940,0migration/322573-21kthreadcore20:39:063
339940,0migration/310263-21kthreadcore21:34:073
329940,0watchdog/326239-21kthreadcore20:19:083
329940,0watchdog/30-21swapper/322:04:093
329940,0watchdog/30-21swapper/321:19:083
329940,0watchdog/30-21swapper/320:09:083
329940,0watchdog/30-21swapper/300:34:093
29815040,0irq/29-eth0-tx-24524-21ssh00:13:542
29815040,0irq/29-eth0-tx-11003-21ssh23:28:502
29815040,0irq/29-eth0-tx-0-21swapper/221:51:422
29815040,0irq/29-eth0-tx-0-21swapper/221:24:032
29815040,0irq/29-eth0-tx-0-21swapper/200:41:412
29815040,0irq/29-eth0-tx-0-21swapper/200:34:042
29815040,0irq/29-eth0-tx-0-21swapper/200:23:572
29815040,0irq/29-eth0-tx-0-21swapper/021:18:550
29815040,0irq/29-eth0-tx-0-21swapper/020:33:390
29815040,0irq/29-eth0-tx-0-21swapper/020:24:030
29815040,0irq/29-eth0-tx-0-21swapper/019:58:370
29815040,0irq/29-eth0-tx-0-21swapper/019:39:040
29805040,0irq/28-eth0-rx-0-21swapper/323:23:543
29805040,0irq/28-eth0-rx-0-21swapper/323:14:083
29805040,0irq/28-eth0-rx-0-21swapper/322:29:033
259940,0migration/28051-21taskset20:07:442
259940,0migration/26064-21kthreadcore22:09:082
259940,0migration/25070-21kthreadcore00:19:082
259940,0migration/229020-21smart_sda20:19:132
259940,0migration/222190-21kthreadcore20:39:062
259940,0migration/221790-21sendmail_mailst20:14:112
259940,0migration/219323-21cpuspeed_turbos19:54:012
259940,0migration/21287-21munin-node19:19:012
259940,0migration/212489-21kthreadcore20:09:082
259940,0migration/211261-21munin-node22:29:142
249940,0watchdog/24125-21chrt19:40:082
249940,0watchdog/218227-21sort21:19:082
249940,0watchdog/212878-21kthreadcore19:24:082
249940,0watchdog/20-21swapper/219:34:082
249940,0watchdog/20-21swapper/200:09:092
179940,0migration/18818-21sh21:53:521
179940,0migration/16338-21irqrtprio20:29:051
179940,0migration/14317-21kthreadcore20:04:091
179940,0migration/132027-21kthreadcore19:39:061
179940,0migration/130309-21cpuspeed_turbos20:24:021
179940,0migration/128680-21kthreadcore21:04:091
179940,0migration/127203-21munin-node21:24:101
179940,0migration/127054-21kthreadcore21:44:071
179940,0migration/121715-21timerandwakeup19:29:141
179940,0migration/118060-21df_abs23:14:031
179940,0migration/116574-21gltestperf20:14:031
179940,0migration/115592-21kthreadcore23:29:101
179940,0migration/114387-21fschecks_time23:49:031
179940,0migration/112852-21timerwakeupswit21:34:141
169940,0watchdog/1331-21ssh00:18:331
169940,0watchdog/131382-21kthreadcore22:04:091
169940,0watchdog/126965-21tr19:34:081
169940,0watchdog/124073-21aten2.4-expect22:59:011
169940,0watchdog/120706-21hwlatdetect22:19:051
169940,0watchdog/119925-21rm23:33:531
169940,0watchdog/117904-21ps00:44:131
169940,0watchdog/116811-21ssh00:26:011
169940,0watchdog/10-21swapper/100:34:091
149940,0migration/08294-21runrttasks23:07:410
149940,0migration/032071-21kthreadcore21:29:070
149940,0migration/026098-21kthreadcore19:34:080
149940,0migration/024522-21kthreadcore20:19:080
8305030,0irq/26-0000:00:0-21swapper/220:34:242
8305030,0irq/26-0000:00:0-21swapper/219:59:232
6319932,0cyclictest3571-21lldpd20:48:102
6319932,0cyclictest3524-21snmpd20:28:582
6259932,0cyclictest23894-21awk20:19:061
6259931,0cyclictest0-21swapper/119:48:491
6259930,0cyclictest19959-21perl19:54:031
6189933,0cyclictest18729-21awk23:14:050
6189933,0cyclictest12803-21awk00:44:070
6189933,0cyclictest0-21swapper/000:28:580
6189932,0cyclictest5786-21awk22:29:040
6189932,0cyclictest21527-21sensors21:39:120
6189932,0cyclictest16695-21awk20:14:050
4130,0ktimersoftd/00-21swapper/020:39:340
329930,0watchdog/30-21swapper/321:14:043
29815030,0irq/29-eth0-tx-0-21swapper/020:09:060
29815030,0irq/29-eth0-tx-0-21swapper/019:19:010
29805030,0irq/28-eth0-rx-611-21cyclictest21:00:563
29805030,0irq/28-eth0-rx-0-21swapper/320:34:443
29805030,0irq/28-eth0-rx-0-21swapper/320:14:013
29805030,0irq/28-eth0-rx-0-21swapper/320:03:503
29805030,0irq/28-eth0-rx-0-21swapper/319:59:013
169930,0watchdog/10-21swapper/100:04:051
6189921,0cyclictest15989-21cpu20:59:010
6189921,0cyclictest11012-21latency_hist23:28:500
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional