You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-16 - 23:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Sat May 16, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
314326059,0sleep00-21swapper/007:20:130
310923626,0sleep20-21swapper/207:19:472
310223627,0sleep30-21swapper/307:19:443
2883023026,0sleep10-21swapper/107:17:581
34649976,0cyclictest0-21swapper/012:23:070
34649974,0cyclictest1563-21iostat_ios08:28:080
34649973,0cyclictest32528-21munin-node07:43:040
35160,0ktimersoftd/30-21swapper/309:58:093
34669960,0cyclictest0-21swapper/211:42:012
34649964,0cyclictest8616-21perl09:18:050
34649964,0cyclictest8517-21perl08:33:020
34649964,0cyclictest8360-21gltestperf11:48:050
34649964,0cyclictest678-21rt-features09:48:130
34649964,0cyclictest6311-21if_err_eth111:28:050
34649964,0cyclictest6181-21perl12:43:040
34649964,0cyclictest4265-21iostat11:08:070
34649964,0cyclictest31056-21aten_r1power_cu10:28:010
34649964,0cyclictest2998-21port_sshpriv08:48:120
34649964,0cyclictest29015-21aten2.4-expect10:08:000
34649964,0cyclictest27697-21perl12:18:050
34649964,0cyclictest26613-21perl09:08:050
34649964,0cyclictest26436-21perl08:23:040
34649964,0cyclictest24814-21aten2.4-expect11:58:020
34649964,0cyclictest24376-21sh11:57:470
34649964,0cyclictest22817-21df11:38:030
34649964,0cyclictest21308-21sh11:35:210
34649964,0cyclictest20765-21diskstats11:18:040
34649964,0cyclictest19449-21perl09:03:030
34649964,0cyclictest19360-21iostat_ios10:58:070
34649964,0cyclictest19211-21perl08:18:050
34649964,0cyclictest18152-21aten2.4-expect07:33:010
34649964,0cyclictest17505-21irqstats10:38:070
34649964,0cyclictest1628-21perl10:48:050
34649964,0cyclictest16219-21vmstat10:53:160
34649964,0cyclictest14689-21perl12:48:040
34649964,0cyclictest12651-21perl09:58:050
34649964,0cyclictest12176-21df_inode12:28:030
34649963,0cyclictest9657-21diskstats09:38:030
34649963,0cyclictest4591-21df_inode08:53:020
34649963,0cyclictest26724-21python12:33:150
34649963,0cyclictest25724-21df_abs07:38:020
34649963,0cyclictest24301-21diskstats09:28:030
34649963,0cyclictest18490-21diskstats09:43:030
34649963,0cyclictest18420-21ssh11:13:180
34649963,0cyclictest17734-21cut10:18:100
34649963,0cyclictest1548-21perl12:03:050
34649963,0cyclictest14900-21munin-node08:38:050
34649963,0cyclictest14664-21ssh10:35:020
34649963,0cyclictest12999-21cut08:13:070
34649963,0cyclictest12450-21ssh10:14:360
34649963,0cyclictest10358-21unixbench_multi08:08:160
34649963,0cyclictest10034-21df_inode12:08:030
34649961,0cyclictest41ktimersoftd/009:33:190
34649960,0cyclictest0-21swapper/008:03:080
339960,0migration/39901-21sh09:53:283
339960,0migration/38208-21sh10:49:573
339960,0migration/329724-21sh11:39:473
339960,0migration/324643-21sh11:57:543
339960,0migration/312727-21sh11:30:243
29805060,0irq/28-eth0-rx-32145-21sh10:45:403
35150,0ktimersoftd/30-21swapper/307:48:143
34669950,0cyclictest0-21swapper/211:35:242
34669950,0cyclictest0-21swapper/211:27:592
34659955,0cyclictest0-21swapper/112:32:511
34659955,0cyclictest0-21swapper/112:07:091
34659955,0cyclictest0-21swapper/111:49:011
34659955,0cyclictest0-21swapper/111:43:581
34659955,0cyclictest0-21swapper/111:33:061
34659955,0cyclictest0-21swapper/110:42:201
34659950,0cyclictest0-21swapper/111:01:531
34659950,0cyclictest0-21swapper/110:16:381
34659950,0cyclictest0-21swapper/109:23:581
34649954,0cyclictest22522-21aten2.4-expect10:23:010
34649953,0cyclictest7398-21sed07:47:490
34649953,0cyclictest453-21latency_hist09:12:500
34649953,0cyclictest3662-21latency_hist07:22:490
34649953,0cyclictest30967-21latency_hist11:42:510
34649953,0cyclictest3005-21latency_hist09:52:500
34649953,0cyclictest28895-21sh11:22:550
34649953,0cyclictest28842-21latency_hist12:37:500
34649953,0cyclictest26650-21cut11:02:500
34649953,0cyclictest24555-21rm10:42:590
34649953,0cyclictest22084-21cut08:43:010
34649953,0cyclictest21736-21latency_hist07:57:490
34649953,0cyclictest20052-21latency_hist10:02:500
34649953,0cyclictest18199-21ssh12:12:530
34649953,0cyclictest15001-21latency_hist09:22:500
34649953,0cyclictest14525-21latency_hist07:52:490
34649953,0cyclictest11336-21cat08:57:500
34649953,0cyclictest11178-21sort07:28:020
339950,0migration/39382-21kthreadcore10:13:093
339950,0migration/38297-21fschecks_count08:33:023
339950,0migration/38009-21fschecks_time10:33:043
339950,0migration/36550-21kthreadcore12:03:103
339950,0migration/36426-21taskset11:45:543
339950,0migration/332473-21kthreadcore12:18:093
339950,0migration/329851-21fschecks_count08:48:043
339950,0migration/328270-21taskset11:21:473
339950,0migration/326763-21aten_r1power_cu11:03:013
339950,0migration/326607-21kthreadcore09:28:083
339950,0migration/326550-21taskset12:17:463
339950,0migration/325884-21fschecks_count07:38:033
339950,0migration/325584-21aten_r1power_cu08:23:023
339950,0migration/324908-21kthreadcore08:43:073
339950,0migration/323603-21kthreadcore10:58:093
339950,0migration/320896-21kthreadcore09:03:073
339950,0migration/320477-21kthreadcore08:38:093
339950,0migration/316945-21kthreadcore11:33:093
339950,0migration/315892-21latency_hist11:52:513
339950,0migration/313973-21timerwakeupswit11:48:173
339950,0migration/310003-21kthreadcore12:43:093
329950,0watchdog/35540-21ssh10:28:413
329950,0watchdog/32979-21kthreadcore08:28:093
329950,0watchdog/328852-21cut09:08:093
329950,0watchdog/30-21swapper/309:23:093
29815050,0irq/29-eth0-tx-31055-21munin-node10:28:102
29815050,0irq/29-eth0-tx-3073-21munin-node09:53:152
29815050,0irq/29-eth0-tx-29979-21hwlatdetect12:38:062
29815050,0irq/29-eth0-tx-29658-21perl11:23:022
29815050,0irq/29-eth0-tx-17379-21cut10:38:062
29815050,0irq/29-eth0-tx-11168-21irqstats12:08:072
29815050,0irq/29-eth0-tx-0-21swapper/212:26:102
29815050,0irq/29-eth0-tx-0-21swapper/212:13:092
29815050,0irq/29-eth0-tx-0-21swapper/211:19:262
29815050,0irq/29-eth0-tx-0-21swapper/211:07:552
29815050,0irq/29-eth0-tx-0-21swapper/210:33:072
29815050,0irq/29-eth0-tx-0-21swapper/210:23:272
29815050,0irq/29-eth0-tx-0-21swapper/210:18:062
29815050,0irq/29-eth0-tx-0-21swapper/209:29:542
29805050,0irq/28-eth0-rx-8845-21hddtemp_smartct09:18:063
29805050,0irq/28-eth0-rx-32544-21kthreadcore10:08:063
29805050,0irq/28-eth0-rx-30545-21irqstats08:03:073
29805050,0irq/28-eth0-rx-12842-21if_err_eth1.312:28:063
29805050,0irq/28-eth0-rx-10732-21irqrtprio09:38:073
29805050,0irq/28-eth0-rx-0-21swapper/312:50:133
29805050,0irq/28-eth0-rx-0-21swapper/312:33:103
29805050,0irq/28-eth0-rx-0-21swapper/312:08:403
29805050,0irq/28-eth0-rx-0-21swapper/311:23:063
29805050,0irq/28-eth0-rx-0-21swapper/311:09:493
29805050,0irq/28-eth0-rx-0-21swapper/310:53:113
29805050,0irq/28-eth0-rx-0-21swapper/310:25:233
29805050,0irq/28-eth0-rx-0-21swapper/310:21:143
29805050,0irq/28-eth0-rx-0-21swapper/310:02:503
29805050,0irq/28-eth0-rx-0-21swapper/309:48:143
29805050,0irq/28-eth0-rx-0-21swapper/309:47:223
29805050,0irq/28-eth0-rx-0-21swapper/309:33:053
29805050,0irq/28-eth0-rx-0-21swapper/309:01:323
29805050,0irq/28-eth0-rx-0-21swapper/307:43:063
29805050,0irq/28-eth0-rx-0-21swapper/307:23:063
27150,0ktimersoftd/20-21swapper/211:03:522
259950,0migration/26947-21munin-node12:03:112
259950,0migration/2622-21aten_r1power_vo09:13:022
259950,0migration/25718-21kthreadcore07:43:092
259950,0migration/228047-21munin-node08:43:092
259950,0migration/227694-21kthreadcore09:08:082
259950,0migration/22479-21sh12:21:582
259950,0migration/222600-21kthreadcore10:03:082
259950,0migration/220480-21aten_r1power_po12:33:032
259950,0migration/213276-21irqrtprio09:58:082
259950,0migration/212435-21kthreadcore09:38:072
249950,0watchdog/27994-21ssh10:49:212
249950,0watchdog/229786-21kthreadcore10:43:092
249950,0watchdog/219800-21grep08:38:092
179950,0migration/13139-21aten_r1power_vo11:08:031
179950,0migration/130042-21if_eth010:08:041
179950,0migration/129741-21sh11:39:511
179950,0migration/12698-21munin-run11:07:501
179950,0migration/126968-21munin-node09:48:031
179950,0migration/121483-21kthreadcore07:33:071
179950,0migration/120863-21switchtime07:53:131
179950,0migration/118099-21smart_sda12:28:131
179950,0migration/117581-21sh10:57:061
179950,0migration/114901-21kthreadcore09:58:091
179950,0migration/110309-21kthreadcore08:33:061
169950,0watchdog/10-21swapper/108:23:091
8305040,0irq/26-0000:00:0-21swapper/307:27:493
8305040,0irq/26-0000:00:0-21swapper/212:27:502
34669943,0cyclictest5236-21munin-node10:13:172
34669943,0cyclictest4880-21awk07:23:052
34669943,0cyclictest3524-21snmpd12:48:082
34669943,0cyclictest1444-21awk08:28:072
34659944,0cyclictest0-21swapper/112:46:531
34659944,0cyclictest0-21swapper/110:37:171
34659943,0cyclictest3571-21lldpd11:18:391
34659943,0cyclictest3524-21snmpd12:47:531
34659943,0cyclictest3524-21snmpd12:00:381
34659943,0cyclictest3524-21snmpd10:26:071
34659943,0cyclictest3524-21snmpd10:21:221
34659943,0cyclictest3524-21snmpd09:32:511
34659943,0cyclictest3524-21snmpd09:12:511
34659943,0cyclictest3524-21snmpd08:54:211
34659943,0cyclictest3524-21snmpd08:44:511
34659943,0cyclictest3524-21snmpd08:39:211
34659943,0cyclictest3524-21snmpd08:20:051
34659943,0cyclictest3524-21snmpd07:38:201
34659943,0cyclictest3524-21snmpd07:28:051
34659943,0cyclictest30184-21awk08:03:061
34659943,0cyclictest27937-21awk12:18:061
34659943,0cyclictest25620-21awk10:43:061
329940,0watchdog/3298050irq/28-eth0-rx-11:13:013
329940,0watchdog/30-21swapper/310:37:573
329940,0watchdog/30-21swapper/309:13:093
329940,0watchdog/30-21swapper/307:58:083
29815040,0irq/29-eth0-tx-5329-21aten2.4-expect12:43:022
29815040,0irq/29-eth0-tx-1293-21ssh09:33:052
29815040,0irq/29-eth0-tx-0-21swapper/211:57:512
29815040,0irq/29-eth0-tx-0-21swapper/211:53:022
29815040,0irq/29-eth0-tx-0-21swapper/211:48:262
29815040,0irq/29-eth0-tx-0-21swapper/211:13:292
29815040,0irq/29-eth0-tx-0-21swapper/210:57:562
29805040,0irq/28-eth0-rx-0-21swapper/312:38:063
29805040,0irq/28-eth0-rx-0-21swapper/312:25:393
29805040,0irq/28-eth0-rx-0-21swapper/307:33:013
259940,0migration/221254-21kthreadcore09:43:082
259940,0migration/220808-21kthreadcore09:03:072
259940,0migration/217960-21runrttasks08:58:442
259940,0migration/214603-21runrttasks07:52:582
259940,0migration/211329-21kthreadcore10:53:072
249940,0watchdog/24619-21perl08:08:042
249940,0watchdog/231136-21munin-node11:43:012
249940,0watchdog/22677-21open_inodes10:08:092
249940,0watchdog/223379-21kthreadcore07:58:082
249940,0watchdog/214827-21diskmemload09:48:172
249940,0watchdog/20-21swapper/209:23:332
249940,0watchdog/20-21swapper/208:53:052
249940,0watchdog/20-21swapper/207:48:082
249940,0watchdog/20-21swapper/207:38:082
19140,0ktimersoftd/117107-21sh12:10:251
179940,0migration/19067-21kthreadcore07:48:081
179940,0migration/15211-21kthreadcore10:48:091
179940,0migration/14199-21cpuspeed_turbos08:08:031
179940,0migration/13960-21cpuspeed_turbos07:23:021
179940,0migration/128007-21kthreadcore09:28:081
179940,0migration/125366-21kthreadcore07:58:091
179940,0migration/121880-21kthreadcore11:53:091
179940,0migration/117443-21sh09:41:541
179940,0migration/111828-21fschecks_time08:13:041
169940,0watchdog/12978-21cut08:28:091
169940,0watchdog/124754-21yum09:43:171
169940,0watchdog/119046-21ssh11:15:011
169940,0watchdog/11852-21kthreadcore12:38:091
169940,0watchdog/10-21swapper/110:27:531
169940,0watchdog/10-21swapper/109:18:091
169940,0watchdog/10-21swapper/107:43:081
34669932,0cyclictest8714-21awk08:33:042
34669932,0cyclictest30160-21awk08:03:062
34669932,0cyclictest19502-21awk08:18:072
34669932,0cyclictest11648-21grep08:13:032
34659932,0cyclictest8581-21grep12:23:081
34659932,0cyclictest4298-21awk09:53:061
34659932,0cyclictest3524-21snmpd09:04:211
34659932,0cyclictest3524-21snmpd09:02:211
34659932,0cyclictest3524-21snmpd08:47:511
34659930,0cyclictest8812-21cut11:28:081
329930,0watchdog/30-21swapper/308:52:573
329930,0watchdog/30-21swapper/308:13:133
29805030,0irq/28-eth0-rx-0-21swapper/308:18:033
29805030,0irq/28-eth0-rx-0-21swapper/308:08:063
259930,0migration/217823-21runrttasks07:32:102
249930,0watchdog/20-21swapper/209:18:092
249930,0watchdog/20-21swapper/208:48:092
249930,0watchdog/20-21swapper/208:23:092
169930,0watchdog/10-21swapper/112:13:011
169930,0watchdog/10-21swapper/111:23:051
169930,0watchdog/10-21swapper/110:03:091
169930,0watchdog/10-21swapper/109:08:051
34669920,0cyclictest0-21swapper/207:32:492
329920,0watchdog/30-21swapper/307:52:563
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional