You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-21 - 04:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Tue Apr 21, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2007424839,0sleep30-21swapper/319:17:233
2022424435,0sleep10-21swapper/119:19:091
2000023622,0sleep00-21swapper/019:16:320
2003723523,0sleep20-21swapper/219:16:582
339970,0migration/314540-21munin-node20:00:593
4160,0ktimersoftd/01373-21vmstat00:06:090
339960,0migration/36690-21sh22:19:383
339960,0migration/36453-21sh21:21:373
339960,0migration/36235-21sh23:32:393
339960,0migration/33971-21sh00:26:423
339960,0migration/323040-21sh23:41:183
339960,0migration/321355-21sh23:22:393
339960,0migration/318398-21sh00:00:463
339960,0migration/31839-21sh00:07:243
29815060,0irq/29-eth0-tx-30804-21memory23:46:022
29805060,0irq/28-eth0-rx-835-21python22:51:083
29805060,0irq/28-eth0-rx-31935-21df00:45:573
29805060,0irq/28-eth0-rx-15876-21grep00:16:023
29805060,0irq/28-eth0-rx-14925-21kthreadcore21:06:013
29805060,0irq/28-eth0-rx-0-21swapper/322:28:203
259960,0migration/214064-21sh23:20:492
149960,0migration/07656-21sh23:35:550
149960,0migration/023101-21sh23:41:280
149960,0migration/016188-21sh21:28:460
149960,0migration/011428-21sh23:00:160
8305050,0irq/26-0000:00:0-21swapper/200:10:442
339950,0migration/39482-21munin-node00:11:053
339950,0migration/39452-21kthreadcore22:21:013
339950,0migration/37548-21gltestperf20:41:003
339950,0migration/36217-21kthreadcore21:41:023
339950,0migration/36147-21kthreadcore21:00:593
339950,0migration/331125-21kthreadcore23:11:013
339950,0migration/330881-21kthreadcore20:56:013
339950,0migration/328723-21fschecks_time20:10:573
339950,0migration/328723-21fschecks_time20:10:573
339950,0migration/325683-21kthreadcore20:06:023
339950,0migration/324775-21munin-node22:46:123
339950,0migration/324560-21kthreadcore19:21:023
339950,0migration/322679-21cpuspeed_turbos22:10:563
339950,0migration/320109-21timerandwakeup20:46:093
339950,0migration/318549-21irqcore19:40:593
339950,0migration/316665-21kthreadcore21:46:013
339950,0migration/316433-21timerandwakeup20:21:093
339950,0migration/313716-21latency_hist22:05:433
339950,0migration/31073-21kthreadcore20:36:003
329950,0watchdog/37538-21kthreadcore20:16:023
329950,0watchdog/322629-21cat21:51:033
329950,0watchdog/31621-21python19:26:063
329950,0watchdog/31430-21fschecks_count22:35:593
29815050,0irq/29-eth0-tx-317001diskmemload22:45:132
29815050,0irq/29-eth0-tx-23651-21python21:31:082
29815050,0irq/29-eth0-tx-22750-21munin-node23:26:072
29815050,0irq/29-eth0-tx-2216-21kthreadcore21:21:010
29815050,0irq/29-eth0-tx-20431-21cyclictest22:36:042
29815050,0irq/29-eth0-tx-1955-21ssh22:53:152
29815050,0irq/29-eth0-tx-0-21swapper/223:55:462
29815050,0irq/29-eth0-tx-0-21swapper/223:08:332
29815050,0irq/29-eth0-tx-0-21swapper/222:21:552
29815050,0irq/29-eth0-tx-0-21swapper/222:02:332
29815050,0irq/29-eth0-tx-0-21swapper/221:58:462
29815050,0irq/29-eth0-tx-0-21swapper/200:29:282
29815050,0irq/29-eth0-tx-0-21swapper/020:40:580
29815050,0irq/29-eth0-tx-0-21swapper/019:31:040
29805050,0irq/28-eth0-rx-9710-21iostat_ios21:26:023
29805050,0irq/28-eth0-rx-28827-21ntp_states23:26:053
29805050,0irq/28-eth0-rx-1641-21munin-node23:50:583
29805050,0irq/28-eth0-rx-0-21swapper/323:58:433
29805050,0irq/28-eth0-rx-0-21swapper/323:36:003
29805050,0irq/28-eth0-rx-0-21swapper/323:20:053
29805050,0irq/28-eth0-rx-0-21swapper/322:58:563
29805050,0irq/28-eth0-rx-0-21swapper/322:40:443
29805050,0irq/28-eth0-rx-0-21swapper/322:31:203
29805050,0irq/28-eth0-rx-0-21swapper/321:56:023
29805050,0irq/28-eth0-rx-0-21swapper/321:33:353
29805050,0irq/28-eth0-rx-0-21swapper/300:41:003
29805050,0irq/28-eth0-rx-0-21swapper/300:33:403
29805050,0irq/28-eth0-rx-0-21swapper/300:21:223
259950,0migration/29117-21kthreadcore23:16:012
259950,0migration/24085-21munin-node20:16:012
259950,0migration/24007-21fschecks_count00:10:582
259950,0migration/232405-21kthreadcore20:56:012
259950,0migration/230328-21kthreadcore21:16:022
259950,0migration/224586-21kthreadcore22:11:012
259950,0migration/218804-21sh21:47:462
259950,0migration/215264-21kthreadcore20:01:022
259950,0migration/214062-21cpuspeed_turbos20:45:562
259950,0migration/213306-21if_eth1.300:16:002
259950,0migration/21089-21munin-node23:50:562
259950,0migration/210538-21sh21:43:572
204349955,0cyclictest31700-21diskmemload23:01:152
204349955,0cyclictest0-21swapper/223:43:492
204349955,0cyclictest0-21swapper/222:48:392
204349955,0cyclictest0-21swapper/221:35:482
204349955,0cyclictest0-21swapper/221:06:002
204349950,0cyclictest0-21swapper/222:10:202
204349950,0cyclictest0-21swapper/200:38:322
204349950,0cyclictest0-21swapper/200:30:482
204339955,0cyclictest0-21swapper/122:38:101
204339955,0cyclictest0-21swapper/122:25:141
204339955,0cyclictest0-21swapper/100:49:011
204339954,0cyclictest5831-21unixbench_multi20:36:081
204339954,0cyclictest25568-21tr19:46:001
204339950,0cyclictest0-21swapper/122:49:591
204339950,0cyclictest0-21swapper/121:21:041
204339950,0cyclictest0-21swapper/120:40:521
204339950,0cyclictest0-21swapper/100:42:051
204339950,0cyclictest0-21swapper/100:11:391
204329954,0cyclictest0-21swapper/019:46:000
179950,0migration/17431-21proc_pri23:51:061
179950,0migration/17051-21kthreadcore22:01:011
179950,0migration/15220-21latency_hist23:15:441
179950,0migration/15192-21kthreadcore20:16:021
179950,0migration/14044-21fschecks_time22:55:551
179950,0migration/130163-21kthreadcore21:36:021
179950,0migration/128501-21munin-node22:11:041
179950,0migration/127704-21fschecks_time22:50:581
179950,0migration/12386-21kthreadcore23:31:021
179950,0migration/118363-21kthreadcore22:26:011
179950,0migration/117379-21kthreadcore20:46:021
179950,0migration/116984-21kthreadcore00:36:021
179950,0migration/112072-21munin-node21:45:571
169950,0watchdog/19279-21grep00:31:031
169950,0watchdog/116628-21ssh21:29:511
149950,0migration/08863-21kthreadcore23:16:010
149950,0migration/06770-21kthreadcore21:41:020
149950,0migration/05966-21taskset20:36:300
149950,0migration/0572-21kthreadcore21:56:020
149950,0migration/04784-21kthreadcore23:31:020
149950,0migration/03637-21kthreadcore19:51:020
149950,0migration/032371-21kthreadcore20:11:020
149950,0migration/032371-21kthreadcore20:11:020
149950,0migration/031719-21kthreadcore00:26:000
149950,0migration/030506-21sh22:15:010
149950,0migration/03038-21aten_r1power_cu21:00:530
149950,0migration/029546-21df_abs23:10:570
149950,0migration/029208-21latency_hist00:25:440
149950,0migration/029021-21kthreadcore22:31:020
149950,0migration/026604-21kthreadcore23:26:030
149950,0migration/025250-21taskset22:46:560
149950,0migration/024468-21irqrtprio00:41:010
149950,0migration/023870-21taskset22:29:220
149950,0migration/023585-21rt-features21:31:060
149950,0migration/023434-21needreboot21:11:020
149950,0migration/018957-21kthreadcore20:01:030
149950,0migration/018096-21missed_timers00:16:030
149950,0migration/017741-21kthreadcore20:46:020
149950,0migration/017209-21aten_r1power_en19:40:540
149950,0migration/017024-21kthreadcore00:36:020
149950,0migration/016886-21kthreadcore23:21:010
149950,0migration/016447-21kthreadcore23:01:020
149950,0migration/015832-21missed_timers19:36:030
149950,0migration/015423-21kthreadcore20:21:020
149950,0migration/010406-21kthreadcore00:31:030
339940,0migration/34446-21kthreadcore19:31:013
339940,0migration/328367-21kthreadcore19:46:013
339940,0migration/327854-21taskset20:54:193
339940,0migration/326662-21fschecks_count21:35:583
339940,0migration/324882-21sh23:45:503
339940,0migration/324769-21aten_r1power_en21:15:553
339940,0migration/312578-21kthreadcore19:36:013
329940,0watchdog/30-21swapper/323:06:033
329940,0watchdog/30-21swapper/319:50:583
29815040,0irq/29-eth0-tx-20157-21ssh21:50:532
29815040,0irq/29-eth0-tx-0-21swapper/223:35:452
29815040,0irq/29-eth0-tx-0-21swapper/223:31:172
29815040,0irq/29-eth0-tx-0-21swapper/223:10:462
29815040,0irq/29-eth0-tx-0-21swapper/222:25:572
29815040,0irq/29-eth0-tx-0-21swapper/222:16:122
29815040,0irq/29-eth0-tx-0-21swapper/221:27:132
29815040,0irq/29-eth0-tx-0-21swapper/200:40:452
29815040,0irq/29-eth0-tx-0-21swapper/200:21:502
29815040,0irq/29-eth0-tx-0-21swapper/200:00:572
29815040,0irq/29-eth0-tx-0-21swapper/019:26:020
29805040,0irq/28-eth0-rx-0-21swapper/323:00:553
29805040,0irq/28-eth0-rx-0-21swapper/322:01:023
29805040,0irq/28-eth0-rx-0-21swapper/320:30:553
29805040,0irq/28-eth0-rx-0-21swapper/300:36:013
259940,0migration/26897-21kthreadcore22:55:592
259940,0migration/25024-21kthreadcore21:21:012
259940,0migration/232365-21fschecks_time20:35:562
259940,0migration/224263-21kthreadcore19:21:022
259940,0migration/221796-21hwlatdetect20:05:582
259940,0migration/221358-21kthreadcore21:11:012
259940,0migration/219611-21kthreadcore19:41:002
249940,0watchdog/215126-21kthreadcore19:36:022
249940,0watchdog/20-21swapper/222:32:072
249940,0watchdog/20-21swapper/219:50:582
204349944,0cyclictest0-21swapper/200:46:152
204349943,0cyclictest3524-21snmpd20:27:492
204349943,0cyclictest3524-21snmpd20:23:042
204349943,0cyclictest3524-21snmpd19:45:492
204349943,0cyclictest3524-21snmpd19:30:492
204349943,0cyclictest25532-21awk20:30:592
204339944,0cyclictest0-21swapper/122:08:411
204339944,0cyclictest0-21swapper/100:28:131
204339943,0cyclictest7572-21awk19:55:581
204339943,0cyclictest3571-21lldpd21:40:551
204339943,0cyclictest3524-21snmpd23:25:511
204339943,0cyclictest3524-21snmpd23:15:511
204339943,0cyclictest3524-21snmpd21:30:501
204339943,0cyclictest3524-21snmpd21:10:501
204339943,0cyclictest3524-21snmpd21:02:501
204339943,0cyclictest3524-21snmpd20:30:491
204339943,0cyclictest3524-21snmpd20:11:491
204339943,0cyclictest3524-21snmpd20:11:491
204339943,0cyclictest29366-21awk20:56:001
204339943,0cyclictest25852-21awk22:31:001
204339943,0cyclictest22191-21awk20:50:591
204339943,0cyclictest21971-21awk00:21:011
204339943,0cyclictest18338-21awk20:25:591
204339943,0cyclictest13163-21awk00:15:591
204329944,0cyclictest0-21swapper/000:05:210
204329943,0cyclictest7620-21awk19:55:580
204329943,0cyclictest3571-21lldpd23:51:570
204329943,0cyclictest3571-21lldpd20:54:540
204329943,0cyclictest3571-21lldpd20:31:230
204329943,0cyclictest3571-21lldpd20:08:230
204329943,0cyclictest21756-21awk23:06:000
204329943,0cyclictest21726-21awk19:20:590
204329943,0cyclictest1988-21awk22:36:010
204329943,0cyclictest18416-21awk20:25:590
204329943,0cyclictest11441-21awk21:05:590
204329943,0cyclictest10791-21awk22:41:000
179940,0migration/1384-21kthreadcore21:56:021
179940,0migration/132729-21taskset23:49:241
179940,0migration/131475-21kthreadcore00:06:011
179940,0migration/128497-21fschecks_time19:25:561
179940,0migration/124990-21timerwakeupswit00:01:101
179940,0migration/124196-21kthreadcore23:06:021
179940,0migration/120794-21kthreadcore19:41:001
179940,0migration/114372-21fschecks_time20:00:591
179940,0migration/113097-21kthreadcore23:56:011
179940,0migration/111879-21kthreadcore22:41:011
179940,0migration/111071-21fschecks_time21:05:571
169940,0watchdog/13524-21snmpd22:15:471
169940,0watchdog/121790-21kthreadcore23:41:031
169940,0watchdog/10-21swapper/123:36:031
169940,0watchdog/10-21swapper/121:51:031
169940,0watchdog/10-21swapper/119:50:581
149940,0migration/08551-21kthreadcore20:16:030
149940,0migration/06064-21fschecks_time22:00:570
149940,0migration/028420-21sh21:55:170
149940,0migration/027881-21sh22:50:580
329930,0watchdog/30-21swapper/320:27:303
329930,0watchdog/30-21swapper/319:56:183
249930,0watchdog/20-21swapper/220:11:102
249930,0watchdog/20-21swapper/220:11:102
204349932,0cyclictest7704-21awk20:41:022
204349932,0cyclictest3524-21snmpd19:26:492
204339932,0cyclictest3524-21snmpd23:20:511
204339932,0cyclictest3524-21snmpd19:20:491
204339932,0cyclictest11070-21awk19:36:001
204339930,0cyclictest10989-21perl20:20:571
204339930,0cyclictest0-21swapper/121:17:421
204329933,0cyclictest8493-21awk22:20:590
204329932,0cyclictest3571-21lldpd23:57:270
204329932,0cyclictest3571-21lldpd21:15:550
204329932,0cyclictest3571-21lldpd00:45:580
204329932,0cyclictest31980-21tail22:15:580
204329932,0cyclictest26005-21awk23:45:590
204329932,0cyclictest14757-21head22:05:580
204329930,0cyclictest4245-21perl00:10:580
204329930,0cyclictest28484-21cut21:36:020
204329930,0cyclictest0-21swapper/020:55:470
169930,0watchdog/10-21swapper/123:03:351
169930,0watchdog/10-21swapper/120:06:141
149930,0migration/012673-21sh21:45:590
329920,0watchdog/30-21swapper/321:10:463
204349921,0cyclictest2969-21cat21:00:432
204349921,0cyclictest20783-21latency_hist20:50:432
204349921,0cyclictest0-21swapper/219:55:442
204339921,0cyclictest0-21swapper/119:30:431
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional