You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 08:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Fri Apr 10, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1954724940,0sleep20-21swapper/219:19:482
1917323625,0sleep30-21swapper/319:15:293
1949523329,0sleep10-21swapper/119:19:151
1929322824,0sleep00-21swapper/019:16:540
29805070,0irq/28-eth0-rx-0-21swapper/323:51:583
196169976,0cyclictest4715-21munin-node00:30:121
35160,0ktimersoftd/30-21swapper/321:05:013
339960,0migration/36290-21sh21:22:263
339960,0migration/331617-21kthreadcore19:25:073
339960,0migration/328935-21sh22:13:173
339960,0migration/324078-21cpuspeed_turbos23:45:023
339960,0migration/323900-21timerandwakeup00:00:163
339960,0migration/323228-21kthreadcore20:50:053
339960,0migration/320571-21kthreadcore19:40:073
339960,0migration/312605-21sh23:19:433
329960,0watchdog/328939-21sh23:27:003
29815060,0irq/29-eth0-tx-21619-21munin-node23:25:182
29805060,0irq/28-eth0-rx-6055-21python22:35:133
29805060,0irq/28-eth0-rx-4578-40yum-updatesd-he22:16:193
29805060,0irq/28-eth0-rx-31739-21munin-run22:34:493
29805060,0irq/28-eth0-rx-24604-21perl21:15:023
29805060,0irq/28-eth0-rx-0-21swapper/323:10:303
196179965,0cyclictest4041-21date23:14:492
196179965,0cyclictest3965-21tr00:10:082
179960,0migration/124859-21latency21:50:081
339950,0migration/38887-21taskset20:17:303
339950,0migration/38494-21smart_sdb21:00:133
339950,0migration/36772-21cpuspeed_turbos23:35:023
339950,0migration/35445-21kernelversion22:00:053
339950,0migration/35133-21munin-node20:35:163
339950,0migration/34878-21aten2.4-expect00:30:043
339950,0migration/325620-21kthreadcore19:45:063
339950,0migration/325113-21kthreadcore19:20:063
339950,0migration/32396-21aten_r1power_po00:10:013
339950,0migration/323710-21unixbench_singl22:45:153
339950,0migration/32091-21aten_r1power_vo22:55:043
339950,0migration/319766-21fschecks_time21:50:033
339950,0migration/318710-21kthreadcore21:30:083
339950,0migration/317341-21kthreadcore23:40:063
339950,0migration/317323-21sh21:46:013
339950,0migration/315785-21taskset23:56:093
339950,0migration/31525-21taskset22:54:343
339950,0migration/314946-21kernelversion00:35:083
339950,0migration/312095-21kthreadcore20:20:043
329950,0watchdog/332145-21cut00:45:053
329950,0watchdog/331029-21cut00:25:093
329950,0watchdog/319971-21ssh23:21:043
329950,0watchdog/319924-21ps20:49:203
29815050,0irq/29-eth0-tx-6534-21ssh00:49:262
29815050,0irq/29-eth0-tx-32023-21munin-node22:35:052
29815050,0irq/29-eth0-tx-28363-21munin-node00:25:022
29815050,0irq/29-eth0-tx-274812chrt00:23:132
29815050,0irq/29-eth0-tx-27004-21munin-node19:25:140
29815050,0irq/29-eth0-tx-25162-21munin-node21:35:022
29815050,0irq/29-eth0-tx-20046-21if_err_eth021:50:042
29815050,0irq/29-eth0-tx-13088-21ssh22:20:582
29815050,0irq/29-eth0-tx-10997-21df23:00:022
29815050,0irq/29-eth0-tx-0-21swapper/223:45:382
29815050,0irq/29-eth0-tx-0-21swapper/223:20:062
29815050,0irq/29-eth0-tx-0-21swapper/222:30:382
29815050,0irq/29-eth0-tx-0-21swapper/221:44:572
29815050,0irq/29-eth0-tx-0-21swapper/221:32:282
29815050,0irq/29-eth0-tx-0-21swapper/200:44:382
29805050,0irq/28-eth0-rx-28484-21kthreadcore00:05:063
29805050,0irq/28-eth0-rx-24925-21kthreadcore23:05:063
29805050,0irq/28-eth0-rx-2473-21cut23:30:073
29805050,0irq/28-eth0-rx-17435-21grep22:05:093
29805050,0irq/28-eth0-rx-0-21swapper/322:39:563
29805050,0irq/28-eth0-rx-0-21swapper/322:20:033
29805050,0irq/28-eth0-rx-0-21swapper/321:57:233
29805050,0irq/28-eth0-rx-0-21swapper/321:36:193
29805050,0irq/28-eth0-rx-0-21swapper/321:25:093
29805050,0irq/28-eth0-rx-0-21swapper/320:40:023
29805050,0irq/28-eth0-rx-0-21swapper/300:43:103
259950,0migration/29920-21kthreadcore21:25:092
259950,0migration/26585-21sh21:23:092
259950,0migration/25382-21sh22:18:322
259950,0migration/22726-21fschecks_time22:55:062
259950,0migration/215773-21kthreadcore20:45:062
259950,0migration/212160-21munin-node00:15:052
259950,0migration/21114-21kthreadcore23:30:072
249950,0watchdog/20-21swapper/200:09:172
196179955,0cyclictest0-21swapper/220:20:082
196169950,0cyclictest0-21swapper/122:46:091
196169950,0cyclictest0-21swapper/100:12:141
196159955,0cyclictest0-21swapper/023:48:420
196159955,0cyclictest0-21swapper/023:20:200
196159955,0cyclictest0-21swapper/023:02:120
196159955,0cyclictest0-21swapper/021:56:180
196159955,0cyclictest0-21swapper/021:36:260
196159955,0cyclictest0-21swapper/020:00:060
196159950,0cyclictest0-21swapper/023:59:260
196159950,0cyclictest0-21swapper/023:28:410
196159950,0cyclictest0-21swapper/022:26:530
196159950,0cyclictest0-21swapper/021:31:230
179950,0migration/130973-21aten_r1power_en20:35:021
179950,0migration/130411-21kthreadcore20:55:071
179950,0migration/129546-21kthreadcore20:10:061
179950,0migration/128992-21kthreadcore19:25:061
179950,0migration/12863-21taskset00:25:411
179950,0migration/128126-21latency_hist00:24:501
179950,0migration/127456-21kthreadcore22:30:081
179950,0migration/124788-21kthreadcore00:40:071
179950,0migration/119135-21kthreadcore21:10:071
149950,0migration/09007-21sh21:41:590
149950,0migration/07373-21sh22:37:510
149950,0migration/07098-21kthreadcore20:15:040
149950,0migration/05479-21munin-node21:20:170
149950,0migration/032703-21kthreadcore23:10:070
149950,0migration/029013-21sh22:30:080
149950,0migration/025469-21kthreadcore00:20:080
149950,0migration/023158-21ntp_offset22:45:100
149950,0migration/015621-21sh21:28:360
149950,0migration/011476-21sh22:02:470
339940,0migration/317319-21fschecks_time20:25:033
339940,0migration/313302-21kthreadcore19:35:063
329940,0watchdog/39852-21cut19:55:083
329940,0watchdog/318926-21cut22:25:083
329940,0watchdog/30-21swapper/319:50:043
29815040,0irq/29-eth0-tx-26248-21ssh23:05:552
29815040,0irq/29-eth0-tx-13322-21ssh00:34:542
29815040,0irq/29-eth0-tx-0-21swapper/223:55:072
29815040,0irq/29-eth0-tx-0-21swapper/223:36:282
29815040,0irq/29-eth0-tx-0-21swapper/223:15:152
29815040,0irq/29-eth0-tx-0-21swapper/222:50:032
29815040,0irq/29-eth0-tx-0-21swapper/222:44:562
29815040,0irq/29-eth0-tx-0-21swapper/221:59:562
29815040,0irq/29-eth0-tx-0-21swapper/221:56:172
29815040,0irq/29-eth0-tx-0-21swapper/200:29:522
29815040,0irq/29-eth0-tx-0-21swapper/019:35:010
29805040,0irq/28-eth0-rx-0-21swapper/323:01:013
29805040,0irq/28-eth0-rx-0-21swapper/321:40:003
29805040,0irq/28-eth0-rx-0-21swapper/320:55:073
29805040,0irq/28-eth0-rx-0-21swapper/320:00:053
29805040,0irq/28-eth0-rx-0-21swapper/300:20:073
29805040,0irq/28-eth0-rx-0-21swapper/300:15:013
259940,0migration/28464-21runrttasks19:30:262
259940,0migration/25561-21latency_hist19:54:492
259940,0migration/23506-21kthreadcore21:40:092
259940,0migration/22939-21kthreadcore20:35:082
259940,0migration/225990-21latency20:50:062
259940,0migration/221233-21aten_r1power_po22:10:022
259940,0migration/220937-21kthreadcore20:25:072
259940,0migration/220454-21kthreadcore23:40:072
259940,0migration/215853-21timerwakeupswit21:05:142
259940,0migration/214861-21aten_r1power_po22:25:022
259940,0migration/214004-21irqcore20:00:042
249940,0watchdog/26019-21kthreadcore20:15:042
249940,0watchdog/22392-21kthreadcore23:50:092
249940,0watchdog/213564-21kthreadcore22:40:082
249940,0watchdog/212939-21diskstats22:05:042
196179943,0cyclictest3571-21lldpd20:42:122
196179943,0cyclictest3571-21lldpd19:54:092
196179943,0cyclictest3524-21snmpd19:41:252
196179943,0cyclictest28468-21awk20:55:052
196179943,0cyclictest21137-21awk20:05:052
196179943,0cyclictest21137-21awk20:05:052
196179943,0cyclictest18542-21awk00:00:062
196179943,0cyclictest10112-21awk19:35:032
196169944,0cyclictest0-21swapper/122:01:411
196169943,0cyclictest6868-21awk20:40:051
196169943,0cyclictest6667-21awk19:55:051
196169943,0cyclictest3524-21snmpd23:16:571
196169943,0cyclictest3524-21snmpd23:07:111
196169943,0cyclictest3524-21snmpd19:29:551
196169943,0cyclictest3524-21snmpd00:48:271
196169943,0cyclictest31726-21awk19:50:031
196169943,0cyclictest28805-21awk21:55:061
196169943,0cyclictest24546-21awk19:45:041
196169943,0cyclictest14010-21awk23:20:041
196169943,0cyclictest13856-21awk20:00:031
196169943,0cyclictest11846-21awk23:00:061
196159943,0cyclictest6898-21awk20:40:050
196159943,0cyclictest3571-21lldpd22:18:430
196159943,0cyclictest3524-21snmpd22:07:260
196159943,0cyclictest3524-21snmpd20:28:250
196159943,0cyclictest3524-21snmpd00:41:420
196159943,0cyclictest3250-21irqbalance23:59:560
196159943,0cyclictest3250-21irqbalance23:50:460
196159943,0cyclictest3250-21irqbalance23:41:060
196159943,0cyclictest3250-21irqbalance23:35:560
196159943,0cyclictest3250-21irqbalance23:30:160
196159943,0cyclictest3250-21irqbalance22:50:060
196159943,0cyclictest3250-21irqbalance21:15:050
196159943,0cyclictest3250-21irqbalance00:44:560
196159943,0cyclictest3250-21irqbalance00:04:560
196159943,0cyclictest22241-21awk22:10:060
196159943,0cyclictest21693-21sadc00:39:500
196159943,0cyclictest20391-21awk23:05:030
196159943,0cyclictest17710-21awk21:10:040
196159943,0cyclictest11970-21ls19:55:150
19140,0ktimersoftd/10-21swapper/122:07:501
179940,0migration/19951-21fschecks_count21:05:021
179940,0migration/19629-21kthreadcore22:20:071
179940,0migration/15868-21munin-node22:35:121
179940,0migration/13678-21kthreadcore23:30:081
179940,0migration/132550-21aten_r1power_fr23:50:021
179940,0migration/129798-21kthreadcore22:50:071
179940,0migration/128314-21kthreadcore20:30:061
179940,0migration/12830-21fschecks_count21:00:021
179940,0migration/126140-21aten_r1power_fr00:05:001
179940,0migration/122837-21kthreadcore22:10:071
179940,0migration/120845-21kthreadcore20:25:071
179940,0migration/120619-21kthreadcore00:00:081
179940,0migration/120334-21munin-node20:50:001
179940,0migration/120293-21fschecks_count19:20:011
179940,0migration/12015-21kthreadcore21:20:091
179940,0migration/113616-21kthreadcore20:20:051
179940,0migration/112976-21latency_hist20:44:481
179940,0migration/112014-21kthreadcore21:25:091
179940,0migration/111542-21kthreadcore22:40:081
179940,0migration/110722-21kthreadcore19:35:051
169940,0watchdog/16314-21runrttasks23:25:321
169940,0watchdog/13185-21iostat22:55:081
169940,0watchdog/12913-21fschecks_time20:15:001
169940,0watchdog/125023-21if_eth1.221:15:041
169940,0watchdog/119888-21kthreadcore21:30:081
169940,0watchdog/115733-21ssh22:25:041
169940,0watchdog/10-21swapper/100:35:091
149940,0migration/08614-21kthreadcore00:30:100
149940,0migration/07489-21irqcore22:20:060
149940,0migration/05271-21hwlatdetect23:15:040
149940,0migration/04627-21kthreadcore00:10:080
149940,0migration/031586-21kthreadcore00:25:090
149940,0migration/029153-21kthreadcore20:30:070
149940,0migration/027064-21latency_hist20:09:490
149940,0migration/027064-21latency_hist20:09:490
149940,0migration/02449-21kthreadcore19:50:060
149940,0migration/020175-21kthreadcore19:40:070
149940,0migration/014705-21kthreadcore20:45:060
149940,0migration/014160-21kthreadcore22:40:080
149940,0migration/013472-21kthreadcore00:15:070
149940,0migration/010710-21irqcore21:05:060
329930,0watchdog/30-21swapper/321:14:443
329930,0watchdog/30-21swapper/320:30:043
329930,0watchdog/30-21swapper/320:07:403
329930,0watchdog/30-21swapper/320:07:403
329930,0watchdog/30-21swapper/319:29:523
29815030,0irq/29-eth0-tx-0-21swapper/020:10:050
29815030,0irq/29-eth0-tx-0-21swapper/019:45:010
29805030,0irq/28-eth0-rx-0-21swapper/320:10:123
259930,0migration/217935-21irqcore21:10:062
249930,0watchdog/20-21swapper/221:00:042
249930,0watchdog/20-21swapper/220:30:042
249930,0watchdog/20-21swapper/220:10:082
249930,0watchdog/20-21swapper/219:25:082
196179932,0cyclictest24515-21awk19:45:042
196179931,0cyclictest23232-21grep19:20:062
196179930,0cyclictest0-21swapper/221:15:062
196169932,0cyclictest30885-21awk22:15:051
196169932,0cyclictest27971-21aten_r1power_en23:10:001
196169932,0cyclictest12142-21awk00:15:041
196169932,0cyclictest11386-21awk21:45:041
196159932,0cyclictest8319-21grep21:00:100
196159932,0cyclictest3250-21irqbalance22:54:560
196159932,0cyclictest3250-21irqbalance20:20:050
196159932,0cyclictest20863-21awk19:20:030
196159932,0cyclictest19135-21basename21:50:010
196159932,0cyclictest18701-21sadc21:49:490
196159932,0cyclictest0-21swapper/019:30:000
196159930,0cyclictest27823-21diskstats20:55:020
196159930,0cyclictest20204-21munin-node20:50:000
196159930,0cyclictest0-21swapper/020:35:090
179930,0migration/18424-21diskmemload21:40:221
179930,0migration/131958-21sh21:35:211
179930,0migration/129547-21kthreadcore23:45:081
179930,0migration/122401-21sh23:41:381
169930,0watchdog/10-21swapper/123:55:051
169930,0watchdog/10-21swapper/123:35:081
169930,0watchdog/10-21swapper/119:40:081
169920,0watchdog/10-21swapper/120:04:521
169920,0watchdog/10-21swapper/120:04:521
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional