You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 02:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Thu Dec 25, 2025 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3236024435,0sleep10-21swapper/119:08:171
3253124132,0sleep20-21swapper/219:10:182
3238923929,0sleep30-21swapper/319:08:393
3245423624,0sleep00-21swapper/019:09:240
339960,0migration/329403-21sh21:20:083
339960,0migration/328552-21sh21:54:413
339960,0migration/324414-21sh00:35:593
339960,0migration/317818-21sh23:16:383
326699960,0cyclictest0-21swapper/223:34:062
326689965,0cyclictest18882-21ssh21:48:011
326689960,0cyclictest0-21swapper/100:21:251
326679965,0cyclictest0-21swapper/020:36:140
326679960,0cyclictest0-21swapper/000:28:380
329960,0watchdog/35609-21ssh22:52:133
29815060,0irq/29-eth0-tx-0-21swapper/019:41:140
29805060,0irq/28-eth0-rx-30121-21ssh22:49:533
29805060,0irq/28-eth0-rx-28649-21if_eth022:31:203
29805060,0irq/28-eth0-rx-21176-21irqcore23:21:183
29805060,0irq/28-eth0-rx-14772-21munin-run22:06:013
29805060,0irq/28-eth0-rx-1316-21perl19:56:163
29805060,0irq/28-eth0-rx-12736-21cut21:11:163
149960,0migration/030622-21fschecks_time21:01:150
149960,0migration/025715-21sh21:36:110
149960,0migration/025343-21sh21:35:540
149960,0migration/017028-21sh23:54:460
149960,0migration/014729-21sh21:28:160
8305050,0irq/26-0000:00:18717-21sh20:31:012
339950,0migration/39209-21kthreadcore21:26:183
339950,0migration/38385-21kthreadcore22:36:203
339950,0migration/37955-21kthreadcore23:31:213
339950,0migration/36751-21munin-node19:11:223
339950,0migration/35337-21diskmemload00:23:123
339950,0migration/34989-21kthreadcore22:16:193
339950,0migration/332678-21kthreadcore21:21:183
339950,0migration/331523-21kthreadcore20:16:193
339950,0migration/330007-21munin-node23:26:203
339950,0migration/324633-21latency_hist00:36:023
339950,0migration/323472-21kthreadcore19:46:193
339950,0migration/322334-21kthreadcore21:31:213
339950,0migration/319899-21irqcore22:26:173
339950,0migration/31955-21sh23:11:103
339950,0migration/319489-21fschecks_count20:31:163
339950,0migration/316346-21kthreadcore22:41:193
339950,0migration/314392-21taskset19:17:003
339950,0migration/310579-21munin-node21:06:213
326699955,0cyclictest0-21swapper/220:01:162
326699955,0cyclictest0-21swapper/200:32:172
326699954,0cyclictest6290-21mailstats23:46:242
326699950,0cyclictest0-21swapper/223:26:512
326699950,0cyclictest0-21swapper/222:37:022
326699950,0cyclictest0-21swapper/221:39:012
326689955,0cyclictest0-21swapper/100:30:051
326689955,0cyclictest0-21swapper/100:01:051
326689954,0cyclictest3524-21snmpd00:09:151
326689950,0cyclictest0-21swapper/123:41:031
326689950,0cyclictest0-21swapper/123:11:441
326689950,0cyclictest0-21swapper/122:33:441
326679955,0cyclictest0-21swapper/023:16:160
326679955,0cyclictest0-21swapper/022:41:160
326679955,0cyclictest0-21swapper/021:06:020
326679955,0cyclictest0-21swapper/000:03:340
326679950,0cyclictest0-21swapper/022:48:030
329950,0watchdog/323375-21iostat_ios19:26:163
329950,0watchdog/316383-21tr00:11:213
329950,0watchdog/315254-21cut19:41:203
329950,0watchdog/310866-21cut22:56:213
29815050,0irq/29-eth0-tx-593-21munin-node19:56:160
29815050,0irq/29-eth0-tx-30891-21kthreadcore22:31:222
29815050,0irq/29-eth0-tx-28428-21kthreadcore00:01:232
29815050,0irq/29-eth0-tx-28004-21ssh23:06:192
29815050,0irq/29-eth0-tx-0-21swapper/223:36:322
29815050,0irq/29-eth0-tx-0-21swapper/222:16:182
29815050,0irq/29-eth0-tx-0-21swapper/222:05:372
29815050,0irq/29-eth0-tx-0-21swapper/020:26:180
29815050,0irq/29-eth0-tx-0-21swapper/020:02:050
29815050,0irq/29-eth0-tx-0-21swapper/019:52:030
29805050,0irq/28-eth0-rx-30393-21if_err_eth019:31:153
29805050,0irq/28-eth0-rx-30095-21kthreadcore00:01:233
29805050,0irq/28-eth0-rx-19219-21ssh21:48:473
29805050,0irq/28-eth0-rx-11331-21latency_hist19:41:013
29805050,0irq/28-eth0-rx-0-21swapper/323:57:063
29805050,0irq/28-eth0-rx-0-21swapper/323:38:553
29805050,0irq/28-eth0-rx-0-21swapper/323:10:443
29805050,0irq/28-eth0-rx-0-21swapper/323:03:073
29805050,0irq/28-eth0-rx-0-21swapper/322:10:503
29805050,0irq/28-eth0-rx-0-21swapper/321:36:193
29805050,0irq/28-eth0-rx-0-21swapper/320:06:203
259950,0migration/27661-21kthreadcore19:36:192
259950,0migration/25824-21latency_hist22:01:012
259950,0migration/24618-21sh00:21:292
259950,0migration/228227-21taskset21:17:402
259950,0migration/225394-21kthreadcore00:16:202
259950,0migration/220715-21kthreadcore22:26:182
249950,0watchdog/27028-21kthreadcore00:06:212
179950,0migration/18331-21sh23:50:201
179950,0migration/1376-21sh23:08:041
179950,0migration/125315-21fschecks_count00:36:141
179950,0migration/12458-21kernelversion20:41:171
179950,0migration/122492-21kthreadcore20:31:201
179950,0migration/121371-21sh23:37:041
179950,0migration/118025-21kthreadcore20:51:211
179950,0migration/117951-21kthreadcore20:06:211
169950,0watchdog/119249-21kthreadcore00:31:211
169950,0watchdog/10-21swapper/121:41:201
149950,0migration/09378-21kthreadcore22:56:200
149950,0migration/07087-21kernelversion23:31:200
149950,0migration/05632-21ksmtuned22:00:440
149950,0migration/04165-21latency_hist19:36:010
149950,0migration/04028-21latency_hist22:36:010
149950,0migration/03255-21ntp_kernel_err20:16:210
149950,0migration/03146-21sh22:34:330
149950,0migration/030626-21kthreadcore23:06:200
149950,0migration/029867-21gltestperf23:26:180
149950,0migration/028536-21sh21:18:170
149950,0migration/028117-21kthreadcore23:41:210
149950,0migration/026286-21kthreadcore19:26:170
149950,0migration/025259-21latency_hist23:06:010
149950,0migration/024972-21timerandwakeup19:46:260
149950,0migration/023448-21kthreadcore21:51:190
149950,0migration/022308-21munin-node00:16:170
149950,0migration/022132-21ksmtuned20:10:420
149950,0migration/021735-21sh23:37:560
149950,0migration/021633-21smart_nvme0n120:51:260
149950,0migration/019936-21kthreadcore22:06:190
149950,0migration/018920-21cpuspeed_turbos22:26:130
149950,0migration/016200-21kthreadcore21:11:200
149950,0migration/014727-21kthreadcore00:11:200
149950,0migration/011996-21fschecks_count21:46:140
149950,0migration/011870-21kthreadcore22:01:210
149950,0migration/010638-21kthreadcore20:46:190
8305040,0irq/26-0000:00:0-21swapper/223:16:022
339940,0migration/38384-21kthreadcore20:21:193
339940,0migration/3310-21taskset19:55:353
339940,0migration/326504-21kthreadcore22:11:183
339940,0migration/326205-21kthreadcore20:11:203
339940,0migration/321274-21diskmemload00:16:103
339940,0migration/311660-21kthreadcore22:21:193
339940,0migration/311363-21kthreadcore20:01:223
326699943,0cyclictest3571-21lldpd23:01:202
326699943,0cyclictest3571-21lldpd21:11:172
326699943,0cyclictest3571-21lldpd20:40:472
326699943,0cyclictest3571-21lldpd20:11:172
326699943,0cyclictest3524-21snmpd19:34:132
326699943,0cyclictest3524-21snmpd19:28:122
326699943,0cyclictest3250-21irqbalance22:46:082
326699943,0cyclictest3250-21irqbalance21:07:582
326699943,0cyclictest3250-21irqbalance00:26:182
326699943,0cyclictest30905-21awk21:01:172
326699943,0cyclictest19804-21awk19:46:172
326699943,0cyclictest16431-21munin-node21:31:152
326699943,0cyclictest10788-21awk22:21:172
326689944,0cyclictest0-21swapper/123:03:131
326689944,0cyclictest0-21swapper/122:22:331
326689943,0cyclictest8283-21awk21:26:161
326689943,0cyclictest3571-21lldpd21:31:171
326689943,0cyclictest3571-21lldpd21:04:171
326689943,0cyclictest3571-21lldpd19:46:161
326689943,0cyclictest3524-21snmpd23:32:451
326689943,0cyclictest3524-21snmpd19:53:281
326689943,0cyclictest3524-21snmpd19:36:281
326689943,0cyclictest32063-21awk22:51:191
326689943,0cyclictest25148-21awk22:11:161
326689943,0cyclictest19060-21awk23:56:181
326689943,0cyclictest1707-21awk19:56:181
326689943,0cyclictest16058-21awk19:21:171
326689943,0cyclictest13049-21awk21:11:171
326689943,0cyclictest12904-21awk20:26:181
326679944,0cyclictest0-21swapper/000:32:150
326679943,0cyclictest3571-21lldpd23:50:200
326679943,0cyclictest32075-21kworker/0:122:51:250
326679943,0cyclictest10847-21awk22:21:170
326679941,0cyclictest11504-21munin-run20:26:010
329940,0watchdog/315639-21kthreadcore20:26:203
329940,0watchdog/311713-21kthreadcore20:46:203
329940,0watchdog/30-21swapper/323:51:213
329940,0watchdog/30-21swapper/321:41:203
329940,0watchdog/30-21swapper/320:51:203
329940,0watchdog/30-21swapper/319:21:203
29815040,0irq/29-eth0-tx-7077-21ssh21:26:082
29815040,0irq/29-eth0-tx-31343-21ssh22:51:162
29815040,0irq/29-eth0-tx-23435-21sh23:41:142
29815040,0irq/29-eth0-tx-22628-21munin-node20:56:180
29815040,0irq/29-eth0-tx-22628-21munin-node20:56:180
29815040,0irq/29-eth0-tx-0-21swapper/223:56:212
29815040,0irq/29-eth0-tx-0-21swapper/223:51:242
29815040,0irq/29-eth0-tx-0-21swapper/223:11:412
29815040,0irq/29-eth0-tx-0-21swapper/222:41:072
29815040,0irq/29-eth0-tx-0-21swapper/221:51:202
29815040,0irq/29-eth0-tx-0-21swapper/200:36:092
29815040,0irq/29-eth0-tx-0-21swapper/200:11:282
29815040,0irq/29-eth0-tx-0-21swapper/019:31:570
29815040,0irq/29-eth0-tx-0-21swapper/019:11:160
29805040,0irq/28-eth0-rx-0-21swapper/323:46:153
29805040,0irq/28-eth0-rx-0-21swapper/323:41:043
29805040,0irq/28-eth0-rx-0-21swapper/321:57:303
29805040,0irq/28-eth0-rx-0-21swapper/320:41:113
29805040,0irq/28-eth0-rx-0-21swapper/300:26:133
29805040,0irq/28-eth0-rx-0-21swapper/300:08:083
259940,0migration/28884-21fschecks_time20:46:162
259940,0migration/25639-21kthreadcore20:41:182
259940,0migration/231252-21taskset21:21:162
259940,0migration/226742-21kthreadcore20:56:192
259940,0migration/226742-21kthreadcore20:56:192
259940,0migration/226171-21kthreadcore22:11:182
259940,0migration/22488-21aten_r1power_po21:41:142
259940,0migration/223010-21kthreadcore23:21:192
259940,0migration/220247-21kthreadcore19:21:202
259940,0migration/218977-21aten2.4-expect20:31:132
259940,0migration/214966-21latency_hist22:06:012
259940,0migration/210440-21needreboot20:21:212
249940,0watchdog/23270-21kthreadcore19:56:202
249940,0watchdog/23114-21memory20:16:202
249940,0watchdog/218313-21ssh21:46:402
249940,0watchdog/216914-21sed20:51:202
249940,0watchdog/215510-21cpuspeed_turbos20:06:162
249940,0watchdog/20-21swapper/222:56:212
249940,0watchdog/20-21swapper/219:41:202
179940,0migration/18957-21kthreadcore22:36:201
179940,0migration/15062-21taskset21:22:311
179940,0migration/127048-21sh23:22:201
179940,0migration/126360-21fschecks_count21:36:151
179940,0migration/123756-21kthreadcore21:16:201
179940,0migration/119275-21taskset23:20:091
179940,0migration/117365-21needreboot19:41:211
179940,0migration/110336-21kthreadcore20:46:191
169940,0watchdog/1338-21taskset20:37:441
169940,0watchdog/129366-21ssh00:19:411
169940,0watchdog/115248-21ssh22:58:451
169940,0watchdog/10-21swapper/123:26:211
169940,0watchdog/10-21swapper/122:08:091
169940,0watchdog/10-21swapper/122:01:201
169940,0watchdog/10-21swapper/120:56:161
169940,0watchdog/10-21swapper/120:56:161
169940,0watchdog/10-21swapper/100:12:411
149940,0migration/05135-21kthreadcore23:11:200
149940,0migration/028803-21kthreadcore22:11:190
149940,0migration/027156-21kthreadcore00:36:180
149940,0migration/025702-21kthreadcore20:11:200
149940,0migration/022898-21kthreadcore23:56:210
326699933,0cyclictest0-21swapper/219:51:202
326699932,0cyclictest8813-21awk19:16:162
326699932,0cyclictest3571-21lldpd19:11:152
326689933,0cyclictest3571-21lldpd21:07:471
326689932,0cyclictest8955-21cut20:21:191
326689932,0cyclictest30544-21tail20:16:151
326689932,0cyclictest30500-21awk19:31:151
326689932,0cyclictest24924-21sensors22:26:231
326689932,0cyclictest20318-21sort21:51:011
326679933,0cyclictest32075-21kworker/0:123:21:110
326679933,0cyclictest32075-21kworker/0:122:16:130
326679933,0cyclictest32075-21kworker/0:100:06:130
326679933,0cyclictest22155-21kworker/0:120:41:080
326679933,0cyclictest22155-21kworker/0:120:31:360
326679933,0cyclictest10968-21kworker/0:021:21:150
326679932,0cyclictest3206-17auditd00:21:020
326679930,0cyclictest3124-21perl21:41:160
326679930,0cyclictest0-21swapper/019:21:130
326679930,0cyclictest0-21swapper/019:16:150
329930,0watchdog/36314-21runrttasks20:37:443
29805030,0irq/28-eth0-rx-0-21swapper/321:01:183
29805030,0irq/28-eth0-rx-0-21swapper/320:56:123
29805030,0irq/28-eth0-rx-0-21swapper/320:56:123
179930,0migration/18970-21interrupts19:16:171
179930,0migration/122255-21cpuspeed_turbos22:46:141
169930,0watchdog/10-21swapper/123:51:211
169930,0watchdog/10-21swapper/122:41:171
169930,0watchdog/10-21swapper/122:16:131
169930,0watchdog/10-21swapper/121:56:201
169930,0watchdog/10-21swapper/120:11:201
169930,0watchdog/10-21swapper/120:01:241
169930,0watchdog/10-21swapper/119:26:041
169920,0watchdog/10-21swapper/119:11:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional