You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-09 - 04:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Thu Jul 09, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1962024836,0sleep10-21swapper/119:26:591
1946923726,0sleep00-21swapper/019:25:140
1926123626,0sleep30-21swapper/319:22:453
1961123425,0sleep20-21swapper/219:26:522
8305060,0irq/26-0000:00:27409-21if_eth1.322:57:282
339960,0migration/37597-21sh23:57:463
339960,0migration/37325-21sh00:56:313
339960,0migration/331925-21gltestperf20:42:253
339960,0migration/331532-21sh21:42:343
339960,0migration/328737-21latency00:47:313
339960,0migration/327540-21sh23:15:173
339960,0migration/326708-21sh21:59:553
339960,0migration/319845-21dump-pmu-power20:12:123
339960,0migration/318849-21sh00:23:253
29815060,0irq/29-eth0-tx-20070-21munin-node20:12:340
29805060,0irq/28-eth0-rx-4323-21kthreadcore23:37:303
29805060,0irq/28-eth0-rx-24264-21grep20:57:283
197219960,0cyclictest0-21swapper/100:30:181
197159960,0cyclictest0-21swapper/022:39:520
339950,0migration/39982-21kthreadcore22:27:313
339950,0migration/33728-21diskmemload22:06:503
339950,0migration/332090-21kthreadcore23:17:303
339950,0migration/331604-21kthreadcore20:17:333
339950,0migration/327550-21kthreadcore23:32:313
339950,0migration/326150-21kthreadcore23:52:293
339950,0migration/324026-21cpuspeed_turbos20:37:243
339950,0migration/32283-21munin-node20:22:243
339950,0migration/319884-21kthreadcore22:52:293
339950,0migration/319313-21kthreadcore19:47:303
339950,0migration/318949-21fschecks_time00:07:263
339950,0migration/316988-21munin-node20:32:243
339950,0migration/315705-21unixbench_singl19:42:363
339950,0migration/314683-21munin-node20:52:283
339950,0migration/313210-21needreboot23:42:303
339950,0migration/312940-21kthreadcore21:12:293
339950,0migration/311914-21fschecks_count23:07:263
329950,0watchdog/37001-21kthreadcore21:47:313
329950,0watchdog/34278-21if_err_eth1.200:17:283
329950,0watchdog/34229-21python22:22:353
329950,0watchdog/332036-21kthreadcore19:32:313
329950,0watchdog/327971-21ssh00:29:323
329950,0watchdog/324412-21df21:22:233
329950,0watchdog/319940-21kthreadcore00:42:323
329950,0watchdog/317916-21if_err_eth121:17:273
329950,0watchdog/315556-21df22:32:233
329950,0watchdog/315556-21df22:32:233
329950,0watchdog/31426-21sh00:13:203
329950,0watchdog/30-21swapper/322:21:193
329950,0watchdog/30-21swapper/321:38:033
329950,0watchdog/30-21swapper/320:47:273
329950,0watchdog/30-21swapper/319:37:273
29815050,0irq/29-eth0-tx-6125-21grep23:22:292
29815050,0irq/29-eth0-tx-32553-21munin-node22:42:222
29815050,0irq/29-eth0-tx-22222-21munin-node23:32:292
29815050,0irq/29-eth0-tx-21780-21memory23:47:312
29815050,0irq/29-eth0-tx-1884-21munin-node19:37:300
29815050,0irq/29-eth0-tx-14830-21ssh23:45:132
29815050,0irq/29-eth0-tx-14201-21ssh00:42:242
29815050,0irq/29-eth0-tx-12941-21ssh00:39:322
29815050,0irq/29-eth0-tx-11269-21munin-node23:07:292
29815050,0irq/29-eth0-tx-10327-21perl00:02:262
29815050,0irq/29-eth0-tx-0-21swapper/223:54:132
29815050,0irq/29-eth0-tx-0-21swapper/222:39:542
29815050,0irq/29-eth0-tx-0-21swapper/221:32:272
29815050,0irq/29-eth0-tx-0-21swapper/200:54:252
29805050,0irq/28-eth0-rx-9408-21kthreadcore22:07:303
29805050,0irq/28-eth0-rx-15370-21ssh21:35:283
29805050,0irq/28-eth0-rx-14219-21kthreadcore20:27:303
29805050,0irq/28-eth0-rx-12266-21ssh23:24:253
29805050,0irq/28-eth0-rx-11798-21kthreadcore22:47:303
29805050,0irq/28-eth0-rx-10811-21kthreadcore00:37:323
29805050,0irq/28-eth0-rx-0-21swapper/323:47:243
29805050,0irq/28-eth0-rx-0-21swapper/323:31:233
29805050,0irq/28-eth0-rx-0-21swapper/322:12:283
29805050,0irq/28-eth0-rx-0-21swapper/321:52:163
29805050,0irq/28-eth0-rx-0-21swapper/321:27:203
29805050,0irq/28-eth0-rx-0-21swapper/300:32:253
29805050,0irq/28-eth0-rx-0-21swapper/300:02:253
27150,0ktimersoftd/20-21swapper/222:12:402
259950,0migration/23466-21sh23:19:112
259950,0migration/232528-21sh21:44:132
259950,0migration/230298-21kthreadcore20:17:322
259950,0migration/224765-21kthreadcore22:17:302
259950,0migration/22341-21munin-node21:07:232
259950,0migration/222220-21munin-node21:37:312
259950,0migration/211780-21munin-node20:47:312
259950,0migration/211128-21sh22:08:152
249950,0watchdog/20-21swapper/223:59:232
197289955,0cyclictest0-21swapper/200:36:332
197289955,0cyclictest0-21swapper/200:12:262
197289950,0cyclictest0-21swapper/200:23:282
197219955,0cyclictest0-21swapper/121:34:311
197219955,0cyclictest0-21swapper/120:17:351
197219955,0cyclictest0-21swapper/100:13:171
197219950,0cyclictest0-21swapper/123:01:231
197219950,0cyclictest0-21swapper/122:00:031
197219950,0cyclictest0-21swapper/100:37:051
197159955,0cyclictest0-21swapper/023:54:070
197159955,0cyclictest0-21swapper/023:44:210
197159955,0cyclictest0-21swapper/023:18:200
197159955,0cyclictest0-21swapper/023:05:340
197159955,0cyclictest0-21swapper/022:34:490
197159955,0cyclictest0-21swapper/022:34:490
197159955,0cyclictest0-21swapper/021:42:190
197159955,0cyclictest0-21swapper/020:57:230
197159955,0cyclictest0-21swapper/000:25:390
197159955,0cyclictest0-21swapper/000:12:250
197159954,0cyclictest9716-21fschecks_time22:47:260
197159950,0cyclictest0-21swapper/022:44:550
197159950,0cyclictest0-21swapper/021:58:150
179950,0migration/17589-21idleruntime22:27:281
179950,0migration/116124-21kthreadcore21:52:291
179950,0migration/114746-21kthreadcore21:12:291
179950,0migration/113774-21fschecks_count20:52:251
149950,0migration/08432-21kthreadcore23:22:300
149950,0migration/07272-21kthreadcore20:02:270
149950,0migration/06982-21latency_hist23:42:120
149950,0migration/06185-21taskset21:29:440
149950,0migration/06147-21sh00:53:200
149950,0migration/05375-21kthreadcore21:47:310
149950,0migration/031802-21fschecks_time20:42:250
149950,0migration/029969-21kthreadcore21:02:300
149950,0migration/029644-21mdstat20:37:300
149950,0migration/029022-21kthreadcore19:52:270
149950,0migration/027652-21irqcore22:57:290
149950,0migration/027159-21unixbench-2d00:27:370
149950,0migration/025347-21kthreadcore19:27:290
149950,0migration/024920-21idleruntime-cro21:42:120
149950,0migration/024612-21kthreadcore23:32:310
149950,0migration/023414-21kthreadcore00:07:310
149950,0migration/019948-21munin-node23:27:360
149950,0migration/019828-21latency_hist23:12:120
149950,0migration/017030-21fschecks_count20:32:240
149950,0migration/013037-21timerandwakeup22:27:380
149950,0migration/011007-21fschecks_count21:52:240
149950,0migration/01046-21munin-node20:17:370
8305040,0irq/26-0000:00:0-21swapper/222:47:332
8305040,0irq/26-0000:00:0-21swapper/200:07:132
339940,0migration/3371-21kthreadcore21:02:313
339940,0migration/325184-21kthreadcore19:27:293
339940,0migration/322165-21kthreadcore20:12:293
329940,0watchdog/37070-21sh22:42:553
329940,0watchdog/30-21swapper/323:02:233
329940,0watchdog/30-21swapper/320:02:273
329940,0watchdog/30-21swapper/319:52:273
29815040,0irq/29-eth0-tx-27096-21munin-node19:32:280
29815040,0irq/29-eth0-tx-16013-21fschecks_time22:32:242
29815040,0irq/29-eth0-tx-16013-21fschecks_time22:32:242
29815040,0irq/29-eth0-tx-0-21swapper/223:12:242
29815040,0irq/29-eth0-tx-0-21swapper/222:22:302
29815040,0irq/29-eth0-tx-0-21swapper/222:02:162
29815040,0irq/29-eth0-tx-0-21swapper/221:52:472
29815040,0irq/29-eth0-tx-0-21swapper/200:48:202
29815040,0irq/29-eth0-tx-0-21swapper/021:12:300
29815040,0irq/29-eth0-tx-0-21swapper/020:47:320
29815040,0irq/29-eth0-tx-0-21swapper/019:46:070
29805040,0irq/28-eth0-rx-0-21swapper/322:57:303
29805040,0irq/28-eth0-rx-0-21swapper/322:37:273
259940,0migration/25323-21kthreadcore00:17:302
259940,0migration/2530-21kthreadcore23:37:292
259940,0migration/229997-21unixbench-2d19:52:342
259940,0migration/225869-21kthreadcore20:37:292
259940,0migration/222179-21kthreadcore21:57:292
259940,0migration/221896-21kthreadcore21:17:302
259940,0migration/221008-21kthreadcore20:32:292
259940,0migration/217831-21cpuspeed_turbos22:52:242
259940,0migration/215605-21kthreadcore20:07:282
259940,0migration/21513-21latency_hist21:47:122
249940,0watchdog/231775-21munin-node19:57:272
249940,0watchdog/231350-21aten_r1power_en21:27:232
249940,0watchdog/220991-21if_err_eth1.219:27:272
249940,0watchdog/210650-21kthreadcore22:27:312
249940,0watchdog/20-21swapper/223:02:232
249940,0watchdog/20-21swapper/221:22:272
249940,0watchdog/20-21swapper/220:02:312
197289943,0cyclictest3524-21snmpd20:54:052
197289943,0cyclictest21592-21awk00:27:272
197289943,0cyclictest16629-21sadc21:17:122
197289943,0cyclictest10235-21awk19:42:252
197289940,0cyclictest0-21swapper/223:27:202
197289940,0cyclictest0-21swapper/220:27:202
197219944,0cyclictest0-21swapper/123:31:111
197219944,0cyclictest0-21swapper/120:47:131
197219943,0cyclictest3591-21awk21:07:281
197219943,0cyclictest3571-21lldpd22:09:261
197219943,0cyclictest3571-21lldpd00:38:271
197219943,0cyclictest3524-21snmpd23:49:381
197219943,0cyclictest3524-21snmpd23:02:231
197219943,0cyclictest3524-21snmpd22:52:221
197219943,0cyclictest3524-21snmpd22:42:521
197219943,0cyclictest3524-21snmpd22:32:221
197219943,0cyclictest3524-21snmpd22:32:221
197219943,0cyclictest3524-21snmpd22:12:371
197219943,0cyclictest3524-21snmpd21:42:361
197219943,0cyclictest3524-21snmpd00:09:541
197219943,0cyclictest32597-21awk00:52:271
197219943,0cyclictest31958-21awk19:57:281
197219943,0cyclictest29660-21awk23:17:281
197219943,0cyclictest25684-21awk23:52:281
197219943,0cyclictest22631-21awk22:17:281
197219943,0cyclictest21105-21awk19:27:271
197159944,0cyclictest24872-21kworker/0:122:15:270
197159944,0cyclictest0-21swapper/023:48:360
197159944,0cyclictest0-21swapper/023:09:490
197159944,0cyclictest0-21swapper/021:24:300
197159944,0cyclictest0-21swapper/000:44:440
197159943,0cyclictest3571-21lldpd22:25:270
197159943,0cyclictest3250-21irqbalance23:57:290
197159943,0cyclictest3250-21irqbalance22:52:290
197159943,0cyclictest3250-21irqbalance22:06:380
197159943,0cyclictest3250-21irqbalance21:17:180
197159943,0cyclictest3250-21irqbalance20:52:280
197159943,0cyclictest3250-21irqbalance20:07:180
197159943,0cyclictest3250-21irqbalance20:00:080
197159943,0cyclictest22684-21awk22:17:280
197159943,0cyclictest10426-21awk20:27:270
179940,0migration/18203-21kthreadcore23:22:301
179940,0migration/14707-21proc_pri23:37:331
179940,0migration/14110-21proc_pri22:22:341
179940,0migration/130819-21runrttasks21:24:461
179940,0migration/129301-21kthreadcore19:32:301
179940,0migration/126036-21ntp_kernel_pll_20:12:321
179940,0migration/125941-21kthreadcore23:32:311
179940,0migration/120852-21kthreadcore20:32:291
179940,0migration/114312-21irqrtprio20:07:281
179940,0migration/113165-21kthreadcore20:27:291
179940,0migration/110367-21kthreadcore23:42:281
169940,0watchdog/19915-21ps22:47:271
169940,0watchdog/17002-21kthreadcore21:47:311
169940,0watchdog/14593-21kthreadcore23:57:311
169940,0watchdog/13070-21if_eth1.219:37:271
169940,0watchdog/130120-21users19:52:351
169940,0watchdog/129725-21tail20:37:311
169940,0watchdog/123875-21kthreadcore23:12:311
169940,0watchdog/123213-21ssh21:38:031
169940,0watchdog/116921-21ssh00:04:321
169940,0watchdog/10-21swapper/121:30:391
169940,0watchdog/10-21swapper/100:50:201
149940,0migration/05585-21kthreadcore20:22:300
149940,0migration/05534-21aten_r1power_en00:37:240
149940,0migration/04585-21diskmemload22:07:250
149940,0migration/011439-21kthreadcore00:02:300
149940,0migration/010359-21kthreadcore21:32:300
329930,0watchdog/30-21swapper/321:07:233
29815030,0irq/29-eth0-tx-0-21swapper/021:07:230
29805030,0irq/28-eth0-rx-0-21swapper/319:57:143
249930,0watchdog/20-21swapper/221:02:352
197289933,0cyclictest3571-21lldpd20:13:242
197289933,0cyclictest0-21swapper/220:42:262
197289932,0cyclictest3524-21snmpd20:26:202
197289932,0cyclictest3524-21snmpd19:37:342
197289932,0cyclictest28235-21awk19:32:282
197289932,0cyclictest21431-21awk20:57:252
197289931,0cyclictest0-21swapper/219:47:312
197219933,0cyclictest3571-21lldpd23:09:571
197219932,0cyclictest3236-21awk20:22:281
197219932,0cyclictest28929-21awk22:02:281
197219932,0cyclictest17449-21awk19:47:281
197219930,0cyclictest0-21swapper/119:45:531
197159933,0cyclictest21507-21kworker/0:100:32:260
197159932,0cyclictest4451-21ps00:17:290
197159932,0cyclictest23972-21awk00:47:280
197159932,0cyclictest16721-21df19:47:250
169930,0watchdog/119941-21kthreadcore00:42:321
169930,0watchdog/113056-21munin-node00:22:281
169930,0watchdog/10-21swapper/121:02:311
169930,0watchdog/10-21swapper/120:57:351
169930,0watchdog/10-21swapper/120:02:231
169930,0watchdog/10-21swapper/100:17:281
197219920,0cyclictest0-21swapper/121:17:211
197219920,0cyclictest0-21swapper/120:42:121
169920,0watchdog/10-21swapper/122:37:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional