You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 03:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Mon Sep 07, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2657326362,0sleep20-21swapper/219:30:262
2666425352,0sleep10-21swapper/119:31:291
2650624231,0sleep00-21swapper/019:29:400
2640923927,0sleep30-21swapper/319:28:313
267869970,0cyclictest0-21swapper/000:42:270
339960,0migration/38919-21sh00:58:023
339960,0migration/323005-21sh21:42:023
339960,0migration/319552-21sh22:32:563
339960,0migration/318759-21munin-node20:07:273
339960,0migration/311434-21latency_hist23:47:083
329960,0watchdog/38819-21ls21:52:223
29805060,0irq/28-eth0-rx-6472-21diskstats22:47:203
29805060,0irq/28-eth0-rx-20705-21ssh00:09:013
29805060,0irq/28-eth0-rx-0-21swapper/300:01:273
267889960,0cyclictest0-21swapper/223:23:522
267879960,0cyclictest0-21swapper/121:46:531
267869960,0cyclictest0-21swapper/022:02:350
179960,0migration/127817-21fschecks_time23:37:231
149960,0migration/05605-21aten_r1power_fr20:02:210
8305050,0irq/26-0000:00:31821-21idleruntime-cro21:47:072
8305050,0irq/26-0000:00:1907-21cut20:22:072
339950,0migration/39546-21fschecks_count19:42:183
339950,0migration/37958-21kthreadcore21:32:263
339950,0migration/37025-21kthreadcore23:22:283
339950,0migration/327750-21latency_hist22:22:083
339950,0migration/326415-21runrttasks23:17:243
339950,0migration/324685-21kthreadcore00:12:273
339950,0migration/324676-21munin-node19:52:253
339950,0migration/32457-21df_abs22:07:213
339950,0migration/323936-21kthreadcore20:57:253
339950,0migration/323589-21kthreadcore20:12:253
339950,0migration/322968-21sh00:30:103
339950,0migration/322211-21kthreadcore21:17:263
339950,0migration/317552-21kthreadcore20:52:263
339950,0migration/316509-21kthreadcore22:52:263
339950,0migration/314706-21kthreadcore21:12:263
339950,0migration/311777-21taskset00:02:503
339950,0migration/311523-21munin-node22:12:243
339950,0migration/310821-21kthreadcore00:42:263
329950,0watchdog/3626-21irqrtprio23:02:273
329950,0watchdog/35271-21grep21:47:263
329950,0watchdog/35052-21python21:27:303
329950,0watchdog/327599-21perl23:37:233
329950,0watchdog/327080-21kthreadcore22:57:263
329950,0watchdog/323430-21cut21:42:183
329950,0watchdog/321406-21kthreadcore20:32:263
29815050,0irq/29-eth0-tx-15618-21grep00:07:242
29815050,0irq/29-eth0-tx-0-21swapper/221:32:272
29805050,0irq/28-eth0-rx-4358-21netstat00:17:283
29805050,0irq/28-eth0-rx-31688-21kthreadcore20:17:263
29805050,0irq/28-eth0-rx-30250-21diskstats22:42:203
29805050,0irq/28-eth0-rx-20630-21diskstats23:52:223
29805050,0irq/28-eth0-rx-20630-21diskstats23:52:223
29805050,0irq/28-eth0-rx-17837-21port_sshpriv23:47:293
29805050,0irq/28-eth0-rx-0-21swapper/323:32:213
29805050,0irq/28-eth0-rx-0-21swapper/323:12:283
29805050,0irq/28-eth0-rx-0-21swapper/322:37:383
29805050,0irq/28-eth0-rx-0-21swapper/322:27:263
29805050,0irq/28-eth0-rx-0-21swapper/322:02:233
29805050,0irq/28-eth0-rx-0-21swapper/321:22:243
29805050,0irq/28-eth0-rx-0-21swapper/320:22:263
29805050,0irq/28-eth0-rx-0-21swapper/319:37:253
29805050,0irq/28-eth0-rx-0-21swapper/300:52:253
29805050,0irq/28-eth0-rx-0-21swapper/300:40:003
29805050,0irq/28-eth0-rx-0-21swapper/300:32:273
267889955,0cyclictest0-21swapper/222:24:072
267889955,0cyclictest0-21swapper/221:56:222
267889954,0cyclictest2913-21grep23:57:332
267889950,0cyclictest0-21swapper/223:38:512
267889950,0cyclictest0-21swapper/221:07:202
267879955,0cyclictest0-21swapper/123:48:071
267879955,0cyclictest0-21swapper/122:54:311
267879955,0cyclictest0-21swapper/100:24:041
267879954,0cyclictest13522-21grep22:32:241
267879950,0cyclictest0-21swapper/123:24:471
267879950,0cyclictest0-21swapper/122:22:401
267869954,0cyclictest3453-21ps21:07:250
267869950,0cyclictest0-21swapper/022:51:090
267869950,0cyclictest0-21swapper/022:39:570
267869950,0cyclictest0-21swapper/021:55:200
267869950,0cyclictest0-21swapper/000:34:150
267869950,0cyclictest0-21swapper/000:07:370
259950,0migration/29497-21munin-node23:42:342
259950,0migration/23461-21kthreadcore23:02:282
259950,0migration/227733-21kthreadcore00:32:282
259950,0migration/226542-21sh22:19:112
259950,0migration/222267-21sh00:28:062
259950,0migration/221188-21hddtemp_smartct23:52:232
259950,0migration/221188-21hddtemp_smartct23:52:232
259950,0migration/219585-21kthreadcore21:57:262
259950,0migration/21683-21kthreadcore19:57:252
259950,0migration/210905-21diskmemload22:12:232
179950,0migration/131682-21kthreadcore20:17:261
179950,0migration/124439-21hddtemp_smartct19:52:221
179950,0migration/123283-21sh00:12:251
179950,0migration/123118-21timerwakeupswit21:17:331
169950,0watchdog/123149-21ssh23:12:431
169950,0watchdog/10-21swapper/121:37:221
149950,0migration/09016-21sh22:08:010
149950,0migration/07974-21sh23:22:370
149950,0migration/07879-21ntp_kernel_pll_19:37:270
149950,0migration/07522-21kthreadcore23:42:270
149950,0migration/031611-21kthreadcore23:57:260
149950,0migration/030526-21sh22:59:410
149950,0migration/027909-21kthreadcore21:22:270
149950,0migration/027107-21aten_r1power_po19:32:190
149950,0migration/024695-21kthreadcore20:57:260
149950,0migration/023539-21taskset21:20:290
149950,0migration/022276-21sh21:40:060
149950,0migration/020728-21kthreadcore23:12:280
149950,0migration/020532-21munin-node23:52:210
149950,0migration/020532-21munin-node23:52:210
149950,0migration/019296-21kthreadcore19:47:250
149950,0migration/019033-21kthreadcore00:27:280
149950,0migration/018289-21idleruntime00:47:240
149950,0migration/018032-21fschecks_time21:57:220
149950,0migration/012787-21kthreadcore22:12:280
339940,0migration/317749-21irqrtprio19:47:243
339940,0migration/316208-21runrttasks20:31:533
329940,0watchdog/34125-21kthreadcore21:07:263
329940,0watchdog/332481-21kthreadcore19:32:263
329940,0watchdog/321079-21kthreadcore21:57:263
329940,0watchdog/30-21swapper/323:27:233
329940,0watchdog/30-21swapper/322:17:103
329940,0watchdog/30-21swapper/319:58:103
29815040,0irq/29-eth0-tx-8671-21ssh00:42:102
29815040,0irq/29-eth0-tx-5818-21diskmemload23:12:102
29815040,0irq/29-eth0-tx-5535-21munin-node20:02:232
29815040,0irq/29-eth0-tx-32099-21munin-node21:47:252
29815040,0irq/29-eth0-tx-12277-21tune2fs23:47:222
29815040,0irq/29-eth0-tx-0-21swapper/223:34:462
29815040,0irq/29-eth0-tx-0-21swapper/223:17:192
29815040,0irq/29-eth0-tx-0-21swapper/223:07:462
29815040,0irq/29-eth0-tx-0-21swapper/222:57:172
29815040,0irq/29-eth0-tx-0-21swapper/222:07:122
29815040,0irq/29-eth0-tx-0-21swapper/222:02:282
29815040,0irq/29-eth0-tx-0-21swapper/219:32:192
29815040,0irq/29-eth0-tx-0-21swapper/200:58:492
29815040,0irq/29-eth0-tx-0-21swapper/200:52:262
29815040,0irq/29-eth0-tx-0-21swapper/200:47:082
29815040,0irq/29-eth0-tx-0-21swapper/200:17:212
29815040,0irq/29-eth0-tx-0-21swapper/200:02:252
29805040,0irq/28-eth0-rx-0-21swapper/323:09:543
29805040,0irq/28-eth0-rx-0-21swapper/300:47:363
29805040,0irq/28-eth0-rx-0-21swapper/300:22:283
267889943,0cyclictest8865-21sadc19:42:062
267889943,0cyclictest3571-21lldpd22:52:212
267889943,0cyclictest3571-21lldpd20:20:202
267889943,0cyclictest3524-21snmpd21:17:182
267889943,0cyclictest3250-21irqbalance22:47:142
267889943,0cyclictest3250-21irqbalance22:42:142
267889943,0cyclictest3250-21irqbalance22:32:242
267889943,0cyclictest3250-21irqbalance21:28:142
267889943,0cyclictest3250-21irqbalance21:12:242
267889943,0cyclictest3250-21irqbalance21:02:132
267889943,0cyclictest3250-21irqbalance20:57:532
267889943,0cyclictest3250-21irqbalance20:52:132
267889943,0cyclictest3250-21irqbalance20:47:232
267889943,0cyclictest3250-21irqbalance20:37:232
267889943,0cyclictest32060-21awk20:42:252
267889943,0cyclictest22309-21awk22:37:232
267889943,0cyclictest17601-21awk20:32:242
267889940,0cyclictest9818-21munin-node23:27:212
267879944,0cyclictest16468-21ssh21:55:421
267879944,0cyclictest0-21swapper/122:29:171
267879943,0cyclictest9778-21awk00:42:241
267879943,0cyclictest3571-21lldpd23:52:521
267879943,0cyclictest3571-21lldpd23:52:521
267879943,0cyclictest3571-21lldpd23:08:221
267879943,0cyclictest3571-21lldpd00:53:521
267879943,0cyclictest3524-21snmpd20:22:171
267879943,0cyclictest3524-21snmpd19:48:171
267879943,0cyclictest3524-21snmpd19:37:171
267879943,0cyclictest31957-21awk20:42:241
267879943,0cyclictest28131-21awk19:32:231
267879943,0cyclictest24218-21awk22:57:241
267869944,0cyclictest0-21swapper/022:27:580
267869943,0cyclictest8945-21awk23:07:230
267869943,0cyclictest3571-21lldpd21:50:210
267869943,0cyclictest3571-21lldpd20:33:210
267869943,0cyclictest3571-21lldpd20:27:510
267869943,0cyclictest3571-21lldpd20:22:510
267869943,0cyclictest3571-21lldpd20:17:210
267869943,0cyclictest3250-21irqbalance23:37:340
267869943,0cyclictest3250-21irqbalance23:35:040
267869943,0cyclictest3250-21irqbalance22:22:140
267869943,0cyclictest3250-21irqbalance22:17:140
267869943,0cyclictest3250-21irqbalance00:57:140
267869943,0cyclictest3250-21irqbalance00:24:140
267869943,0cyclictest25143-21cpu23:17:190
267869943,0cyclictest15623-21awk22:52:240
267869943,0cyclictest1107-21awk00:37:230
267869943,0cyclictest10562-21awk21:12:230
267869943,0cyclictest10226-21awk19:42:210
267869940,0cyclictest0-21swapper/023:02:490
259940,0migration/24720-21fschecks_count22:27:212
259940,0migration/23216-21kthreadcore00:37:262
259940,0migration/226144-21runrttasks20:12:302
259940,0migration/223860-21kthreadcore00:12:262
259940,0migration/218476-21kthreadcore20:07:252
249940,0watchdog/27288-21diskstats00:22:232
249940,0watchdog/216265-21sshd19:47:142
249940,0watchdog/215421-21fschecks_time21:37:222
249940,0watchdog/215145-21port_sshpriv19:42:262
249940,0watchdog/20-21swapper/221:22:262
249940,0watchdog/20-21swapper/220:27:262
249940,0watchdog/20-21swapper/219:52:262
179940,0migration/18854-21kthreadcore20:02:271
179940,0migration/16897-21sh21:48:341
179940,0migration/16207-21df_abs20:47:191
179940,0migration/15018-21aten_r1power_en00:02:201
179940,0migration/14944-21ksmtuned22:44:471
179940,0migration/125858-21sh23:34:531
179940,0migration/123664-21latency_hist20:37:071
179940,0migration/122622-21kthreadcore20:12:241
179940,0migration/120355-21munin-node20:57:191
179940,0migration/116251-21kthreadcore20:52:261
179940,0migration/112144-21munin-node22:12:271
179940,0migration/110482-21gltestperf21:12:221
169940,0watchdog/18736-21kthreadcore21:32:261
169940,0watchdog/16142-21cut23:42:271
169940,0watchdog/15776-21ps21:31:461
169940,0watchdog/149432sleep119:58:101
169940,0watchdog/13201-21ssh23:57:591
169940,0watchdog/131516-21ssh00:35:111
169940,0watchdog/129344-21ssh22:41:341
169940,0watchdog/126049-21if_eth023:17:231
169940,0watchdog/121423-21cut00:47:271
169940,0watchdog/121405-21kthreadcore20:32:261
169940,0watchdog/120944-21ssh00:09:431
169940,0watchdog/11872-21sshd21:06:141
169940,0watchdog/11599-21kthreadcore00:17:271
169940,0watchdog/113689-21ssh22:50:221
169940,0watchdog/10-21swapper/123:27:231
169940,0watchdog/10-21swapper/123:02:271
169940,0watchdog/10-21swapper/100:57:271
169940,0watchdog/10-21swapper/100:27:311
149940,0migration/04993-21ksmtuned19:58:450
149940,0migration/028844-21kthreadcore00:52:260
149940,0migration/02861-21kthreadcore00:17:270
149940,0migration/023077-21idleruntime00:12:240
149940,0migration/016455-21kthreadcore23:47:260
149940,0migration/016150-21kthreadcore20:52:260
149940,0migration/011912-21kthreadcore23:27:260
329930,0watchdog/30-21swapper/320:47:183
29805030,0irq/28-eth0-rx-0-21swapper/321:02:203
29805030,0irq/28-eth0-rx-0-21swapper/320:42:203
29805030,0irq/28-eth0-rx-0-21swapper/320:37:073
29805030,0irq/28-eth0-rx-0-21swapper/320:06:183
267879933,0cyclictest3571-21lldpd20:29:501
267879932,0cyclictest3345-21awk21:07:251
267879932,0cyclictest30127-21sensors21:22:311
267879932,0cyclictest2363-21grep22:07:211
267879932,0cyclictest20439-21awk22:17:231
267879930,0cyclictest17721-21diskstats21:57:211
267869933,0cyclictest3571-21lldpd21:03:510
267869933,0cyclictest0-21swapper/022:32:140
267869932,0cyclictest4987-21aten_r1power_en00:02:200
267869932,0cyclictest3524-21snmpd20:48:470
267869932,0cyclictest3524-21snmpd19:56:160
267869932,0cyclictest32198-21awk21:27:230
267869932,0cyclictest31988-21awk20:42:240
267869932,0cyclictest30869-21awk22:42:230
267869932,0cyclictest28157-21grep20:37:260
267869932,0cyclictest21056-21awk20:12:230
267869930,0cyclictest8500-21cut21:32:260
179930,0migration/112827-21aten_r1power_fr20:07:181
169930,0watchdog/132446-21ssh00:37:151
169930,0watchdog/10-21swapper/122:06:541
169930,0watchdog/10-21swapper/119:44:141
267869921,0cyclictest23383-21aten_r1power_en21:42:180
267869920,0cyclictest0-21swapper/020:07:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional