You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-13 - 07:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Sat Jun 13, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2936424435,0sleep30-21swapper/319:21:183
2931023927,0sleep20-21swapper/219:20:412
2950723223,0sleep10-21swapper/119:23:001
2939523228,0sleep00-21swapper/019:21:390
29757992323,0cyclictest27779-21awk20:30:191
29758991918,0cyclictest31100-21sadc22:15:052
339960,0migration/329640-21sh00:24:413
339960,0migration/326109-21sh22:47:343
339960,0migration/320915-21kthreadcore20:00:223
339960,0migration/315059-21munin-node22:05:193
339960,0migration/311736-21sh00:12:593
29815060,0irq/29-eth0-tx-12342-21munin-node20:20:180
29805060,0irq/28-eth0-rx-22005-21ssh00:36:213
297579966,0cyclictest3524-21snmpd23:56:551
297579965,0cyclictest22200-21ps22:45:201
297579960,0cyclictest0-21swapper/121:57:521
297569960,0cyclictest0-21swapper/023:20:300
169960,0watchdog/14080-21python20:10:281
149960,0migration/08204-21sh22:35:500
149960,0migration/028556-21sh23:08:050
149960,0migration/026162-21sh22:47:430
149960,0migration/023576-21runrttasks00:40:100
149960,0migration/022424-21sh00:37:330
149960,0migration/01942-21fschecks_count20:35:160
149960,0migration/011359-21munin-node19:30:290
35150,0ktimersoftd/30-21swapper/300:08:113
339950,0migration/39822-21kthreadcore21:00:223
339950,0migration/37513-21kthreadcore21:40:203
339950,0migration/35499-21aten_r1power_fr22:00:153
339950,0migration/35359-21kthreadcore21:20:233
339950,0migration/332443-21kthreadcore20:10:233
339950,0migration/332349-21sh23:45:463
339950,0migration/331760-21irqrtprio20:55:213
339950,0migration/329829-21fschecks_time21:55:193
339950,0migration/329511-21kthreadcore21:15:223
339950,0migration/329511-21kthreadcore21:15:223
339950,0migration/323212-21aten_r1power_cu23:25:153
339950,0migration/322347-21kthreadcore21:10:233
339950,0migration/318869-21needreboot00:15:293
339950,0migration/318318-21taskset21:05:223
339950,0migration/315418-21fschecks_time23:20:203
339950,0migration/313302-21kthreadcore20:40:213
339950,0migration/312869-21fschecks_count23:00:193
339950,0migration/311279-21kthreadcore22:20:223
329950,0watchdog/35389-21taskset22:15:283
329950,0watchdog/31301-21aten_r1power_en19:50:163
329950,0watchdog/310089-21irqrtprio19:55:203
29815050,0irq/29-eth0-tx-27079-21munin-node23:45:212
29815050,0irq/29-eth0-tx-25056-21munin-node22:30:152
29815050,0irq/29-eth0-tx-0-21swapper/021:25:160
29815050,0irq/29-eth0-tx-0-21swapper/020:54:280
29815050,0irq/29-eth0-tx-0-21swapper/019:55:140
29815050,0irq/29-eth0-tx-0-21swapper/019:54:160
29805050,0irq/28-eth0-rx-9710-21iostat_ios00:50:213
29805050,0irq/28-eth0-rx-5642-21ls23:15:053
29805050,0irq/28-eth0-rx-4602-21ssh22:55:193
29805050,0irq/28-eth0-rx-25850-21grep22:30:173
29805050,0irq/28-eth0-rx-21398-21cut20:25:213
29805050,0irq/28-eth0-rx-20658-21ssh21:50:163
29805050,0irq/28-eth0-rx-1176-21munin-node22:50:253
29805050,0irq/28-eth0-rx-10638-21tr23:15:223
29805050,0irq/28-eth0-rx-0-21swapper/323:50:233
29805050,0irq/28-eth0-rx-0-21swapper/323:05:193
29805050,0irq/28-eth0-rx-0-21swapper/322:26:493
29805050,0irq/28-eth0-rx-0-21swapper/321:45:313
29805050,0irq/28-eth0-rx-0-21swapper/319:25:213
29805050,0irq/28-eth0-rx-0-21swapper/300:46:533
29805050,0irq/28-eth0-rx-0-21swapper/300:41:493
29805050,0irq/28-eth0-rx-0-21swapper/300:31:183
29805050,0irq/28-eth0-rx-0-21swapper/300:27:273
29805050,0irq/28-eth0-rx-0-21swapper/300:00:253
297589955,0cyclictest8812-21diskmemload23:22:472
297589955,0cyclictest0-21swapper/223:55:062
297589955,0cyclictest0-21swapper/223:13:382
297589955,0cyclictest0-21swapper/222:05:222
297589955,0cyclictest0-21swapper/221:25:292
297589955,0cyclictest0-21swapper/221:00:152
297589955,0cyclictest0-21swapper/200:01:052
297589950,0cyclictest0-21swapper/222:59:172
297589950,0cyclictest0-21swapper/200:28:412
297579955,0cyclictest23186-21sensors23:40:281
297579955,0cyclictest0-21swapper/122:32:431
297579955,0cyclictest0-21swapper/121:37:411
297579954,0cyclictest8812-21diskmemload23:14:581
297579950,0cyclictest0-21swapper/122:54:371
297579950,0cyclictest0-21swapper/122:22:471
297569955,0cyclictest0-21swapper/023:50:180
297569955,0cyclictest0-21swapper/021:20:310
297569950,0cyclictest0-21swapper/022:19:290
27150,0ktimersoftd/20-21swapper/221:47:052
27150,0ktimersoftd/20-21swapper/200:08:112
259950,0migration/29192-21kthreadcore19:30:222
259950,0migration/231090-21kthreadcore21:15:232
259950,0migration/231090-21kthreadcore21:15:232
259950,0migration/212205-21latency_hist23:00:052
259950,0migration/211858-21kthreadcore23:35:222
249950,0watchdog/232243-21aten2.4-expect00:45:172
249950,0watchdog/20-21swapper/200:33:052
179950,0migration/132524-21munin-node19:45:251
179950,0migration/123666-21fschecks_count20:50:171
179950,0migration/12303-21idleruntime22:35:201
179950,0migration/111671-21timerwakeupswit21:00:281
179950,0migration/11166-21latency_hist19:50:051
179950,0migration/111079-21taskset00:11:051
149950,0migration/07529-21kthreadcore22:00:220
149950,0migration/06618-21fschecks_time23:15:180
149950,0migration/05037-21kthreadcore21:40:190
149950,0migration/04571-21gltestperf22:55:180
149950,0migration/032139-21kthreadcore20:55:220
149950,0migration/031063-21kthreadcore22:50:210
149950,0migration/030522-21kthreadcore19:45:220
149950,0migration/029896-21cpuspeed_turbos23:10:170
149950,0migration/027725-21idleruntime20:30:190
149950,0migration/027099-21taskset00:04:000
149950,0migration/026201-21latency_hist21:35:050
149950,0migration/026181-21taskset20:26:410
149950,0migration/024666-21taskset22:29:490
149950,0migration/024610-21kthreadcore20:05:210
149950,0migration/022118-21kthreadcore19:40:220
149950,0migration/017919-21kthreadcore20:45:220
149950,0migration/017802-21taskset23:57:120
149950,0migration/014191-21aten_r1power_po22:05:170
149950,0migration/013456-21irqcore19:35:200
149950,0migration/013141-21sh00:30:390
149950,0migration/012938-21kthreadcore20:40:210
149950,0migration/012786-21kthreadcore22:40:230
149950,0migration/012022-21ksmtuned20:19:110
149950,0migration/010951-21sh00:10:430
8305040,0irq/26-0000:00:31750-21wc23:30:052
4140,0ktimersoftd/00-21swapper/000:46:540
339940,0migration/3969-21taskset19:49:333
339940,0migration/332734-21fschecks_time23:30:183
339940,0migration/319245-21taskset20:24:473
339940,0migration/315611-21kthreadcore19:35:213
339940,0migration/314421-21proc_pri23:35:263
339940,0migration/311331-21irqcore22:40:223
329940,0watchdog/30-21swapper/321:30:083
329940,0watchdog/30-21swapper/321:25:163
329940,0watchdog/30-21swapper/320:38:483
29815040,0irq/29-eth0-tx-8049-21ssh23:50:262
29815040,0irq/29-eth0-tx-22281-21kthreadcore23:40:242
29815040,0irq/29-eth0-tx-19694-21munin-node21:10:230
29815040,0irq/29-eth0-tx-10844-21ssh22:40:192
29815040,0irq/29-eth0-tx-0-21swapper/223:05:342
29815040,0irq/29-eth0-tx-0-21swapper/222:45:262
29815040,0irq/29-eth0-tx-0-21swapper/222:35:482
29815040,0irq/29-eth0-tx-0-21swapper/222:25:102
29815040,0irq/29-eth0-tx-0-21swapper/222:15:292
29815040,0irq/29-eth0-tx-0-21swapper/222:00:182
29815040,0irq/29-eth0-tx-0-21swapper/221:55:122
29815040,0irq/29-eth0-tx-0-21swapper/221:40:142
29815040,0irq/29-eth0-tx-0-21swapper/221:35:222
29815040,0irq/29-eth0-tx-0-21swapper/200:40:172
29815040,0irq/29-eth0-tx-0-21swapper/200:20:182
29815040,0irq/29-eth0-tx-0-21swapper/200:10:172
29805040,0irq/28-eth0-rx-0-21swapper/323:55:173
29805040,0irq/28-eth0-rx-0-21swapper/323:42:033
29805040,0irq/28-eth0-rx-0-21swapper/322:39:203
29805040,0irq/28-eth0-rx-0-21swapper/322:10:223
29805040,0irq/28-eth0-rx-0-21swapper/321:35:123
297589944,0cyclictest0-21swapper/222:50:092
297589943,0cyclictest7020-21awk23:15:202
297589943,0cyclictest3571-21lldpd21:10:022
297589943,0cyclictest3571-21lldpd19:57:322
297589943,0cyclictest3524-21snmpd20:24:532
297589943,0cyclictest3250-21irqbalance23:25:122
297589943,0cyclictest3250-21irqbalance19:40:112
297589943,0cyclictest3250-21irqbalance00:50:222
297589943,0cyclictest17172-21awk20:45:212
297589943,0cyclictest16088-21awk00:35:212
297589943,0cyclictest13152-21awk19:35:192
297589940,0cyclictest12802-21munin-node00:15:222
297579944,0cyclictest8812-21diskmemload00:17:431
297579944,0cyclictest0-21swapper/100:27:201
297579943,0cyclictest9972-21awk20:40:191
297579943,0cyclictest4716-21awk22:55:201
297579943,0cyclictest3571-21lldpd00:02:341
297579943,0cyclictest3524-21snmpd21:11:391
297579943,0cyclictest3524-21snmpd20:55:541
297579943,0cyclictest3524-21snmpd20:19:231
297579943,0cyclictest3524-21snmpd19:56:231
297579943,0cyclictest31100-21awk19:25:191
297579943,0cyclictest2747-21awk21:20:211
297579943,0cyclictest26633-21awk23:45:201
297579943,0cyclictest17579-21awk22:25:211
297569944,0cyclictest0-21swapper/022:20:160
297569944,0cyclictest0-21swapper/021:05:230
297569944,0cyclictest0-21swapper/000:52:250
297569943,0cyclictest3524-21snmpd23:40:100
297569943,0cyclictest31037-21awk19:25:190
297569943,0cyclictest28963-21awk00:05:210
297569943,0cyclictest22633-21awk00:20:260
297569943,0cyclictest13898-21awk00:15:240
259940,0migration/27664-21latency_hist22:20:052
259940,0migration/25020-21latency_hist20:15:052
259940,0migration/24798-21kthreadcore21:20:232
259940,0migration/228306-21kthreadcore20:05:222
259940,0migration/227271-21fschecks_time19:45:172
259940,0migration/223688-21kthreadcore20:25:222
259940,0migration/220067-21df_abs21:10:182
259940,0migration/217729-21aten_r1power_vo21:30:172
259940,0migration/21224-21kthreadcore20:55:222
249940,0watchdog/21303-21aten_r1power_en19:50:162
249940,0watchdog/20-21swapper/221:50:202
249940,0watchdog/20-21swapper/220:40:202
179940,0migration/19867-21kthreadcore22:00:221
179940,0migration/19717-21runrttasks21:40:491
179940,0migration/17285-21fschecks_time00:30:201
179940,0migration/17085-21runrttasks23:15:201
179940,0migration/129463-21kthreadcore00:05:221
179940,0migration/128469-21taskset23:07:501
179940,0migration/127433-21kthreadcore00:40:231
179940,0migration/126996-21kthreadcore20:05:221
179940,0migration/123984-21munin-node22:10:221
179940,0migration/122321-21fschecks_time00:20:231
179940,0migration/122111-21sh00:36:401
179940,0migration/121372-21taskset23:20:481
179940,0migration/11960-21fschecks_count20:35:161
179940,0migration/118594-21munin-node21:30:201
179940,0migration/117238-21kthreadcore21:45:231
179940,0migration/116107-21cpuspeed_turbos20:00:171
179940,0migration/112433-21latency_hist21:05:051
179940,0migration/11023-21sshd21:15:311
179940,0migration/11023-21sshd21:15:311
169940,0watchdog/19983-21ssh22:40:081
169940,0watchdog/1641-21interrupts23:30:201
169940,0watchdog/124994-1kworker/1:2H23:53:531
169940,0watchdog/121022-21awk22:06:121
169940,0watchdog/114555-21ssh23:35:281
169940,0watchdog/10-21swapper/122:17:441
169940,0watchdog/10-21swapper/121:50:201
169940,0watchdog/10-21swapper/121:25:161
169940,0watchdog/10-21swapper/120:25:201
169940,0watchdog/10-21swapper/100:51:051
149940,0migration/05784-21fschecks_count21:00:170
149940,0migration/032194-21kthreadcore21:15:230
149940,0migration/032194-21kthreadcore21:15:230
149940,0migration/021237-21kthreadcore20:00:230
149940,0migration/015030-21kthreadcore23:00:230
149940,0migration/014745-21kthreadcore21:45:220
8305030,0irq/26-0000:00:0-21swapper/219:25:052
329930,0watchdog/30-21swapper/320:45:123
329930,0watchdog/30-21swapper/319:30:243
29805030,0irq/28-eth0-rx-0-21swapper/320:50:153
29805030,0irq/28-eth0-rx-0-21swapper/320:30:153
29805030,0irq/28-eth0-rx-0-21swapper/320:16:553
29805030,0irq/28-eth0-rx-0-21swapper/320:05:233
29805030,0irq/28-eth0-rx-0-21swapper/319:40:263
297589932,0cyclictest3571-21lldpd20:10:312
297589932,0cyclictest26665-21cat20:30:052
297589932,0cyclictest24342-21awk20:50:202
297579933,0cyclictest0-21swapper/123:01:241
297579933,0cyclictest0-21swapper/120:45:301
297579932,0cyclictest5915-21awk19:30:191
297569933,0cyclictest26657-21awk23:45:200
297569932,0cyclictest9329-21awk23:35:200
297569932,0cyclictest5865-21sensors23:30:260
297569932,0cyclictest3524-21snmpd21:54:390
297569932,0cyclictest31347-21sensors22:30:250
297569932,0cyclictest31211-21awk00:25:210
297569932,0cyclictest30213-21awk21:55:210
297569932,0cyclictest24308-21awk23:25:190
297569930,0cyclictest18263-21perl21:30:190
259930,0migration/219370-21kthreadcore20:00:222
249930,0watchdog/23802-21grep20:35:202
169930,0watchdog/18812-21diskmemload00:45:171
169930,0watchdog/10-21swapper/123:28:001
169930,0watchdog/10-21swapper/119:40:201
297579921,0cyclictest11833-21latency_hist19:35:051
297579920,0cyclictest12313-21cat20:20:051
297569921,0cyclictest30604-21sed20:10:180
297569920,0cyclictest8812-21diskmemload22:10:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional