You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 09:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Tue Jun 16, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1925824635,0sleep00-21swapper/019:23:400
1901723828,0sleep30-21swapper/319:20:513
1902023525,0sleep10-21swapper/119:20:531
1907723324,0sleep20-21swapper/219:21:342
194779988,0cyclictest3524-21snmpd22:15:290
339960,0migration/38660-21sh23:59:433
339960,0migration/3718-21sh00:10:523
339960,0migration/35038-21sh23:36:103
339960,0migration/313357-21sh22:26:253
339960,0migration/312383-21sh23:23:473
329960,0watchdog/38128-21port_sshpriv20:20:433
329960,0watchdog/38128-21port_sshpriv20:20:433
27160,0ktimersoftd/20-21swapper/222:50:392
194789960,0cyclictest0-21swapper/123:05:371
149960,0migration/0960-21sh22:57:390
149960,0migration/05017-21sh23:36:050
149960,0migration/022556-21missed_timers21:15:380
8305050,0irq/26-0000:00:6248-21cat22:25:202
4150,0ktimersoftd/030879-21diskmemload23:17:530
4150,0ktimersoftd/00-21swapper/000:21:540
339950,0migration/37905-21idleruntime23:40:363
339950,0migration/35994-21fschecks_time00:35:343
339950,0migration/332624-21kthreadcore20:15:383
339950,0migration/332473-21irqcore00:50:373
339950,0migration/330013-21munin-node22:35:433
339950,0migration/32837-21munin-node19:35:353
339950,0migration/327055-21kthreadcore20:35:373
339950,0migration/326489-21munin-node00:25:443
339950,0migration/325103-21kthreadcore23:10:403
339950,0migration/324895-21munin-node21:20:353
339950,0migration/324822-21sh22:52:543
339950,0migration/322652-21kthreadcore20:55:373
339950,0migration/319848-21unixbench_multi23:25:463
339950,0migration/319614-21latency_hist19:25:203
339950,0migration/31914-21cpuspeed_turbos21:45:323
339950,0migration/318537-21taskset21:54:153
339950,0migration/316536-21aten_r1power_en20:30:313
339950,0migration/312652-21latency_hist22:10:203
339950,0migration/310894-21kthreadcore22:45:373
329950,0watchdog/37717-21sh22:43:273
329950,0watchdog/331032-21diskstats19:55:303
329950,0watchdog/315036-21iostat_ios00:40:353
329950,0watchdog/314031-21iostat22:10:353
29815050,0irq/29-eth0-tx-28789-21munin-node00:30:422
29815050,0irq/29-eth0-tx-11409-21cut21:30:382
29815050,0irq/29-eth0-tx-0-21swapper/021:25:320
29815050,0irq/29-eth0-tx-0-21swapper/021:20:320
29815050,0irq/29-eth0-tx-0-21swapper/020:05:040
29815050,0irq/29-eth0-tx-0-21swapper/019:35:350
29805050,0irq/28-eth0-rx-5521-21cut00:15:393
29805050,0irq/28-eth0-rx-2971-21timerwakeupswit00:30:453
29805050,0irq/28-eth0-rx-25432-21cut23:30:383
29805050,0irq/28-eth0-rx-21997-21tune2fs22:15:313
29805050,0irq/28-eth0-rx-18452-21fschecks_time00:05:333
29805050,0irq/28-eth0-rx-18047-21ssh23:06:453
29805050,0irq/28-eth0-rx-14093-21ssh21:30:473
29805050,0irq/28-eth0-rx-12724-21kthreadcore00:00:373
29805050,0irq/28-eth0-rx-1223-21kthreadcore22:00:383
29805050,0irq/28-eth0-rx-0-21swapper/323:45:433
29805050,0irq/28-eth0-rx-0-21swapper/323:00:373
29805050,0irq/28-eth0-rx-0-21swapper/322:55:353
29805050,0irq/28-eth0-rx-0-21swapper/322:34:313
29805050,0irq/28-eth0-rx-0-21swapper/322:20:373
29805050,0irq/28-eth0-rx-0-21swapper/321:55:373
29805050,0irq/28-eth0-rx-0-21swapper/321:36:503
29805050,0irq/28-eth0-rx-0-21swapper/319:45:353
29805050,0irq/28-eth0-rx-0-21swapper/300:46:443
29805050,0irq/28-eth0-rx-0-21swapper/300:20:423
259950,0migration/210429-21kthreadcore23:20:412
194799955,0cyclictest0-21swapper/222:05:342
194799954,0cyclictest3524-21snmpd00:50:282
194799954,0cyclictest3524-21snmpd00:26:582
194789955,0cyclictest0-21swapper/123:40:371
194789950,0cyclictest0-21swapper/123:46:271
194789950,0cyclictest0-21swapper/100:53:371
194779950,0cyclictest0-21swapper/022:06:090
19150,0ktimersoftd/10-21swapper/122:55:321
19150,0ktimersoftd/10-21swapper/122:10:551
19150,0ktimersoftd/10-21swapper/100:05:321
179950,0migration/19464-21kthreadcore22:05:381
179950,0migration/19111-21latency_hist00:00:201
179950,0migration/16618-21fschecks_time20:45:331
179950,0migration/13586-21irqcore23:00:371
179950,0migration/132457-21aten_r1power_vo22:40:321
179950,0migration/129990-21timerandwakeup20:35:451
179950,0migration/127462-21needreboot22:15:371
179950,0migration/121935-21kthreadcore20:10:371
179950,0migration/121200-21sh00:42:371
179950,0migration/120470-21irqcore21:55:361
169950,0watchdog/124873-21idleruntime21:20:351
149950,0migration/04932-21sh22:22:040
149950,0migration/03204-21kthreadcore20:40:380
149950,0migration/030179-21kthreadcore21:40:390
149950,0migration/028019-21cpu22:00:320
149950,0migration/025788-21latency_hist22:55:200
149950,0migration/022670-21timerandwakeup21:35:440
149950,0migration/022496-21kthreadcore20:10:370
149950,0migration/018743-21kthreadcore00:40:370
149950,0migration/018444-21kthreadcore22:30:380
149950,0migration/018280-21kthreadcore19:45:350
149950,0migration/016513-21idleruntime23:45:380
149950,0migration/015627-21taskset19:41:380
149950,0migration/014950-21kthreadcore22:10:360
149950,0migration/013058-21unixbench_singl22:25:460
149950,0migration/012860-21kthreadcore22:45:380
149950,0migration/011187-21kthreadcore00:00:370
8305040,0irq/26-0000:00:1283-21latency_hist21:45:202
8305040,0irq/26-0000:00:0-21swapper/223:00:202
8305040,0irq/26-0000:00:0-21swapper/221:00:192
8305040,0irq/26-0000:00:0-21swapper/219:50:202
339940,0migration/36591-21taskset21:29:093
339940,0migration/35915-21df_abs20:00:323
339940,0migration/327741-21kthreadcore23:50:393
339940,0migration/311937-21kthreadcore19:40:383
329940,0watchdog/330969-21kthreadcore21:40:393
329940,0watchdog/32303-21munin-node21:05:313
329940,0watchdog/315297-21grep20:50:393
329940,0watchdog/30-21swapper/321:00:313
329940,0watchdog/30-21swapper/320:25:393
29815040,0irq/29-eth0-tx-32364-21ssh22:55:462
29815040,0irq/29-eth0-tx-17708-21ssh23:05:482
29815040,0irq/29-eth0-tx-15495-21munin-node23:45:352
29815040,0irq/29-eth0-tx-0-21swapper/223:55:282
29815040,0irq/29-eth0-tx-0-21swapper/223:36:422
29815040,0irq/29-eth0-tx-0-21swapper/223:30:352
29815040,0irq/29-eth0-tx-0-21swapper/223:10:262
29815040,0irq/29-eth0-tx-0-21swapper/222:45:302
29815040,0irq/29-eth0-tx-0-21swapper/222:40:302
29815040,0irq/29-eth0-tx-0-21swapper/200:45:302
29815040,0irq/29-eth0-tx-0-21swapper/200:01:212
29815040,0irq/29-eth0-tx-0-21swapper/021:10:310
29815040,0irq/29-eth0-tx-0-21swapper/021:00:390
29805040,0irq/28-eth0-rx-0-21swapper/323:15:233
29805040,0irq/28-eth0-rx-0-21swapper/321:20:183
259940,0migration/29398-21latency_hist21:10:192
259940,0migration/28155-21kthreadcore20:45:372
259940,0migration/232519-21munin-node00:10:402
259940,0migration/226956-21kthreadcore21:40:382
259940,0migration/222152-21kthreadcore21:55:372
259940,0migration/213971-21sh22:28:072
259940,0migration/213020-21aten_r1power_cu20:50:322
259940,0migration/212290-21kthreadcore20:25:392
259940,0migration/211562-21kthreadcore19:40:382
249940,0watchdog/229642-21missed_timers22:35:392
249940,0watchdog/228111-21hwlatdetect20:15:352
249940,0watchdog/216406-21awk19:45:302
249940,0watchdog/20-21swapper/221:20:352
249940,0watchdog/20-21swapper/200:20:272
194799944,0cyclictest0-21swapper/223:52:372
194799944,0cyclictest0-21swapper/222:15:582
194799944,0cyclictest0-21swapper/221:27:532
194799943,0cyclictest6355-21awk00:35:362
194799943,0cyclictest3571-21lldpd21:06:012
194799943,0cyclictest3571-21lldpd20:10:292
194799943,0cyclictest3571-21lldpd20:01:292
194799943,0cyclictest3571-21lldpd19:59:292
194799943,0cyclictest3571-21lldpd00:16:032
194799943,0cyclictest3524-21snmpd21:15:412
194799943,0cyclictest3524-21snmpd20:40:252
194799943,0cyclictest3524-21snmpd20:21:402
194799943,0cyclictest3524-21snmpd20:21:402
194799943,0cyclictest3524-21snmpd20:06:402
194799943,0cyclictest3524-21snmpd19:26:242
194799943,0cyclictest3250-21irqbalance23:25:372
194799943,0cyclictest3250-21irqbalance23:15:272
194799943,0cyclictest3250-21irqbalance21:35:262
194799943,0cyclictest3250-21irqbalance20:55:462
194799943,0cyclictest3250-21irqbalance19:35:562
194799943,0cyclictest29020-21awk22:00:362
194799943,0cyclictest18947-21awk00:05:352
194799943,0cyclictest17510-21awk20:30:352
194799943,0cyclictest13895-21awk22:10:342
194799943,0cyclictest10277-21crond21:50:202
194799940,0cyclictest6863-21munin-node23:40:352
194799940,0cyclictest15074-21munin-node22:30:332
194799940,0cyclictest13802-21munin-node00:40:322
194789944,0cyclictest0-21swapper/123:29:451
194789944,0cyclictest0-21swapper/123:23:551
194789944,0cyclictest0-21swapper/122:32:591
194789944,0cyclictest0-21swapper/100:35:481
194789943,0cyclictest3571-21lldpd00:50:041
194789943,0cyclictest3366-21awk21:05:351
194789943,0cyclictest29861-21awk00:30:351
194789943,0cyclictest29457-21awk23:15:371
194789943,0cyclictest2810-21awk19:35:351
194789943,0cyclictest14079-21awk20:50:371
194789943,0cyclictest12498-21sadc20:05:201
194779944,0cyclictest0-21swapper/021:45:200
194779944,0cyclictest0-21swapper/000:50:540
194779943,0cyclictest8293-21sed21:05:390
194779943,0cyclictest3571-21lldpd23:22:320
194779943,0cyclictest3524-21snmpd22:36:270
194779943,0cyclictest3524-21snmpd19:27:540
194779943,0cyclictest3524-21snmpd00:15:120
194779943,0cyclictest28174-21awk20:15:350
194779943,0cyclictest22998-21awk23:30:350
194779943,0cyclictest21230-21awk20:55:350
194779943,0cyclictest20813-21awk23:10:370
194779943,0cyclictest1500-21awk23:55:340
194779943,0cyclictest11653-21awk21:50:360
194779940,0cyclictest16477-21munin-node20:30:380
179940,0migration/18968-21kthreadcore22:25:371
179940,0migration/132504-21kthreadcore21:00:361
179940,0migration/132474-21kthreadcore20:40:371
179940,0migration/132067-21kthreadcore19:30:371
179940,0migration/131307-21fschecks_time19:55:311
179940,0migration/130408-21kthreadcore20:15:381
179940,0migration/129713-21kthreadcore22:00:371
179940,0migration/127932-21kthreadcore21:40:381
179940,0migration/127122-21fschecks_time00:10:341
179940,0migration/125699-21kthreadcore19:50:371
179940,0migration/12448-21kthreadcore23:55:361
179940,0migration/123658-21kthreadcore00:25:391
179940,0migration/12290-21kthreadcore21:25:381
179940,0migration/122831-21gltestperf23:30:341
179940,0migration/122100-21kthreadcore20:55:371
179940,0migration/120116-21kthreadcore20:30:371
179940,0migration/119487-21kthreadcore19:45:361
179940,0migration/114999-21kthreadcore00:20:391
179940,0migration/111233-21kthreadcore19:40:371
169940,0watchdog/13534-21sshd19:25:421
169940,0watchdog/129053-21grep23:50:391
169940,0watchdog/12392-21df_inode20:20:351
169940,0watchdog/12392-21df_inode20:20:351
169940,0watchdog/123295-21kthreadcore23:10:391
169940,0watchdog/121678-21kthreadcore22:50:391
169940,0watchdog/118275-21ssh21:53:311
169940,0watchdog/112902-21tr21:30:391
169940,0watchdog/10-21swapper/122:35:391
169940,0watchdog/10-21swapper/100:15:391
149940,0migration/03340-21fschecks_count00:15:340
149940,0migration/02894-21timerandwakeup00:30:450
149940,0migration/025002-21kthreadcore00:45:370
149940,0migration/024953-21irqcore20:35:360
149940,0migration/024307-21sh23:50:320
149940,0migration/02321-21aten_r1power_fr23:00:320
149940,0migration/015596-21kthreadcore20:05:360
149940,0migration/011561-21kthreadcore20:45:380
329930,0watchdog/30-21swapper/321:10:313
329930,0watchdog/30-21swapper/320:42:273
329930,0watchdog/30-21swapper/320:10:393
329930,0watchdog/30-21swapper/319:30:303
29815030,0irq/29-eth0-tx-0-21swapper/019:50:310
29805030,0irq/28-eth0-rx-0-21swapper/320:47:533
29805030,0irq/28-eth0-rx-0-21swapper/320:09:283
29805030,0irq/28-eth0-rx-0-21swapper/319:50:313
194799932,0cyclictest3524-21snmpd20:38:252
194799932,0cyclictest3250-21irqbalance19:30:362
194789933,0cyclictest3571-21lldpd21:37:301
194789933,0cyclictest0-21swapper/123:35:351
194789932,0cyclictest514-21grep22:20:381
194789932,0cyclictest2806-21awk21:45:361
194789932,0cyclictest17756-21awk21:15:351
194789930,0cyclictest0-21swapper/120:09:311
194779933,0cyclictest3524-21snmpd20:51:550
194779933,0cyclictest0-21swapper/019:30:330
194779932,0cyclictest8255-21sensors20:20:440
194779932,0cyclictest8255-21sensors20:20:440
194779932,0cyclictest3524-21snmpd00:27:280
194779932,0cyclictest24308-21cut21:55:380
194779932,0cyclictest13556-21grep21:30:420
194779932,0cyclictest10291-21awk20:25:360
194779930,0cyclictest4511-21smart_nvme0n119:55:400
194779930,0cyclictest24975-21ssh00:07:020
194779930,0cyclictest12753-21runrttasks00:38:120
194779930,0cyclictest0-21swapper/023:40:340
179930,0migration/115749-21switchtime21:10:461
169930,0watchdog/10-21swapper/122:45:311
194779921,0cyclictest32567-21cpuspeed_turbos22:40:320
194779921,0cyclictest0-21swapper/023:25:320
194779921,0cyclictest0-21swapper/023:05:310
169920,0watchdog/10-21swapper/120:25:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional