You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-03 - 02:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Wed Jun 03, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1764524637,0sleep20-21swapper/219:21:282
1754324535,0sleep30-21swapper/319:20:173
1215523827,0sleep00-21swapper/019:19:340
1785623026,0sleep10-21swapper/119:23:511
179599985,0cyclictest0-21swapper/122:47:221
179599973,0cyclictest8596-21awk23:14:311
179599973,0cyclictest3571-21lldpd21:45:181
179599973,0cyclictest27539-21sadc21:34:161
179599973,0cyclictest2141-21awk23:29:301
179599973,0cyclictest2109-21sadc20:34:151
179599973,0cyclictest15434-21sadc22:04:161
179599973,0cyclictest11020-21awk21:24:321
179599972,0cyclictest7251-21sadc23:14:161
179599972,0cyclictest21420-21awk20:24:311
179599970,0cyclictest0-21swapper/122:55:481
179599970,0cyclictest0-21swapper/121:57:051
179599970,0cyclictest0-21swapper/100:29:461
8305060,0irq/26-0000:00:32760-21sh22:14:162
339960,0migration/39443-21sh00:47:143
339960,0migration/37793-21sh22:15:393
339960,0migration/36560-21runrttasks21:58:463
339960,0migration/35903-21sh23:10:403
339960,0migration/331691-21sh23:25:103
339960,0migration/329121-21unixbench-2d23:04:423
339960,0migration/327068-21unixbench_multi21:09:393
339960,0migration/323810-21aten_r1power_cu20:04:253
339960,0migration/316735-21sh22:21:223
339960,0migration/311683-21sh23:53:543
329960,0watchdog/321416-21sh21:48:273
29815060,0irq/29-eth0-tx-9963-21munin-node21:24:332
29815060,0irq/29-eth0-tx-27801-21munin-node21:14:320
29815060,0irq/29-eth0-tx-0-21swapper/020:39:390
29805060,0irq/28-eth0-rx-18286-21port_sshpriv23:54:373
29805060,0irq/28-eth0-rx-16597-21diskstats23:19:313
29805060,0irq/28-eth0-rx-0-21swapper/323:31:163
179599963,0cyclictest3571-21lldpd23:08:191
179599963,0cyclictest3571-21lldpd19:28:151
179599962,0cyclictest6196-21kthreadcore21:19:341
179599962,0cyclictest30445-21awk00:04:331
179599962,0cyclictest24855-21awk20:04:291
179599962,0cyclictest24171-21kthreadcore21:49:331
179599962,0cyclictest17939-21cat22:24:161
179599962,0cyclictest17875-21cut22:04:351
179599961,0cyclictest29579-21kthreadcore22:29:341
179599961,0cyclictest28203-21awk23:44:321
179599961,0cyclictest25570-21fschecks_time23:24:301
179599961,0cyclictest17953-21awk00:34:341
179599961,0cyclictest11823-21sadc23:54:161
179599960,0cyclictest7885-21kthreadcore21:39:341
179599960,0cyclictest6314-21runrttasks00:44:331
179599960,0cyclictest6051-21cut22:34:351
179599960,0cyclictest4194-21ssh22:52:161
179599960,0cyclictest31992-21ntpq19:34:311
179599960,0cyclictest30340-21memory22:09:341
179599960,0cyclictest29370-21kthreadcore21:14:341
179599960,0cyclictest29137-21kthreadcore00:39:351
179599960,0cyclictest25012-21sed23:39:411
179599960,0cyclictest23751-21cut23:59:331
179599960,0cyclictest19998-40yum-updatesd-he20:22:551
179599960,0cyclictest13604-21ssh00:12:531
179599960,0cyclictest13059-21kthreadcore22:19:341
179599960,0cyclictest12525-21kthreadcore23:34:351
179579965,0cyclictest2117-21ls20:34:150
179579960,0cyclictest0-21swapper/023:50:110
149960,0migration/09103-21sh22:19:150
149960,0migration/028028-21sh22:47:360
149960,0migration/017467-21sh22:23:230
149960,0migration/012088-21sh23:54:250
8305050,0irq/26-0000:00:0-21swapper/319:24:153
35150,0ktimersoftd/30-21swapper/300:29:463
339950,0migration/39427-21kthreadcore21:39:353
339950,0migration/38419-21kthreadcore22:54:333
339950,0migration/38351-21taskset19:47:243
339950,0migration/37906-21kthreadcore20:34:343
339950,0migration/35794-21aten_r1power_fr00:09:283
339950,0migration/330347-21taskset00:21:153
339950,0migration/328406-21taskset20:29:303
339950,0migration/327010-21sh22:44:443
339950,0migration/324296-21latency_hist22:09:163
339950,0migration/317594-21kthreadcore20:19:373
339950,0migration/317419-21kthreadcore21:04:343
339950,0migration/317282-21kthreadcore22:39:343
339950,0migration/312509-21taskset20:14:463
329950,0watchdog/331528-21kthreadcore21:34:353
329950,0watchdog/322014-21kthreadcore21:29:353
329950,0watchdog/316438-21perl22:04:313
329950,0watchdog/30-21swapper/320:59:393
29815050,0irq/29-eth0-tx-24187-21if_err_eth100:19:372
29815050,0irq/29-eth0-tx-23013-21ssh23:20:062
29815050,0irq/29-eth0-tx-0-21swapper/223:59:272
29815050,0irq/29-eth0-tx-0-21swapper/020:58:380
29815050,0irq/29-eth0-tx-0-21swapper/019:36:040
29805050,0irq/28-eth0-rx-9618-21kthreadcore21:59:333
29805050,0irq/28-eth0-rx-9347-21munin-node22:34:393
29805050,0irq/28-eth0-rx-8669-21iwlist23:14:323
29805050,0irq/28-eth0-rx-525-21grep00:24:343
29805050,0irq/28-eth0-rx-3882-21ssh22:51:263
29805050,0irq/28-eth0-rx-28197-21proc_pri21:49:373
29805050,0irq/28-eth0-rx-27227-21timerwakeupswit23:59:403
29805050,0irq/28-eth0-rx-22352-21kthreadcore20:24:333
29805050,0irq/28-eth0-rx-22254-21kthreadcore19:59:343
29805050,0irq/28-eth0-rx-21531-21cut00:34:373
29805050,0irq/28-eth0-rx-1169-21ssh22:30:143
29805050,0irq/28-eth0-rx-0-21swapper/323:34:343
29805050,0irq/28-eth0-rx-0-21swapper/323:01:243
29805050,0irq/28-eth0-rx-0-21swapper/300:49:283
29805050,0irq/28-eth0-rx-0-21swapper/300:42:253
29805050,0irq/28-eth0-rx-0-21swapper/300:14:353
29805050,0irq/28-eth0-rx-0-21swapper/300:04:223
259950,0migration/28086-21fschecks_count23:14:302
259950,0migration/26138-21df_abs00:09:302
259950,0migration/231846-21fschecks_count20:54:292
259950,0migration/231314-21kthreadcore21:34:352
259950,0migration/221556-21munin-node20:24:322
259950,0migration/21450-21sh23:44:492
259950,0migration/213723-21latency_hist22:59:162
249950,0watchdog/28319-21kthreadcore21:19:352
249950,0watchdog/22748-21grep00:24:352
179599950,0cyclictest9601-21latency_hist20:39:161
179599950,0cyclictest9325-21wc19:54:151
179599950,0cyclictest6314-21runrttasks21:09:251
179599950,0cyclictest6171-21basename20:59:281
179599950,0cyclictest5654-21latency_hist20:14:151
179599950,0cyclictest472-21latency_hist22:14:161
179599950,0cyclictest35241snmpd00:24:161
179599950,0cyclictest31329-21aten2.4-expect20:54:271
179599950,0cyclictest31030-21head20:09:281
179599950,0cyclictest27852-21ssh21:34:271
179599950,0cyclictest2675-21cut20:34:281
179599950,0cyclictest25703-21chrt19:33:231
179599950,0cyclictest24144-21aten2.4-expect20:49:281
179599950,0cyclictest23117-21munin-node00:19:331
179599950,0cyclictest17103-21cpuspeed_turbos20:44:301
179599950,0cyclictest16661-21aten_r1power_en19:59:271
179599950,0cyclictest14249-21latency_hist00:14:161
179599950,0cyclictest13753-21ls22:59:161
179599950,0cyclictest1353-21latency_hist19:44:151
179599950,0cyclictest13333-21latency_hist21:04:161
179599950,0cyclictest12148-21aten_r1power_en23:54:271
179599950,0cyclictest11704-21aten_r1power_en22:39:261
179599950,0cyclictest1138-21ps19:43:361
179599950,0cyclictest10570-21aten2.4-expect00:49:291
179599950,0cyclictest0-21swapper/123:19:291
179599950,0cyclictest0-21swapper/119:49:541
179579955,0cyclictest0-21swapper/023:39:190
179579955,0cyclictest0-21swapper/022:37:210
179579950,0cyclictest0-21swapper/021:26:430
179579950,0cyclictest0-21swapper/020:44:380
179579950,0cyclictest0-21swapper/000:17:560
179579950,0cyclictest0-21swapper/000:11:290
149950,0migration/09845-21kthreadcore00:29:360
149950,0migration/05902-21kthreadcore21:19:340
149950,0migration/04956-21ntp_states23:09:370
149950,0migration/04948-21fschecks_time21:39:300
149950,0migration/030924-21irqrtprio00:04:340
149950,0migration/027615-21latency_hist21:34:160
149950,0migration/025687-21kthreadcore20:24:340
149950,0migration/025572-21sh22:27:000
149950,0migration/025134-21kthreadcore23:59:330
149950,0migration/024898-21kthreadcore21:49:330
149950,0migration/020053-21kthreadcore19:24:320
149950,0migration/014849-21kthreadcore00:49:350
149950,0migration/014127-21kthreadcore22:39:320
149950,0migration/013727-21kthreadcore19:54:300
149950,0migration/012249-21pmu-power20:59:380
8305040,0irq/26-0000:00:0-21swapper/200:14:162
339940,0migration/3798-21taskset19:39:583
339940,0migration/331701-21fschecks_time20:09:303
339940,0migration/324788-21sendmail_mailqu23:39:383
339940,0migration/31917-21kthreadcore20:54:333
339940,0migration/316260-21taskset20:40:123
329940,0watchdog/30-21swapper/321:14:353
329940,0watchdog/30-21swapper/320:44:353
329940,0watchdog/30-21swapper/319:34:223
29815040,0irq/29-eth0-tx-9392-21munin-node22:19:392
29815040,0irq/29-eth0-tx-32255-21ssh21:54:322
29815040,0irq/29-eth0-tx-3004-21cat22:49:412
29815040,0irq/29-eth0-tx-2902-21ssh22:34:222
29815040,0irq/29-eth0-tx-28797-21ssh21:49:532
29815040,0irq/29-eth0-tx-1524-21telnet19:44:230
29815040,0irq/29-eth0-tx-1369-21ssh22:30:472
29815040,0irq/29-eth0-tx-13430-21python21:59:392
29815040,0irq/29-eth0-tx-0-21swapper/223:40:162
29815040,0irq/29-eth0-tx-0-21swapper/223:34:412
29815040,0irq/29-eth0-tx-0-21swapper/223:25:252
29815040,0irq/29-eth0-tx-0-21swapper/223:04:262
29815040,0irq/29-eth0-tx-0-21swapper/222:44:252
29815040,0irq/29-eth0-tx-0-21swapper/222:39:242
29815040,0irq/29-eth0-tx-0-21swapper/222:14:322
29815040,0irq/29-eth0-tx-0-21swapper/200:44:312
29815040,0irq/29-eth0-tx-0-21swapper/200:39:442
29815040,0irq/29-eth0-tx-0-21swapper/020:14:420
29805040,0irq/28-eth0-rx-0-21swapper/323:45:323
29805040,0irq/28-eth0-rx-0-21swapper/322:29:023
29805040,0irq/28-eth0-rx-0-21swapper/321:25:383
259940,0migration/28758-21runrttasks19:49:312
259940,0migration/228819-21irqcore20:29:332
259940,0migration/225981-21latency_hist19:34:152
259940,0migration/220250-21kthreadcore00:34:362
259940,0migration/215697-21sh22:04:232
259940,0migration/21539-21kthreadcore20:09:342
249940,0watchdog/24217-21sh21:39:192
249940,0watchdog/23552-21lldpd23:09:192
249940,0watchdog/2300-21kthreadcore00:04:352
249940,0watchdog/229864-21sed20:49:352
249940,0watchdog/219737-21perl21:29:312
249940,0watchdog/21324-21tr23:29:272
249940,0watchdog/20-21swapper/221:14:352
249940,0watchdog/20-21swapper/220:44:352
249940,0watchdog/20-21swapper/220:19:352
249940,0watchdog/20-21swapper/200:29:352
179609944,0cyclictest0-21swapper/219:24:332
179609943,0cyclictest7331-21awk20:59:332
179609943,0cyclictest7004-21awk20:14:322
179609943,0cyclictest3524-21snmpd21:44:302
179609943,0cyclictest3524-21snmpd21:13:002
179609943,0cyclictest3250-21irqbalance23:54:232
179609943,0cyclictest3250-21irqbalance23:49:332
179609943,0cyclictest19200-21awk22:24:322
179609943,0cyclictest0-21swapper/222:59:282
179609941,0cyclictest0-21swapper/200:49:292
179579944,0cyclictest0-21swapper/022:32:190
179579944,0cyclictest0-21swapper/021:55:160
179579944,0cyclictest0-21swapper/020:04:260
179579944,0cyclictest0-21swapper/000:44:440
179579943,0cyclictest3571-21lldpd21:59:180
179579943,0cyclictest3571-21lldpd00:39:500
179579943,0cyclictest3524-21snmpd23:29:160
179579943,0cyclictest25427-21awk22:09:310
179579943,0cyclictest16896-21awk22:04:330
179579943,0cyclictest14942-21awk22:59:320
179579940,0cyclictest24054-21munin-node20:49:350
149940,0migration/08053-21kthreadcore22:54:330
149940,0migration/04480-21kthreadcore20:34:330
149940,0migration/032518-21fschecks_time00:24:310
149940,0migration/030086-21kthreadcore21:34:340
149940,0migration/013267-21kthreadcore23:34:350
8305030,0irq/26-0000:00:0-21swapper/319:29:223
8305030,0irq/26-0000:00:0-21swapper/221:04:232
329930,0watchdog/30-21swapper/321:19:353
329930,0watchdog/30-21swapper/319:56:543
329930,0watchdog/30-21swapper/319:52:423
29815030,0irq/29-eth0-tx-16662-21aten2.4-expect19:59:270
29805030,0irq/28-eth0-rx-0-21swapper/320:49:273
259930,0migration/210535-21munin-node19:54:282
249930,0watchdog/20-21swapper/219:44:262
249930,0watchdog/20-21swapper/219:42:262
179609933,0cyclictest17668-21awk19:59:312
179609932,0cyclictest27351-21grep20:04:322
179609932,0cyclictest10758-21awk20:39:312
179609930,0cyclictest6501-21grep20:34:332
179579933,0cyclictest0-21swapper/000:36:140
179579932,0cyclictest3571-21lldpd00:20:500
179579932,0cyclictest3524-21snmpd20:13:280
179579932,0cyclictest23693-21awk23:04:320
179579932,0cyclictest2166-21awk23:29:300
179579932,0cyclictest20696-21awk21:09:250
179579932,0cyclictest17291-21awk23:19:330
179579932,0cyclictest14233-21awk20:19:350
179579932,0cyclictest13273-21cut21:44:410
179579932,0cyclictest1014-21sensors23:44:390
179579932,0cyclictest0-21swapper/021:08:390
149930,0migration/04460-21sh22:53:000
249920,0watchdog/20-21swapper/219:29:222
179579921,0cyclictest8669-21ls19:49:150
179579920,0cyclictest9697-21diskmemload23:14:190
179579920,0cyclictest0-21swapper/019:40:150
179579920,0cyclictest0-21swapper/019:29:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional