You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-08 - 02:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Wed Jul 08, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
621124132,0sleep30-21swapper/319:25:303
624123928,0sleep00-21swapper/019:25:510
606023827,0sleep20-21swapper/219:23:452
617923724,0sleep10-21swapper/119:25:041
8305070,0irq/26-0000:00:15033-21munin-run21:47:082
8305060,0irq/26-0000:00:27092-21open_files19:37:282
64299966,0cyclictest83050irq/26-0000:00:20:33:122
64299960,0cyclictest0-21swapper/223:52:082
64289960,0cyclictest0-21swapper/120:47:201
339960,0migration/39187-21aten_r1power_en22:02:193
339960,0migration/34564-21sh23:50:193
339960,0migration/331725-21sh23:08:353
339960,0migration/326750-21sh00:40:413
339960,0migration/319843-21sh21:29:393
339960,0migration/317029-21sh00:32:433
339960,0migration/313798-21munin-node00:52:253
29805060,0irq/28-eth0-rx-8747-21sh22:01:523
29805060,0irq/28-eth0-rx-25602-21cut22:27:253
29805060,0irq/28-eth0-rx-23835-21munin-node22:07:273
29805060,0irq/28-eth0-rx-1738-21perl23:12:213
149960,0migration/07843-21fschecks_count22:57:200
149960,0migration/03608-21sh00:47:070
149960,0migration/012341-21sh23:52:490
149960,0migration/012251-21sh22:38:480
64299955,0cyclictest0-21swapper/223:33:032
64299955,0cyclictest0-21swapper/223:28:572
64299955,0cyclictest0-21swapper/220:47:312
64299950,0cyclictest0-21swapper/222:54:352
64299950,0cyclictest0-21swapper/222:21:002
64289955,0cyclictest0-21swapper/123:58:151
64289955,0cyclictest0-21swapper/120:52:231
64289955,0cyclictest0-21swapper/100:53:361
64289950,0cyclictest0-21swapper/122:59:461
64279955,0cyclictest0-21swapper/023:34:160
64279955,0cyclictest0-21swapper/023:30:570
64279955,0cyclictest0-21swapper/023:13:170
64279953,0cyclictest32477-21kworker/0:000:22:250
64279952,0cyclictest32477-21kworker/0:000:12:230
64279950,0cyclictest0-21swapper/021:56:020
64279950,0cyclictest0-21swapper/021:27:110
64279950,0cyclictest0-21swapper/020:12:090
64279950,0cyclictest0-21swapper/000:10:500
339950,0migration/39155-21kthreadcore21:22:243
339950,0migration/37035-21munin-node19:27:183
339950,0migration/34263-21idleruntime23:32:243
339950,0migration/331691-21runrttasks21:55:033
339950,0migration/331636-21timerandwakeup00:22:333
339950,0migration/331133-21munin-node20:02:343
339950,0migration/329668-21kthreadcore20:47:273
339950,0migration/329553-21munin-node22:32:223
339950,0migration/329313-21fschecks_time20:27:213
339950,0migration/329137-21taskset22:47:453
339950,0migration/326214-21kthreadcore21:07:253
339950,0migration/320934-21kthreadcore19:57:243
339950,0migration/31778-21df_abs00:27:213
339950,0migration/311199-21kthreadcore00:12:253
329950,0watchdog/331874-21kthreadcore22:12:263
329950,0watchdog/323815-21kthreadcore21:32:263
329950,0watchdog/322467-21latency00:17:273
329950,0watchdog/320440-21users22:42:343
329950,0watchdog/318336-21cut21:02:263
329950,0watchdog/318237-21python23:37:313
329950,0watchdog/313086-21munin-node20:12:303
329950,0watchdog/312749-21ssh22:40:103
29815050,0irq/29-eth0-tx-6653-21ssh22:37:242
29815050,0irq/29-eth0-tx-6631-40yum-updatesd-he19:27:110
29815050,0irq/29-eth0-tx-4337-21df_inode00:47:202
29815050,0irq/29-eth0-tx-32220-21munin-node20:52:290
29815050,0irq/29-eth0-tx-27983-21ssh22:30:502
29815050,0irq/29-eth0-tx-27580-21munin-node00:42:352
29815050,0irq/29-eth0-tx-27572-21kthreadcore00:22:252
29815050,0irq/29-eth0-tx-27316-21tr22:12:222
29815050,0irq/29-eth0-tx-21057-21munin-node21:32:272
29815050,0irq/29-eth0-tx-1443-21munin-node00:27:222
29815050,0irq/29-eth0-tx-10025-21munin-node23:17:202
29815050,0irq/29-eth0-tx-0-21swapper/223:58:292
29815050,0irq/29-eth0-tx-0-21swapper/223:38:372
29815050,0irq/29-eth0-tx-0-21swapper/223:10:302
29815050,0irq/29-eth0-tx-0-21swapper/221:50:532
29815050,0irq/29-eth0-tx-0-21swapper/020:42:160
29805050,0irq/28-eth0-rx-99542sleep319:50:153
29805050,0irq/28-eth0-rx-9422-21cut21:42:263
29805050,0irq/28-eth0-rx-6314-21runrttasks00:50:343
29805050,0irq/28-eth0-rx-4387-21munin-node20:32:233
29805050,0irq/28-eth0-rx-31623-21fschecks_count22:52:203
29805050,0irq/28-eth0-rx-29047-21irqrtprio00:42:263
29805050,0irq/28-eth0-rx-24817-21kthreadcore20:22:253
29805050,0irq/28-eth0-rx-22272-21ssh00:01:203
29805050,0irq/28-eth0-rx-12640-21ssh23:53:393
29805050,0irq/28-eth0-rx-1182-21users23:27:333
29805050,0irq/28-eth0-rx-10294-21cat19:52:073
29805050,0irq/28-eth0-rx-0-21swapper/323:42:263
29805050,0irq/28-eth0-rx-0-21swapper/323:23:183
29805050,0irq/28-eth0-rx-0-21swapper/323:19:103
29805050,0irq/28-eth0-rx-0-21swapper/323:00:143
29805050,0irq/28-eth0-rx-0-21swapper/322:17:263
29805050,0irq/28-eth0-rx-0-21swapper/321:41:343
29805050,0irq/28-eth0-rx-0-21swapper/300:07:273
259950,0migration/28019-21fschecks_time22:57:212
259950,0migration/2348-21kthreadcore21:37:272
259950,0migration/232616-21kthreadcore22:32:272
259950,0migration/230430-21sh22:51:202
259950,0migration/224055-21kthreadcore20:22:242
259950,0migration/222614-21unixbench_multi23:02:372
259950,0migration/219604-21kthreadcore22:07:252
259950,0migration/211051-21fschecks_time19:52:212
19150,0ktimersoftd/10-21swapper/123:53:321
179950,0migration/123898-21kthreadcore22:27:251
179950,0migration/12195-21fschecks_time00:27:221
179950,0migration/113795-21sh21:44:111
149950,0migration/0942-21kthreadcore21:37:270
149950,0migration/08095-21sh20:57:220
149950,0migration/0612-21df21:57:200
149950,0migration/05283-21latency_hist21:22:070
149950,0migration/032428-21needreboot22:12:270
149950,0migration/032065-21munin-node21:17:240
149950,0migration/032065-21munin-node21:17:240
149950,0migration/031186-21kthreadcore22:32:260
149950,0migration/029427-21if_eth1.219:42:230
149950,0migration/027697-21kthreadcore00:02:260
149950,0migration/024878-21kthreadcore23:42:260
149950,0migration/02366-21kthreadcore22:52:250
149950,0migration/02339-21kthreadcore20:07:240
149950,0migration/022604-21kthreadcore00:37:230
149950,0migration/021410-21latency_hist21:07:070
149950,0migration/019771-21kthreadcore20:17:240
149950,0migration/019373-21kthreadcore22:42:260
149950,0migration/017812-21latency23:37:250
149950,0migration/017781-21sh22:07:180
149950,0migration/01673-21kthreadcore23:47:230
149950,0migration/015985-21kthreadcore20:37:250
149950,0migration/014645-21kthreadcore22:22:230
149950,0migration/010962-21sh00:48:300
8305040,0irq/26-0000:00:28628-21latency_hist21:12:072
8305040,0irq/26-0000:00:0-21swapper/220:42:072
64299944,0cyclictest0-21swapper/220:52:342
64299943,0cyclictest9094-21awk00:12:232
64299943,0cyclictest8159-21awk20:57:222
64299943,0cyclictest6505-21awk21:22:222
64299943,0cyclictest4323-21awk19:47:232
64299943,0cyclictest3571-21lldpd21:05:022
64299943,0cyclictest3571-21lldpd20:10:592
64299943,0cyclictest3571-21lldpd19:58:592
64299943,0cyclictest13644-21awk00:52:232
64299943,0cyclictest11345-21awk00:32:242
64289944,0cyclictest0-21swapper/100:09:271
64289943,0cyclictest6132-21awk22:37:231
64289943,0cyclictest4323-21awk23:32:251
64289943,0cyclictest3571-21lldpd23:18:321
64289943,0cyclictest3571-21lldpd22:32:321
64289943,0cyclictest3571-21lldpd22:14:321
64289943,0cyclictest3571-21lldpd21:40:321
64289943,0cyclictest3571-21lldpd20:15:301
64289943,0cyclictest3571-21lldpd19:32:291
64289943,0cyclictest3571-21lldpd00:27:071
64289943,0cyclictest3524-21snmpd23:10:361
64289943,0cyclictest3250-21irqbalance22:52:141
64289943,0cyclictest3250-21irqbalance22:22:141
64289943,0cyclictest3250-21irqbalance22:18:141
64289943,0cyclictest3250-21irqbalance21:22:131
64289943,0cyclictest3250-21irqbalance21:17:231
64289943,0cyclictest3250-21irqbalance21:17:231
64289943,0cyclictest3250-21irqbalance21:12:431
64289943,0cyclictest3250-21irqbalance19:27:131
64289943,0cyclictest3250-21irqbalance00:47:341
64289943,0cyclictest3250-21irqbalance00:02:141
64289943,0cyclictest28287-21sadc20:27:071
64289943,0cyclictest25221-21awk21:52:231
64289943,0cyclictest21662-21awk23:42:231
64289943,0cyclictest18922-21awk22:07:231
64289943,0cyclictest16435-21awk21:47:231
64289943,0cyclictest14818-21awk22:42:231
64289943,0cyclictest1379-21awk21:57:221
64289943,0cyclictest13701-21awk21:27:231
64289940,0cyclictest0-21swapper/120:43:051
64279944,0cyclictest9957-21kworker/0:200:33:130
64279944,0cyclictest20498-21sensors21:02:300
64279943,0cyclictest7508-21awk21:42:240
64279943,0cyclictest4226-21awk19:47:220
64279943,0cyclictest32477-21kworker/0:022:47:310
64279943,0cyclictest25718-21awk23:07:240
64279940,0cyclictest17581-21munin-node19:57:200
64279940,0cyclictest0-21swapper/020:02:220
339940,0migration/316999-21timerwakeupswit20:37:323
339940,0migration/316794-21kthreadcore20:17:233
339940,0migration/31240-21irqrtprio20:52:243
329940,0watchdog/30-21swapper/322:22:303
29815040,0irq/29-eth0-tx-17783-21munin-node22:22:302
29815040,0irq/29-eth0-tx-0-21swapper/223:42:132
29815040,0irq/29-eth0-tx-0-21swapper/222:42:192
29815040,0irq/29-eth0-tx-0-21swapper/222:03:202
29815040,0irq/29-eth0-tx-0-21swapper/221:57:322
29815040,0irq/29-eth0-tx-0-21swapper/221:52:262
29815040,0irq/29-eth0-tx-0-21swapper/200:07:202
29815040,0irq/29-eth0-tx-0-21swapper/021:12:230
29815040,0irq/29-eth0-tx-0-21swapper/020:27:180
29815040,0irq/29-eth0-tx-0-21swapper/019:32:220
29805040,0irq/28-eth0-rx-15262-21ssh21:47:103
29805040,0irq/28-eth0-rx-0-21swapper/323:02:253
29805040,0irq/28-eth0-rx-0-21swapper/320:07:183
29805040,0irq/28-eth0-rx-0-21swapper/319:32:213
29805040,0irq/28-eth0-rx-0-21swapper/300:02:193
259940,0migration/2996-21kthreadcore19:42:252
259940,0migration/2849-21taskset23:12:152
259940,0migration/229282-21switchtime00:02:332
259940,0migration/224159-21kthreadcore21:07:242
259940,0migration/220441-21kthreadcore23:22:262
259940,0migration/219452-21kthreadcore00:17:262
259940,0migration/21633-21kthreadcore20:27:262
259940,0migration/21470-21kthreadcore21:17:242
259940,0migration/21470-21kthreadcore21:17:242
259940,0migration/213933-21latency_hist20:17:072
259940,0migration/211220-21fschecks_count20:37:202
249940,0watchdog/229800-21fschecks_count23:47:192
249940,0watchdog/219532-21fschecks_count00:37:192
249940,0watchdog/217317-21kthreadcore21:27:262
249940,0watchdog/20-21swapper/220:17:182
249940,0watchdog/20-21swapper/220:02:262
179940,0migration/18381-21kthreadcore19:47:251
179940,0migration/18007-21munin-node00:12:191
179940,0migration/13701-21cpuspeed_turbos20:32:201
179940,0migration/130664-21kthreadcore20:27:251
179940,0migration/129814-21munin-node19:42:241
179940,0migration/128586-21latency_hist21:12:071
179940,0migration/124289-21kthreadcore19:37:251
179940,0migration/12220-21runrttasks23:30:211
179940,0migration/118503-21gltestperf19:57:201
179940,0migration/118423-21aten_r1power_vo23:22:201
179940,0migration/118306-21kthreadcore23:02:281
179940,0migration/116217-21mdstat19:52:261
179940,0migration/113221-21irqcore23:37:231
179940,0migration/11185-21missed_timers00:42:281
179940,0migration/111465-21kthreadcore22:02:251
179940,0migration/111215-21munin-node00:32:231
179940,0migration/110541-21latency_hist20:37:071
169940,0watchdog/128705-21python22:47:301
169940,0watchdog/122468-21latency00:17:271
169940,0watchdog/121860-21perl21:32:221
169940,0watchdog/114316-21cpuspeed_turbos20:17:181
169940,0watchdog/10-21swapper/123:47:191
169940,0watchdog/10-21swapper/120:02:261
169940,0watchdog/10-21swapper/100:37:191
149940,0migration/021138-21kthreadcore23:02:290
149940,0migration/017872-21kthreadcore23:57:250
149940,0migration/017865-21irqcore00:17:250
149940,0migration/016759-21sh23:18:420
149940,0migration/014084-21kthreadcore22:02:260
64299932,0cyclictest7784-21awk19:27:212
64299932,0cyclictest20080-21sensors19:32:322
64289932,0cyclictest16542-21kthreadcore21:02:251
64289930,0cyclictest0-21swapper/120:07:551
64279933,0cyclictest9957-21kworker/0:200:54:090
64279933,0cyclictest32477-21kworker/0:022:28:270
64279933,0cyclictest29355-21kworker/0:021:47:200
64279933,0cyclictest29355-21kworker/0:021:32:220
64279933,0cyclictest29355-21kworker/0:020:47:100
64279933,0cyclictest29355-21kworker/0:020:32:140
64279933,0cyclictest29355-21kworker/0:020:22:140
64279933,0cyclictest29355-21kworker/0:019:52:100
64279933,0cyclictest29355-21kworker/0:019:37:120
64279932,0cyclictest7352-21grep22:17:270
64279932,0cyclictest19371-21awk23:22:240
64279931,0cyclictest32477-21kworker/0:000:27:090
329930,0watchdog/30-21swapper/319:44:263
329930,0watchdog/30-21swapper/319:37:183
29805030,0irq/28-eth0-rx-0-21swapper/321:14:203
29805030,0irq/28-eth0-rx-0-21swapper/320:57:263
29805030,0irq/28-eth0-rx-0-21swapper/320:45:593
169930,0watchdog/10-21swapper/123:12:221
29805020,0irq/28-eth0-rx-0-21swapper/321:17:103
29805020,0irq/28-eth0-rx-0-21swapper/321:17:103
169920,0watchdog/10-21swapper/120:57:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional