You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 09:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Sat Aug 15, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2577624039,0sleep00-21swapper/019:30:050
2555023525,0sleep10-21swapper/119:27:291
2540422723,0sleep30-21swapper/319:25:433
2505322622,0sleep20-21swapper/219:25:382
25859991212,0cyclictest3524-21snmpd22:04:490
339960,0migration/35424-21sh21:46:103
339960,0migration/32399-21sh22:40:593
339960,0migration/321575-21sh00:29:533
339960,0migration/320299-21munin-node20:10:303
339960,0migration/314322-21sh21:51:563
339960,0migration/311516-21taskset20:03:143
29815060,0irq/29-eth0-tx-15616-21munin-node20:30:400
29805060,0irq/28-eth0-rx-8889-21tr00:00:333
29805060,0irq/28-eth0-rx-0-21swapper/322:20:343
29805060,0irq/28-eth0-rx-0-21swapper/300:15:593
27160,0ktimersoftd/20-21swapper/223:39:032
258609960,0cyclictest4769-21diskmemload00:37:091
19160,0ktimersoftd/10-21swapper/123:39:031
149960,0migration/031267-21munin-node21:45:260
149960,0migration/026938-21kthreadcore21:20:330
149960,0migration/018721-21missed_timers22:50:340
149960,0migration/01156-21aten_r1power_po23:40:260
8305050,0irq/26-0000:00:26269-21latency_hist21:00:133
339950,0migration/3893-21taskset21:03:513
339950,0migration/38911-21fschecks_count20:25:283
339950,0migration/38682-21aten_r1power_po21:10:263
339950,0migration/36973-21kthreadcore21:30:323
339950,0migration/36777-21kthreadcore21:05:323
339950,0migration/33338-21kthreadcore19:35:333
339950,0migration/330508-21fschecks_count20:40:273
339950,0migration/328118-21kthreadcore00:50:323
339950,0migration/325753-21kthreadcore19:50:293
339950,0migration/325498-21kthreadcore00:30:313
339950,0migration/319759-21kthreadcore19:45:333
339950,0migration/313688-21kthreadcore20:50:293
329950,0watchdog/38074-21cut23:05:293
329950,0watchdog/36314-21runrttasks23:36:053
329950,0watchdog/33966-21kthreadcore23:20:333
329950,0watchdog/328736-21cut19:30:373
329950,0watchdog/320010-21kthreadcore23:10:333
329950,0watchdog/315059-21kthreadcore20:05:293
329950,0watchdog/30-21swapper/320:30:333
29815050,0irq/29-eth0-tx-9033-21munin-node22:10:302
29815050,0irq/29-eth0-tx-19099-21munin-node20:10:260
29815050,0irq/29-eth0-tx-17958-21ssh00:05:382
29815050,0irq/29-eth0-tx-15718-21munin-node21:55:342
29815050,0irq/29-eth0-tx-1258-21munin-node21:05:340
29815050,0irq/29-eth0-tx-10901-21munin-node22:30:402
29815050,0irq/29-eth0-tx-0-21swapper/223:59:192
29815050,0irq/29-eth0-tx-0-21swapper/222:25:312
29815050,0irq/29-eth0-tx-0-21swapper/222:09:312
29815050,0irq/29-eth0-tx-0-21swapper/200:47:012
29815050,0irq/29-eth0-tx-0-21swapper/200:28:142
29815050,0irq/29-eth0-tx-0-21swapper/020:00:340
29815050,0irq/29-eth0-tx-0-21swapper/019:35:390
29805050,0irq/28-eth0-rx-6732-21seq00:40:263
29805050,0irq/28-eth0-rx-6637-21kthreadcore00:20:323
29805050,0irq/28-eth0-rx-6314-21runrttasks23:55:243
29805050,0irq/28-eth0-rx-3246-21kthreadcore00:55:323
29805050,0irq/28-eth0-rx-28331-21kthreadcore22:00:313
29805050,0irq/28-eth0-rx-23721-21kthreadcore21:40:313
29805050,0irq/28-eth0-rx-23705-21munin-node00:10:323
29805050,0irq/28-eth0-rx-21709-21fschecks_count22:55:293
29805050,0irq/28-eth0-rx-20989-21kthreadcore00:45:343
29805050,0irq/28-eth0-rx-14673-21irqcore21:35:313
29805050,0irq/28-eth0-rx-0-21swapper/323:50:393
29805050,0irq/28-eth0-rx-0-21swapper/323:45:153
29805050,0irq/28-eth0-rx-0-21swapper/323:40:333
29805050,0irq/28-eth0-rx-0-21swapper/323:16:493
29805050,0irq/28-eth0-rx-0-21swapper/323:00:323
29805050,0irq/28-eth0-rx-0-21swapper/322:51:223
29805050,0irq/28-eth0-rx-0-21swapper/322:45:283
29805050,0irq/28-eth0-rx-0-21swapper/322:37:333
29805050,0irq/28-eth0-rx-0-21swapper/322:14:283
29805050,0irq/28-eth0-rx-0-21swapper/321:25:263
258709955,0cyclictest0-21swapper/223:05:242
258709955,0cyclictest0-21swapper/219:30:312
258709950,0cyclictest0-21swapper/223:48:272
258609955,0cyclictest0-21swapper/123:04:551
258609955,0cyclictest0-21swapper/100:46:171
258609954,0cyclictest26598-21latency_hist23:55:151
258609950,0cyclictest0-21swapper/122:15:441
258609950,0cyclictest0-21swapper/100:28:471
258609950,0cyclictest0-21swapper/100:21:131
258599950,0cyclictest0-21swapper/022:47:470
258599950,0cyclictest0-21swapper/000:40:210
259950,0migration/29487-21switchtime00:00:392
259950,0migration/27995-21latency_hist19:40:142
259950,0migration/25196-21sh00:36:402
259950,0migration/232182-21munin-node22:20:352
259950,0migration/232127-21idleruntime-cro00:55:152
259950,0migration/229856-21aten_r1power_fr23:00:252
259950,0migration/229236-21unixbench-2d20:35:392
259950,0migration/226186-21latency_hist20:15:142
259950,0migration/220621-21kthreadcore22:15:332
19150,0ktimersoftd/10-21swapper/123:56:571
179950,0migration/16007-21munin-node21:30:291
179950,0migration/15636-21kthreadcore00:55:331
179950,0migration/130772-21kthreadcore19:30:371
179950,0migration/128658-21kthreadcore23:15:311
179950,0migration/123969-21kthreadcore21:40:311
179950,0migration/122987-21munin-node19:50:251
149950,0migration/07391-21kthreadcore21:30:320
149950,0migration/05925-21kthreadcore22:05:320
149950,0migration/05274-21kthreadcore00:00:320
149950,0migration/0446-21taskset20:15:530
149950,0migration/031330-21switchtime23:35:370
149950,0migration/031214-21irqcore20:40:300
149950,0migration/030387-21kthreadcore19:30:370
149950,0migration/029658-21latency_hist23:00:140
149950,0migration/029157-21taskset21:41:280
149950,0migration/028759-21sh00:30:590
149950,0migration/026912-21runrttasks22:37:520
149950,0migration/025987-21kthreadcore20:35:320
149950,0migration/02284-21kthreadcore00:55:320
149950,0migration/021331-21taskset21:38:550
149950,0migration/019171-21kthreadcore00:25:340
149950,0migration/018314-21kthreadcore21:15:320
149950,0migration/014668-21kthreadcore20:05:290
149950,0migration/014658-21proc_pri21:10:350
149950,0migration/012039-21latency_hist20:50:130
149950,0migration/011823-21run-parts00:21:150
339940,0migration/3515-21taskset20:16:393
339940,0migration/325700-21kthreadcore20:35:323
339940,0migration/315861-21taskset23:29:313
339940,0migration/310313-21kthreadcore20:45:313
329940,0watchdog/32705-21kthreadcore20:20:333
29815040,0irq/29-eth0-tx-4900-21munin-node00:20:322
29815040,0irq/29-eth0-tx-4171-21ssh22:45:242
29815040,0irq/29-eth0-tx-22080-21ssh21:40:202
29815040,0irq/29-eth0-tx-0-21swapper/223:40:162
29815040,0irq/29-eth0-tx-0-21swapper/223:30:302
29815040,0irq/29-eth0-tx-0-21swapper/223:20:272
29815040,0irq/29-eth0-tx-0-21swapper/223:10:242
29815040,0irq/29-eth0-tx-0-21swapper/222:40:232
29815040,0irq/29-eth0-tx-0-21swapper/222:00:232
29815040,0irq/29-eth0-tx-0-21swapper/221:50:372
29815040,0irq/29-eth0-tx-0-21swapper/221:45:152
29815040,0irq/29-eth0-tx-0-21swapper/221:35:192
29805040,0irq/28-eth0-rx-3114-21kthreadcore19:55:313
29805040,0irq/28-eth0-rx-30457-21sh00:35:223
29805040,0irq/28-eth0-rx-23490-40yum-updatesd-he23:31:523
29805040,0irq/28-eth0-rx-0-21swapper/322:32:433
29805040,0irq/28-eth0-rx-0-21swapper/322:25:203
29805040,0irq/28-eth0-rx-0-21swapper/322:15:173
29805040,0irq/28-eth0-rx-0-21swapper/322:05:263
29805040,0irq/28-eth0-rx-0-21swapper/321:55:293
29805040,0irq/28-eth0-rx-0-21swapper/321:20:263
258709944,0cyclictest0-21swapper/220:20:302
258709943,0cyclictest9004-21awk23:25:302
258709943,0cyclictest7862-21awk00:40:302
258709943,0cyclictest3571-21lldpd23:50:182
258709943,0cyclictest3571-21lldpd21:30:162
258709943,0cyclictest3571-21lldpd20:00:462
258709943,0cyclictest3571-21lldpd00:15:192
258709943,0cyclictest3524-21snmpd20:25:302
258709943,0cyclictest3250-21irqbalance21:05:202
258709943,0cyclictest3250-21irqbalance21:03:102
258709943,0cyclictest31250-21awk21:25:302
258709943,0cyclictest31047-21awk20:40:292
258709943,0cyclictest26173-21cut00:30:312
258709943,0cyclictest25193-21tr20:55:362
258709943,0cyclictest24051-21awk21:20:312
258709943,0cyclictest22311-21awk22:55:302
258709943,0cyclictest21245-21awk00:10:302
258609944,0cyclictest0-21swapper/122:02:571
258609943,0cyclictest7942-21sadc19:40:141
258609943,0cyclictest3524-21snmpd00:41:031
258609943,0cyclictest16899-21awk21:15:301
258609943,0cyclictest16801-21awk21:55:311
258609943,0cyclictest13822-21awk22:50:301
258599944,0cyclictest0-21swapper/023:54:180
258599944,0cyclictest0-21swapper/023:19:180
258599944,0cyclictest0-21swapper/022:40:500
258599944,0cyclictest0-21swapper/022:31:130
258599944,0cyclictest0-21swapper/022:18:270
258599944,0cyclictest0-21swapper/022:10:440
258599944,0cyclictest0-21swapper/000:08:110
258599943,0cyclictest3524-21snmpd22:24:310
258599943,0cyclictest3524-21snmpd20:59:310
258599943,0cyclictest31323-21awk21:25:300
258599943,0cyclictest29740-21awk00:15:270
258599943,0cyclictest24987-21awk00:50:300
258599943,0cyclictest2167-21awk20:20:300
258599943,0cyclictest16505-21awk00:45:310
258599943,0cyclictest16407-21awk19:45:290
258599943,0cyclictest16188-21sort23:10:320
259940,0migration/28234-21kthreadcore20:45:312
259940,0migration/232507-21sendmail_mailst20:15:352
259940,0migration/23153-21kthreadcore00:55:322
259940,0migration/223000-21latency_hist23:15:142
259940,0migration/222824-21cpuspeed_turbos19:50:242
259940,0migration/222655-21kthreadcore22:35:312
259940,0migration/22146-21kthreadcore19:55:312
259940,0migration/218907-21kthreadcore21:15:322
259940,0migration/216375-21fschecks_time20:30:282
259940,0migration/216317-21kthreadcore22:50:322
259940,0migration/213632-21munin-node20:50:292
259940,0migration/210745-21kthreadcore21:10:322
249940,0watchdog/20-21swapper/219:45:332
179940,0migration/19889-21kthreadcore20:45:311
179940,0migration/19553-21kthreadcore22:45:341
179940,0migration/18131-21kthreadcore23:05:291
179940,0migration/16930-21kthreadcore22:25:321
179940,0migration/14399-21latency21:45:311
179940,0migration/128988-21munin-node20:35:361
179940,0migration/124639-21kthreadcore22:35:321
179940,0migration/123350-21kthreadcore22:55:331
179940,0migration/122897-21kthreadcore20:55:341
179940,0migration/12285-21kthreadcore23:20:331
179940,0migration/120777-21kthreadcore23:30:321
179940,0migration/11886-21kthreadcore20:40:311
179940,0migration/116448-21kthreadcore00:05:331
179940,0migration/115408-21fschecks_time23:10:281
179940,0migration/11458-21df_abs23:40:271
179940,0migration/113886-21kthreadcore19:40:321
179940,0migration/113611-21munin-node21:35:261
179940,0migration/112225-21kthreadcore20:25:331
179940,0migration/111984-21kthreadcore23:25:321
169940,0watchdog/19052-21memory00:00:341
169940,0watchdog/17981-21ssh22:07:571
169940,0watchdog/13706-21ssh22:44:411
169940,0watchdog/128139-21tr21:20:331
169940,0watchdog/125083-21nfs4_client20:10:331
169940,0watchdog/120350-21kthreadcore20:30:331
169940,0watchdog/118975-21grep19:45:331
169940,0watchdog/117239-21python22:30:371
169940,0watchdog/116479-21ssh22:12:491
169940,0watchdog/113463-21ssh21:50:331
169940,0watchdog/10-21swapper/120:50:251
169940,0watchdog/10-21swapper/100:10:261
149940,0migration/04227-21kthreadcore22:25:310
149940,0migration/024623-21kthreadcore00:10:320
149940,0migration/024302-21kthreadcore19:50:290
149940,0migration/023857-21sh23:32:530
149940,0migration/022311-21if_err_eth022:55:300
149940,0migration/017168-21sh23:47:410
329930,0watchdog/30-21swapper/321:15:253
29815030,0irq/29-eth0-tx-0-21swapper/021:00:250
29805030,0irq/28-eth0-rx-0-21swapper/319:40:373
29805030,0irq/28-eth0-rx-0-21swapper/300:05:283
258709932,0cyclictest3571-21lldpd19:40:162
258709932,0cyclictest12895-21hwlatdetect20:05:262
258609933,0cyclictest30954-21awk19:55:291
258609932,0cyclictest9602-21awk21:10:291
258609932,0cyclictest7560-21sensors21:05:361
258609932,0cyclictest5834-21awk20:00:291
258609932,0cyclictest32524-21sensors20:15:351
258609932,0cyclictest27027-21grep21:00:271
258609932,0cyclictest13051-21awk20:05:271
258609931,0cyclictest23813-21munin-node00:50:311
258609930,0cyclictest29118-21df_inode00:15:251
258609930,0cyclictest26937-21perl22:20:291
258599932,0cyclictest9483-21awk20:25:300
258599932,0cyclictest6729-21iperf23:25:280
258599932,0cyclictest3524-21snmpd21:59:480
258599932,0cyclictest32596-21grep23:20:290
258599932,0cyclictest29802-21munin-node19:55:300
258599932,0cyclictest13404-21ssh23:07:370
258599932,0cyclictest11148-21tr19:40:310
258599930,0cyclictest4866-21munin-node20:45:280
169930,0watchdog/10-21swapper/123:45:341
169930,0watchdog/10-21swapper/121:25:411
169930,0watchdog/10-21swapper/120:20:331
169930,0watchdog/10-21swapper/100:30:381
149930,0migration/05738-21runrttasks00:38:160
149930,0migration/01812-21sh23:57:360
258599920,0cyclictest0-21swapper/021:50:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional