You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-28 - 11:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sun Jun 28, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
79023823,0sleep00-21swapper/018:47:000
87823627,0sleep30-21swapper/318:47:473
69023430,0sleep20-21swapper/218:46:502
87622622,0sleep10-21swapper/118:47:451
35160,0ktimersoftd/30-21swapper/323:39:513
339960,0migration/33944-21taskset20:02:293
339960,0migration/331692-21latency_hist23:31:243
339960,0migration/331574-21sh22:10:163
339960,0migration/331390-21sh21:49:213
339960,0migration/331373-21sh23:51:183
339960,0migration/330800-21sh22:28:103
339960,0migration/315413-21sh22:00:043
339960,0migration/315364-21sh23:00:433
339960,0migration/314931-21sh23:19:523
339960,0migration/314371-21sh22:17:233
339960,0migration/314019-21sh00:18:223
29715060,0irq/26-eth0-rx-23689-21sh22:05:423
29715060,0irq/26-eth0-rx-20170-21grep23:41:423
149960,0migration/06233-21sh23:12:590
149960,0migration/013684-21ntp_offset21:56:420
12719966,0cyclictest31909-21diskmemload21:13:092
12699966,0cyclictest31909-21diskmemload22:32:251
12699960,0cyclictest31909-21diskmemload23:12:561
12689960,0cyclictest0-21swapper/023:08:550
8215050,0irq/24-0000:00:15699-21latency_hist21:01:242
4150,0ktimersoftd/014896-21ssh00:20:520
339950,0migration/39777-21taskset19:44:073
339950,0migration/37907-21latency_hist21:56:243
339950,0migration/331862-21kthreadcore19:36:423
339950,0migration/331820-21fschecks_time20:26:383
339950,0migration/330864-21taskset20:25:393
339950,0migration/329555-21munin-node23:06:453
339950,0migration/328756-21taskset19:34:043
339950,0migration/320975-21taskset19:02:373
339950,0migration/318366-21taskset20:38:553
339950,0migration/31744-21kthreadcore23:11:413
339950,0migration/312048-21kthreadcore23:56:433
339950,0migration/311615-21munin-node20:11:383
339950,0migration/311600-21kthreadcore22:36:433
29725050,0irq/27-eth0-tx-7969-21ssh22:16:312
29725050,0irq/27-eth0-tx-30685-21ssh00:09:342
29725050,0irq/27-eth0-tx-26529-21kthreadcore23:26:422
29725050,0irq/27-eth0-tx-24516-21diskstats22:46:372
29725050,0irq/27-eth0-tx-22737-21ssh21:42:312
29725050,0irq/27-eth0-tx-16301-21cpuspeed_turbos22:21:372
29725050,0irq/27-eth0-tx-14467-21ssh22:58:092
29725050,0irq/27-eth0-tx-14136-21grep21:56:462
29725050,0irq/27-eth0-tx-12197-21munin-node20:36:410
29725050,0irq/27-eth0-tx-0-21swapper/223:01:412
29725050,0irq/27-eth0-tx-0-21swapper/221:38:352
29725050,0irq/27-eth0-tx-0-21swapper/221:26:422
29725050,0irq/27-eth0-tx-0-21swapper/019:51:450
29725050,0irq/27-eth0-tx-0-21swapper/018:51:470
29715050,0irq/26-eth0-rx-4718-21kthreadcore19:16:423
29715050,0irq/26-eth0-rx-324-21cpuspeed_turbos21:31:373
29715050,0irq/26-eth0-rx-31573-21ssh00:11:263
29715050,0irq/26-eth0-rx-29382-21munin-node23:26:453
29715050,0irq/26-eth0-rx-2636-21cut21:11:413
29715050,0irq/26-eth0-rx-25369-21grep19:56:413
29715050,0irq/26-eth0-rx-18574-21kthreadcore00:01:433
29715050,0irq/26-eth0-rx-0-21swapper/323:51:393
29715050,0irq/26-eth0-rx-0-21swapper/322:52:103
29715050,0irq/26-eth0-rx-0-21swapper/322:31:253
29715050,0irq/26-eth0-rx-0-21swapper/322:11:393
29715050,0irq/26-eth0-rx-0-21swapper/321:43:353
29715050,0irq/26-eth0-rx-0-21swapper/321:40:083
29715050,0irq/26-eth0-rx-0-21swapper/321:27:523
29715050,0irq/26-eth0-rx-0-21swapper/321:23:223
29715050,0irq/26-eth0-rx-0-21swapper/300:06:423
259950,0migration/25951-21sh22:51:482
259950,0migration/230984-21sh22:08:352
259950,0migration/228737-21kthreadcore23:46:432
259950,0migration/223932-21sh22:06:232
259950,0migration/213782-21sh23:57:192
259950,0migration/213353-21pmu-power23:16:452
259950,0migration/210526-21unixbench_singl20:06:472
19150,0ktimersoftd/10-21swapper/122:11:461
179950,0migration/1990-21kthreadcore23:31:411
179950,0migration/1452-21fschecks_count21:51:371
179950,0migration/130753-21sh23:29:121
179950,0migration/12921-21kthreadcore20:51:411
179950,0migration/126897-21kthreadcore22:26:421
179950,0migration/116674-21munin-node23:01:371
179950,0migration/116007-21munin-node22:41:361
169950,0watchdog/19802-21kthreadcore20:56:431
169950,0watchdog/17234-21ssh22:55:231
169950,0watchdog/118999-21tr21:41:431
149950,0migration/09779-21taskset19:44:090
149950,0migration/08289-21latency_hist21:16:240
149950,0migration/07784-21kthreadcore20:06:410
149950,0migration/07192-21sh22:14:550
149950,0migration/0601-21idleruntime22:31:400
149950,0migration/05274-21kthreadcore21:11:420
149950,0migration/03919-21taskset20:02:110
149950,0migration/032071-21cpuspeed_turbos23:31:360
149950,0migration/031624-21taskset20:48:220
149950,0migration/031074-21taskset22:08:500
149950,0migration/026877-21kthreadcore20:21:420
149950,0migration/02660-21kthreadcore21:51:410
149950,0migration/024456-21kthreadcore19:31:410
149950,0migration/023854-21aten_r1power_en23:26:360
149950,0migration/021941-21munin-node19:06:380
149950,0migration/020659-21kthreadcore22:21:420
149950,0migration/015544-21sh21:40:000
149950,0migration/012886-21missed_timers23:56:440
149950,0migration/011211-21kthreadcore20:56:440
12719954,0cyclictest9630-21grep21:16:422
12719950,0cyclictest0-21swapper/223:52:512
12719950,0cyclictest0-21swapper/223:14:422
12719950,0cyclictest0-21swapper/222:27:432
12719950,0cyclictest0-21swapper/221:25:072
12719950,0cyclictest0-21swapper/221:07:192
12719950,0cyclictest0-21swapper/220:53:362
12699955,0cyclictest0-21swapper/100:13:381
12699954,0cyclictest3514-21snmpd21:01:331
12699954,0cyclictest17261-21df_inode19:51:361
12699950,0cyclictest0-21swapper/121:39:081
12699950,0cyclictest0-21swapper/121:32:401
12699950,0cyclictest0-21swapper/121:17:411
12689955,0cyclictest0-21swapper/023:52:260
12689955,0cyclictest0-21swapper/021:48:590
12689955,0cyclictest0-21swapper/021:11:090
12689954,0cyclictest22321-21munin-run19:31:250
12689950,0cyclictest0-21swapper/023:37:550
8215040,0irq/24-0000:00:0-21swapper/221:31:242
339940,0migration/38800-21irqcore20:56:423
339940,0migration/36067-21kthreadcore18:51:443
339940,0migration/323740-21kthreadcore19:06:423
339940,0migration/314715-21latency_hist19:01:263
339940,0migration/310076-21kthreadcore20:31:403
29725040,0irq/27-eth0-tx-31909-21diskmemload22:12:222
29725040,0irq/27-eth0-tx-31198-21telnet20:26:360
29725040,0irq/27-eth0-tx-23922-21chrt23:06:262
29725040,0irq/27-eth0-tx-0-21swapper/223:31:362
29725040,0irq/27-eth0-tx-0-21swapper/223:21:352
29725040,0irq/27-eth0-tx-0-21swapper/222:41:442
29725040,0irq/27-eth0-tx-0-21swapper/221:52:072
29725040,0irq/27-eth0-tx-0-21swapper/200:16:302
29725040,0irq/27-eth0-tx-0-21swapper/200:02:022
29715040,0irq/26-eth0-rx-0-21swapper/323:22:353
29715040,0irq/26-eth0-rx-0-21swapper/323:01:353
29715040,0irq/26-eth0-rx-0-21swapper/322:46:363
29715040,0irq/26-eth0-rx-0-21swapper/322:42:173
29715040,0irq/26-eth0-rx-0-21swapper/322:22:323
29715040,0irq/26-eth0-rx-0-21swapper/321:16:243
29715040,0irq/26-eth0-rx-0-21swapper/321:06:413
29715040,0irq/26-eth0-rx-0-21swapper/321:02:243
29715040,0irq/26-eth0-rx-0-21swapper/320:51:453
29715040,0irq/26-eth0-rx-0-21swapper/320:16:423
29715040,0irq/26-eth0-rx-0-21swapper/319:51:353
29715040,0irq/26-eth0-rx-0-21swapper/319:46:373
29715040,0irq/26-eth0-rx-0-21swapper/319:46:373
29715040,0irq/26-eth0-rx-0-21swapper/319:26:403
259940,0migration/26385-21kthreadcore19:41:412
259940,0migration/23098-21kthreadcore22:31:432
259940,0migration/229217-21aten_r1power_cu19:36:362
259940,0migration/225501-21aten_r1power_cu20:46:362
259940,0migration/224464-21kthreadcore19:06:432
259940,0migration/222352-21kthreadcore20:41:422
259940,0migration/221343-21ntp_states19:26:442
259940,0migration/218732-21if_err_eth1.220:16:392
259940,0migration/218188-21kthreadcore19:51:402
259940,0migration/21574-21kthreadcore00:11:422
259940,0migration/212259-21kthreadcore19:21:432
249940,0watchdog/230159-21cut19:11:392
249940,0watchdog/22007-21fschecks_count18:51:402
249940,0watchdog/20-21swapper/223:36:382
249940,0watchdog/20-21swapper/220:56:432
249940,0watchdog/20-21swapper/219:16:432
179940,0migration/19916-21kthreadcore00:16:401
179940,0migration/19038-21kthreadcore23:36:411
179940,0migration/14248-21kthreadcore23:51:441
179940,0migration/129427-21latency22:46:421
179940,0migration/129192-21ksmtuned19:36:321
179940,0migration/123504-21taskset19:56:271
179940,0migration/122474-21taskset19:06:411
179940,0migration/121582-21switchtime19:26:461
179940,0migration/119863-21kthreadcore23:21:421
179940,0migration/11443-21latency_hist18:51:261
179940,0migration/113884-21sendmail_mailst21:56:441
179940,0migration/112112-21kthreadcore18:56:431
169940,0watchdog/19501-21grep19:41:471
169940,0watchdog/16774-21kernelversion20:31:391
169940,0watchdog/14131-21munin-node20:26:431
169940,0watchdog/1308332sleep120:25:191
169940,0watchdog/124828-21if_err_eth023:06:391
169940,0watchdog/120813-21kthreadcore23:41:421
169940,0watchdog/114899-21sensors_temp19:21:471
169940,0watchdog/1141861ssh22:16:511
169940,0watchdog/10-21swapper/123:56:421
169940,0watchdog/10-21swapper/122:36:431
169940,0watchdog/10-21swapper/121:46:431
149940,0migration/025774-21kthreadcore23:46:420
149940,0migration/019337-21kthreadcore20:16:410
149940,0migration/013856-21kthreadcore20:11:420
149940,0migration/012977-21kthreadcore22:16:420
12719943,0cyclictest8894-21awk22:36:402
12719943,0cyclictest3556-21lldpd21:46:342
12719943,0cyclictest3556-21lldpd19:57:022
12719943,0cyclictest3556-21lldpd18:57:022
12719943,0cyclictest23400-21awk19:31:392
12719943,0cyclictest16458-21awk23:41:392
12699944,0cyclictest0-21swapper/123:20:211
12699944,0cyclictest0-21swapper/121:11:511
12699943,0cyclictest3556-21lldpd21:26:041
12699943,0cyclictest3556-21lldpd20:03:041
12699943,0cyclictest3514-21snmpd21:30:181
12699943,0cyclictest3514-21snmpd20:42:481
12699943,0cyclictest3514-21snmpd19:32:171
12699943,0cyclictest3241-21irqbalance23:46:331
12699943,0cyclictest3241-21irqbalance22:56:531
12699943,0cyclictest3241-21irqbalance20:16:431
12699943,0cyclictest3241-21irqbalance20:11:431
12699943,0cyclictest3241-21irqbalance00:01:431
12699943,0cyclictest26349-21awk20:46:401
12699943,0cyclictest25217-21awk21:06:411
12699943,0cyclictest25140-21awk22:06:401
12699943,0cyclictest24567-21awk00:06:411
12699943,0cyclictest10981-21sadc20:11:251
12689944,0cyclictest0-21swapper/022:37:510
12689944,0cyclictest0-21swapper/021:25:110
12689943,0cyclictest5835-21kworker/0:223:16:500
12689943,0cyclictest3556-21lldpd21:32:050
12689943,0cyclictest3514-21snmpd22:49:180
12689943,0cyclictest3514-21snmpd22:01:480
12689943,0cyclictest16879-21awk21:01:410
12689943,0cyclictest16609-21awk23:21:380
12689943,0cyclictest16446-21awk00:01:400
12689943,0cyclictest16429-21sort23:41:390
12689943,0cyclictest10198-21awk19:21:410
12689940,0cyclictest0-21swapper/020:51:410
29715030,0irq/26-eth0-rx-0-21swapper/320:48:053
29715030,0irq/26-eth0-rx-0-21swapper/320:42:483
29715030,0irq/26-eth0-rx-0-21swapper/320:06:353
29715030,0irq/26-eth0-rx-0-21swapper/319:21:373
259930,0migration/22643-21kthreadcore20:01:432
249930,0watchdog/20-21swapper/220:31:392
249930,0watchdog/20-21swapper/220:26:472
249930,0watchdog/20-21swapper/220:11:272
169930,0watchdog/10-21swapper/122:23:111
169930,0watchdog/10-21swapper/119:16:271
12719932,0cyclictest18174-21kthreadcore19:01:422
12719932,0cyclictest13103-21awk20:36:402
12719930,0cyclictest11060-21if_err_eth119:46:392
12719930,0cyclictest11060-21if_err_eth119:46:392
12719930,0cyclictest0-21swapper/220:21:382
12699933,0cyclictest3556-21lldpd19:46:321
12699933,0cyclictest3556-21lldpd19:46:321
12699933,0cyclictest15706-21awk19:01:401
12699932,0cyclictest3556-21lldpd22:04:351
12699932,0cyclictest28219-21munin-node19:11:351
12699932,0cyclictest15615-21grep20:36:421
12689933,0cyclictest5835-21kworker/0:222:41:360
12689933,0cyclictest5835-21kworker/0:222:26:340
12689933,0cyclictest32504-21kworker/0:000:11:290
12689933,0cyclictest32504-21kworker/0:000:06:370
12689933,0cyclictest21902-21kworker/0:019:56:440
12689933,0cyclictest21902-21kworker/0:019:36:350
12689933,0cyclictest21902-21kworker/0:019:11:310
12689933,0cyclictest21902-21kworker/0:019:01:350
12689933,0cyclictest21902-21kworker/0:018:56:290
12689933,0cyclictest10966-21kworker/0:121:26:360
12689933,0cyclictest10966-21kworker/0:120:31:320
12689933,0cyclictest0-21swapper/023:01:300
12689932,0cyclictest5245-21cat22:51:430
12689932,0cyclictest19706-21awk20:41:390
12689932,0cyclictest17236-21awk21:41:410
12689931,0cyclictest8800-21awk22:56:380
12689930,0cyclictest2465-21munin-node19:16:380
12689930,0cyclictest11345-21cut19:46:410
12689930,0cyclictest11345-21cut19:46:410
329920,0watchdog/328853-21perl19:11:363
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional