You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-29 - 10:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sat Aug 29, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450970,0irq/25-eth10-21swapper/318:42:153
975026766,0sleep20-21swapper/218:44:232
953324948,0sleep00-21swapper/018:41:530
976923425,0sleep10-21swapper/118:44:381
99159980,0cyclictest23690-21latency_hist19:20:300
99159970,0cyclictest0-21swapper/022:45:470
99179960,0cyclictest6630-21diskmemload22:59:242
99169966,0cyclictest6630-21diskmemload23:53:411
99169960,0cyclictest6630-21diskmemload23:36:301
99169960,0cyclictest0-21swapper/123:20:541
339960,0migration/34805-21latency_hist22:05:303
339960,0migration/312220-21sh21:47:283
29715060,0irq/26-eth0-rx-6985-21diskstats21:05:433
29715060,0irq/26-eth0-rx-31369-21load00:00:493
29715060,0irq/26-eth0-rx-28401-21kthreadcore19:45:473
29715060,0irq/26-eth0-rx-26536-21munin-node22:15:503
29715060,0irq/26-eth0-rx-0-21swapper/323:40:473
29715060,0irq/26-eth0-rx-0-21swapper/323:12:433
149960,0migration/09817-21sh23:50:240
149960,0migration/08734-21kthreadcore19:55:470
149960,0migration/026130-21sh22:56:320
149960,0migration/021135-21sh21:55:230
149960,0migration/019824-21sh22:35:060
149960,0migration/013148-21taskset21:50:170
99179955,0cyclictest0-21swapper/200:06:052
99179950,0cyclictest0-21swapper/223:28:052
99179950,0cyclictest0-21swapper/223:07:452
99179950,0cyclictest0-21swapper/222:39:032
99179950,0cyclictest0-21swapper/222:12:532
99179950,0cyclictest0-21swapper/220:54:132
99169955,0cyclictest0-21swapper/123:03:051
99169955,0cyclictest0-21swapper/121:44:441
99169955,0cyclictest0-21swapper/120:53:101
99169954,0cyclictest3241-21irqbalance23:25:481
99169950,0cyclictest0-21swapper/122:26:021
99159955,0cyclictest0-21swapper/022:15:490
99159954,0cyclictest12046-21sh22:30:300
99159950,0cyclictest0-21swapper/023:56:430
99159950,0cyclictest0-21swapper/021:29:380
8215050,0irq/24-0000:00:3570-21perf19:05:302
4150,0ktimersoftd/00-21swapper/023:07:220
4150,0ktimersoftd/00-21swapper/020:50:320
339950,0migration/33770-21taskset22:45:313
339950,0migration/332024-21kthreadcore22:20:493
339950,0migration/331072-21kthreadcore22:00:473
339950,0migration/331072-21kthreadcore22:00:473
339950,0migration/329613-21timerandwakeup19:20:523
339950,0migration/327937-21munin-node23:00:423
339950,0migration/326575-21taskset22:36:243
339950,0migration/325782-21aten_r1power_cu20:10:403
339950,0migration/32211-21kthreadcore21:40:483
339950,0migration/320814-21irqcore22:55:463
339950,0migration/319815-21fschecks_time20:30:443
339950,0migration/318338-21kthreadcore21:10:483
339950,0migration/318149-21munin-node19:15:453
339950,0migration/316753-21kthreadcore20:00:483
339950,0migration/315081-21fschecks_count20:50:423
339950,0migration/312931-21munin-node22:10:403
339950,0migration/311295-21open_files19:55:503
339950,0migration/310901-21taskset19:31:363
29725050,0irq/27-eth0-tx-5918-21munin-node20:20:510
29725050,0irq/27-eth0-tx-5489-21munin-node21:45:482
29725050,0irq/27-eth0-tx-31360-21kthreadcore22:40:482
29725050,0irq/27-eth0-tx-10494-21munin-node19:10:440
29725050,0irq/27-eth0-tx-0-21swapper/223:43:502
29725050,0irq/27-eth0-tx-0-21swapper/223:35:212
29725050,0irq/27-eth0-tx-0-21swapper/223:22:582
29725050,0irq/27-eth0-tx-0-21swapper/222:09:072
29725050,0irq/27-eth0-tx-0-21swapper/020:35:400
29725050,0irq/27-eth0-tx-0-21swapper/019:30:430
29715050,0irq/26-eth0-rx-5261-21munin-node22:25:473
29715050,0irq/26-eth0-rx-4038-21cut19:50:473
29715050,0irq/26-eth0-rx-26720-21kthreadcore20:55:453
29715050,0irq/26-eth0-rx-24980-40yum-updatesd-he23:36:373
29715050,0irq/26-eth0-rx-23218-21cut21:55:463
29715050,0irq/26-eth0-rx-18443-21df_abs23:55:413
29715050,0irq/26-eth0-rx-14076-21aten_r1power_fr21:30:413
29715050,0irq/26-eth0-rx-13477-21taskset21:29:483
29715050,0irq/26-eth0-rx-12915-21fschecks_time22:30:433
29715050,0irq/26-eth0-rx-12111-21perl19:35:433
29715050,0irq/26-eth0-rx-0-21swapper/323:31:333
29715050,0irq/26-eth0-rx-0-21swapper/323:27:263
29715050,0irq/26-eth0-rx-0-21swapper/323:05:453
29715050,0irq/26-eth0-rx-0-21swapper/322:53:443
29715050,0irq/26-eth0-rx-0-21swapper/322:43:543
29715050,0irq/26-eth0-rx-0-21swapper/321:36:233
29715050,0irq/26-eth0-rx-0-21swapper/320:45:513
29715050,0irq/26-eth0-rx-0-21swapper/318:45:463
29715050,0irq/26-eth0-rx-0-21swapper/300:10:463
29715050,0irq/26-eth0-rx-0-21swapper/300:05:463
259950,0migration/24397-21aten_r1power_en22:25:432
259950,0migration/23699-21latency_hist19:05:302
259950,0migration/23264-21sh22:01:202
259950,0migration/23264-21sh22:01:202
259950,0migration/229254-21sh20:56:582
259950,0migration/224873-21proc_pri23:15:502
259950,0migration/224295-21kthreadcore18:55:472
259950,0migration/222647-21kthreadcore22:15:452
249950,0watchdog/227886-21timerwakeupswit21:35:522
249950,0watchdog/221531-21needreboot18:50:492
249950,0watchdog/215564-21expr23:50:482
19150,0ktimersoftd/10-21swapper/123:49:171
19150,0ktimersoftd/10-21swapper/123:07:221
179950,0migration/15243-21taskset21:23:561
179950,0migration/13749-21latency_hist22:45:291
179950,0migration/124529-21kthreadcore21:35:461
179950,0migration/123311-21munin-node21:15:431
179950,0migration/12023-21kthreadcore19:00:481
179950,0migration/116612-21taskset19:12:081
179950,0migration/113725-21cpuspeed_turbos21:50:411
179950,0migration/112873-21munin-node20:00:441
179950,0migration/110162-21aten_r1power_en18:45:401
169950,0watchdog/121533-21tail18:50:491
169950,0watchdog/120476-21gltestperf22:55:441
149950,0migration/07350-21fschecks_count20:45:420
149950,0migration/0325-21kthreadcore21:00:470
149950,0migration/031870-21taskset20:12:040
149950,0migration/031154-21kthreadcore23:20:450
149950,0migration/030533-21kthreadcore22:20:480
149950,0migration/03045-21df_abs23:25:420
149950,0migration/02994-21missed_timers21:40:490
149950,0migration/028347-21aten_r1power_po22:40:420
149950,0migration/028318-40yum-updatesd21:36:350
149950,0migration/026691-21runrttasks23:20:010
149950,0migration/025301-21kthreadcore18:55:470
149950,0migration/024418-21mdstat20:05:480
149950,0migration/023543-21idleruntime20:55:420
149950,0migration/022606-21kthreadcore22:35:470
149950,0migration/021373-21sh21:12:540
149950,0migration/01892-21kthreadcore20:40:450
149950,0migration/015637-21kthreadcore20:00:480
149950,0migration/014501-21kthreadcore20:25:460
149950,0migration/013970-21taskset21:09:250
149950,0migration/013528-21fschecks_time22:10:420
99179943,0cyclictest3556-21lldpd19:53:482
99179943,0cyclictest3556-21lldpd19:46:182
99179943,0cyclictest3514-21snmpd23:46:162
99179943,0cyclictest3514-21snmpd20:25:462
99179943,0cyclictest26757-21awk20:35:442
99179943,0cyclictest20091-21awk20:30:462
99179943,0cyclictest11245-21sadc19:35:302
99169944,0cyclictest0-21swapper/123:44:331
99169944,0cyclictest0-21swapper/121:31:201
99169944,0cyclictest0-21swapper/121:11:281
99169944,0cyclictest0-21swapper/121:03:351
99169943,0cyclictest974-21awk20:15:461
99169943,0cyclictest6789-21awk20:20:431
99169943,0cyclictest5523-21sadc19:55:301
99169943,0cyclictest3556-21lldpd22:31:491
99169943,0cyclictest3556-21lldpd20:12:191
99169943,0cyclictest3514-21snmpd21:27:311
99169943,0cyclictest3514-21snmpd20:35:311
99169943,0cyclictest3514-21snmpd19:30:301
99169943,0cyclictest3241-21irqbalance23:15:481
99169943,0cyclictest3241-21irqbalance20:57:281
99169943,0cyclictest25660-21awk19:45:451
99169943,0cyclictest23797-21awk18:55:461
99169943,0cyclictest20076-21awk20:30:461
99169943,0cyclictest1395-21sed00:05:291
99169943,0cyclictest11554-21awk23:30:451
99169943,0cyclictest1066-21awk20:40:441
99169943,0cyclictest10524-21awk00:10:441
99159944,0cyclictest0-21swapper/023:51:120
99159943,0cyclictest5784-21awk22:05:450
99159943,0cyclictest3241-21irqbalance00:05:280
99159943,0cyclictest3019-21latency_hist23:05:290
99159943,0cyclictest25642-21sadc20:35:300
99159943,0cyclictest12432-21awk19:35:450
99159943,0cyclictest10992-21awk18:45:440
99159940,0cyclictest0-21swapper/019:25:460
339940,0migration/39065-21kthreadcore20:20:453
339940,0migration/33911-21kthreadcore20:15:483
339940,0migration/325187-21taskset20:06:223
339940,0migration/323310-21kthreadcore23:15:473
339940,0migration/32104-21aten_r1power_fr23:45:413
339940,0migration/314119-21fschecks_time21:50:423
339940,0migration/311700-21irqrtprio19:10:473
29725040,0irq/27-eth0-tx-6630-21diskmemload00:00:392
29725040,0irq/27-eth0-tx-30471-21telnet21:20:402
29725040,0irq/27-eth0-tx-30022-21ssh21:40:422
29725040,0irq/27-eth0-tx-18045-21ssh23:55:322
29725040,0irq/27-eth0-tx-17344-21ssh22:50:492
29725040,0irq/27-eth0-tx-14706-21aten_r1power_po21:10:422
29725040,0irq/27-eth0-tx-11421-21telnet23:10:402
29725040,0irq/27-eth0-tx-0-21swapper/223:02:042
29725040,0irq/27-eth0-tx-0-21swapper/222:45:402
29725040,0irq/27-eth0-tx-0-21swapper/222:31:132
29725040,0irq/27-eth0-tx-0-21swapper/221:50:432
29725040,0irq/27-eth0-tx-0-21swapper/221:15:412
29725040,0irq/27-eth0-tx-0-21swapper/220:47:382
29725040,0irq/27-eth0-tx-0-21swapper/200:11:242
29725040,0irq/27-eth0-tx-0-21swapper/019:45:490
29725040,0irq/27-eth0-tx-0-21swapper/019:20:450
29715040,0irq/26-eth0-rx-0-21swapper/323:50:433
29715040,0irq/26-eth0-rx-0-21swapper/323:20:373
29715040,0irq/26-eth0-rx-0-21swapper/321:20:403
29715040,0irq/26-eth0-rx-0-21swapper/321:15:353
29715040,0irq/26-eth0-rx-0-21swapper/321:01:303
29715040,0irq/26-eth0-rx-0-21swapper/319:28:323
259940,0migration/28577-21kthreadcore21:25:462
259940,0migration/26403-21fschecks_time19:55:432
259940,0migration/23127-21kthreadcore20:40:462
259940,0migration/229940-21runrttasks19:22:062
259940,0migration/226098-21munin-node20:10:422
259940,0migration/223099-21kthreadcore20:05:472
259940,0migration/220423-21kthreadcore23:35:492
259940,0migration/220188-21kthreadcore19:15:462
259940,0migration/215292-21kernelversion21:30:462
259940,0migration/215168-21kthreadcore20:00:482
259940,0migration/214022-21kthreadcore19:10:482
259940,0migration/210351-21kthreadcore20:20:462
259940,0migration/210045-21latency_hist18:45:302
249940,0watchdog/265172sleep221:05:322
249940,0watchdog/25180-21ssh21:02:282
249940,0watchdog/20-21swapper/222:20:442
249940,0watchdog/20-21swapper/221:55:442
179940,0migration/19482-21kthreadcore21:05:471
179940,0migration/19105-21kthreadcore19:55:471
179940,0migration/15852-21if_eth022:05:451
179940,0migration/129497-21irqrtprio22:40:461
179940,0migration/129195-21fschecks_count22:20:441
179940,0migration/127369-21timerwakeupswit21:55:521
179940,0migration/126362-21df_abs00:00:421
179940,0migration/122403-21kthreadcore20:05:471
179940,0migration/120675-21kthreadcore19:15:471
179940,0migration/11967-21kthreadcore22:00:481
179940,0migration/11967-21kthreadcore22:00:481
179940,0migration/116027-21kthreadcore22:50:471
179940,0migration/112683-21aten_r1power_fr20:25:411
179940,0migration/112154-21kthreadcore20:45:481
179940,0migration/110238-21taskset19:10:171
169940,0watchdog/124723-21ssh23:57:281
169940,0watchdog/123861-21cut22:35:481
169940,0watchdog/118362-21awk22:10:481
169940,0watchdog/1178112sleep119:39:091
169940,0watchdog/10-21swapper/122:19:321
149940,0migration/03440-21kthreadcore19:50:470
149940,0migration/026612-21kthreadcore21:15:460
149940,0migration/021393-21kthreadcore23:35:490
99179932,0cyclictest17151-21sensors_fan19:35:512
99169932,0cyclictest3514-21snmpd19:21:451
99169930,0cyclictest31079-21perl19:25:431
99159933,0cyclictest7481-21kworker/0:219:05:360
99159933,0cyclictest7481-21kworker/0:219:00:480
99159933,0cyclictest7481-21kworker/0:218:50:360
99159933,0cyclictest15422-21kworker/0:022:50:350
99159933,0cyclictest15422-21kworker/0:021:20:370
99159932,0cyclictest5398-21grep00:05:460
99159932,0cyclictest3514-21snmpd23:30:310
99159932,0cyclictest3514-21snmpd19:40:300
99159932,0cyclictest30222-21awk22:00:450
99159932,0cyclictest30222-21awk22:00:450
99159932,0cyclictest28141-21kthreadcore23:40:450
99159932,0cyclictest12265-21awk23:10:440
99159932,0cyclictest10475-21awk00:10:440
99159930,0cyclictest15283-21irqstats21:30:450
29725030,0irq/27-eth0-tx-32433-21aten2.4-expect20:15:410
29715030,0irq/26-eth0-rx-0-21swapper/320:43:183
29715030,0irq/26-eth0-rx-0-21swapper/320:35:403
29715030,0irq/26-eth0-rx-0-21swapper/319:42:343
29715030,0irq/26-eth0-rx-0-21swapper/319:09:383
29715030,0irq/26-eth0-rx-0-21swapper/319:00:303
29715030,0irq/26-eth0-rx-0-21swapper/318:55:303
259930,0migration/21772-21kthreadcore19:25:482
249930,0watchdog/20-21swapper/219:40:332
179930,0migration/111761-21diskmemload21:46:041
169930,0watchdog/10-21swapper/123:10:441
169930,0watchdog/10-21swapper/119:40:331
149930,0migration/023743-21kthreadcore21:55:460
99179920,0cyclictest32471-21aten_r1power_en20:15:422
329920,0watchdog/321603-21munin-node18:50:503
29715020,0irq/26-eth0-rx-0-21swapper/320:25:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional