You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-11 - 13:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Tue Aug 11, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2864829491,0sleep20-21swapper/218:45:282
304450820,0irq/25-eth10-21swapper/318:42:243
2876927170,0sleep10-21swapper/118:46:551
2866723925,0sleep00-21swapper/018:45:420
339960,0migration/39427-21sh21:16:143
339960,0migration/36073-21sh22:55:173
339960,0migration/35657-21sh23:16:013
339960,0migration/331719-21sh22:32:063
339960,0migration/324136-21sh21:22:513
339960,0migration/315592-21sh21:37:463
339960,0migration/311901-21kthreadcore22:17:303
29715060,0irq/26-eth0-rx-26123-21sed21:07:133
29715060,0irq/26-eth0-rx-17938-21munin-run21:02:133
29715060,0irq/26-eth0-rx-13880-21hddtemp_smartct00:02:253
149960,0migration/03221-21fschecks_time18:52:290
149960,0migration/021733-21sh22:42:440
149960,0migration/021277-21kthreadcore22:22:330
149960,0migration/020063-21sh00:05:080
149960,0migration/015794-21sh22:00:110
149960,0migration/010889-21idleruntime20:57:290
339950,0migration/39924-21needreboot19:42:323
339950,0migration/332719-21diskmemload21:51:393
339950,0migration/332719-21diskmemload21:51:393
339950,0migration/330040-21mdstat22:07:303
339950,0migration/329186-21munin-node00:12:253
339950,0migration/325332-21kthreadcore19:32:303
339950,0migration/323611-21timerandwakeup19:52:383
339950,0migration/323168-21cpuspeed_turbos23:07:253
339950,0migration/32265-21munin-node20:52:283
339950,0migration/322200-21munin-node00:07:283
339950,0migration/322048-21taskset19:04:023
339950,0migration/317370-21taskset19:49:453
339950,0migration/31247-21kthreadcore23:52:313
339950,0migration/312367-21cpuspeed_turbos20:12:253
29725050,0irq/27-eth0-tx-865-21ssh21:31:352
29725050,0irq/27-eth0-tx-7653-21munin-node22:37:252
29725050,0irq/27-eth0-tx-7364-21mdstat20:52:342
29725050,0irq/27-eth0-tx-5803-21munin-node23:37:282
29725050,0irq/27-eth0-tx-29756-21ssh22:47:582
29725050,0irq/27-eth0-tx-27398-21if_eth1.320:47:290
29725050,0irq/27-eth0-tx-19779-21tail20:42:250
29725050,0irq/27-eth0-tx-0-21swapper/223:42:292
29725050,0irq/27-eth0-tx-0-21swapper/222:57:292
29725050,0irq/27-eth0-tx-0-21swapper/222:46:372
29725050,0irq/27-eth0-tx-0-21swapper/221:34:452
29725050,0irq/27-eth0-tx-0-21swapper/221:21:502
29725050,0irq/27-eth0-tx-0-21swapper/019:11:540
29725050,0irq/27-eth0-tx-0-21swapper/018:47:270
29715050,0irq/26-eth0-rx-8776-21kthreadcore23:37:323
29715050,0irq/26-eth0-rx-8726-21cat20:32:293
29715050,0irq/26-eth0-rx-7729-21perl22:57:273
29715050,0irq/26-eth0-rx-5948-21ssh22:32:593
29715050,0irq/26-eth0-rx-4017-21kthreadcore21:32:283
29715050,0irq/26-eth0-rx-377-21cpuspeed_turbos22:12:233
29715050,0irq/26-eth0-rx-30149-21sed23:32:123
29715050,0irq/26-eth0-rx-25728-21users20:42:373
29715050,0irq/26-eth0-rx-22605-21kthreadcore21:42:303
29715050,0irq/26-eth0-rx-1582-21munin-run20:52:133
29715050,0irq/26-eth0-rx-14794-21ps23:42:323
29715050,0irq/26-eth0-rx-10228-21kthreadcore23:17:303
29715050,0irq/26-eth0-rx-0-21swapper/323:57:293
29715050,0irq/26-eth0-rx-0-21swapper/323:47:273
29715050,0irq/26-eth0-rx-0-21swapper/323:02:333
29715050,0irq/26-eth0-rx-0-21swapper/322:47:243
29715050,0irq/26-eth0-rx-0-21swapper/322:37:293
29715050,0irq/26-eth0-rx-0-21swapper/322:04:083
29715050,0irq/26-eth0-rx-0-21swapper/321:17:293
288759955,0cyclictest26159-21diskmemload22:08:352
288759955,0cyclictest0-21swapper/222:15:592
288759955,0cyclictest0-21swapper/221:13:052
288759950,0cyclictest0-21swapper/223:53:162
288759950,0cyclictest0-21swapper/222:28:172
288759950,0cyclictest0-21swapper/221:00:562
288739955,0cyclictest0-21swapper/123:36:301
288739950,0cyclictest0-21swapper/123:57:281
288739950,0cyclictest0-21swapper/122:27:551
288739950,0cyclictest0-21swapper/121:59:231
288739950,0cyclictest0-21swapper/121:51:591
288739950,0cyclictest0-21swapper/121:51:591
288739950,0cyclictest0-21swapper/121:44:341
288739950,0cyclictest0-21swapper/121:20:361
288739950,0cyclictest0-21swapper/121:04:311
288739950,0cyclictest0-21swapper/120:56:201
288739950,0cyclictest0-21swapper/100:15:461
288729954,0cyclictest14677-21munin-run23:02:120
288729950,0cyclictest0-21swapper/021:12:190
288729950,0cyclictest0-21swapper/020:27:320
27150,0ktimersoftd/20-21swapper/223:11:382
259950,0migration/24909-21munin-node19:42:272
259950,0migration/227487-21kthreadcore21:47:282
259950,0migration/227487-21kthreadcore21:47:282
259950,0migration/218785-21aten2.4-expect20:17:252
249950,0watchdog/24074-21kthreadcore18:52:322
249950,0watchdog/222044-21wc22:02:312
249950,0watchdog/217766-21smart_sda20:12:352
249950,0watchdog/20-21swapper/222:32:272
179950,0migration/116043-21timerwakeupswit20:57:381
169950,0watchdog/126068-21perl20:22:271
169950,0watchdog/122034-21kthreadcore21:22:311
169950,0watchdog/113231-21grep22:17:311
169950,0watchdog/10-21swapper/123:37:341
149950,0migration/09178-21kthreadcore20:32:290
149950,0migration/06317-21kthreadcore19:42:300
149950,0migration/05002-21sh23:35:380
149950,0migration/03785-21kthreadcore20:52:320
149950,0migration/03496-21sh19:37:350
149950,0migration/03338-21sh00:14:380
149950,0migration/032449-21runrttasks21:29:010
149950,0migration/031585-21hwlatdetect23:12:260
149950,0migration/030987-21munin-node21:47:330
149950,0migration/030987-21munin-node21:47:330
149950,0migration/030960-21kthreadcore23:52:300
149950,0migration/030245-21munin-node22:27:380
149950,0migration/029411-21unixbench-2d19:32:360
149950,0migration/028988-21kthreadcore20:22:320
149950,0migration/023363-21fschecks_count23:07:260
149950,0migration/022411-21kthreadcore21:42:300
149950,0migration/021199-21kthreadcore21:22:310
149950,0migration/01684-21cpuspeed_turbos21:32:230
149950,0migration/016294-21kthreadcore23:02:290
149950,0migration/013591-21fschecks_count20:37:260
149950,0migration/013492-21kthreadcore21:37:310
149950,0migration/012614-21fschecks_count20:12:260
149950,0migration/011327-21kernelversion21:17:300
149950,0migration/011220-21mdstat23:37:330
339940,0migration/39330-21timerandwakeup19:17:373
339940,0migration/322620-21diskmemload22:23:363
339940,0migration/316991-21kthreadcore22:42:303
339940,0migration/315359-21kthreadcore20:37:293
29725040,0irq/27-eth0-tx-437-21ssh20:49:172
29725040,0irq/27-eth0-tx-26256-21ssh21:07:252
29725040,0irq/27-eth0-tx-18195-21ssh21:02:212
29725040,0irq/27-eth0-tx-0-21swapper/223:57:142
29725040,0irq/27-eth0-tx-0-21swapper/223:48:362
29725040,0irq/27-eth0-tx-0-21swapper/223:32:492
29725040,0irq/27-eth0-tx-0-21swapper/223:27:292
29725040,0irq/27-eth0-tx-0-21swapper/223:02:342
29725040,0irq/27-eth0-tx-0-21swapper/222:52:282
29725040,0irq/27-eth0-tx-0-21swapper/222:17:252
29725040,0irq/27-eth0-tx-0-21swapper/221:52:252
29725040,0irq/27-eth0-tx-0-21swapper/221:42:272
29725040,0irq/27-eth0-tx-0-21swapper/200:08:182
29725040,0irq/27-eth0-tx-0-21swapper/200:05:372
29725040,0irq/27-eth0-tx-0-21swapper/020:02:260
29715040,0irq/26-eth0-rx-0-21swapper/323:28:273
29715040,0irq/26-eth0-rx-0-21swapper/323:22:553
29715040,0irq/26-eth0-rx-0-21swapper/321:57:513
29715040,0irq/26-eth0-rx-0-21swapper/321:53:103
29715040,0irq/26-eth0-rx-0-21swapper/321:27:353
29715040,0irq/26-eth0-rx-0-21swapper/321:06:283
29715040,0irq/26-eth0-rx-0-21swapper/320:27:243
29715040,0irq/26-eth0-rx-0-21swapper/320:17:253
29715040,0irq/26-eth0-rx-0-21swapper/319:27:313
288759944,0cyclictest0-21swapper/218:49:082
288759943,0cyclictest3556-21lldpd19:58:232
288759943,0cyclictest3556-21lldpd19:49:532
288759943,0cyclictest31668-21awk23:12:262
288759943,0cyclictest30153-21awk19:12:262
288759943,0cyclictest24412-21awk19:32:282
288759943,0cyclictest17118-21awk22:22:302
288759943,0cyclictest10224-21awk18:57:302
288739944,0cyclictest3514-21snmpd22:22:301
288739944,0cyclictest0-21swapper/122:52:121
288739943,0cyclictest7877-21awk22:57:281
288739943,0cyclictest6063-21sadc23:17:121
288739943,0cyclictest3556-21lldpd23:47:531
288739943,0cyclictest3556-21lldpd23:44:531
288739943,0cyclictest3556-21lldpd23:02:531
288739943,0cyclictest3556-21lldpd22:50:231
288739943,0cyclictest3556-21lldpd21:33:541
288739943,0cyclictest3556-21lldpd19:42:231
288739943,0cyclictest3556-21lldpd19:27:231
288739943,0cyclictest3556-21lldpd18:57:231
288739943,0cyclictest3556-21lldpd18:47:231
288739943,0cyclictest3556-21lldpd00:02:251
288739943,0cyclictest3514-21snmpd23:20:121
288739943,0cyclictest3241-21irqbalance22:02:311
288739943,0cyclictest23452-21awk19:07:291
288739943,0cyclictest23156-21awk23:27:271
288739943,0cyclictest15334-21awk23:22:291
288739940,0cyclictest0-21swapper/119:37:361
288729944,0cyclictest0-21swapper/023:28:410
288729944,0cyclictest0-21swapper/023:17:390
288729944,0cyclictest0-21swapper/021:08:220
288729943,0cyclictest8528-21awk22:37:270
288729943,0cyclictest3556-21lldpd19:12:240
288729943,0cyclictest3514-21snmpd22:07:420
288729943,0cyclictest3241-21irqbalance22:56:210
288729943,0cyclictest3241-21irqbalance21:55:010
288729943,0cyclictest3241-21irqbalance21:03:310
288729943,0cyclictest25411-21awk19:57:280
288729943,0cyclictest24349-21awk22:47:270
288729940,0cyclictest0-21swapper/022:19:380
259940,0migration/22030-21kthreadcore20:27:302
259940,0migration/219150-21kthreadcore23:22:322
259940,0migration/21642-21kthreadcore00:12:302
259940,0migration/213350-21cpuspeed_turbos20:37:242
259940,0migration/213007-21runrttasks23:19:022
259940,0migration/212541-21runrttasks20:33:242
259940,0migration/211761-21kthreadcore21:37:302
259940,0migration/210242-21kthreadcore21:57:302
249940,0watchdog/26433-21if_eth1.320:07:272
249940,0watchdog/226737-21kthreadcore20:22:312
249940,0watchdog/225615-21kthreadcore19:07:322
249940,0watchdog/222035-21kthreadcore21:22:312
249940,0watchdog/20-21swapper/219:52:272
249940,0watchdog/20-21swapper/219:02:362
179940,0migration/15221-21kthreadcore21:52:301
179940,0migration/132550-21fschecks_count22:32:261
179940,0migration/129617-21aten_r1power_cu23:52:241
179940,0migration/12804-21hddtemp_smartct21:12:271
179940,0migration/126845-21kthreadcore23:07:311
179940,0migration/124540-21sh19:57:241
179940,0migration/122877-21kthreadcore00:07:291
179940,0migration/121215-21kthreadcore20:42:301
179940,0migration/118259-21taskset20:14:151
179940,0migration/112930-21kthreadcore22:37:301
179940,0migration/111798-21taskset20:11:101
179940,0migration/111557-21kthreadcore21:37:301
179940,0migration/110011-21kthreadcore20:32:291
169940,0watchdog/18179-21kthreadcore19:17:321
169940,0watchdog/125541-21if_eth022:07:271
169940,0watchdog/119528-21hdparm20:17:271
169940,0watchdog/118211-21df_abs19:52:271
169940,0watchdog/11516-21ssh21:11:391
169940,0watchdog/10-21swapper/122:42:311
169940,0watchdog/10-21swapper/122:12:231
149940,0migration/021715-21sh23:47:240
149940,0migration/021242-21sh23:25:000
149940,0migration/013164-21kthreadcore19:47:300
149940,0migration/012727-21kthreadcore19:22:300
8215030,0irq/24-0000:00:0-21swapper/220:42:282
8215030,0irq/24-0000:00:0-21swapper/219:22:352
339930,0migration/36275-21kthreadcore18:52:323
339930,0migration/316311-21taskset19:23:493
29715030,0irq/26-eth0-rx-0-21swapper/320:22:243
29715030,0irq/26-eth0-rx-0-21swapper/320:07:243
29715030,0irq/26-eth0-rx-0-21swapper/320:02:193
29715030,0irq/26-eth0-rx-0-21swapper/319:57:353
29715030,0irq/26-eth0-rx-0-21swapper/319:07:263
29715030,0irq/26-eth0-rx-0-21swapper/318:49:103
288759933,0cyclictest3556-21lldpd19:17:232
288759933,0cyclictest0-21swapper/219:29:112
288759931,0cyclictest0-21swapper/220:02:282
288739933,0cyclictest3556-21lldpd19:32:231
288739932,0cyclictest2417-21sensors19:12:321
288739932,0cyclictest12064-21awk19:47:281
288729933,0cyclictest8976-21kworker/0:122:32:160
288729933,0cyclictest2812-21kworker/0:022:02:300
288729933,0cyclictest21820-21kworker/0:220:17:180
288729933,0cyclictest21820-21kworker/0:220:07:170
288729933,0cyclictest21820-21kworker/0:219:52:170
288729933,0cyclictest21820-21kworker/0:219:27:170
288729933,0cyclictest21820-21kworker/0:219:17:150
288729933,0cyclictest21820-21kworker/0:219:02:290
288729933,0cyclictest21820-21kworker/0:218:57:230
288729933,0cyclictest15124-21kworker/0:023:57:160
288729933,0cyclictest15124-21kworker/0:023:42:260
288729933,0cyclictest15124-21kworker/0:000:07:220
288729930,0cyclictest495-21diskstats22:12:230
179930,0migration/14625-21timerwakeupswit20:02:341
169930,0watchdog/16061-21taskset20:31:071
169930,0watchdog/126159-21diskmemload20:47:151
169930,0watchdog/121573-21munin-node19:02:361
169930,0watchdog/110197-21runrttasks19:22:241
169930,0watchdog/10-21swapper/121:27:151
169930,0watchdog/10-21swapper/120:37:231
169930,0watchdog/10-21swapper/118:52:321
329920,0watchdog/329713-21fschecks_count19:12:243
29715020,0irq/26-eth0-rx-0-21swapper/319:37:253
29715020,0irq/26-eth0-rx-0-21swapper/318:57:453
288759920,0cyclictest30126-21latency_hist19:37:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional