You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-12 - 06:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Wed Aug 12, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450740,0irq/25-eth10-21swapper/318:44:423
60426261,0sleep10-21swapper/118:45:191
50223525,0sleep20-21swapper/218:44:082
57623322,0sleep00-21swapper/018:44:580
8719987,0cyclictest27605-21if_eth123:47:210
8729960,0cyclictest0-21swapper/123:59:511
8729960,0cyclictest0-21swapper/123:43:371
339960,0migration/34820-21sh22:10:523
339960,0migration/332489-21kthreadcore21:27:223
339960,0migration/329727-21sh21:45:323
339960,0migration/326639-21sh23:04:113
339960,0migration/312050-21munin-node22:57:163
339960,0migration/310628-21taskset23:15:383
29725060,0irq/27-eth0-tx-17392-21munin-node20:12:330
29715060,0irq/26-eth0-rx-9268-21ssh23:33:113
29715060,0irq/26-eth0-rx-29251-21tail21:22:303
29715060,0irq/26-eth0-rx-15952-21diskstats20:57:233
27160,0ktimersoftd/20-21swapper/223:30:212
27160,0ktimersoftd/20-21swapper/221:22:292
149960,0migration/08030-21unixbench-2d19:12:310
149960,0migration/028625-21sh22:04:060
149960,0migration/025215-21sh00:05:290
149960,0migration/013689-21sh21:13:020
149960,0migration/012074-21sh22:13:500
8739950,0cyclictest0-21swapper/223:58:532
8739950,0cyclictest0-21swapper/221:14:462
8739950,0cyclictest0-21swapper/220:57:442
8729955,0cyclictest0-21swapper/119:37:311
8729955,0cyclictest0-21swapper/100:06:101
8729950,0cyclictest0-21swapper/122:44:581
8729950,0cyclictest0-21swapper/122:33:091
8729950,0cyclictest0-21swapper/122:23:321
8729950,0cyclictest0-21swapper/122:06:301
8729950,0cyclictest0-21swapper/121:34:391
8729950,0cyclictest0-21swapper/121:19:031
8729950,0cyclictest0-21swapper/121:02:481
8719954,0cyclictest6079-21cut20:27:240
8719950,0cyclictest0-21swapper/021:44:320
4150,0ktimersoftd/00-21swapper/022:56:070
4150,0ktimersoftd/00-21swapper/022:50:360
4150,0ktimersoftd/00-21swapper/000:08:010
339950,0migration/37047-21cpuspeed_turbos21:32:193
339950,0migration/36979-21latency00:12:263
339950,0migration/34131-21kthreadcore19:12:253
339950,0migration/34048-21taskset22:30:373
339950,0migration/331944-21irqrtprio20:22:253
339950,0migration/331103-21fschecks_time21:47:193
339950,0migration/330469-21munin-node20:42:283
339950,0migration/326618-21ntp_kernel_pll_19:02:273
339950,0migration/324545-21kthreadcore22:02:213
339950,0migration/324374-21taskset00:02:553
339950,0migration/322735-21munin-node19:27:193
339950,0migration/322212-21idleruntime22:22:203
339950,0migration/319662-21kernelversion20:37:253
339950,0migration/319427-21kthreadcore19:22:253
339950,0migration/318957-21sh22:37:423
339950,0migration/318415-21sh23:41:523
339950,0migration/31468-21kthreadcore19:57:253
339950,0migration/31460-21kthreadcore19:32:263
29725050,0irq/27-eth0-tx-5821-21ssh20:48:510
29725050,0irq/27-eth0-tx-22094-21munin-node19:27:220
29725050,0irq/27-eth0-tx-16053-21expr21:17:202
29725050,0irq/27-eth0-tx-12662-21cut20:52:252
29725050,0irq/27-eth0-tx-11390-21munin-node23:17:292
29725050,0irq/27-eth0-tx-0-21swapper/223:34:162
29725050,0irq/27-eth0-tx-0-21swapper/222:42:392
29725050,0irq/27-eth0-tx-0-21swapper/222:07:262
29725050,0irq/27-eth0-tx-0-21swapper/222:03:462
29725050,0irq/27-eth0-tx-0-21swapper/200:02:242
29715050,0irq/26-eth0-rx-8835-21grep22:52:253
29715050,0irq/26-eth0-rx-6457-21cut22:32:233
29715050,0irq/26-eth0-rx-3209-21cut18:47:243
29715050,0irq/26-eth0-rx-27431-21grep23:47:203
29715050,0irq/26-eth0-rx-25838-21cut21:02:263
29715050,0irq/26-eth0-rx-1346-21ssh23:28:293
29715050,0irq/26-eth0-rx-0-21swapper/323:45:173
29715050,0irq/26-eth0-rx-0-21swapper/323:07:293
29715050,0irq/26-eth0-rx-0-21swapper/322:47:213
29715050,0irq/26-eth0-rx-0-21swapper/321:18:563
29715050,0irq/26-eth0-rx-0-21swapper/321:12:393
29715050,0irq/26-eth0-rx-0-21swapper/320:52:023
29715050,0irq/26-eth0-rx-0-21swapper/319:43:193
29715050,0irq/26-eth0-rx-0-21swapper/318:57:253
29715050,0irq/26-eth0-rx-0-21swapper/300:07:483
259950,0migration/29926-21aten_r1power_vo19:42:272
259950,0migration/28774-21sh23:53:402
259950,0migration/28203-21sh00:13:562
259950,0migration/24914-21latency_hist20:27:072
259950,0migration/24354-21sh21:47:312
259950,0migration/231984-21kthreadcore19:57:252
259950,0migration/22758-21kthreadcore18:47:242
259950,0migration/227570-21kthreadcore00:07:232
259950,0migration/218457-21aten_r1power_fr20:37:202
259950,0migration/214204-21munin-node22:17:192
259950,0migration/212207-21munin-node21:32:262
249950,0watchdog/227728-21tr21:42:252
249950,0watchdog/220715-21gltestperf23:02:212
249950,0watchdog/20-21swapper/223:37:212
19150,0ktimersoftd/10-21swapper/100:12:561
179950,0migration/19029-21munin-node19:17:201
179950,0migration/123993-21latency_hist20:17:071
179950,0migration/113747-21kthreadcore23:17:251
149950,0migration/09613-21kthreadcore18:52:240
149950,0migration/07507-21kthreadcore21:52:250
149950,0migration/06858-21kthreadcore19:37:290
149950,0migration/05823-21diskmemload22:32:220
149950,0migration/05700-21taskset21:08:060
149950,0migration/0484-21kthreadcore22:07:250
149950,0migration/031684-21fschecks_count21:27:190
149950,0migration/030910-21kthreadcore22:27:240
149950,0migration/030355-21sh21:25:310
149950,0migration/028214-21kthreadcore19:52:270
149950,0migration/027592-21kthreadcore20:42:270
149950,0migration/027418-21unixbench_multi22:22:290
149950,0migration/027126-21runrttasks23:05:400
149950,0migration/026686-21kthreadcore21:02:260
149950,0migration/025456-21sh23:44:130
149950,0migration/021596-21sh22:01:500
149950,0migration/021081-21df_inode22:42:210
149950,0migration/021071-21rt-features19:22:280
149950,0migration/017821-21kthreadcore22:37:230
149950,0migration/017687-21kthreadcore20:57:270
149950,0migration/017521-21munin-node23:17:320
149950,0migration/01699-21sh23:07:520
149950,0migration/016170-21munin-node21:17:210
149950,0migration/013884-21kthreadcore20:32:250
149950,0migration/013881-21kthreadcore23:57:240
149950,0migration/012077-21kthreadcore19:42:320
149950,0migration/01177-21kthreadcore19:57:250
149950,0migration/010280-21kthreadcore19:17:240
8739943,0cyclictest3556-21lldpd19:37:332
8739943,0cyclictest28766-21awk19:07:232
8739943,0cyclictest28766-21awk19:07:232
8739943,0cyclictest26028-21awk20:42:252
8739943,0cyclictest16393-21awk19:22:222
8729944,0cyclictest0-21swapper/123:25:101
8729944,0cyclictest0-21swapper/121:24:151
8729943,0cyclictest8349-21awk20:52:221
8729943,0cyclictest6529-21awk22:12:231
8729943,0cyclictest3556-21lldpd22:38:331
8729943,0cyclictest3556-21lldpd20:38:331
8729943,0cyclictest32581-21awk21:07:231
8729943,0cyclictest30809-21awk22:07:231
8729943,0cyclictest3077-21awk19:12:231
8729943,0cyclictest22021-21awk19:02:221
8729943,0cyclictest12582-21awk20:32:231
8719944,0cyclictest0-21swapper/023:15:400
8719943,0cyclictest3241-21irqbalance23:34:450
8719943,0cyclictest31519-21kworker/0:120:22:270
8719943,0cyclictest28701-21awk19:07:220
8719943,0cyclictest28701-21awk19:07:220
8719943,0cyclictest2752-21sadc19:37:080
8719943,0cyclictest15614-21awk21:37:230
339940,0migration/38669-21irqrtprio20:52:243
339940,0migration/38148-21kthreadcore20:27:253
339940,0migration/35991-21kthreadcore20:02:253
339940,0migration/35256-21kthreadcore23:52:253
339940,0migration/330451-21taskset20:21:353
339940,0migration/318500-21kthreadcore21:37:263
339940,0migration/313608-21kthreadcore20:32:253
339940,0migration/311699-21kthreadcore23:57:243
29725040,0irq/27-eth0-tx-536-21ssh23:48:042
29725040,0irq/27-eth0-tx-4108-21munin-node22:52:192
29725040,0irq/27-eth0-tx-30739-21kthreadcore23:07:242
29725040,0irq/27-eth0-tx-18792-21munin-node23:42:242
29725040,0irq/27-eth0-tx-15844-21tr21:57:232
29725040,0irq/27-eth0-tx-0-21swapper/223:12:372
29725040,0irq/27-eth0-tx-0-21swapper/222:47:312
29725040,0irq/27-eth0-tx-0-21swapper/222:37:162
29725040,0irq/27-eth0-tx-0-21swapper/222:32:172
29725040,0irq/27-eth0-tx-0-21swapper/222:27:142
29725040,0irq/27-eth0-tx-0-21swapper/222:23:152
29725040,0irq/27-eth0-tx-0-21swapper/221:52:542
29725040,0irq/27-eth0-tx-0-21swapper/221:37:252
29725040,0irq/27-eth0-tx-0-21swapper/221:07:232
29725040,0irq/27-eth0-tx-0-21swapper/221:02:172
29725040,0irq/27-eth0-tx-0-21swapper/020:17:290
29725040,0irq/27-eth0-tx-0-21swapper/019:47:330
29725040,0irq/27-eth0-tx-0-21swapper/019:02:290
29715040,0irq/26-eth0-rx-0-21swapper/323:24:083
29715040,0irq/26-eth0-rx-0-21swapper/323:18:193
29715040,0irq/26-eth0-rx-0-21swapper/322:42:263
29715040,0irq/26-eth0-rx-0-21swapper/322:17:233
29715040,0irq/26-eth0-rx-0-21swapper/322:12:253
29715040,0irq/26-eth0-rx-0-21swapper/321:57:123
29715040,0irq/26-eth0-rx-0-21swapper/321:54:593
29715040,0irq/26-eth0-rx-0-21swapper/321:08:043
29715040,0irq/26-eth0-rx-0-21swapper/319:47:263
259940,0migration/29873-21kthreadcore20:27:252
259940,0migration/29155-21kthreadcore20:02:262
259940,0migration/231940-21hddtemp_smartct21:27:192
259940,0migration/224647-21fschecks_time20:17:192
259940,0migration/22040-21latency_hist19:12:082
259940,0migration/219786-21fschecks_count23:22:222
259940,0migration/216583-21kthreadcore22:57:232
259940,0migration/211321-21switchtime22:12:302
249940,0watchdog/26026-21taskset20:49:212
249940,0watchdog/217533-21aten_r1power_vo20:12:222
249940,0watchdog/216196-21cut20:32:262
249940,0watchdog/20-21swapper/219:52:262
249940,0watchdog/20-21swapper/219:32:222
179940,0migration/17975-21kthreadcore23:32:261
179940,0migration/17652-21kthreadcore21:52:251
179940,0migration/16921-21kthreadcore22:52:241
179940,0migration/14633-21fschecks_time20:02:221
179940,0migration/14065-21fschecks_time23:12:201
179940,0migration/131803-21munin-node00:07:281
179940,0migration/131625-21kthreadcore23:27:241
179940,0migration/131455-21cpuspeed_turbos21:27:181
179940,0migration/130663-21munin-node20:42:311
179940,0migration/124172-21kthreadcore21:42:241
179940,0migration/122755-21fschecks_time19:27:191
179940,0migration/114411-21kthreadcore22:57:231
179940,0migration/111616-21kthreadcore19:42:321
169940,0watchdog/14317-21kthreadcore23:52:251
169940,0watchdog/132409-21kthreadcore22:27:251
169940,0watchdog/132080-21grep23:47:251
169940,0watchdog/12610-21kthreadcore20:47:251
169940,0watchdog/124408-21kthreadcore19:52:261
169940,0watchdog/122011-21ssh20:58:211
169940,0watchdog/120713-21gltestperf23:02:211
169940,0watchdog/118188-21kthreadcore19:47:261
169940,0watchdog/117084-21kthreadcore21:37:251
169940,0watchdog/114415-21if_eth1.322:17:211
169940,0watchdog/110838-21munin-node23:37:211
169940,0watchdog/10-21swapper/123:07:251
169940,0watchdog/10-21swapper/122:47:211
169940,0watchdog/10-21swapper/120:22:261
169940,0watchdog/10-21swapper/119:32:221
169940,0watchdog/10-21swapper/119:07:301
169940,0watchdog/10-21swapper/119:07:301
149940,0migration/08539-21sh00:14:580
149940,0migration/0719-21timerandwakeup23:27:290
149940,0migration/05806-21kthreadcore20:02:250
149940,0migration/021141-21latency_hist22:22:070
8739932,0cyclictest9788-21awk19:17:232
8739932,0cyclictest22573-21tune2fs19:27:192
8739932,0cyclictest22066-21awk19:02:232
8739930,0cyclictest15207-21perl18:57:212
8729933,0cyclictest3556-21lldpd20:16:331
8729932,0cyclictest5921-21awk20:27:221
8729932,0cyclictest3556-21lldpd21:48:321
8729932,0cyclictest3556-21lldpd18:47:311
8729932,0cyclictest30668-21awk19:57:231
8729932,0cyclictest13963-21grep20:07:261
8729932,0cyclictest13514-21sensors18:52:291
8719933,0cyclictest4216-21kworker/0:023:37:200
8719933,0cyclictest4216-21kworker/0:023:22:180
8719933,0cyclictest31519-21kworker/0:120:52:350
8719933,0cyclictest31519-21kworker/0:120:37:090
8719933,0cyclictest19846-21kworker/0:222:58:240
8719933,0cyclictest12383-21kworker/0:120:07:110
8719933,0cyclictest12383-21kworker/0:118:57:110
8719933,0cyclictest12383-21kworker/0:118:47:110
8719932,0cyclictest31379-21awk21:47:200
8719932,0cyclictest3068-21awk23:52:220
8719930,0cyclictest7495-21perl21:32:210
8215030,0irq/24-0000:00:0-21swapper/218:52:182
339930,0migration/328818-21runrttasks19:52:323
29715030,0irq/26-eth0-rx-0-21swapper/320:15:163
29715030,0irq/26-eth0-rx-0-21swapper/320:07:203
29715030,0irq/26-eth0-rx-0-21swapper/319:37:273
29715030,0irq/26-eth0-rx-0-21swapper/319:09:303
29715030,0irq/26-eth0-rx-0-21swapper/319:09:303
29715030,0irq/26-eth0-rx-0-21swapper/318:54:193
249930,0watchdog/20-21swapper/220:07:262
249930,0watchdog/20-21swapper/219:47:262
169930,0watchdog/18187-21smartctl21:12:211
169930,0watchdog/10-21swapper/121:58:451
169930,0watchdog/10-21swapper/118:57:341
8729921,0cyclictest15419-21latency_hist19:22:081
29715020,0irq/26-eth0-rx-0-21swapper/319:17:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional