You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 08:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Mon Jul 20, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3060023723,0sleep00-21swapper/018:48:320
304450350,0irq/25-eth10-21swapper/318:45:323
3029323526,0sleep20-21swapper/218:44:582
2429823424,0sleep10-21swapper/118:44:251
339970,0migration/327908-21sh21:04:533
4160,0ktimersoftd/032404-21latency19:59:360
339960,0migration/37747-21idleruntime23:29:323
339960,0migration/317454-21sh22:17:333
339960,0migration/313637-21sh21:34:473
307359960,0cyclictest0-21swapper/221:44:302
307359960,0cyclictest0-21swapper/219:59:302
307339966,0cyclictest28828-21diskmemload21:25:211
307339960,0cyclictest0-21swapper/123:37:191
29715060,0irq/26-eth0-rx-4034-21cut22:29:343
29715060,0irq/26-eth0-rx-3373-21ssh23:04:443
29715060,0irq/26-eth0-rx-15778-21grep22:34:363
29715060,0irq/26-eth0-rx-0-21swapper/322:01:303
149960,0migration/07371-21sh00:04:590
149960,0migration/024802-21sh22:03:080
149960,0migration/022925-21taskset23:38:080
149960,0migration/016677-21sh21:58:500
149960,0migration/010439-21cpuspeed_turbos22:14:300
4150,0ktimersoftd/00-21swapper/023:56:240
4150,0ktimersoftd/00-21swapper/021:14:480
35150,0ktimersoftd/30-21swapper/323:20:113
35150,0ktimersoftd/30-21swapper/319:09:213
339950,0migration/38043-21munin-node19:44:383
339950,0migration/35088-21munin-node19:14:413
339950,0migration/3436-21munin-node21:49:303
339950,0migration/33795-21taskset22:48:573
339950,0migration/331975-21irqcore23:24:343
339950,0migration/329691-21kthreadcore19:59:353
339950,0migration/327775-21munin-node22:24:343
339950,0migration/322456-21kthreadcore22:39:363
339950,0migration/319012-21munin-node19:04:323
339950,0migration/31772-21kthreadcore18:49:363
339950,0migration/317410-21kthreadcore20:39:383
339950,0migration/314873-21aten_r1power_fr20:14:303
339950,0migration/312782-21munin-node18:59:353
339950,0migration/311717-21ntp_offset19:19:403
339950,0migration/310628-21kthreadcore21:54:363
307359955,0cyclictest598-21kthreadcore20:24:342
307359955,0cyclictest0-21swapper/221:29:502
307359954,0cyclictest18764-21kthreadcore21:19:352
307359950,0cyclictest0-21swapper/221:13:172
307339955,0cyclictest0-21swapper/123:47:431
307339955,0cyclictest0-21swapper/121:09:541
307339950,0cyclictest0-21swapper/123:51:491
307329955,0cyclictest0-21swapper/023:21:060
307329955,0cyclictest0-21swapper/022:44:210
307329952,0cyclictest27877-21munin-run20:24:190
307329950,0cyclictest0-21swapper/020:56:220
29725050,0irq/27-eth0-tx-9079-21munin-node20:34:350
29725050,0irq/27-eth0-tx-3514-21snmpd19:47:490
29725050,0irq/27-eth0-tx-26780-21open_inodes22:59:392
29725050,0irq/27-eth0-tx-18619-21munin-node19:04:360
29725050,0irq/27-eth0-tx-13287-21munin-node20:59:442
29715050,0irq/26-eth0-rx-5443-21irqrtprio22:49:343
29715050,0irq/26-eth0-rx-5125-21kthreadcore22:09:373
29715050,0irq/26-eth0-rx-26935-21kthreadcore22:04:343
29715050,0irq/26-eth0-rx-22639-21cut22:59:363
29715050,0irq/26-eth0-rx-21885-21kthreadcore23:54:363
29715050,0irq/26-eth0-rx-21665-21cpuspeed_turbos20:19:303
29715050,0irq/26-eth0-rx-16769-21sh00:12:253
29715050,0irq/26-eth0-rx-16148-21cut20:59:453
29715050,0irq/26-eth0-rx-14289-21awk19:49:323
29715050,0irq/26-eth0-rx-10035-21if_eth1.220:34:353
29715050,0irq/26-eth0-rx-0-21swapper/323:49:583
29715050,0irq/26-eth0-rx-0-21swapper/323:44:353
29715050,0irq/26-eth0-rx-0-21swapper/323:44:053
29715050,0irq/26-eth0-rx-0-21swapper/323:14:343
29715050,0irq/26-eth0-rx-0-21swapper/323:09:493
29715050,0irq/26-eth0-rx-0-21swapper/321:48:523
29715050,0irq/26-eth0-rx-0-21swapper/321:42:103
29715050,0irq/26-eth0-rx-0-21swapper/321:26:543
29715050,0irq/26-eth0-rx-0-21swapper/321:22:213
29715050,0irq/26-eth0-rx-0-21swapper/321:16:033
29715050,0irq/26-eth0-rx-0-21swapper/320:49:313
29715050,0irq/26-eth0-rx-0-21swapper/300:14:533
29715050,0irq/26-eth0-rx-0-21swapper/300:08:343
29715050,0irq/26-eth0-rx-0-21swapper/300:01:553
27150,0ktimersoftd/20-21swapper/221:09:072
249950,0watchdog/223018-21kthreadcore22:39:362
19150,0ktimersoftd/10-21swapper/119:09:211
179950,0migration/125330-21latency_hist22:04:181
179950,0migration/122843-21forks20:44:321
179950,0migration/120926-21sh21:20:151
179950,0migration/118442-21fschecks_time00:14:301
179950,0migration/117555-21sh00:14:161
169950,0watchdog/116509-21kthreadcore22:34:361
149950,0migration/09719-21kthreadcore23:29:350
149950,0migration/07199-21munin-node22:09:380
149950,0migration/06303-21timerandwakeup21:49:410
149950,0migration/05714-21munin-node23:09:300
149950,0migration/0567-21sh00:04:080
149950,0migration/04997-21sh23:08:300
149950,0migration/030021-21kthreadcore19:34:380
149950,0migration/026388-21irqcore19:09:370
149950,0migration/025578-21kthreadcore22:59:370
149950,0migration/025066-21kthreadcore21:24:350
149950,0migration/023311-21taskset21:42:390
149950,0migration/023256-21kthreadcore19:29:360
149950,0migration/020106-21kthreadcore20:39:390
149950,0migration/016255-21kthreadcore20:14:360
149950,0migration/014881-21kthreadcore18:59:370
149950,0migration/013487-21missed_timers20:09:380
149950,0migration/013213-21sh20:59:210
149950,0migration/013104-21kthreadcore23:49:360
149950,0migration/013070-21df_abs22:54:300
149950,0migration/011589-21sh22:52:230
149950,0migration/011100-21kthreadcore00:09:350
149950,0migration/010197-21sh22:32:140
339940,0migration/38556-21taskset20:31:033
339940,0migration/38186-21kthreadcore18:54:373
339940,0migration/328104-21kthreadcore19:34:373
339940,0migration/327305-21kthreadcore20:44:373
339940,0migration/320626-21kthreadcore22:19:353
339940,0migration/315022-21kthreadcore22:54:353
307359943,0cyclictest9170-21awk23:49:342
307359943,0cyclictest5226-21awk22:49:332
307359943,0cyclictest3556-21lldpd23:14:182
307359943,0cyclictest3556-21lldpd22:00:182
307359943,0cyclictest3556-21lldpd19:50:152
307359943,0cyclictest3514-21snmpd19:45:432
307359943,0cyclictest3514-21snmpd19:40:432
307359943,0cyclictest3514-21snmpd19:36:432
307359943,0cyclictest3514-21snmpd19:08:582
307359943,0cyclictest3514-21snmpd18:56:432
307359943,0cyclictest3514-21snmpd18:52:432
307359943,0cyclictest3241-21irqbalance23:56:362
307359943,0cyclictest3241-21irqbalance22:54:272
307359943,0cyclictest3241-21irqbalance21:14:372
307359943,0cyclictest3241-21irqbalance20:44:272
307359943,0cyclictest3241-21irqbalance20:39:272
307359943,0cyclictest3241-21irqbalance20:34:272
307359943,0cyclictest3241-21irqbalance20:30:072
307359943,0cyclictest3241-21irqbalance20:19:472
307359943,0cyclictest3241-21irqbalance20:14:472
307359943,0cyclictest3241-21irqbalance20:09:272
307359943,0cyclictest3241-21irqbalance20:04:572
307359943,0cyclictest3241-21irqbalance19:14:372
307359943,0cyclictest2595-21awk22:09:352
307359943,0cyclictest1915-21awk00:04:322
307359943,0cyclictest12781-21awk18:59:352
307339944,0cyclictest0-21swapper/119:54:421
307339943,0cyclictest6668-21awk23:09:341
307339943,0cyclictest3514-21snmpd23:57:141
307339943,0cyclictest3261-21awk20:29:341
307339943,0cyclictest32240-21awk21:29:331
307339943,0cyclictest29199-21awk22:44:341
307339943,0cyclictest28013-21awk19:59:331
307339943,0cyclictest27157-21awk19:34:361
307339943,0cyclictest20764-21awk22:39:351
307339943,0cyclictest1964-21awk00:04:321
307339943,0cyclictest16633-21awk20:39:361
307339943,0cyclictest15522-21sadc20:39:181
307339943,0cyclictest15134-21cut22:54:351
307339943,0cyclictest13798-21awk19:24:321
307339943,0cyclictest11042-21awk22:14:341
307339943,0cyclictest10460-21ntpq20:54:391
307329944,0cyclictest0-21swapper/021:46:200
307329944,0cyclictest0-21swapper/021:10:240
307329943,0cyclictest7195-21awk19:19:350
307329943,0cyclictest3241-21irqbalance22:36:070
307329943,0cyclictest3241-21irqbalance21:34:370
307329943,0cyclictest32208-21awk21:29:330
307329943,0cyclictest24745-21awk23:39:350
307329943,0cyclictest15043-21ps19:49:350
29725040,0irq/27-eth0-tx-9766-21cpuspeed_turbos00:09:302
29725040,0irq/27-eth0-tx-7378-21ssh21:34:202
29725040,0irq/27-eth0-tx-28828-21diskmemload23:34:412
29725040,0irq/27-eth0-tx-10129-21munin-node22:14:292
29725040,0irq/27-eth0-tx-0-21swapper/223:59:452
29725040,0irq/27-eth0-tx-0-21swapper/223:46:092
29725040,0irq/27-eth0-tx-0-21swapper/223:30:292
29725040,0irq/27-eth0-tx-0-21swapper/223:19:222
29725040,0irq/27-eth0-tx-0-21swapper/222:44:342
29725040,0irq/27-eth0-tx-0-21swapper/222:35:592
29725040,0irq/27-eth0-tx-0-21swapper/222:31:192
29725040,0irq/27-eth0-tx-0-21swapper/222:24:262
29725040,0irq/27-eth0-tx-0-21swapper/221:24:342
29725040,0irq/27-eth0-tx-0-21swapper/200:14:272
29725040,0irq/27-eth0-tx-0-21swapper/020:44:330
29725040,0irq/27-eth0-tx-0-21swapper/020:24:380
29725040,0irq/27-eth0-tx-0-21swapper/018:49:300
29715040,0irq/26-eth0-rx-4567-21ntp_kernel_pll_21:29:383
29715040,0irq/26-eth0-rx-0-21swapper/323:34:353
29715040,0irq/26-eth0-rx-0-21swapper/321:09:283
29715040,0irq/26-eth0-rx-0-21swapper/320:54:193
259940,0migration/27904-21kthreadcore19:19:372
259940,0migration/25540-21latency_hist23:09:182
259940,0migration/22938-21munin-node23:04:412
259940,0migration/227672-21kthreadcore19:09:382
259940,0migration/225473-21latency_hist22:04:182
259940,0migration/224323-21kthreadcore19:54:362
259940,0migration/213818-21if_eth019:24:322
259940,0migration/212136-21kthreadcore21:54:372
249940,0watchdog/25562-21perl20:54:332
249940,0watchdog/232755-21aten_r1power_cu21:49:292
249940,0watchdog/224929-21ssh23:39:362
249940,0watchdog/224753-21ssh22:19:562
249940,0watchdog/223244-21ssh21:42:292
249940,0watchdog/21556-21kthreadcore23:24:362
249940,0watchdog/20-21swapper/220:49:332
179940,0migration/19433-21diskmemload22:13:201
179940,0migration/17658-21taskset20:06:281
179940,0migration/130563-21kthreadcore20:24:331
179940,0migration/129355-21cpuspeed_turbos20:49:321
179940,0migration/129208-21sh21:07:571
179940,0migration/129008-21kthreadcore22:24:361
179940,0migration/121114-21kthreadcore19:29:351
179940,0migration/11767-21kthreadcore19:39:341
179940,0migration/116233-21kthreadcore20:59:451
179940,0migration/11545-21kthreadcore18:49:361
179940,0migration/112406-21taskset19:21:131
179940,0migration/11112-21kthreadcore23:04:371
179940,0migration/110577-21taskset22:49:571
179940,0migration/110469-21kthreadcore19:44:411
169940,0watchdog/132676-21ssh21:49:211
169940,0watchdog/132324-21diskstats19:14:331
169940,0watchdog/128828-21diskmemload21:48:571
169940,0watchdog/121727-21swap21:39:411
169940,0watchdog/121656-21grep22:59:321
169940,0watchdog/1180062sleep119:00:011
169940,0watchdog/10-21swapper/123:24:361
169940,0watchdog/10-21swapper/123:19:361
169940,0watchdog/10-21swapper/123:17:041
169940,0watchdog/10-21swapper/122:29:321
169940,0watchdog/10-21swapper/121:54:371
169940,0watchdog/10-21swapper/120:09:371
169940,0watchdog/10-21swapper/118:54:371
149940,0migration/05371-21kthreadcore20:04:360
149940,0migration/04673-21kthreadcore19:39:350
149940,0migration/032180-21aten_r1power_cu23:44:340
149940,0migration/030867-21aten_r1power_en23:24:290
149940,0migration/029874-21kthreadcore22:24:360
149940,0migration/029743-21fschecks_time20:49:330
149940,0migration/026487-21kthreadcore21:04:360
149940,0migration/024886-21sh00:16:470
149940,0migration/020642-21aten_r1power_po19:54:300
149940,0migration/014850-21kthreadcore19:24:330
307359932,0cyclictest20503-21awk19:29:342
307339932,0cyclictest3556-21lldpd23:59:481
307339932,0cyclictest3514-21snmpd20:19:281
307339932,0cyclictest14741-21awk19:49:341
307339930,0cyclictest30619-21grep22:04:351
307329933,0cyclictest23004-21kworker/0:223:14:290
307329933,0cyclictest23004-21kworker/0:222:39:240
307329933,0cyclictest23004-21kworker/0:222:04:260
307329933,0cyclictest11845-21kworker/0:121:19:540
307329933,0cyclictest11845-21kworker/0:120:29:220
307329933,0cyclictest11845-21kworker/0:119:14:240
307329933,0cyclictest11845-21kworker/0:118:54:220
307329931,0cyclictest0-21swapper/022:19:370
29715030,0irq/26-eth0-rx-0-21swapper/320:26:513
29715030,0irq/26-eth0-rx-0-21swapper/320:09:313
29715030,0irq/26-eth0-rx-0-21swapper/320:04:293
29715030,0irq/26-eth0-rx-0-21swapper/319:58:183
29715030,0irq/26-eth0-rx-0-21swapper/319:29:303
29715030,0irq/26-eth0-rx-0-21swapper/319:24:403
19130,0ktimersoftd/10-21swapper/120:16:311
169930,0watchdog/10-21swapper/123:39:361
169930,0watchdog/10-21swapper/123:30:481
169930,0watchdog/10-21swapper/122:20:121
169930,0watchdog/10-21swapper/121:34:331
169930,0watchdog/10-21swapper/121:14:331
29715020,0irq/26-eth0-rx-0-21swapper/319:39:233
169920,0watchdog/10-21swapper/119:04:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional