You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-20 - 22:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Aug 20, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1432329089,0sleep00-21swapper/006:43:480
1438224536,0sleep10-21swapper/106:44:341
304450350,0irq/25-eth10-21swapper/306:42:503
1427723424,0sleep20-21swapper/206:43:182
146089976,0cyclictest15543-21munin-node07:31:372
35160,0ktimersoftd/30-21swapper/309:11:223
35160,0ktimersoftd/30-21swapper/307:08:053
35160,0ktimersoftd/30-21swapper/307:08:053
339960,0migration/39472-21munin-node09:41:433
339960,0migration/38111-21sendmail_mailtr07:01:403
339960,0migration/320565-21timerandwakeup06:46:403
29715060,0irq/26-eth0-rx-28779-21sshd07:20:013
27160,0ktimersoftd/29606-21cut12:06:342
146069966,0cyclictest26876-21awk09:11:430
149960,0migration/09158-21sh10:23:160
149960,0migration/012236-21kthreadcore12:06:350
8215050,0irq/24-0000:00:10727-21latency_hist10:06:182
339950,0migration/3899-21turbostat.cron11:01:133
339950,0migration/3895-21kthreadcore12:01:343
339950,0migration/37953-21munin-node10:21:373
339950,0migration/34488-21aten_r1power_cu07:51:293
339950,0migration/330019-21munin-node11:36:363
339950,0migration/329533-21taskset07:41:483
339950,0migration/327571-21aten_r1power_po09:56:303
339950,0migration/323108-21kthreadcore09:31:363
339950,0migration/321685-21taskset12:12:383
339950,0migration/31953-21taskset06:59:213
339950,0migration/319426-21irqcore10:31:333
339950,0migration/31834-21kthreadcore07:21:363
339950,0migration/317493-21taskset08:00:063
339950,0migration/316284-21kthreadcore08:46:363
339950,0migration/314629-21kthreadcore10:46:353
339950,0migration/313704-21munin-node09:06:323
339950,0migration/313550-21kthreadcore08:21:333
339950,0migration/311965-21kthreadcore07:31:353
339950,0migration/311847-21taskset08:20:103
339950,0migration/311324-21kthreadcore11:26:353
29725050,0irq/27-eth0-tx-9247-21munin-node11:06:342
29725050,0irq/27-eth0-tx-8275-21python10:21:402
29725050,0irq/27-eth0-tx-5447-21munin-node08:16:350
29725050,0irq/27-eth0-tx-31721-21munin-node12:01:352
29725050,0irq/27-eth0-tx-25081-21munin-node11:16:412
29725050,0irq/27-eth0-tx-2145-21ssh09:37:502
29725050,0irq/27-eth0-tx-20250-21sh09:31:302
29725050,0irq/27-eth0-tx-15822-21munin-node07:11:320
29725050,0irq/27-eth0-tx-0-21swapper/209:47:412
29725050,0irq/27-eth0-tx-0-21swapper/209:41:372
29725050,0irq/27-eth0-tx-0-21swapper/209:27:052
29725050,0irq/27-eth0-tx-0-21swapper/208:55:362
29725050,0irq/27-eth0-tx-0-21swapper/008:11:340
29725050,0irq/27-eth0-tx-0-21swapper/007:36:320
29715050,0irq/26-eth0-rx-8444-21irqcore12:06:333
29715050,0irq/26-eth0-rx-8405-21sed11:26:183
29715050,0irq/26-eth0-rx-28082-21grep11:16:353
29715050,0irq/26-eth0-rx-25136-21kthreadcore11:56:353
29715050,0irq/26-eth0-rx-22892-21kthreadcore08:51:353
29715050,0irq/26-eth0-rx-21852-21latency11:31:343
29715050,0irq/26-eth0-rx-17431-21ssh10:29:213
29715050,0irq/26-eth0-rx-15799-21grep09:26:363
29715050,0irq/26-eth0-rx-14310-21ssh11:47:073
29715050,0irq/26-eth0-rx-0-21swapper/311:51:263
29715050,0irq/26-eth0-rx-0-21swapper/311:11:353
29715050,0irq/26-eth0-rx-0-21swapper/311:03:123
29715050,0irq/26-eth0-rx-0-21swapper/310:55:353
29715050,0irq/26-eth0-rx-0-21swapper/310:42:093
29715050,0irq/26-eth0-rx-0-21swapper/310:36:393
29715050,0irq/26-eth0-rx-0-21swapper/310:15:323
29715050,0irq/26-eth0-rx-0-21swapper/310:06:153
29715050,0irq/26-eth0-rx-0-21swapper/309:55:493
29715050,0irq/26-eth0-rx-0-21swapper/309:24:373
29715050,0irq/26-eth0-rx-0-21swapper/309:17:273
29715050,0irq/26-eth0-rx-0-21swapper/309:02:593
29715050,0irq/26-eth0-rx-0-21swapper/308:56:213
259950,0migration/230675-21kthreadcore06:56:352
259950,0migration/226662-21latency_hist10:16:182
259950,0migration/221468-21fschecks_time09:11:332
259950,0migration/212276-21timerandwakeup08:41:412
249950,0watchdog/25687-21sed08:36:412
19150,0ktimersoftd/10-21swapper/111:47:221
179950,0migration/13946-21kthreadcore07:01:351
179950,0migration/124148-21kthreadcore06:51:371
179950,0migration/116219-21munin-node07:11:311
179950,0migration/11513-21munin-node11:21:331
179950,0migration/11387-21sh10:19:021
169950,0watchdog/122984-21munin-node11:11:401
169950,0watchdog/122132-21ssh12:14:001
146089955,0cyclictest12930-21diskmemload10:37:482
146089955,0cyclictest0-21swapper/209:01:482
146089950,0cyclictest0-21swapper/211:46:332
146089950,0cyclictest0-21swapper/209:10:562
146079955,0cyclictest0-21swapper/109:38:051
146079955,0cyclictest0-21swapper/109:25:381
146079950,0cyclictest0-21swapper/110:53:551
146079950,0cyclictest0-21swapper/110:15:081
146079950,0cyclictest0-21swapper/109:36:021
146069955,0cyclictest0-21swapper/011:32:300
146069955,0cyclictest0-21swapper/010:57:490
146069955,0cyclictest0-21swapper/009:19:270
146069950,0cyclictest0-21swapper/011:49:410
149950,0migration/09153-21latency_hist11:06:180
149950,0migration/09084-21missed_timers09:41:390
149950,0migration/05158-21kthreadcore07:26:330
149950,0migration/05017-21kthreadcore07:01:360
149950,0migration/04242-21kthreadcore11:21:350
149950,0migration/03104-21aten_r1power_fr10:01:280
149950,0migration/030276-21kthreadcore10:36:350
149950,0migration/029703-21kthreadcore11:36:350
149950,0migration/028725-21fschecks_time06:56:310
149950,0migration/027055-21kthreadcore11:16:350
149950,0migration/02593-21kthreadcore11:41:360
149950,0migration/024791-21kthreadcore07:16:350
149950,0migration/022401-21kthreadcore08:01:350
149950,0migration/021243-21kthreadcore11:11:350
149950,0migration/02097-21needreboot07:21:370
149950,0migration/020293-21aten_r1power_vo09:31:300
149950,0migration/019260-21taskset09:07:230
149950,0migration/018088-21cpuspeed_turbos10:51:300
149950,0migration/016820-21kthreadcore12:11:350
149950,0migration/015623-21kthreadcore08:21:340
149950,0migration/013453-21kthreadcore10:26:350
149950,0migration/01059-21missed_timers09:36:370
8215040,0irq/24-0000:00:22255-21latency_hist07:16:192
339940,0migration/34027-21ksmtuned07:48:473
339940,0migration/33589-21kthreadcore11:41:363
339940,0migration/331119-21kthreadcore10:16:363
339940,0migration/328601-21kthreadcore08:31:363
339940,0migration/322138-21taskset07:15:113
339940,0migration/313701-21kthreadcore09:46:353
339940,0migration/310334-21kthreadcore08:41:363
29725040,0irq/27-eth0-tx-22753-21ssh11:11:382
29725040,0irq/27-eth0-tx-2141-21df10:41:312
29725040,0irq/27-eth0-tx-17210-21ssh10:06:462
29725040,0irq/27-eth0-tx-0-21swapper/212:11:312
29725040,0irq/27-eth0-tx-0-21swapper/211:56:392
29725040,0irq/27-eth0-tx-0-21swapper/211:38:352
29725040,0irq/27-eth0-tx-0-21swapper/211:26:212
29725040,0irq/27-eth0-tx-0-21swapper/211:22:202
29725040,0irq/27-eth0-tx-0-21swapper/210:53:282
29725040,0irq/27-eth0-tx-0-21swapper/210:31:382
29725040,0irq/27-eth0-tx-0-21swapper/209:57:372
29725040,0irq/27-eth0-tx-0-21swapper/008:46:320
29725040,0irq/27-eth0-tx-0-21swapper/007:56:280
29725040,0irq/27-eth0-tx-0-21swapper/007:51:320
29725040,0irq/27-eth0-tx-0-21swapper/006:51:430
29715040,0irq/26-eth0-rx-0-21swapper/311:06:423
29715040,0irq/26-eth0-rx-0-21swapper/310:06:313
29715040,0irq/26-eth0-rx-0-21swapper/309:36:473
259940,0migration/26645-21kthreadcore07:01:362
259940,0migration/26180-21kthreadcore07:51:352
259940,0migration/227434-21kthreadcore08:31:352
259940,0migration/227194-21cpuspeed_turbos10:16:302
259940,0migration/22261-21timerwakeupswit09:16:412
259940,0migration/219380-21fschecks_time08:26:342
259940,0migration/219362-21kthreadcore07:36:362
259940,0migration/218097-21kthreadcore11:51:322
259940,0migration/217450-21munin-node11:31:312
259940,0migration/21729-21fschecks_count11:01:322
259940,0migration/215004-21kthreadcore10:46:352
259940,0migration/214542-21kthreadcore07:56:352
259940,0migration/212062-21kthreadcore07:06:352
259940,0migration/212062-21kthreadcore07:06:352
249940,0watchdog/23542-21lldpd07:23:452
249940,0watchdog/226746-21iostat_ios10:56:322
249940,0watchdog/226067-21ssh09:52:532
249940,0watchdog/20-21swapper/209:21:292
249940,0watchdog/20-21swapper/208:11:372
179940,0migration/19834-21ksmtuned09:41:471
179940,0migration/15461-21kthreadcore10:01:341
179940,0migration/14708-21kernelversion07:26:321
179940,0migration/132508-21taskset10:36:591
179940,0migration/129163-21irqcore06:56:341
179940,0migration/126020-21kthreadcore11:36:341
179940,0migration/125003-21irqrtprio11:56:341
179940,0migration/123885-21kthreadcore08:51:351
179940,0migration/121756-21if_eth009:11:351
179940,0migration/120762-21unixbench_singl06:46:401
179940,0migration/11904-21kthreadcore12:01:351
179940,0migration/117858-21kthreadcore08:46:361
179940,0migration/117085-21needreboot09:46:371
179940,0migration/115399-21ntp_kernel_pll_10:46:371
179940,0migration/114641-21kthreadcore07:31:361
179940,0migration/113060-21kthreadcore11:06:351
169940,0watchdog/17275-21ssh12:06:201
169940,0watchdog/15844-21diskstats08:16:331
169940,0watchdog/132728-21sh10:59:241
169940,0watchdog/125096-21perl08:06:331
169940,0watchdog/119148-21df08:26:331
169940,0watchdog/117340-21kthreadcore11:51:321
169940,0watchdog/112297-21timerwakeupswit08:41:411
169940,0watchdog/10-21swapper/111:41:361
169940,0watchdog/10-21swapper/111:30:041
169940,0watchdog/10-21swapper/110:06:371
169940,0watchdog/10-21swapper/107:41:371
146089943,0cyclictest6314-21awk08:16:352
146089943,0cyclictest4384-21awk07:26:312
146089943,0cyclictest3556-21lldpd11:41:182
146089943,0cyclictest3556-21lldpd08:05:152
146089943,0cyclictest3514-21snmpd08:46:452
146089943,0cyclictest30058-21awk08:56:342
146089943,0cyclictest27870-21sadc06:56:192
146089943,0cyclictest24462-21awk07:41:362
146089943,0cyclictest11353-21awk10:26:332
146079944,0cyclictest0-21swapper/110:44:471
146079943,0cyclictest3556-21lldpd11:17:181
146079943,0cyclictest3514-21snmpd09:28:161
146079943,0cyclictest3514-21snmpd09:19:311
146079943,0cyclictest3514-21snmpd08:40:001
146079943,0cyclictest3514-21snmpd08:23:151
146079943,0cyclictest3514-21snmpd08:15:151
146079943,0cyclictest3514-21snmpd07:54:001
146079943,0cyclictest3514-21snmpd07:38:451
146079943,0cyclictest3514-21snmpd07:21:301
146079943,0cyclictest3514-21snmpd07:09:151
146079943,0cyclictest3514-21snmpd07:09:151
146079943,0cyclictest3241-21irqbalance10:21:471
146079943,0cyclictest3241-21irqbalance09:52:071
146079943,0cyclictest3241-21irqbalance08:56:471
146079943,0cyclictest28461-21awk09:56:341
146079943,0cyclictest26335-21awk08:31:331
146079943,0cyclictest23328-21awk07:16:331
146079943,0cyclictest2089-21awk11:01:341
146079943,0cyclictest19213-21awk10:31:321
146079943,0cyclictest17525-21awk11:31:321
146069944,0cyclictest0-21swapper/011:55:410
146069944,0cyclictest0-21swapper/011:05:420
146069944,0cyclictest0-21swapper/010:41:540
146069944,0cyclictest0-21swapper/010:10:310
146069943,0cyclictest3556-21lldpd10:32:480
146069943,0cyclictest28436-21awk09:56:340
146069943,0cyclictest27810-21awk10:16:330
146069943,0cyclictest26350-21awk08:31:330
146069943,0cyclictest25423-21awk08:06:350
146069943,0cyclictest21950-21awk08:51:330
146069943,0cyclictest19920-21awk10:11:350
146069943,0cyclictest13441-21cut09:26:350
146069943,0cyclictest10100-21awk07:06:340
146069943,0cyclictest10100-21awk07:06:340
149940,0migration/032426-21kthreadcore07:46:350
149940,0migration/013167-21kthreadcore09:46:350
35130,0ktimersoftd/30-21swapper/308:07:033
29715030,0irq/26-eth0-rx-0-21swapper/308:38:483
29715030,0irq/26-eth0-rx-0-21swapper/308:30:473
29715030,0irq/26-eth0-rx-0-21swapper/308:11:253
29715030,0irq/26-eth0-rx-0-21swapper/307:36:413
29715030,0irq/26-eth0-rx-0-21swapper/307:30:063
249930,0watchdog/20-21swapper/208:21:292
249930,0watchdog/20-21swapper/206:46:292
179930,0migration/118755-21if_eth108:01:321
169930,0watchdog/10-21swapper/107:46:331
146089932,0cyclictest3556-21lldpd07:11:452
146089932,0cyclictest31065-21awk07:46:332
146089932,0cyclictest24434-21cat08:06:182
146079932,0cyclictest3241-21irqbalance09:01:271
146079932,0cyclictest18669-21sensors09:06:401
146079932,0cyclictest11402-21awk10:26:331
146069933,0cyclictest8980-21kworker/0:212:01:510
146069933,0cyclictest8980-21kworker/0:211:56:230
146069933,0cyclictest8980-21kworker/0:209:51:260
146069933,0cyclictest8980-21kworker/0:209:21:320
146069933,0cyclictest8980-21kworker/0:209:01:460
146069933,0cyclictest8980-21kworker/0:208:56:280
146069933,0cyclictest8980-21kworker/0:208:41:260
146069933,0cyclictest8980-21kworker/0:208:36:200
146069933,0cyclictest8980-21kworker/0:208:26:320
146069933,0cyclictest8980-21kworker/0:207:41:200
146069933,0cyclictest8980-21kworker/0:207:31:260
146069933,0cyclictest8980-21kworker/0:206:46:250
146069932,0cyclictest12981-21sh10:46:350
146069931,0cyclictest11158-21kthreadcore11:26:350
339920,0migration/318230-21diskstats08:01:303
329920,0watchdog/327139-21switchtime06:51:423
146079920,0cyclictest11201-21cut07:56:281
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional