You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 19:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Mon Jul 06, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
374024029,0sleep30-21swapper/306:46:523
393923828,0sleep20-21swapper/206:49:032
384623523,0sleep00-21swapper/006:48:010
399922824,0sleep10-21swapper/106:49:501
41449966,0cyclictest2379-21diskmemload10:33:542
41449960,0cyclictest2379-21diskmemload11:23:432
41429966,0cyclictest0-21swapper/112:10:471
41419960,0cyclictest0-21swapper/011:03:170
41419960,0cyclictest0-21swapper/009:30:440
339960,0migration/38811-21sh11:12:503
339960,0migration/331919-21munin-node07:55:583
339960,0migration/328333-21kthreadcore11:25:523
339960,0migration/324427-21sh12:03:173
339960,0migration/31860-21sh09:28:153
29725060,0irq/27-eth0-tx-27725-21perl10:05:512
29725060,0irq/27-eth0-tx-26404-21munin-node07:55:540
29715060,0irq/26-eth0-rx-3701-21iostat_ios08:50:533
149960,0migration/09236-21sh11:34:520
149960,0migration/09032-21sh08:51:480
149960,0migration/025221-21sh10:42:360
149960,0migration/016344-21sh11:16:290
8215050,0irq/24-0000:00:5125-21latency_hist07:15:372
8215050,0irq/24-0000:00:4323-21cat06:50:372
41449955,0cyclictest0-21swapper/211:11:252
41449955,0cyclictest0-21swapper/210:17:212
41449955,0cyclictest0-21swapper/209:55:072
41449950,0cyclictest0-21swapper/211:07:012
41429955,0cyclictest2379-21diskmemload10:05:271
41429955,0cyclictest0-21swapper/111:53:551
41429955,0cyclictest0-21swapper/110:58:541
41429955,0cyclictest0-21swapper/110:42:111
41429955,0cyclictest0-21swapper/109:21:281
41429955,0cyclictest0-21swapper/108:51:401
41429950,0cyclictest0-21swapper/109:51:151
41429950,0cyclictest0-21swapper/109:47:191
41429950,0cyclictest0-21swapper/109:16:441
41419955,0cyclictest0-21swapper/011:56:530
41419955,0cyclictest0-21swapper/011:54:500
41419955,0cyclictest0-21swapper/010:01:280
41419955,0cyclictest0-21swapper/009:38:180
41419953,0cyclictest18589-21kworker/0:109:59:310
41419950,0cyclictest0-21swapper/011:43:190
41419950,0cyclictest0-21swapper/010:57:450
41419950,0cyclictest0-21swapper/010:35:410
41419950,0cyclictest0-21swapper/010:25:260
41419950,0cyclictest0-21swapper/009:49:010
35150,0ktimersoftd/30-21swapper/310:30:133
35150,0ktimersoftd/30-21swapper/309:09:583
339950,0migration/36310-21kthreadcore11:30:513
339950,0migration/36187-21idleruntime07:15:513
339950,0migration/36043-21kthreadcore06:50:543
339950,0migration/33217-21cpuspeed_turbos09:10:473
339950,0migration/330701-21latency07:30:553
339950,0migration/329639-21kthreadcore10:05:543
339950,0migration/329336-21if_eth1.308:45:513
339950,0migration/328553-21kthreadcore11:45:543
339950,0migration/327809-21fschecks_count09:45:483
339950,0migration/327806-21taskset08:41:553
339950,0migration/325257-21runrttasks10:21:593
339950,0migration/319819-21aten_r1power_fr07:50:473
339950,0migration/319354-21munin-node09:00:503
339950,0migration/317841-21aten_r1power_en11:40:493
339950,0migration/317416-21taskset10:17:313
339950,0migration/317003-21kthreadcore07:20:533
339950,0migration/316051-21munin-node08:35:533
339950,0migration/31530-21aten_r1power_vo11:50:463
339950,0migration/312714-21missed_timers08:05:553
339950,0migration/312286-21kthreadcore11:35:543
339950,0migration/312179-21kthreadcore10:55:503
339950,0migration/311243-21fschecks_time08:55:493
339950,0migration/310104-21kthreadcore07:40:533
29725050,0irq/27-eth0-tx-32070-21ntp_offset10:45:542
29725050,0irq/27-eth0-tx-25797-21munin-node11:45:582
29725050,0irq/27-eth0-tx-25505-21munin-node12:05:572
29725050,0irq/27-eth0-tx-24346-21munin-node07:05:480
29725050,0irq/27-eth0-tx-19273-21munin-node09:20:482
29725050,0irq/27-eth0-tx-16717-21ssh10:56:502
29725050,0irq/27-eth0-tx-11695-21grep09:15:482
29725050,0irq/27-eth0-tx-11042-21munin-node06:55:500
29725050,0irq/27-eth0-tx-10481-21munin-node10:35:522
29725050,0irq/27-eth0-tx-0-21swapper/210:43:172
29725050,0irq/27-eth0-tx-0-21swapper/210:11:062
29725050,0irq/27-eth0-tx-0-21swapper/209:44:482
29725050,0irq/27-eth0-tx-0-21swapper/209:32:162
29725050,0irq/27-eth0-tx-0-21swapper/007:28:110
29715050,0irq/26-eth0-rx-8714-21timerandwakeup10:10:593
29715050,0irq/26-eth0-rx-8109-21kthreadcore09:50:533
29715050,0irq/26-eth0-rx-26870-21cat10:05:363
29715050,0irq/26-eth0-rx-24320-21unixbench_multi11:00:583
29715050,0irq/26-eth0-rx-18395-21df_abs11:20:473
29715050,0irq/26-eth0-rx-0-21swapper/312:10:013
29715050,0irq/26-eth0-rx-0-21swapper/311:07:453
29715050,0irq/26-eth0-rx-0-21swapper/310:46:463
29715050,0irq/26-eth0-rx-0-21swapper/310:32:223
29715050,0irq/26-eth0-rx-0-21swapper/309:55:513
29715050,0irq/26-eth0-rx-0-21swapper/309:40:513
29715050,0irq/26-eth0-rx-0-21swapper/309:37:533
29715050,0irq/26-eth0-rx-0-21swapper/309:31:183
27150,0ktimersoftd/20-21swapper/210:26:482
259950,0migration/29872-21taskset09:12:462
259950,0migration/2456-21latency_hist08:00:362
259950,0migration/219053-21aten_r1power_cu10:00:482
259950,0migration/218991-21munin-node07:45:592
259950,0migration/218988-21cpuspeed_turbos10:20:472
259950,0migration/217393-21sh11:19:332
259950,0migration/217152-21kthreadcore08:10:532
259950,0migration/215801-21sh12:17:152
259950,0migration/210513-21munin-node11:55:522
249950,0watchdog/2884-21grep09:45:582
249950,0watchdog/214632-21kthreadcore06:55:552
179950,0migration/118047-21unixbench_singl07:20:591
179950,0migration/115059-21ntp_offset11:55:561
149950,0migration/07998-21fschecks_time08:05:500
149950,0migration/07769-21kthreadcore09:10:540
149950,0migration/07418-21switchtime08:25:590
149950,0migration/07119-21kthreadcore11:10:530
149950,0migration/06220-21munin-node07:15:510
149950,0migration/0587-21taskset11:07:410
149950,0migration/027928-21munin-node09:05:480
149950,0migration/027727-21kthreadcore12:05:530
149950,0migration/027308-21cpuspeed_turbos10:05:490
149950,0migration/027264-21munin-node10:45:480
149950,0migration/020533-21kthreadcore07:00:520
149950,0migration/020533-21kthreadcore07:00:520
149950,0migration/018868-21kthreadcore12:00:520
149950,0migration/012676-21kthreadcore12:15:530
149950,0migration/01225-21taskset08:23:480
8215040,0irq/24-0000:00:6324-21cat07:40:362
41449943,0cyclictest6349-21awk07:15:522
41449943,0cyclictest544-21awk07:35:532
41449943,0cyclictest3514-21snmpd09:25:432
41449943,0cyclictest3514-21snmpd08:41:582
41449943,0cyclictest3514-21snmpd07:51:272
41449943,0cyclictest3514-21snmpd07:07:572
41449943,0cyclictest3241-21irqbalance11:50:442
41449943,0cyclictest18552-21awk07:00:502
41449943,0cyclictest18552-21awk07:00:502
41449943,0cyclictest12108-21awk09:35:522
41429944,0cyclictest2379-21diskmemload09:12:001
41429944,0cyclictest0-21swapper/111:39:251
41429944,0cyclictest0-21swapper/110:29:251
41429943,0cyclictest3556-21lldpd11:20:141
41429943,0cyclictest3556-21lldpd11:02:451
41429943,0cyclictest3556-21lldpd10:16:441
41429943,0cyclictest3556-21lldpd09:26:141
41429943,0cyclictest3514-21snmpd11:27:581
41429943,0cyclictest3514-21snmpd10:38:581
41429943,0cyclictest3514-21snmpd08:04:421
41429943,0cyclictest3514-21snmpd07:51:571
41429943,0cyclictest3514-21snmpd07:39:571
41429943,0cyclictest3514-21snmpd07:26:421
41429943,0cyclictest3514-21snmpd07:05:571
41429943,0cyclictest3514-21snmpd07:02:121
41429943,0cyclictest3514-21snmpd07:02:121
41429943,0cyclictest3047-21awk10:50:501
41429943,0cyclictest29340-21awk08:45:521
41429943,0cyclictest28133-21awk09:05:501
41429943,0cyclictest27931-21awk10:05:521
41429943,0cyclictest2668-21grep11:30:491
41429943,0cyclictest26390-21awk12:05:511
41429943,0cyclictest2492-21awk08:25:511
41429943,0cyclictest19030-21awk11:20:501
41429943,0cyclictest18772-21awk11:40:531
41429943,0cyclictest15010-21awk08:10:511
41429943,0cyclictest12033-21awk09:55:491
41419944,0cyclictest0-21swapper/009:28:130
41419943,0cyclictest9250-21awk08:30:510
41419943,0cyclictest3831-21awk09:50:500
41419943,0cyclictest3556-21lldpd06:51:140
41419943,0cyclictest3241-21irqbalance11:36:440
41419943,0cyclictest26357-21awk07:30:520
41419943,0cyclictest14892-21awk08:10:500
41419943,0cyclictest14028-21awk07:45:510
41419943,0cyclictest11749-21awk10:15:500
339940,0migration/39485-21runrttasks11:55:453
339940,0migration/315469-21kthreadcore10:35:533
29725040,0irq/27-eth0-tx-0-21swapper/211:40:472
29725040,0irq/27-eth0-tx-0-21swapper/211:36:202
29725040,0irq/27-eth0-tx-0-21swapper/211:30:362
29725040,0irq/27-eth0-tx-0-21swapper/209:55:402
29725040,0irq/27-eth0-tx-0-21swapper/208:55:422
29725040,0irq/27-eth0-tx-0-21swapper/008:45:480
29725040,0irq/27-eth0-tx-0-21swapper/008:40:550
29725040,0irq/27-eth0-tx-0-21swapper/007:50:470
29715040,0irq/26-eth0-rx-24582-21munin-node10:40:593
29715040,0irq/26-eth0-rx-0-21swapper/312:18:473
29715040,0irq/26-eth0-rx-0-21swapper/312:10:523
29715040,0irq/26-eth0-rx-0-21swapper/311:15:433
29715040,0irq/26-eth0-rx-0-21swapper/310:51:233
29715040,0irq/26-eth0-rx-0-21swapper/309:22:373
29715040,0irq/26-eth0-rx-0-21swapper/309:15:373
29715040,0irq/26-eth0-rx-0-21swapper/307:07:113
29715040,0irq/26-eth0-rx-0-21swapper/307:00:523
29715040,0irq/26-eth0-rx-0-21swapper/307:00:523
259940,0migration/23555-21kthreadcore10:50:522
259940,0migration/229288-21kthreadcore09:05:512
259940,0migration/229160-21idleruntime08:45:502
259940,0migration/228383-21runrttasks08:20:522
259940,0migration/224601-21timerwakeupswit07:25:592
259940,0migration/223044-21kthreadcore11:00:532
259940,0migration/220892-21aten_r1power_vo08:15:482
259940,0migration/219624-21kthreadcore12:00:522
259940,0migration/212466-21fschecks_count07:20:492
259940,0migration/210733-21kthreadcore08:30:532
249940,0watchdog/231470-21missed_timers11:25:542
249940,0watchdog/21973-21kthreadcore08:00:542
249940,0watchdog/21934-21sed12:10:492
249940,0watchdog/215767-21grep08:35:502
249940,0watchdog/20-21swapper/209:00:542
249940,0watchdog/20-21swapper/208:50:542
249940,0watchdog/20-21swapper/208:25:542
179940,0migration/19331-21aten2.4-expect12:15:471
179940,0migration/16194-21kthreadcore10:10:531
179940,0migration/14084-21irqcore09:30:511
179940,0migration/127209-21fschecks_time10:45:481
179940,0migration/125822-21aten_r1power_cu11:45:481
179940,0migration/125123-21kthreadcore08:15:541
179940,0migration/124178-21taskset12:02:341
179940,0migration/120211-21kthreadcore10:20:511
179940,0migration/112984-21kthreadcore08:30:541
169940,0watchdog/130696-21latency07:30:551
169940,0watchdog/127712-21kthreadcore07:55:541
169940,0watchdog/124669-21ssh09:40:541
169940,0watchdog/119449-21perl09:00:501
169940,0watchdog/118106-21ssh08:59:261
169940,0watchdog/116182-21kthreadcore09:35:541
169940,0watchdog/114630-21kthreadcore06:55:551
169940,0watchdog/113920-21if_err_eth007:45:511
169940,0watchdog/10-21swapper/110:30:541
169940,0watchdog/10-21swapper/106:50:511
149940,0migration/08856-21sh10:31:430
149940,0migration/04524-21kthreadcore12:10:520
149940,0migration/027779-21if_eth1.310:25:510
149940,0migration/027276-21irqrtprio11:25:510
149940,0migration/025650-21runrttasks09:21:420
149940,0migration/010453-21kthreadcore07:40:530
8215030,0irq/24-0000:00:0-21swapper/208:05:362
41429933,0cyclictest3556-21lldpd07:10:441
41429932,0cyclictest3556-21lldpd08:22:441
41429932,0cyclictest3556-21lldpd07:40:441
41429932,0cyclictest3514-21snmpd08:05:421
41429932,0cyclictest11816-21turbostat07:20:371
41419933,0cyclictest3590-21awk10:10:510
41419933,0cyclictest27576-21kworker/0:010:50:530
41419933,0cyclictest18980-21awk11:20:500
41419933,0cyclictest18819-21kworker/0:111:45:370
41419933,0cyclictest18589-21kworker/0:109:40:370
41419933,0cyclictest18589-21kworker/0:109:16:230
41419933,0cyclictest18589-21kworker/0:108:35:400
41419933,0cyclictest18589-21kworker/0:108:15:380
41419933,0cyclictest18589-21kworker/0:108:00:380
41419933,0cyclictest18589-21kworker/0:107:35:420
41419933,0cyclictest18589-21kworker/0:107:20:400
41419933,0cyclictest18589-21kworker/0:107:10:440
41419932,0cyclictest18863-21aten_r1power_cu09:00:470
41419932,0cyclictest11554-21awk08:55:510
339930,0migration/35216-21kthreadcore08:00:553
29715030,0irq/26-eth0-rx-0-21swapper/308:30:473
29715030,0irq/26-eth0-rx-0-21swapper/308:29:113
29715030,0irq/26-eth0-rx-0-21swapper/308:16:243
29715030,0irq/26-eth0-rx-0-21swapper/308:10:473
29715030,0irq/26-eth0-rx-0-21swapper/307:47:283
29715030,0irq/26-eth0-rx-0-21swapper/307:35:493
29715030,0irq/26-eth0-rx-0-21swapper/307:25:483
29715030,0irq/26-eth0-rx-0-21swapper/307:11:283
249930,0watchdog/20-21swapper/207:30:552
179930,0migration/126869-21diskmemload11:05:501
169930,0watchdog/10-21swapper/111:12:381
169930,0watchdog/10-21swapper/108:35:501
329920,0watchdog/327432-21aten_r1power_en08:20:473
29715020,0irq/26-eth0-rx-0-21swapper/306:55:383
169920,0watchdog/10-21swapper/108:40:381
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional