You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 19:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Mon Jul 20, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
875023624,0sleep10-21swapper/106:44:521
874723627,0sleep30-21swapper/306:44:503
893823324,0sleep20-21swapper/206:47:052
876423322,0sleep00-21swapper/006:45:030
91999960,0cyclictest0-21swapper/109:14:311
4160,0ktimersoftd/00-21swapper/011:45:540
339960,0migration/39113-21aten_r1power_vo12:14:263
339960,0migration/332355-21timerwakeupswit08:39:393
339960,0migration/316524-21sh11:35:013
29725060,0irq/27-eth0-tx-7522-21munin-node08:49:280
29715060,0irq/26-eth0-rx-7373-21open_inodes11:49:363
29715060,0irq/26-eth0-rx-11158-21ssh10:53:173
29715060,0irq/26-eth0-rx-0-21swapper/312:08:383
149960,0migration/013922-21sh09:11:360
92009955,0cyclictest0-21swapper/211:42:372
92009955,0cyclictest0-21swapper/207:14:262
92009950,0cyclictest0-21swapper/211:35:122
92009950,0cyclictest0-21swapper/209:45:092
92009950,0cyclictest0-21swapper/209:11:532
91999950,0cyclictest0-21swapper/111:37:311
91999950,0cyclictest0-21swapper/108:58:361
91989954,0cyclictest30261-21awk07:04:280
8215050,0irq/24-0000:00:665-21latency_hist12:09:152
8215050,0irq/24-0000:00:22466-21ls06:59:172
339950,0migration/36345-21kthreadcore07:09:333
339950,0migration/332407-21munin-node11:24:373
339950,0migration/331098-21idleruntime07:29:313
339950,0migration/330263-21kthreadcore11:44:333
339950,0migration/328431-21aten_r1power_vo10:44:283
339950,0migration/326069-21kthreadcore10:19:353
339950,0migration/323623-21sh07:44:393
339950,0migration/321578-21kthreadcore08:09:333
339950,0migration/321383-21kthreadcore11:19:313
339950,0migration/320886-21munin-node08:34:323
339950,0migration/319689-21kthreadcore11:39:323
339950,0migration/315985-21fschecks_time08:54:313
339950,0migration/315959-21kthreadcore10:34:343
339950,0migration/315853-21kthreadcore10:54:353
339950,0migration/31484-21kthreadcore08:19:333
339950,0migration/313727-21latency_hist09:54:153
339950,0migration/312899-21munin-node09:09:383
339950,0migration/312179-21kthreadcore08:49:333
29725050,0irq/27-eth0-tx-4699-21ssh10:08:252
29725050,0irq/27-eth0-tx-3805-21munin-node10:49:362
29725050,0irq/27-eth0-tx-32205-21munin-node08:19:390
29725050,0irq/27-eth0-tx-30283-21munin-node07:29:290
29725050,0irq/27-eth0-tx-19881-21munin-node08:34:330
29725050,0irq/27-eth0-tx-17954-21munin-node07:44:350
29725050,0irq/27-eth0-tx-1575-21grep10:24:332
29725050,0irq/27-eth0-tx-0-21swapper/212:10:082
29725050,0irq/27-eth0-tx-0-21swapper/211:05:312
29725050,0irq/27-eth0-tx-0-21swapper/210:35:422
29725050,0irq/27-eth0-tx-0-21swapper/210:14:152
29725050,0irq/27-eth0-tx-0-21swapper/209:43:322
29725050,0irq/27-eth0-tx-0-21swapper/208:53:442
29725050,0irq/27-eth0-tx-0-21swapper/006:56:540
29715050,0irq/26-eth0-rx-6559-21runrttasks07:14:353
29715050,0irq/26-eth0-rx-27815-21kthreadcore07:24:333
29715050,0irq/26-eth0-rx-23352-21sendmail_mailst11:59:363
29715050,0irq/26-eth0-rx-21482-21kthreadcore10:59:323
29715050,0irq/26-eth0-rx-17750-21kthreadcore10:14:333
29715050,0irq/26-eth0-rx-0-21swapper/312:10:093
29715050,0irq/26-eth0-rx-0-21swapper/311:14:253
29715050,0irq/26-eth0-rx-0-21swapper/310:25:093
29715050,0irq/26-eth0-rx-0-21swapper/310:05:003
29715050,0irq/26-eth0-rx-0-21swapper/309:59:303
29715050,0irq/26-eth0-rx-0-21swapper/309:46:303
29715050,0irq/26-eth0-rx-0-21swapper/309:35:433
29715050,0irq/26-eth0-rx-0-21swapper/309:20:583
29715050,0irq/26-eth0-rx-0-21swapper/309:14:203
29715050,0irq/26-eth0-rx-0-21swapper/309:05:123
29715050,0irq/26-eth0-rx-0-21swapper/308:44:403
259950,0migration/232357-21munin-node11:24:362
259950,0migration/217774-21latency_hist07:44:162
259950,0migration/217566-21sh11:15:572
259950,0migration/210142-21dump-pmu-power07:14:162
249950,0watchdog/231832-21kthreadcore10:44:342
179950,0migration/16304-21gltestperf07:59:301
179950,0migration/15677-21kthreadcore11:09:341
179950,0migration/14667-21munin-node09:24:401
179950,0migration/129866-21kthreadcore11:04:321
179950,0migration/125336-21latency_hist12:04:151
179950,0migration/12119-21latency_hist11:29:151
179950,0migration/119537-21taskset10:15:141
179950,0migration/11073-21aten_r1power_fr12:09:281
169950,0watchdog/132131-21tr07:04:301
169950,0watchdog/128581-21grep08:59:341
149950,0migration/09902-21sh11:11:350
149950,0migration/08919-21sh12:14:160
149950,0migration/06589-21kthreadcore10:49:340
149950,0migration/0498-21kthreadcore09:04:320
149950,0migration/03870-21munin-node09:24:350
149950,0migration/03670-21kthreadcore11:49:320
149950,0migration/032062-21kthreadcore10:04:350
149950,0migration/030899-21kthreadcore10:44:330
149950,0migration/030300-21sh09:44:250
149950,0migration/02921-21kthreadcore08:44:340
149950,0migration/027713-21irqrtprio08:39:320
149950,0migration/025569-21kthreadcore08:59:330
149950,0migration/02308-21aten_r1power_cu11:29:260
149950,0migration/022871-21fschecks_count09:39:290
149950,0migration/022190-21sh08:56:520
149950,0migration/020707-21kthreadcore08:09:330
149950,0migration/018548-21kthreadcore09:54:310
149950,0migration/015040-21kthreadcore10:34:330
149950,0migration/012831-21taskset08:27:470
149950,0migration/011316-21switchtime07:59:390
149950,0migration/010384-21fschecks_time11:54:300
92009943,0cyclictest3556-21lldpd09:59:202
92009943,0cyclictest3556-21lldpd07:24:202
92009943,0cyclictest3556-21lldpd07:08:202
92009943,0cyclictest20787-21awk08:34:312
92009943,0cyclictest10435-21ps06:49:312
91999944,0cyclictest0-21swapper/110:24:311
91999943,0cyclictest5453-21awk10:29:301
91999943,0cyclictest4607-21awk07:09:311
91999943,0cyclictest3556-21lldpd12:04:211
91999943,0cyclictest3556-21lldpd11:40:221
91999943,0cyclictest3514-21snmpd11:55:151
91999943,0cyclictest3241-21irqbalance11:51:031
91999943,0cyclictest3241-21irqbalance10:45:241
91999943,0cyclictest3241-21irqbalance08:51:241
91999943,0cyclictest19854-21awk08:09:311
91999943,0cyclictest13178-21awk08:04:321
91989944,0cyclictest0-21swapper/011:17:130
91989944,0cyclictest0-21swapper/010:42:410
91989943,0cyclictest5520-21awk10:29:310
91989943,0cyclictest3556-21lldpd10:56:520
91989943,0cyclictest3556-21lldpd07:14:200
91989943,0cyclictest3514-21snmpd09:49:450
91989943,0cyclictest3514-21snmpd08:32:000
91989943,0cyclictest27703-21awk11:24:320
91989943,0cyclictest26421-21awk08:14:310
91989943,0cyclictest19863-21awk11:19:300
91989943,0cyclictest17578-21cat08:04:350
91989943,0cyclictest14167-21awk10:14:310
91989942,0cyclictest28504-21nfs4_client09:19:350
339940,0migration/36645-21kthreadcore10:09:323
339940,0migration/324014-21kthreadcore09:39:323
29725040,0irq/27-eth0-tx-3669-21munin-node07:09:370
29725040,0irq/27-eth0-tx-24770-21timerandwakeup11:19:372
29725040,0irq/27-eth0-tx-15887-21ssh09:14:302
29725040,0irq/27-eth0-tx-0-21swapper/212:01:162
29725040,0irq/27-eth0-tx-0-21swapper/211:54:202
29725040,0irq/27-eth0-tx-0-21swapper/211:49:202
29725040,0irq/27-eth0-tx-0-21swapper/211:29:312
29725040,0irq/27-eth0-tx-0-21swapper/210:54:562
29725040,0irq/27-eth0-tx-0-21swapper/210:29:402
29725040,0irq/27-eth0-tx-0-21swapper/210:19:222
29725040,0irq/27-eth0-tx-0-21swapper/209:49:252
29725040,0irq/27-eth0-tx-0-21swapper/209:35:062
29725040,0irq/27-eth0-tx-0-21swapper/209:21:532
29725040,0irq/27-eth0-tx-0-21swapper/209:04:212
29725040,0irq/27-eth0-tx-0-21swapper/208:54:292
29725040,0irq/27-eth0-tx-0-21swapper/007:54:380
29715040,0irq/26-eth0-rx-404-21kthreadcore09:24:333
29715040,0irq/26-eth0-rx-0-21swapper/311:54:343
29715040,0irq/26-eth0-rx-0-21swapper/311:29:173
29715040,0irq/26-eth0-rx-0-21swapper/311:09:253
29715040,0irq/26-eth0-rx-0-21swapper/311:04:483
29715040,0irq/26-eth0-rx-0-21swapper/310:40:553
29715040,0irq/26-eth0-rx-0-21swapper/310:32:033
29715040,0irq/26-eth0-rx-0-21swapper/309:51:013
29715040,0irq/26-eth0-rx-0-21swapper/309:29:323
29715040,0irq/26-eth0-rx-0-21swapper/308:59:293
29715040,0irq/26-eth0-rx-0-21swapper/308:29:273
29715040,0irq/26-eth0-rx-0-21swapper/308:24:283
29715040,0irq/26-eth0-rx-0-21swapper/307:53:153
29715040,0irq/26-eth0-rx-0-21swapper/307:39:283
29715040,0irq/26-eth0-rx-0-21swapper/307:34:333
29715040,0irq/26-eth0-rx-0-21swapper/307:19:333
29715040,0irq/26-eth0-rx-0-21swapper/306:49:273
27140,0ktimersoftd/20-21swapper/212:15:332
259940,0migration/26714-21irqcore07:59:322
259940,0migration/26487-21kthreadcore07:34:332
259940,0migration/26222-21if_eth110:09:302
259940,0migration/23871-21kthreadcore08:44:342
259940,0migration/231163-21cpuspeed_turbos09:24:292
259940,0migration/230751-21runrttasks07:51:062
259940,0migration/230201-21kthreadcore08:39:342
259940,0migration/227917-21kthreadcore11:44:322
259940,0migration/227585-21kthreadcore06:59:332
259940,0migration/222845-21kthreadcore08:09:332
259940,0migration/221642-21kthreadcore07:44:342
259940,0migration/22151-21kthreadcore07:29:342
259940,0migration/220297-21latency_hist10:39:152
259940,0migration/215851-21kthreadcore09:54:302
259940,0migration/210114-21runrttasks11:12:142
249940,0watchdog/28262-21kthreadcore08:24:342
249940,0watchdog/231932-21fschecks_time07:54:302
249940,0watchdog/229987-21tr08:14:342
249940,0watchdog/224873-21cut10:59:332
249940,0watchdog/217399-21cut08:04:342
249940,0watchdog/211991-21expr09:29:342
249940,0watchdog/20-21swapper/208:59:342
179940,0migration/18956-21kthreadcore10:49:341
179940,0migration/18261-21kthreadcore09:29:321
179940,0migration/16586-21kernelversion10:09:321
179940,0migration/16333-21munin-node08:44:371
179940,0migration/14926-21switchtime09:04:381
179940,0migration/131874-21kthreadcore07:29:331
179940,0migration/13178-21if_err_eth111:29:301
179940,0migration/13161-21kthreadcore09:44:331
179940,0migration/131526-21kthreadcore10:04:341
179940,0migration/127375-21kthreadcore07:24:331
179940,0migration/127166-21kthreadcore07:49:341
179940,0migration/126772-21sh10:40:271
179940,0migration/124539-21kthreadcore10:59:331
179940,0migration/124154-21irqcore09:19:321
179940,0migration/123127-21kthreadcore09:59:321
179940,0migration/121165-21kthreadcore11:19:311
179940,0migration/119997-21kthreadcore06:54:351
179940,0migration/116947-21latency_hist07:19:161
179940,0migration/114739-21kthreadcore10:34:331
179940,0migration/114375-21irqrtprio08:29:311
179940,0migration/114097-21cpuspeed_turbos09:54:261
179940,0migration/113573-21kthreadcore12:14:321
169940,0watchdog/131619-21kthreadcore08:39:341
169940,0watchdog/131484-21kthreadcore11:44:331
169940,0watchdog/123400-21cut10:19:341
169940,0watchdog/121363-21tr07:44:341
169940,0watchdog/112743-21ssh09:51:421
169940,0watchdog/10-21swapper/110:57:571
169940,0watchdog/10-21swapper/109:39:341
169940,0watchdog/10-21swapper/109:09:461
169940,0watchdog/10-21swapper/108:24:341
169940,0watchdog/10-21swapper/107:54:301
169940,0watchdog/10-21swapper/107:34:461
149940,0migration/09862-21fschecks_count06:49:290
149940,0migration/08676-21runrttasks12:14:110
149940,0migration/025249-21kthreadcore10:19:340
149940,0migration/025150-21kthreadcore07:24:330
149940,0migration/023337-21kthreadcore11:39:330
149940,0migration/022305-21sh09:18:040
149940,0migration/020562-21sh10:59:310
92009932,0cyclictest14057-21awk08:29:302
92009932,0cyclictest0-21swapper/207:19:162
91999932,0cyclictest3556-21lldpd06:59:201
91999932,0cyclictest16795-21pmu-power07:39:371
91999932,0cyclictest11888-21awk11:14:301
91999930,0cyclictest0-21swapper/107:15:101
91989933,0cyclictest0-21swapper/011:05:140
91989932,0cyclictest3514-21snmpd07:20:290
91989932,0cyclictest29657-21grep12:04:330
91989932,0cyclictest29197-21stty10:24:270
91989932,0cyclictest25491-21awk07:49:320
91989932,0cyclictest23552-21awk06:59:300
91989932,0cyclictest22111-21munin-run09:39:150
91989932,0cyclictest11250-21awk11:34:320
91989931,0cyclictest18930-21kthreadcore11:59:310
91989930,0cyclictest9919-21cut10:09:330
91989930,0cyclictest0-21swapper/007:39:350
29715030,0irq/26-eth0-rx-0-21swapper/308:04:533
29715030,0irq/26-eth0-rx-0-21swapper/307:59:533
29715030,0irq/26-eth0-rx-0-21swapper/307:54:283
29715030,0irq/26-eth0-rx-0-21swapper/307:04:253
29715030,0irq/26-eth0-rx-0-21swapper/306:54:283
259930,0migration/24220-21kthreadcore08:19:342
169930,0watchdog/10-21swapper/109:35:381
169930,0watchdog/10-21swapper/108:14:341
91999921,0cyclictest3241-21irqbalance08:34:241
91999920,0cyclictest0-21swapper/108:19:171
91989921,0cyclictest0-21swapper/007:34:160
91989920,0cyclictest0-21swapper/009:59:280
91989920,0cyclictest0-21swapper/009:29:190
29715020,0irq/26-eth0-rx-0-21swapper/308:14:273
29715020,0irq/26-eth0-rx-0-21swapper/306:59:223
169920,0watchdog/10-21swapper/106:49:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional