You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-10 - 00:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun Aug 09, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450350,0irq/25-eth10-21swapper/306:43:063
1578823424,0sleep10-21swapper/106:46:011
1574723322,0sleep00-21swapper/006:45:360
1583122925,0sleep20-21swapper/206:46:342
159739976,0cyclictest9034-21python10:42:441
35160,0ktimersoftd/30-21swapper/311:25:373
35160,0ktimersoftd/30-21swapper/310:07:033
339960,0migration/321050-21sh09:31:513
29725060,0irq/27-eth0-tx-10461-21munin-node07:07:480
29715060,0irq/26-eth0-rx-3282-21perl11:02:353
29715060,0irq/26-eth0-rx-27903-21hwlatdetect10:57:353
29715060,0irq/26-eth0-rx-26916-21sh10:14:043
29715060,0irq/26-eth0-rx-0-21swapper/311:37:393
29715060,0irq/26-eth0-rx-0-21swapper/309:13:223
159749965,0cyclictest28562-21sadc09:57:212
159749965,0cyclictest14276-21kthreadcore09:47:372
159739960,0cyclictest14191-21diskmemload10:23:581
159739960,0cyclictest0-21swapper/109:08:271
149960,0migration/08290-21sh11:22:490
149960,0migration/07274-21sh12:03:370
149960,0migration/0554-21sh11:40:510
149960,0migration/025458-21sh11:36:530
149960,0migration/020572-21sh09:08:480
149960,0migration/012666-21munin-node10:07:340
149960,0migration/012327-21sh09:24:300
8215050,0irq/24-0000:00:23543-21latency_hist07:17:222
8215050,0irq/24-0000:00:0-21swapper/208:27:212
339950,0migration/39118-21munin-node12:07:333
339950,0migration/38965-21kthreadcore08:17:393
339950,0migration/37748-21taskset08:42:273
339950,0migration/36449-21fschecks_time07:52:353
339950,0migration/33311-21latency07:22:403
339950,0migration/332408-21kthreadcore08:57:403
339950,0migration/326738-21cpuspeed_turbos11:17:333
339950,0migration/325577-21kthreadcore06:52:403
339950,0migration/324644-21kthreadcore08:52:393
339950,0migration/323162-21taskset12:13:513
339950,0migration/322453-21munin-node09:32:373
339950,0migration/321842-21munin-node09:52:373
339950,0migration/320113-21munin-node10:32:353
339950,0migration/319380-21kthreadcore06:47:413
339950,0migration/317332-21kthreadcore10:07:403
339950,0migration/314487-21kthreadcore11:07:393
339950,0migration/311701-21cpuspeed_turbos07:32:343
29725050,0irq/27-eth0-tx-9689-21ssh11:05:212
29725050,0irq/27-eth0-tx-9576-21ssh11:26:472
29725050,0irq/27-eth0-tx-6710-21munin-node08:17:370
29725050,0irq/27-eth0-tx-4728-21munin-node07:27:400
29725050,0irq/27-eth0-tx-25644-21ssh10:53:482
29725050,0irq/27-eth0-tx-25442-21cut09:32:392
29725050,0irq/27-eth0-tx-13655-21ssh11:27:402
29725050,0irq/27-eth0-tx-12352-21kthreadcore11:07:382
29725050,0irq/27-eth0-tx-11479-21kthreadcore11:47:382
29725050,0irq/27-eth0-tx-10497-21ssh10:24:242
29725050,0irq/27-eth0-tx-10479-21ssh10:46:062
29725050,0irq/27-eth0-tx-0-21swapper/210:51:242
29725050,0irq/27-eth0-tx-0-21swapper/210:30:452
29725050,0irq/27-eth0-tx-0-21swapper/208:59:482
29725050,0irq/27-eth0-tx-0-21swapper/208:54:392
29725050,0irq/27-eth0-tx-0-21swapper/007:27:100
29725050,0irq/27-eth0-tx-0-21swapper/007:15:110
29725050,0irq/27-eth0-tx-0-21swapper/006:57:100
29715050,0irq/26-eth0-rx-29184-21if_eth010:17:363
29715050,0irq/26-eth0-rx-19314-21kthreadcore11:32:363
29715050,0irq/26-eth0-rx-16413-21ssh11:28:263
29715050,0irq/26-eth0-rx-12504-21kthreadcore10:47:393
29715050,0irq/26-eth0-rx-10152-21grep09:02:393
29715050,0irq/26-eth0-rx-0-21swapper/311:59:173
29715050,0irq/26-eth0-rx-0-21swapper/311:54:583
29715050,0irq/26-eth0-rx-0-21swapper/311:12:243
29715050,0irq/26-eth0-rx-0-21swapper/310:56:513
29715050,0irq/26-eth0-rx-0-21swapper/310:38:133
29715050,0irq/26-eth0-rx-0-21swapper/310:22:283
29715050,0irq/26-eth0-rx-0-21swapper/309:57:333
29715050,0irq/26-eth0-rx-0-21swapper/309:47:383
29715050,0irq/26-eth0-rx-0-21swapper/309:44:153
29715050,0irq/26-eth0-rx-0-21swapper/309:37:233
29715050,0irq/26-eth0-rx-0-21swapper/309:23:023
29715050,0irq/26-eth0-rx-0-21swapper/309:17:483
29715050,0irq/26-eth0-rx-0-21swapper/309:11:003
29715050,0irq/26-eth0-rx-0-21swapper/308:47:513
259950,0migration/26882-21timerandwakeup08:37:462
259950,0migration/25135-21munin-node07:27:352
259950,0migration/23310-21kthreadcore11:42:372
259950,0migration/227942-21sh10:17:132
259950,0migration/22765-21sh10:20:092
259950,0migration/217920-21fschecks_time11:52:352
259950,0migration/211673-21sh10:05:582
259950,0migration/210993-21latency07:52:402
259950,0migration/210849-21switchtime09:42:452
19150,0ktimersoftd/10-21swapper/111:54:281
179950,0migration/18246-21munin-node11:22:441
169950,0watchdog/18478-21head08:42:361
169950,0watchdog/15372-21ssh09:01:201
169950,0watchdog/128378-21kthreadcore08:07:401
159749955,0cyclictest31119-21irqcore09:17:402
159749955,0cyclictest0-21swapper/209:08:032
159749950,0cyclictest0-21swapper/212:16:182
159749950,0cyclictest0-21swapper/211:38:372
159749950,0cyclictest0-21swapper/208:12:242
159739955,0cyclictest0-21swapper/111:35:421
159739955,0cyclictest0-21swapper/111:02:451
159739955,0cyclictest0-21swapper/109:18:041
159739950,0cyclictest0-21swapper/111:15:031
159739950,0cyclictest0-21swapper/109:48:011
159739950,0cyclictest0-21swapper/109:24:221
149950,0migration/09657-21kthreadcore09:42:390
149950,0migration/08356-21fschecks_time08:42:360
149950,0migration/08331-21kthreadcore07:52:390
149950,0migration/07227-21kthreadcore10:02:370
149950,0migration/06043-21kthreadcore07:02:380
149950,0migration/05925-21latency_hist09:02:210
149950,0migration/04046-21idleruntime10:42:360
149950,0migration/032623-21taskset12:01:350
149950,0migration/031523-21kthreadcore09:17:410
149950,0migration/029217-21sh09:15:520
149950,0migration/028927-21aten_r1power_fr09:57:320
149950,0migration/028276-21kthreadcore11:17:380
149950,0migration/028207-21kthreadcore08:32:380
149950,0migration/027222-21taskset10:37:020
149950,0migration/026528-21kthreadcore07:42:400
149950,0migration/025068-21kthreadcore08:27:400
149950,0migration/023733-21kthreadcore08:52:380
149950,0migration/02259-21kthreadcore07:47:390
149950,0migration/020480-21kthreadcore11:12:390
149950,0migration/020462-21munin-node08:47:450
149950,0migration/02014-21sh11:01:230
149950,0migration/018560-21kthreadcore06:47:400
149950,0migration/018324-21kthreadcore12:12:380
149950,0migration/011299-21fschecks_time11:07:350
339940,0migration/35469-21taskset07:51:573
339940,0migration/34184-21df_inode07:02:333
339940,0migration/325383-21kthreadcore07:17:393
339940,0migration/324575-21latency_hist07:42:213
29725040,0irq/27-eth0-tx-3168-21ssh09:37:502
29725040,0irq/27-eth0-tx-20026-21df_abs10:32:342
29725040,0irq/27-eth0-tx-14191-21diskmemload09:23:152
29725040,0irq/27-eth0-tx-0-21swapper/212:07:442
29725040,0irq/27-eth0-tx-0-21swapper/212:02:392
29725040,0irq/27-eth0-tx-0-21swapper/211:32:262
29725040,0irq/27-eth0-tx-0-21swapper/211:12:222
29725040,0irq/27-eth0-tx-0-21swapper/210:57:582
29725040,0irq/27-eth0-tx-0-21swapper/210:37:322
29725040,0irq/27-eth0-tx-0-21swapper/209:57:292
29725040,0irq/27-eth0-tx-0-21swapper/209:12:572
29725040,0irq/27-eth0-tx-0-21swapper/209:02:302
29725040,0irq/27-eth0-tx-0-21swapper/008:37:220
29725040,0irq/27-eth0-tx-0-21swapper/007:32:450
29715040,0irq/26-eth0-rx-0-21swapper/312:02:503
29715040,0irq/26-eth0-rx-0-21swapper/311:49:153
29715040,0irq/26-eth0-rx-0-21swapper/311:43:103
29715040,0irq/26-eth0-rx-0-21swapper/310:44:123
29715040,0irq/26-eth0-rx-0-21swapper/310:27:393
29715040,0irq/26-eth0-rx-0-21swapper/308:32:443
29715040,0irq/26-eth0-rx-0-21swapper/308:25:033
29715040,0irq/26-eth0-rx-0-21swapper/307:10:343
259940,0migration/29773-21unixbench_singl07:02:442
259940,0migration/2680-21kthreadcore07:22:392
259940,0migration/230483-21kthreadcore08:07:412
259940,0migration/230400-21kthreadcore11:57:382
259940,0migration/225753-21if_eth1.307:42:392
259940,0migration/216087-21kthreadcore09:27:392
259940,0migration/215554-21irqcore08:47:382
259940,0migration/212606-21timerwakeupswit08:17:452
259940,0migration/212444-21kthreadcore07:07:422
249940,0watchdog/226483-21ssh11:17:272
249940,0watchdog/218120-21grep06:47:402
249940,0watchdog/215544-21kthreadcore10:07:392
179940,0migration/16206-21kthreadcore07:27:381
179940,0migration/15128-21kthreadcore07:02:371
179940,0migration/132408-21taskset11:38:571
179940,0migration/129816-21munin-node09:57:361
179940,0migration/124447-21kthreadcore10:32:391
179940,0migration/122167-21munin-node12:12:401
179940,0migration/121523-21fschecks_time09:52:351
179940,0migration/121115-21kthreadcore06:47:411
179940,0migration/116928-21kthreadcore08:47:391
179940,0migration/114721-21kthreadcore11:27:401
179940,0migration/114234-21kthreadcore10:07:391
179940,0migration/113251-21kthreadcore11:07:391
179940,0migration/111337-21taskset09:43:201
179940,0migration/11095-21munin-node07:22:391
179940,0migration/110258-21kthreadcore12:07:371
169940,0watchdog/132186-21ssh12:00:151
169940,0watchdog/127400-21kthreadcore07:17:401
169940,0watchdog/126750-21grep09:32:401
169940,0watchdog/116339-21kthreadcore10:27:391
169940,0watchdog/11533-21smartctl12:02:351
169940,0watchdog/111656-21fschecks_count10:47:351
169940,0watchdog/10-21swapper/110:57:431
169940,0watchdog/10-21swapper/108:27:361
169940,0watchdog/10-21swapper/108:22:361
169940,0watchdog/10-21swapper/108:02:401
169940,0watchdog/10-21swapper/107:37:441
159749943,0cyclictest3514-21snmpd08:29:412
159749943,0cyclictest3514-21snmpd07:59:562
159749943,0cyclictest3514-21snmpd07:36:562
159749943,0cyclictest3514-21snmpd07:20:562
159749940,0cyclictest0-21swapper/207:37:422
159739944,0cyclictest0-21swapper/111:49:441
159739944,0cyclictest0-21swapper/107:12:251
159739943,0cyclictest7036-21awk09:02:371
159739943,0cyclictest3556-21lldpd11:18:101
159739943,0cyclictest3556-21lldpd09:28:111
159739943,0cyclictest3556-21lldpd08:22:111
159739943,0cyclictest3241-21irqbalance10:52:391
159739943,0cyclictest3241-21irqbalance10:37:291
159739943,0cyclictest3241-21irqbalance07:58:101
159739943,0cyclictest3241-21irqbalance07:52:401
159739943,0cyclictest3241-21irqbalance07:47:301
159739943,0cyclictest3241-21irqbalance07:32:301
159739943,0cyclictest30322-21awk09:37:391
159739943,0cyclictest29186-21awk10:17:361
159739943,0cyclictest27543-21awk08:32:361
159739943,0cyclictest25650-21awk07:42:381
159739943,0cyclictest23094-21awk08:52:361
159739943,0cyclictest2275-21awk11:42:351
159739943,0cyclictest1834-21awk08:37:381
159739943,0cyclictest11298-21awk07:07:401
159729944,0cyclictest14191-21diskmemload10:50:370
159729944,0cyclictest0-21swapper/012:08:590
159729943,0cyclictest9145-21sadc11:47:210
159729943,0cyclictest3514-21snmpd10:17:260
159729943,0cyclictest3514-21snmpd06:57:260
159729943,0cyclictest3514-21snmpd06:57:260
159729943,0cyclictest3241-21irqbalance09:38:000
159729943,0cyclictest3241-21irqbalance09:37:200
159729943,0cyclictest28634-21kworker/0:011:52:280
159729943,0cyclictest14432-21awk09:27:360
149940,0migration/04913-21irqcore10:22:380
149940,0migration/022343-21kthreadcore08:02:400
149940,0migration/016871-21sh11:29:520
35130,0ktimersoftd/30-21swapper/306:57:323
35130,0ktimersoftd/30-21swapper/306:57:323
29715030,0irq/26-eth0-rx-0-21swapper/308:41:473
29715030,0irq/26-eth0-rx-0-21swapper/308:16:083
29715030,0irq/26-eth0-rx-0-21swapper/308:07:353
29715030,0irq/26-eth0-rx-0-21swapper/308:02:413
29715030,0irq/26-eth0-rx-0-21swapper/307:58:263
29715030,0irq/26-eth0-rx-0-21swapper/307:43:343
29715030,0irq/26-eth0-rx-0-21swapper/307:12:333
259930,0migration/21915-21kthreadcore06:57:392
259930,0migration/21915-21kthreadcore06:57:392
249930,0watchdog/28477-21tail08:42:362
249930,0watchdog/20-21swapper/208:32:362
249930,0watchdog/20-21swapper/208:02:402
169930,0watchdog/114191-21diskmemload10:14:071
169930,0watchdog/10-21swapper/109:12:321
169930,0watchdog/10-21swapper/106:57:361
169930,0watchdog/10-21swapper/106:57:361
169930,0watchdog/10-21swapper/106:52:401
159749932,0cyclictest32251-21awk07:47:362
159749930,0cyclictest0-21swapper/206:54:402
159739932,0cyclictest501-21grep08:12:361
159739930,0cyclictest4308-21wc10:02:211
159729933,0cyclictest28634-21kworker/0:011:47:220
159729933,0cyclictest28634-21kworker/0:011:02:260
159729933,0cyclictest28634-21kworker/0:010:52:280
159729933,0cyclictest28634-21kworker/0:010:37:240
159729933,0cyclictest28634-21kworker/0:010:27:250
159729933,0cyclictest28634-21kworker/0:010:12:230
159729933,0cyclictest28634-21kworker/0:009:52:250
159729933,0cyclictest28634-21kworker/0:009:47:230
159729933,0cyclictest28634-21kworker/0:008:57:230
159729933,0cyclictest28634-21kworker/0:008:22:230
159729933,0cyclictest28634-21kworker/0:008:12:230
159729933,0cyclictest28634-21kworker/0:008:07:230
159729933,0cyclictest28634-21kworker/0:007:57:350
159729933,0cyclictest28634-21kworker/0:007:37:230
159729933,0cyclictest28634-21kworker/0:007:17:230
29715020,0irq/26-eth0-rx-0-21swapper/308:27:333
29715020,0irq/26-eth0-rx-0-21swapper/307:27:463
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional