You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-01 - 19:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Wed Jul 01, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3176924028,0sleep30-21swapper/306:50:463
3147023625,0sleep20-21swapper/206:47:132
3147323522,0sleep00-21swapper/006:47:150
3149923323,0sleep10-21swapper/106:47:361
35160,0ktimersoftd/30-21swapper/309:28:453
339960,0migration/38555-21munin-node10:01:163
339960,0migration/37707-21sh10:20:133
339960,0migration/332202-21sh09:55:343
339960,0migration/322592-21sh10:47:223
339960,0migration/314634-21sh10:22:023
318679960,0cyclictest0-21swapper/210:52:052
318679960,0cyclictest0-21swapper/210:42:382
29715060,0irq/26-eth0-rx-8058-21diskstats11:41:153
29715060,0irq/26-eth0-rx-5247-21cut10:36:213
29715060,0irq/26-eth0-rx-25711-21cut10:31:213
149960,0migration/05958-21sh11:16:530
149960,0migration/032060-21sh09:34:450
149960,0migration/031261-21sh09:12:370
149960,0migration/029182-21munin-node12:11:240
149960,0migration/020743-21sh09:02:390
149960,0migration/015102-21sh11:24:550
149960,0migration/014209-21sh11:01:550
149960,0migration/013086-21aten_r1power_cu07:01:160
4150,0ktimersoftd/00-21swapper/010:09:470
35150,0ktimersoftd/30-21swapper/308:51:143
339950,0migration/37866-21kthreadcore06:56:223
339950,0migration/37804-21kthreadcore08:56:223
339950,0migration/332580-21kthreadcore08:01:233
339950,0migration/332095-21aten_r1power_vo11:36:163
339950,0migration/330231-21munin-node09:31:243
339950,0migration/329353-21rt-features12:11:253
339950,0migration/327844-21kthreadcore07:11:203
339950,0migration/323124-21taskset10:07:593
339950,0migration/322794-21diskmemload10:27:263
339950,0migration/320276-21taskset07:28:583
339950,0migration/319318-21kthreadcore08:41:223
339950,0migration/316507-21fschecks_time11:06:163
339950,0migration/313695-21unixbench_singl12:01:283
339950,0migration/313132-21switchtime07:21:273
339950,0migration/312943-21kthreadcore10:41:223
318679955,0cyclictest0-21swapper/210:31:072
318679955,0cyclictest0-21swapper/209:14:492
318679955,0cyclictest0-21swapper/207:41:102
318679954,0cyclictest16825-21ps11:26:202
318679950,0cyclictest0-21swapper/211:51:312
318679950,0cyclictest0-21swapper/211:33:522
318679950,0cyclictest0-21swapper/210:49:432
318679950,0cyclictest0-21swapper/210:28:452
318669955,0cyclictest0-21swapper/112:19:271
318669955,0cyclictest0-21swapper/111:36:241
318669955,0cyclictest0-21swapper/108:57:481
318669950,0cyclictest0-21swapper/111:28:221
318669950,0cyclictest0-21swapper/109:31:231
318659955,0cyclictest0-21swapper/011:41:040
318659955,0cyclictest0-21swapper/010:39:450
318659950,0cyclictest0-21swapper/010:03:010
29725050,0irq/27-eth0-tx-9297-21munin-node08:11:210
29725050,0irq/27-eth0-tx-9264-21if_err_eth010:01:192
29725050,0irq/27-eth0-tx-7410-21ssh11:00:322
29725050,0irq/27-eth0-tx-32388-21munin-node10:36:162
29725050,0irq/27-eth0-tx-25103-21ssh09:06:222
29725050,0irq/27-eth0-tx-14145-21cat09:21:242
29725050,0irq/27-eth0-tx-0-21swapper/211:36:372
29725050,0irq/27-eth0-tx-0-21swapper/007:57:450
29725050,0irq/27-eth0-tx-0-21swapper/007:27:400
29725050,0irq/27-eth0-tx-0-21swapper/007:16:170
29715050,0irq/26-eth0-rx-9754-21tune2fs08:11:193
29715050,0irq/26-eth0-rx-5663-21kthreadcore09:36:223
29715050,0irq/26-eth0-rx-27645-21ssh10:11:233
29715050,0irq/26-eth0-rx-24752-21if_eth111:31:183
29715050,0irq/26-eth0-rx-24377-21forks11:11:163
29715050,0irq/26-eth0-rx-23101-21grep09:06:183
29715050,0irq/26-eth0-rx-18075-21cat09:46:213
29715050,0irq/26-eth0-rx-12423-21kthreadcore09:41:223
29715050,0irq/26-eth0-rx-0-21swapper/312:21:023
29715050,0irq/26-eth0-rx-0-21swapper/311:47:283
29715050,0irq/26-eth0-rx-0-21swapper/311:25:273
29715050,0irq/26-eth0-rx-0-21swapper/311:18:293
29715050,0irq/26-eth0-rx-0-21swapper/311:01:203
29715050,0irq/26-eth0-rx-0-21swapper/310:59:453
29715050,0irq/26-eth0-rx-0-21swapper/310:52:303
29715050,0irq/26-eth0-rx-0-21swapper/309:22:193
29715050,0irq/26-eth0-rx-0-21swapper/309:17:343
29715050,0irq/26-eth0-rx-0-21swapper/309:11:403
29715050,0irq/26-eth0-rx-0-21swapper/309:01:223
27150,0ktimersoftd/20-21swapper/211:47:422
259950,0migration/222246-21fschecks_time07:56:162
259950,0migration/210490-21kthreadcore06:56:232
249950,0watchdog/218808-21grep12:06:222
19150,0ktimersoftd/10-21swapper/111:47:421
19150,0ktimersoftd/10-21swapper/110:34:271
179950,0migration/17760-21taskset10:20:231
179950,0migration/1519-21fschecks_time10:36:171
179950,0migration/129640-21switchtime11:51:261
169950,0watchdog/18773-21irqcore11:41:181
169950,0watchdog/125864-21cut08:21:231
169950,0watchdog/116548-21perl08:16:191
149950,0migration/08644-21kthreadcore06:56:220
149950,0migration/08518-21kthreadcore08:31:240
149950,0migration/06321-21sh08:56:180
149950,0migration/03631-21kthreadcore11:56:210
149950,0migration/030070-21latency_hist08:51:040
149950,0migration/029455-21aten_r1power_vo08:26:170
149950,0migration/029440-21kthreadcore10:11:230
149950,0migration/028351-21kthreadcore09:51:220
149950,0migration/026783-21kthreadcore11:11:200
149950,0migration/025391-21swap07:06:290
149950,0migration/024630-21munin-node11:51:180
149950,0migration/024189-21munin-node10:51:150
149950,0migration/022716-21sh12:09:210
149950,0migration/021397-21taskset07:55:280
149950,0migration/01595-21latency_hist07:41:050
149950,0migration/015565-21latency_hist11:46:040
149950,0migration/014476-21taskset11:43:240
149950,0migration/013367-21kthreadcore08:36:240
149950,0migration/011953-21kthreadcore10:21:200
149950,0migration/01141-21kthreadcore06:51:210
149950,0migration/011125-21kthreadcore09:41:210
339940,0migration/34696-21irqcore08:31:223
339940,0migration/32867-21kthreadcore07:16:233
339940,0migration/327561-21kthreadcore08:21:243
339940,0migration/322260-21fschecks_time07:56:163
339940,0migration/321324-21nfs_client11:26:243
339940,0migration/313904-21kthreadcore08:36:243
318679943,0cyclictest8633-21awk11:21:182
318679943,0cyclictest3556-21lldpd11:11:052
318679943,0cyclictest3556-21lldpd09:36:352
318679943,0cyclictest3556-21lldpd08:56:052
318679943,0cyclictest3556-21lldpd08:42:042
318679943,0cyclictest3514-21snmpd08:46:162
318679943,0cyclictest3514-21snmpd07:01:162
318679943,0cyclictest32557-21awk12:16:192
318679943,0cyclictest3241-21irqbalance12:11:122
318679943,0cyclictest3241-21irqbalance10:07:432
318679943,0cyclictest3241-21irqbalance08:06:132
318679943,0cyclictest3241-21irqbalance08:02:132
318679943,0cyclictest3241-21irqbalance07:51:232
318679943,0cyclictest3241-21irqbalance07:46:132
318679943,0cyclictest3241-21irqbalance07:21:132
318679943,0cyclictest3241-21irqbalance07:16:132
318679943,0cyclictest30253-21awk08:26:202
318679943,0cyclictest20615-21awk07:06:222
318679943,0cyclictest16876-21awk11:06:182
318679943,0cyclictest16841-21awk08:16:202
318679943,0cyclictest14930-21awk07:26:202
318669944,0cyclictest0-21swapper/111:33:441
318669944,0cyclictest0-21swapper/110:28:461
318669943,0cyclictest9258-21awk07:46:221
318669943,0cyclictest9221-21awk10:21:181
318669943,0cyclictest8489-21awk12:01:201
318669943,0cyclictest3514-21snmpd12:10:311
318669943,0cyclictest3514-21snmpd09:18:011
318669943,0cyclictest27227-21awk07:11:191
318669943,0cyclictest23678-21sadc11:11:041
318669943,0cyclictest17462-21awk09:46:191
318669943,0cyclictest17060-21awk10:46:191
318669942,0cyclictest18463-21kthreadcore08:41:221
318659944,0cyclictest0-21swapper/009:25:290
318659943,0cyclictest9228-21awk07:46:220
318659943,0cyclictest8120-21sadc10:01:040
318659943,0cyclictest3556-21lldpd07:34:050
318659943,0cyclictest22360-21sadc08:21:040
318659943,0cyclictest17110-21gltestperf10:26:180
318659943,0cyclictest16683-21awk11:26:190
318659940,0cyclictest26359-21munin-node07:11:160
318659940,0cyclictest0-21swapper/007:21:210
29725040,0irq/27-eth0-tx-23260-21ssh09:27:422
29725040,0irq/27-eth0-tx-0-21swapper/212:01:402
29725040,0irq/27-eth0-tx-0-21swapper/211:56:112
29725040,0irq/27-eth0-tx-0-21swapper/211:16:102
29725040,0irq/27-eth0-tx-0-21swapper/211:01:292
29725040,0irq/27-eth0-tx-0-21swapper/210:21:182
29725040,0irq/27-eth0-tx-0-21swapper/209:51:212
29725040,0irq/27-eth0-tx-0-21swapper/209:34:022
29725040,0irq/27-eth0-tx-0-21swapper/208:51:242
29725040,0irq/27-eth0-tx-0-21swapper/008:51:210
29725040,0irq/27-eth0-tx-0-21swapper/007:36:230
29715040,0irq/26-eth0-rx-2940-21kthreadcore07:41:223
29715040,0irq/26-eth0-rx-0-21swapper/312:06:163
29715040,0irq/26-eth0-rx-0-21swapper/311:56:053
29715040,0irq/26-eth0-rx-0-21swapper/311:51:163
29715040,0irq/26-eth0-rx-0-21swapper/309:56:073
29715040,0irq/26-eth0-rx-0-21swapper/307:46:233
259940,0migration/26009-21munin-node10:16:272
259940,0migration/232665-21munin-node07:36:232
259940,0migration/232490-21runrttasks07:12:112
259940,0migration/221490-21hwlatdetect07:31:202
259940,0migration/221217-21kthreadcore09:46:222
259940,0migration/21634-21kthreadcore09:56:212
259940,0migration/214754-21munin-node08:11:252
259940,0migration/211270-21kthreadcore09:41:212
259940,0migration/210981-21gltestperf08:36:202
249940,0watchdog/26257-21grep08:31:232
249940,0watchdog/2450-21if_err_eth006:51:192
249940,0watchdog/225132-21fschecks_time10:11:192
249940,0watchdog/218967-21cut09:01:232
249940,0watchdog/20-21swapper/211:41:182
249940,0watchdog/20-21swapper/209:16:192
179940,0migration/15131-21kthreadcore07:41:231
179940,0migration/14339-21kthreadcore09:36:221
179940,0migration/14016-21kthreadcore10:56:221
179940,0migration/13752-21cpu08:31:181
179940,0migration/13277-21taskset08:30:481
179940,0migration/132231-21kthreadcore08:01:231
179940,0migration/129501-21munin-node11:11:221
179940,0migration/12682-21kthreadcore09:56:211
179940,0migration/126299-21kthreadcore09:51:211
179940,0migration/124560-21latency_hist09:31:041
179940,0migration/116563-21kthreadcore07:01:221
179940,0migration/113956-21latency_hist09:01:051
179940,0migration/113928-21needreboot10:01:231
179940,0migration/113770-21switchtime11:01:261
179940,0migration/113680-21munin-node11:21:261
179940,0migration/113516-21runrttasks07:22:201
179940,0migration/111100-21idleruntime08:36:211
179940,0migration/110837-21kthreadcore09:41:211
169940,0watchdog/19838-21fschecks_time08:11:191
169940,0watchdog/131269-21ssh12:15:461
169940,0watchdog/131061-21ssh09:12:031
169940,0watchdog/127480-21kthreadcore09:06:231
169940,0watchdog/125120-21fschecks_time10:11:191
169940,0watchdog/116463-21ssh10:06:111
169940,0watchdog/10-21swapper/109:23:551
169940,0watchdog/10-21swapper/107:16:231
169940,0watchdog/10-21swapper/106:51:191
149940,0migration/08288-21aten_r1power_vo10:41:160
149940,0migration/05947-21kthreadcore08:06:230
149940,0migration/05200-21kthreadcore09:16:210
149940,0migration/02410-21kthreadcore10:56:210
149940,0migration/024018-21kthreadcore09:06:220
149940,0migration/023706-21irqcore08:21:220
149940,0migration/023279-21runrttasks10:49:190
149940,0migration/021711-21kthreadcore09:26:220
149940,0migration/021575-21kthreadcore08:41:230
149940,0migration/019575-21kthreadcore11:06:200
339930,0migration/32431-21munin-node08:26:263
318669932,0cyclictest27338-21grep08:46:221
318669932,0cyclictest21663-21awk07:31:211
318669932,0cyclictest15034-21awk07:26:211
318669931,0cyclictest0-21swapper/111:56:211
318669930,0cyclictest0-21swapper/107:08:141
318659933,0cyclictest3086-21kworker/0:010:31:100
318659933,0cyclictest3086-21kworker/0:010:16:100
318659933,0cyclictest3086-21kworker/0:009:46:060
318659933,0cyclictest3086-21kworker/0:009:36:120
318659933,0cyclictest3086-21kworker/0:008:01:160
318659933,0cyclictest24516-21kworker/0:112:16:090
318659933,0cyclictest24516-21kworker/0:112:01:050
318659932,0cyclictest23777-21ssh11:31:070
29715030,0irq/26-eth0-rx-0-21swapper/308:46:163
29715030,0irq/26-eth0-rx-0-21swapper/308:16:173
29715030,0irq/26-eth0-rx-0-21swapper/308:06:183
29715030,0irq/26-eth0-rx-0-21swapper/307:38:193
29715030,0irq/26-eth0-rx-0-21swapper/307:31:173
29715030,0irq/26-eth0-rx-0-21swapper/307:10:533
249930,0watchdog/20-21swapper/208:21:232
19130,0ktimersoftd/130268-21ssh08:51:141
179930,0migration/15451-21diskmemload11:16:251
179930,0migration/14925-21kthreadcore08:06:231
169930,0watchdog/130017-21diskmemload10:41:141
169930,0watchdog/10-21swapper/110:51:461
169930,0watchdog/10-21swapper/107:00:231
339920,0migration/332482-21diskstats06:51:183
329920,0watchdog/30-21swapper/307:51:083
318669920,0cyclictest21601-21latency_hist07:56:051
318669920,0cyclictest0-21swapper/107:36:051
29715020,0irq/26-eth0-rx-0-21swapper/307:01:143
169920,0watchdog/10-21swapper/107:51:071
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional