You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-09 - 22:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Jul 09, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450640,0irq/25-eth10-21swapper/306:49:143
633623425,0sleep10-21swapper/106:49:371
638123026,0sleep00-21swapper/006:50:080
67922622,0sleep20-21swapper/206:45:342
64669977,0cyclictest10697-21sensors08:50:410
64669976,0cyclictest2548-21ntp_states10:05:390
64689960,0cyclictest4652-21diskmemload11:10:192
64679966,0cyclictest4652-21diskmemload10:04:191
64679966,0cyclictest4652-21diskmemload08:54:191
339960,0migration/328784-21sh09:23:393
339960,0migration/321024-21irqcore07:00:353
339960,0migration/319071-21sh11:58:203
339960,0migration/312302-21sh09:12:543
29715060,0irq/26-eth0-rx-13246-21iostat_ios11:35:323
29715060,0irq/26-eth0-rx-12852-21irqcore12:15:333
149960,0migration/04890-21sh11:50:320
149960,0migration/027522-21sh10:41:460
149960,0migration/02648-21sh11:06:010
149960,0migration/026336-21sh12:01:040
149960,0migration/02346-21sh12:07:180
149960,0migration/018427-21pmu-power08:55:420
64689955,0cyclictest4652-21diskmemload12:19:512
64689955,0cyclictest0-21swapper/210:42:342
64689955,0cyclictest0-21swapper/210:16:332
64689955,0cyclictest0-21swapper/210:05:502
64689955,0cyclictest0-21swapper/209:50:332
64689950,0cyclictest0-21swapper/211:21:122
64689950,0cyclictest0-21swapper/210:38:092
64689950,0cyclictest0-21swapper/209:23:542
64679955,0cyclictest0-21swapper/111:35:361
64679955,0cyclictest0-21swapper/110:09:501
64679950,0cyclictest0-21swapper/110:41:031
64679950,0cyclictest0-21swapper/110:35:321
64669955,0cyclictest0-21swapper/011:10:460
64669955,0cyclictest0-21swapper/010:54:310
64669950,0cyclictest0-21swapper/012:14:370
64669950,0cyclictest0-21swapper/009:20:520
339950,0migration/39262-21taskset08:03:563
339950,0migration/38267-21kthreadcore11:10:363
339950,0migration/37480-21kthreadcore08:25:363
339950,0migration/35434-21df_abs10:10:303
339950,0migration/33541-21latency_hist12:10:183
339950,0migration/332463-21kthreadcore09:45:353
339950,0migration/330854-21munin-node08:20:353
339950,0migration/327589-21runrttasks10:21:183
339950,0migration/324755-21kthreadcore11:00:343
339950,0migration/32464-21needreboot10:05:383
339950,0migration/322881-21latency_hist08:15:193
339950,0migration/31893-21kthreadcore08:45:363
339950,0migration/316959-21taskset08:34:443
339950,0migration/316288-21munin-node07:45:343
339950,0migration/315459-21munin-node08:05:433
339950,0migration/314301-21irqcore10:15:353
339950,0migration/313428-21sh09:35:213
339950,0migration/312785-21cpuspeed_turbos11:15:293
339950,0migration/311273-21taskset11:53:573
29725050,0irq/27-eth0-tx-920-21munin-node07:10:340
29725050,0irq/27-eth0-tx-24604-21kthreadcore10:00:372
29725050,0irq/27-eth0-tx-17243-21munin-node08:35:330
29725050,0irq/27-eth0-tx-0-21swapper/008:25:370
29725050,0irq/27-eth0-tx-0-21swapper/008:10:300
29715050,0irq/26-eth0-rx-4242-21ssh10:29:043
29715050,0irq/26-eth0-rx-3514-21snmpd11:29:523
29715050,0irq/26-eth0-rx-29987-21grep09:25:323
29715050,0irq/26-eth0-rx-24665-21cut08:40:323
29715050,0irq/26-eth0-rx-22507-21kthreadcore11:40:333
29715050,0irq/26-eth0-rx-17625-21cut10:55:373
29715050,0irq/26-eth0-rx-1702-21smartctl07:10:333
29715050,0irq/26-eth0-rx-14400-21if_err_eth1.309:15:323
29715050,0irq/26-eth0-rx-0-21swapper/312:10:393
29715050,0irq/26-eth0-rx-0-21swapper/312:04:573
29715050,0irq/26-eth0-rx-0-21swapper/311:31:213
29715050,0irq/26-eth0-rx-0-21swapper/310:54:473
29715050,0irq/26-eth0-rx-0-21swapper/310:42:433
29715050,0irq/26-eth0-rx-0-21swapper/309:44:523
29715050,0irq/26-eth0-rx-0-21swapper/308:56:093
249950,0watchdog/22511-21missed_timers09:45:372
249950,0watchdog/217879-21cut10:55:372
249950,0watchdog/20-21swapper/207:45:412
179950,0migration/12968-21switchtime09:45:411
179950,0migration/122757-21kthreadcore09:00:361
179950,0migration/121427-21latency_hist09:20:191
179950,0migration/120363-21aten_r1power_vo11:40:281
179950,0migration/112252-21sh10:54:361
169950,0watchdog/111971-21ssh11:55:201
149950,0migration/09808-21irqrtprio07:40:350
149950,0migration/06399-21kthreadcore07:35:360
149950,0migration/06354-21irqrtprio10:10:340
149950,0migration/05464-21cpuspeed_turbos09:50:310
149950,0migration/04899-21latency_hist10:30:190
149950,0migration/031648-21kthreadcore10:25:370
149950,0migration/02830-21ntp_kernel_pll_09:25:400
149950,0migration/027788-21sh11:44:350
149950,0migration/027368-21sh11:01:570
149950,0migration/026853-21latency09:40:370
149950,0migration/022661-21kthreadcore10:20:350
149950,0migration/021159-21fschecks_time11:20:320
149950,0migration/016420-21kthreadcore10:55:360
149950,0migration/015953-21kthreadcore12:15:350
149950,0migration/014992-21kthreadcore09:35:350
149950,0migration/014926-21kthreadcore09:15:340
149950,0migration/014145-21kthreadcore08:30:360
149950,0migration/013329-21aten_r1power_cu09:55:290
64689944,0cyclictest0-21swapper/211:46:062
64689943,0cyclictest8618-21awk07:15:342
64689943,0cyclictest3241-21irqbalance12:10:262
64689943,0cyclictest3241-21irqbalance10:10:272
64689943,0cyclictest3241-21irqbalance08:10:272
64689943,0cyclictest3241-21irqbalance08:06:372
64689943,0cyclictest3241-21irqbalance08:00:272
64689943,0cyclictest3241-21irqbalance07:56:472
64689943,0cyclictest3241-21irqbalance07:50:282
64689943,0cyclictest3241-21irqbalance07:41:182
64689943,0cyclictest3241-21irqbalance07:30:282
64689943,0cyclictest3241-21irqbalance07:20:282
64689943,0cyclictest3241-21irqbalance07:06:082
64689943,0cyclictest3241-21irqbalance07:00:282
64689943,0cyclictest3241-21irqbalance06:50:282
64689943,0cyclictest31466-21awk08:45:342
64689943,0cyclictest29518-21awk11:25:342
64689943,0cyclictest29027-21munin-node10:45:362
64689943,0cyclictest2834-21awk07:35:342
64689943,0cyclictest23838-21awk08:15:332
64689943,0cyclictest1768-21awk07:10:342
64689943,0cyclictest14193-21awk09:55:332
64689943,0cyclictest11489-21awk08:30:342
64679943,0cyclictest9508-21awk07:40:341
64679943,0cyclictest7554-21awk06:50:321
64679943,0cyclictest5990-21awk10:10:331
64679943,0cyclictest5825-21awk10:30:341
64679943,0cyclictest4712-21awk12:10:331
64679943,0cyclictest3514-21snmpd09:40:211
64679943,0cyclictest3514-21snmpd09:22:211
64679943,0cyclictest3514-21snmpd09:07:201
64679943,0cyclictest3514-21snmpd08:59:351
64679943,0cyclictest3514-21snmpd08:45:201
64679943,0cyclictest3514-21snmpd08:36:351
64679943,0cyclictest3514-21snmpd07:50:491
64679943,0cyclictest3514-21snmpd07:30:341
64679943,0cyclictest3514-21snmpd06:59:341
64679943,0cyclictest29465-21awk11:25:341
64679943,0cyclictest21766-21awk11:00:321
64679943,0cyclictest20865-21awk07:00:341
64679943,0cyclictest16758-21grep08:10:321
64679943,0cyclictest14263-21awk09:55:341
64679943,0cyclictest13638-21awk10:55:331
64669944,0cyclictest0-21swapper/010:45:230
64669943,0cyclictest6152-21awk09:10:330
64669943,0cyclictest5149-21awk11:30:340
64669943,0cyclictest3556-21lldpd08:10:120
64669943,0cyclictest3556-21lldpd08:04:420
64669943,0cyclictest3514-21snmpd11:48:220
64669943,0cyclictest3514-21snmpd09:09:510
64669943,0cyclictest3241-21irqbalance10:39:270
64669943,0cyclictest3241-21irqbalance10:02:470
64669943,0cyclictest29207-21kworker/0:211:35:320
64669943,0cyclictest29207-21kworker/0:211:17:140
64669943,0cyclictest23862-21awk08:15:330
64669943,0cyclictest21806-21awk07:25:330
64669943,0cyclictest15134-21awk07:20:340
339940,0migration/39873-21kthreadcore09:50:373
339940,0migration/37672-21kthreadcore09:30:363
339940,0migration/3535-21kthreadcore07:55:373
339940,0migration/34898-21sh08:50:293
339940,0migration/328508-21kthreadcore07:05:353
339940,0migration/327966-21taskset07:50:453
339940,0migration/326861-21unixbench_multi07:25:423
339940,0migration/315002-21kthreadcore06:55:363
339940,0migration/310264-21kthreadcore07:40:353
29725040,0irq/27-eth0-tx-9233-21tr09:10:352
29725040,0irq/27-eth0-tx-4652-21diskmemload11:30:392
29725040,0irq/27-eth0-tx-3930-21ssh11:50:232
29725040,0irq/27-eth0-tx-30636-21kthreadcore09:05:352
29725040,0irq/27-eth0-tx-28548-21ssh10:24:012
29725040,0irq/27-eth0-tx-0-21swapper/212:00:322
29725040,0irq/27-eth0-tx-0-21swapper/211:55:282
29725040,0irq/27-eth0-tx-0-21swapper/211:40:462
29725040,0irq/27-eth0-tx-0-21swapper/211:36:402
29725040,0irq/27-eth0-tx-0-21swapper/211:15:322
29725040,0irq/27-eth0-tx-0-21swapper/210:51:272
29725040,0irq/27-eth0-tx-0-21swapper/210:32:062
29725040,0irq/27-eth0-tx-0-21swapper/210:25:202
29725040,0irq/27-eth0-tx-0-21swapper/209:41:392
29725040,0irq/27-eth0-tx-0-21swapper/209:30:282
29725040,0irq/27-eth0-tx-0-21swapper/209:15:252
29725040,0irq/27-eth0-tx-0-21swapper/208:51:332
29725040,0irq/27-eth0-tx-0-21swapper/007:05:360
29725040,0irq/27-eth0-tx-0-21swapper/007:02:460
29715040,0irq/26-eth0-rx-0-21swapper/311:46:583
29715040,0irq/26-eth0-rx-0-21swapper/311:21:263
29715040,0irq/26-eth0-rx-0-21swapper/311:09:383
29715040,0irq/26-eth0-rx-0-21swapper/310:45:343
29715040,0irq/26-eth0-rx-0-21swapper/310:35:363
29715040,0irq/26-eth0-rx-0-21swapper/310:31:433
29715040,0irq/26-eth0-rx-0-21swapper/310:02:183
29715040,0irq/26-eth0-rx-0-21swapper/309:55:573
29715040,0irq/26-eth0-rx-0-21swapper/309:05:303
29715040,0irq/26-eth0-rx-0-21swapper/309:00:323
29715040,0irq/26-eth0-rx-0-21swapper/306:50:193
259940,0migration/26038-21kthreadcore08:25:352
259940,0migration/230433-21gltestperf09:25:342
259940,0migration/227959-21latency_hist12:05:182
259940,0migration/223452-21kthreadcore07:25:362
259940,0migration/221949-21munin-node09:00:342
259940,0migration/219342-21kthreadcore08:35:342
259940,0migration/217728-21kthreadcore08:55:392
259940,0migration/217450-21kthreadcore06:55:372
249940,0watchdog/221785-21iostat11:00:332
249940,0watchdog/20-21swapper/211:05:372
249940,0watchdog/20-21swapper/209:35:412
179940,0migration/1917-21runrttasks07:10:291
179940,0migration/18980-21kthreadcore08:25:361
179940,0migration/17581-21kthreadcore11:50:351
179940,0migration/17163-21kthreadcore09:10:351
179940,0migration/1689-21latency_hist07:10:191
179940,0migration/16644-21kthreadcore11:10:351
179940,0migration/15677-21fschecks_count09:50:321
179940,0migration/131304-21kthreadcore10:25:361
179940,0migration/131159-21kthreadcore09:25:371
179940,0migration/13042-21cpu08:00:311
179940,0migration/12854-21if_eth1.307:35:341
179940,0migration/126940-21users07:25:421
179940,0migration/125119-21irqrtprio08:40:351
179940,0migration/124241-21kernelversion08:15:351
179940,0migration/12371-21taskset07:57:271
179940,0migration/122133-21kthreadcore11:20:351
179940,0migration/11848-21timerwakeupswit11:45:401
179940,0migration/117454-21kthreadcore07:20:371
179940,0migration/116756-21taskset08:32:251
179940,0migration/115255-21kthreadcore09:35:351
179940,0migration/112379-21kthreadcore07:15:371
179940,0migration/110392-21hddtemp_smartct08:05:341
169940,0watchdog/13736-21ssh10:48:211
169940,0watchdog/130465-21if_eth008:20:331
169940,0watchdog/112710-21if_eth012:15:321
169940,0watchdog/10-21swapper/112:08:281
169940,0watchdog/10-21swapper/111:30:361
169940,0watchdog/10-21swapper/111:15:371
169940,0watchdog/10-21swapper/111:05:371
169940,0watchdog/10-21swapper/110:15:371
169940,0watchdog/10-21swapper/109:30:371
149940,0migration/029102-21fschecks_time11:25:320
149940,0migration/021802-21hddtemp_smartct09:00:330
149940,0migration/019825-21latency_hist07:00:190
149940,0migration/015208-21kthreadcore11:55:370
64689932,0cyclictest30464-21awk08:20:332
64689932,0cyclictest24745-21awk08:40:332
64669933,0cyclictest29207-21kworker/0:210:15:220
64669933,0cyclictest29207-21kworker/0:209:31:140
64669933,0cyclictest29207-21kworker/0:208:40:300
64669933,0cyclictest29207-21kworker/0:208:20:220
64669933,0cyclictest29207-21kworker/0:207:55:280
64669933,0cyclictest29207-21kworker/0:207:45:250
64669933,0cyclictest29207-21kworker/0:206:50:250
64669932,0cyclictest29784-21cpuspeed_turbos09:45:300
64669932,0cyclictest28532-21awk07:30:340
64669930,0cyclictest0-21swapper/007:15:300
339930,0migration/322752-21pmu-power08:35:383
29725030,0irq/27-eth0-tx-0-21swapper/008:45:300
29725030,0irq/27-eth0-tx-0-21swapper/007:50:290
29715030,0irq/26-eth0-rx-0-21swapper/307:35:293
29715030,0irq/26-eth0-rx-0-21swapper/307:30:323
29715030,0irq/26-eth0-rx-0-21swapper/307:20:403
29715030,0irq/26-eth0-rx-0-21swapper/307:16:013
169930,0watchdog/10-21swapper/112:02:441
169930,0watchdog/10-21swapper/110:20:291
169930,0watchdog/10-21swapper/107:45:411
29715020,0irq/26-eth0-rx-0-21swapper/308:10:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional