You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-08 - 22:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Fri May 08, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450570,0irq/25-eth10-21swapper/306:54:283
1480824736,0sleep00-21swapper/006:55:510
1477023928,0sleep20-21swapper/206:55:292
1461722925,0sleep10-21swapper/106:53:391
149099999,0cyclictest28387-21sensors07:26:351
339960,0migration/35634-21munin-node09:31:243
339960,0migration/33745-21switchtime07:56:363
339960,0migration/33442-21sh11:09:543
339960,0migration/320102-21sh09:17:223
339960,0migration/319384-21sh10:58:503
29715060,0irq/26-eth0-rx-728-21kthreadcore09:46:303
29715060,0irq/26-eth0-rx-30937-21munin-node09:26:283
29715060,0irq/26-eth0-rx-28786-21ssh10:05:343
29715060,0irq/26-eth0-rx-27186-21chrt10:42:293
29715060,0irq/26-eth0-rx-24776-21kthreadcore09:41:293
29715060,0irq/26-eth0-rx-17640-21memory11:16:303
149109960,0cyclictest0-21swapper/209:44:212
149099965,0cyclictest0-21swapper/109:21:301
149099960,0cyclictest0-21swapper/111:34:151
149089960,0cyclictest13064-21diskmemload09:22:230
149960,0migration/05698-21fschecks_count09:51:260
149960,0migration/027762-21sh11:25:390
149960,0migration/027762-21sh11:25:390
149960,0migration/020206-21sh09:58:480
149960,0migration/019686-21gltestperf08:36:260
149960,0migration/019271-21sh10:16:480
149960,0migration/013162-21taskset09:15:380
149960,0migration/011972-21sh09:32:410
149960,0migration/011689-21sh10:33:570
8215050,0irq/24-0000:00:29250-21latency_hist09:46:132
4150,0ktimersoftd/00-21swapper/011:08:220
339950,0migration/35400-21aten_r1power_vo09:51:253
339950,0migration/33083-21munin-node07:11:263
339950,0migration/327550-21runrttasks10:22:403
339950,0migration/326963-21sh09:01:343
339950,0migration/326489-21kthreadcore08:16:293
339950,0migration/324229-21fschecks_count07:51:273
339950,0migration/324098-21taskset08:12:113
339950,0migration/32363-21munin-node10:26:333
339950,0migration/323195-21fschecks_count07:26:263
339950,0migration/322389-21taskset07:25:003
339950,0migration/318898-21kthreadcore07:46:313
339950,0migration/318813-21munin-node08:56:313
339950,0migration/316777-21taskset07:46:023
339950,0migration/315900-21kthreadcore10:16:313
339950,0migration/315387-21cpuspeed_turbos06:56:243
339950,0migration/312713-21if_eth1.211:56:253
339950,0migration/311443-21munin-node12:16:223
29725050,0irq/27-eth0-tx-9068-21kthreadcore11:11:292
29725050,0irq/27-eth0-tx-4946-21fschecks_count10:51:262
29725050,0irq/27-eth0-tx-3225-21ssh10:27:492
29725050,0irq/27-eth0-tx-29106-21kthreadcore12:06:282
29725050,0irq/27-eth0-tx-28968-21gltestperf11:26:262
29725050,0irq/27-eth0-tx-24901-21kthreadcore10:41:312
29725050,0irq/27-eth0-tx-20196-21diskstats12:01:252
29725050,0irq/27-eth0-tx-12481-21munin-node10:56:262
29725050,0irq/27-eth0-tx-0-21swapper/211:49:452
29725050,0irq/27-eth0-tx-0-21swapper/211:06:012
29725050,0irq/27-eth0-tx-0-21swapper/210:34:162
29725050,0irq/27-eth0-tx-0-21swapper/007:53:270
29725050,0irq/27-eth0-tx-0-21swapper/007:41:320
29715050,0irq/26-eth0-rx-4773-21aten_r1power_fr10:31:233
29715050,0irq/26-eth0-rx-3734-21aten_r1power_cu11:51:233
29715050,0irq/26-eth0-rx-3514-21snmpd11:47:153
29715050,0irq/26-eth0-rx-30982-21kthreadcore09:06:313
29715050,0irq/26-eth0-rx-19541-21ssh10:38:263
29715050,0irq/26-eth0-rx-0-21swapper/312:22:333
29715050,0irq/26-eth0-rx-0-21swapper/312:09:213
29715050,0irq/26-eth0-rx-0-21swapper/311:41:153
29715050,0irq/26-eth0-rx-0-21swapper/311:37:153
29715050,0irq/26-eth0-rx-0-21swapper/311:21:143
29715050,0irq/26-eth0-rx-0-21swapper/311:21:143
29715050,0irq/26-eth0-rx-0-21swapper/311:13:093
29715050,0irq/26-eth0-rx-0-21swapper/310:06:293
29715050,0irq/26-eth0-rx-0-21swapper/309:38:273
259950,0migration/24694-21runrttasks08:01:142
259950,0migration/226845-21runrttasks12:25:182
249950,0watchdog/226290-21ssh11:42:032
249950,0watchdog/21801-21kthreadcore09:06:322
19150,0ktimersoftd/10-21swapper/111:08:221
179950,0migration/19389-21timerwakeupswit12:11:341
179950,0migration/129333-21kthreadcore08:41:301
179950,0migration/126434-21kthreadcore07:51:301
179950,0migration/122741-21kthreadcore10:01:281
179950,0migration/12265-21taskset07:09:211
179950,0migration/119304-21pmu-power09:16:331
179950,0migration/115739-21munin-node07:41:311
179950,0migration/115046-21kthreadcore10:56:291
179950,0migration/113546-21cpuspeed_turbos09:56:241
149109955,0cyclictest12961-21fschecks_time11:16:252
149109955,0cyclictest0-21swapper/211:36:262
149109955,0cyclictest0-21swapper/210:02:472
149109955,0cyclictest0-21swapper/209:36:282
149109950,0cyclictest0-21swapper/210:06:342
149099954,0cyclictest32461-21sed10:06:291
149099950,0cyclictest0-21swapper/112:18:291
149099950,0cyclictest0-21swapper/112:01:501
149099950,0cyclictest0-21swapper/110:46:101
149099950,0cyclictest0-21swapper/109:32:041
149089955,0cyclictest0-21swapper/012:07:170
149089955,0cyclictest0-21swapper/011:11:280
149089950,0cyclictest0-21swapper/011:30:050
149089950,0cyclictest0-21swapper/008:48:290
149950,0migration/09534-21kthreadcore08:51:300
149950,0migration/08506-21kthreadcore11:51:290
149950,0migration/08030-21latency07:11:310
149950,0migration/05082-21irqcore11:31:290
149950,0migration/04551-21latency_hist10:31:130
149950,0migration/03726-21cpuspeed_turbos12:11:240
149950,0migration/029624-21munin-node10:46:270
149950,0migration/026291-21taskset11:42:030
149950,0migration/020064-21latency_hist11:21:130
149950,0migration/01991-21kthreadcore09:06:320
149950,0migration/019073-21kthreadcore07:46:310
149950,0migration/017594-21kthreadcore07:21:300
149950,0migration/017271-21kthreadcore06:56:290
149950,0migration/017187-21kthreadcore09:36:300
149950,0migration/017117-21latency11:56:280
149950,0migration/015208-21kthreadcore08:06:300
149950,0migration/015203-21kthreadcore11:36:300
149950,0migration/013714-21kthreadcore07:16:300
149950,0migration/013635-21cpuspeed_turbos08:56:250
149950,0migration/012537-21aten_r1power_en10:56:230
149950,0migration/011705-21taskset10:13:170
149950,0migration/010767-21taskset10:52:020
149950,0migration/010518-21kthreadcore08:26:300
339940,0migration/34021-21df_abs07:36:243
339940,0migration/330852-21kthreadcore07:06:293
339940,0migration/325394-21kthreadcore11:01:303
339940,0migration/325067-21kthreadcore09:21:303
29725040,0irq/27-eth0-tx-17047-21pmu-power12:16:322
29725040,0irq/27-eth0-tx-13064-21diskmemload09:34:342
29725040,0irq/27-eth0-tx-0-21swapper/211:52:112
29725040,0irq/27-eth0-tx-0-21swapper/211:21:192
29725040,0irq/27-eth0-tx-0-21swapper/211:21:192
29725040,0irq/27-eth0-tx-0-21swapper/210:21:252
29725040,0irq/27-eth0-tx-0-21swapper/210:11:142
29725040,0irq/27-eth0-tx-0-21swapper/209:56:302
29725040,0irq/27-eth0-tx-0-21swapper/209:51:352
29725040,0irq/27-eth0-tx-0-21swapper/209:26:162
29725040,0irq/27-eth0-tx-0-21swapper/209:22:242
29725040,0irq/27-eth0-tx-0-21swapper/208:57:272
29715040,0irq/26-eth0-rx-32077-21kthreadcore11:26:303
29715040,0irq/26-eth0-rx-0-21swapper/312:11:233
29715040,0irq/26-eth0-rx-0-21swapper/312:01:423
29715040,0irq/26-eth0-rx-0-21swapper/311:32:273
29715040,0irq/26-eth0-rx-0-21swapper/310:51:243
29715040,0irq/26-eth0-rx-0-21swapper/310:46:253
29715040,0irq/26-eth0-rx-0-21swapper/310:11:293
29715040,0irq/26-eth0-rx-0-21swapper/309:56:203
29715040,0irq/26-eth0-rx-0-21swapper/309:13:503
259940,0migration/29605-21kthreadcore08:51:302
259940,0migration/26069-21fschecks_count08:26:262
259940,0migration/24179-21runrttasks07:57:502
259940,0migration/230986-21kthreadcore11:06:292
259940,0migration/228321-21kthreadcore08:16:292
259940,0migration/22642-21sensors_temp07:31:352
259940,0migration/222020-21kthreadcore08:11:302
259940,0migration/216495-21forks07:21:262
259940,0migration/215209-21kthreadcore07:41:302
259940,0migration/211393-21aten_r1power_cu08:06:242
249940,0watchdog/28984-21kthreadcore11:31:312
249940,0watchdog/23455-21awk12:11:232
249940,0watchdog/231338-21munin-node08:21:242
249940,0watchdog/229560-21timerwakeupswit07:51:362
249940,0watchdog/229423-21iostat07:06:282
249940,0watchdog/224520-21kthreadcore09:01:322
249940,0watchdog/221829-21kthreadcore07:46:322
249940,0watchdog/213734-21fschecks_time10:16:272
249940,0watchdog/212237-21fschecks_count11:56:232
179940,0migration/16911-21kthreadcore07:36:291
179940,0migration/1427-21kthreadcore11:26:301
179940,0migration/129607-21fschecks_count10:26:261
179940,0migration/129297-21kthreadcore12:06:291
179940,0migration/127441-21kthreadcore08:16:291
179940,0migration/120470-21taskset11:01:191
179940,0migration/118908-21kthreadcore07:46:311
179940,0migration/113852-21kthreadcore11:16:281
179940,0migration/113351-21latency_hist09:36:131
179940,0migration/112662-21taskset08:51:441
179940,0migration/112170-21taskset10:56:071
169940,0watchdog/126675-21tr09:01:321
169940,0watchdog/125880-21ssh12:22:311
169940,0watchdog/119973-21iostat_ios08:36:281
169940,0watchdog/112238-21fschecks_count11:56:231
169940,0watchdog/10-21swapper/111:36:151
149109944,0cyclictest0-21swapper/207:11:152
149109943,0cyclictest4529-21awk07:36:262
149109943,0cyclictest3556-21lldpd09:16:352
149109943,0cyclictest3556-21lldpd08:50:052
149109943,0cyclictest3556-21lldpd08:43:352
149109943,0cyclictest3556-21lldpd07:28:042
149109943,0cyclictest3556-21lldpd07:03:032
149109943,0cyclictest29513-21grep10:46:262
149109943,0cyclictest13638-21awk10:36:272
149109941,0cyclictest0-21swapper/209:11:262
149099944,0cyclictest0-21swapper/110:24:151
149099944,0cyclictest0-21swapper/110:13:321
149099944,0cyclictest0-21swapper/109:30:101
149099943,0cyclictest5591-21awk08:01:281
149099943,0cyclictest5094-21awk11:11:271
149099943,0cyclictest3556-21lldpd09:54:061
149099943,0cyclictest3514-21snmpd08:50:181
149099943,0cyclictest3514-21snmpd07:56:181
149099943,0cyclictest3241-21irqbalance11:43:111
149099943,0cyclictest3241-21irqbalance08:56:521
149099943,0cyclictest30534-21awk09:06:291
149099943,0cyclictest22511-21sadc07:26:131
149099943,0cyclictest22491-21awk09:41:271
149099943,0cyclictest21482-21kthreadcore08:11:301
149099943,0cyclictest21109-21awk11:21:261
149099943,0cyclictest21109-21awk11:21:261
149099943,0cyclictest12230-21awk08:06:281
149089944,0cyclictest0-21swapper/011:04:230
149089943,0cyclictest3514-21snmpd07:06:030
149089943,0cyclictest3241-21irqbalance12:04:110
149089943,0cyclictest3241-21irqbalance10:45:110
149089943,0cyclictest3241-21irqbalance10:09:020
149089943,0cyclictest30400-21awk09:46:280
149089943,0cyclictest29263-21awk07:06:270
149089943,0cyclictest28997-21awk11:46:280
149089943,0cyclictest18741-21sadc08:36:130
149089943,0cyclictest11387-21kworker/0:209:16:290
149940,0migration/027606-21kthreadcore08:16:290
149940,0migration/020469-21sh12:21:270
149940,0migration/017273-21switchtime12:16:340
29725030,0irq/27-eth0-tx-31425-21aten2.4-expect08:21:240
29725030,0irq/27-eth0-tx-0-21swapper/007:26:240
29715030,0irq/26-eth0-rx-0-21swapper/308:51:323
29715030,0irq/26-eth0-rx-0-21swapper/308:41:243
29715030,0irq/26-eth0-rx-0-21swapper/308:31:243
29715030,0irq/26-eth0-rx-0-21swapper/308:26:243
29715030,0irq/26-eth0-rx-0-21swapper/308:22:443
29715030,0irq/26-eth0-rx-0-21swapper/308:06:243
29715030,0irq/26-eth0-rx-0-21swapper/308:01:273
29715030,0irq/26-eth0-rx-0-21swapper/307:33:253
29715030,0irq/26-eth0-rx-0-21swapper/307:01:143
249930,0watchdog/20-21swapper/208:36:242
179930,0migration/17282-21kthreadcore08:26:291
179930,0migration/132298-21kthreadcore07:31:301
169930,0watchdog/116282-21ps06:56:281
169930,0watchdog/10-21swapper/110:31:231
169930,0watchdog/10-21swapper/110:16:271
169930,0watchdog/10-21swapper/109:48:391
169930,0watchdog/10-21swapper/108:21:241
169930,0watchdog/10-21swapper/107:01:281
149109932,0cyclictest3556-21lldpd07:18:042
149109932,0cyclictest15956-21awk06:56:262
149109930,0cyclictest13216-21munin-node08:31:282
149099932,0cyclictest6357-21ssh09:11:281
149099932,0cyclictest4592-21awk11:51:261
149099932,0cyclictest3241-21irqbalance10:46:411
149099932,0cyclictest3241-21irqbalance07:11:321
149099932,0cyclictest28907-21awk11:46:271
149099932,0cyclictest15360-21cut08:31:301
149099932,0cyclictest13622-21awk10:36:271
149099932,0cyclictest10292-21awk07:16:281
149089933,0cyclictest11387-21kworker/0:210:36:180
149089933,0cyclictest11387-21kworker/0:210:01:350
149089933,0cyclictest11387-21kworker/0:209:41:150
149089933,0cyclictest11387-21kworker/0:209:26:270
149089933,0cyclictest11387-21kworker/0:209:01:170
149089933,0cyclictest11387-21kworker/0:208:41:250
149089933,0cyclictest11387-21kworker/0:208:01:250
149089933,0cyclictest11387-21kworker/0:207:56:310
149089932,0cyclictest30854-21kthreadcore07:31:300
149089931,0cyclictest20990-21cut10:21:130
149089930,0cyclictest18730-21perl08:11:270
35120,0ktimersoftd/324382-21munin-node08:36:313
29715020,0irq/26-eth0-rx-0-21swapper/308:46:323
29715020,0irq/26-eth0-rx-0-21swapper/307:16:203
149089920,0cyclictest0-21swapper/007:36:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional