You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-19 - 17:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Tue May 19, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
749623626,0sleep30-21swapper/306:52:353
745423425,0sleep10-21swapper/106:52:051
736923423,0sleep00-21swapper/006:51:030
760323228,0sleep20-21swapper/206:53:462
35170,0ktimersoftd/30-21swapper/309:13:273
77959966,0cyclictest0-21swapper/109:10:281
4160,0ktimersoftd/00-21swapper/009:13:270
35160,0ktimersoftd/30-21swapper/311:10:593
339960,0migration/331960-21munin-node09:50:253
339960,0migration/329698-21sh09:07:503
339960,0migration/329043-21sh10:27:213
339960,0migration/328356-21taskset10:46:363
339960,0migration/311765-21sh12:19:583
29725060,0irq/27-eth0-tx-10914-21munin-node08:10:310
29715060,0irq/26-eth0-rx-9977-21aten2.4-expect07:45:223
29715060,0irq/26-eth0-rx-11305-21tr09:55:263
29715060,0irq/26-eth0-rx-0-21swapper/311:46:373
27160,0ktimersoftd/20-21swapper/209:13:272
149960,0migration/027937-21sh11:48:250
8215050,0irq/24-0000:00:18337-21latency_hist08:40:112
8215050,0irq/24-0000:00:17522-21memory12:20:312
77969955,0cyclictest0-21swapper/208:55:492
77969950,0cyclictest0-21swapper/211:48:562
77959955,0cyclictest0-21swapper/111:19:161
77959955,0cyclictest0-21swapper/110:05:481
77959955,0cyclictest0-21swapper/107:35:231
77959954,0cyclictest3556-21lldpd07:07:391
77959954,0cyclictest0-21swapper/108:59:251
77959950,0cyclictest0-21swapper/112:17:451
77959950,0cyclictest0-21swapper/110:20:371
77949955,0cyclictest0-21swapper/010:33:440
339950,0migration/39436-21kthreadcore09:15:283
339950,0migration/38278-21kthreadcore11:15:273
339950,0migration/37148-21munin-node08:55:263
339950,0migration/36411-21fschecks_count10:35:243
339950,0migration/36245-21kthreadcore11:35:263
339950,0migration/33765-21taskset08:02:433
339950,0migration/332219-21if_err_eth009:30:253
339950,0migration/32594-21switchtime11:30:323
339950,0migration/325383-21aten2.4-expect08:45:243
339950,0migration/322485-21kthreadcore08:40:313
339950,0migration/322035-21runrttasks10:04:153
339950,0migration/321400-21aten_r1power_fr07:05:233
339950,0migration/320165-21kthreadcore08:15:283
339950,0migration/319984-21unixbench_singl10:40:353
339950,0migration/317958-21kthreadcore09:40:293
339950,0migration/316509-21munin-node07:25:243
339950,0migration/315381-21munin-node07:00:263
339950,0migration/314435-21munin-node07:20:303
339950,0migration/311502-21kthreadcore10:15:273
339950,0migration/311013-21timerandwakeup08:30:333
339950,0migration/310883-21kthreadcore06:55:283
339950,0migration/310463-21kthreadcore09:35:283
29725050,0irq/27-eth0-tx-5060-21ssh09:30:352
29725050,0irq/27-eth0-tx-23384-21perl09:05:232
29725050,0irq/27-eth0-tx-22309-21munin-node07:30:230
29725050,0irq/27-eth0-tx-14279-21ssh10:20:132
29725050,0irq/27-eth0-tx-13540-21ssh09:36:352
29725050,0irq/27-eth0-tx-12856-21munin-node11:40:282
29725050,0irq/27-eth0-tx-11100-21ssh12:18:012
29725050,0irq/27-eth0-tx-0-21swapper/212:11:342
29725050,0irq/27-eth0-tx-0-21swapper/212:04:182
29725050,0irq/27-eth0-tx-0-21swapper/210:51:042
29725050,0irq/27-eth0-tx-0-21swapper/210:26:412
29725050,0irq/27-eth0-tx-0-21swapper/209:21:482
29725050,0irq/27-eth0-tx-0-21swapper/008:05:240
29725050,0irq/27-eth0-tx-0-21swapper/008:00:370
29715050,0irq/26-eth0-rx-4466-21ssh10:10:373
29715050,0irq/26-eth0-rx-31966-21grep10:50:293
29715050,0irq/26-eth0-rx-30235-21ssh10:30:123
29715050,0irq/26-eth0-rx-27369-21ssh12:07:543
29715050,0irq/26-eth0-rx-21570-21ssh11:05:203
29715050,0irq/26-eth0-rx-1689-21proc_pri12:10:303
29715050,0irq/26-eth0-rx-16877-21kthreadcore09:20:273
29715050,0irq/26-eth0-rx-16590-21kthreadcore11:20:263
29715050,0irq/26-eth0-rx-12731-21fschecks_time12:20:263
29715050,0irq/26-eth0-rx-10004-21needreboot11:55:303
29715050,0irq/26-eth0-rx-0-21swapper/312:00:213
29715050,0irq/26-eth0-rx-0-21swapper/311:52:203
29715050,0irq/26-eth0-rx-0-21swapper/311:26:103
29715050,0irq/26-eth0-rx-0-21swapper/310:08:413
29715050,0irq/26-eth0-rx-0-21swapper/309:03:253
29715050,0irq/26-eth0-rx-0-21swapper/308:53:183
259950,0migration/25008-21idleruntime-cro08:30:112
259950,0migration/226547-21kthreadcore09:25:282
249950,0watchdog/24779-21ssh10:32:452
19150,0ktimersoftd/10-21swapper/109:15:211
179950,0migration/19165-21kthreadcore09:35:271
179950,0migration/19158-21kthreadcore11:35:271
179950,0migration/128798-21sh10:26:361
179950,0migration/126071-21kthreadcore09:45:281
179950,0migration/124017-21kthreadcore11:05:271
179950,0migration/116206-21kthreadcore11:00:291
169950,0watchdog/113830-21ssh10:19:331
149950,0migration/09304-21cpuspeed_turbos07:20:230
149950,0migration/09129-21kthreadcore08:30:280
149950,0migration/07827-21kthreadcore10:55:270
149950,0migration/07068-21idleruntime08:55:250
149950,0migration/06693-21sh09:55:190
149950,0migration/04428-21timerwakeupswit08:25:340
149950,0migration/031412-21kthreadcore11:30:270
149950,0migration/030977-21cpuspeed_turbos10:10:230
149950,0migration/030700-21kthreadcore07:35:280
149950,0migration/030345-21kthreadcore12:10:260
149950,0migration/030144-21kthreadcore08:45:300
149950,0migration/029087-21sendmail_mailqu09:25:320
149950,0migration/024732-21kthreadcore10:45:290
149950,0migration/024078-21munin-node09:45:260
149950,0migration/023759-21irqcore10:05:260
149950,0migration/023531-21idleruntime09:05:230
149950,0migration/023440-21kthreadcore12:05:270
149950,0migration/020956-21taskset10:01:080
149950,0migration/020863-21sh11:24:580
149950,0migration/020795-21munin-node09:40:330
149950,0migration/019119-21kthreadcore08:15:270
149950,0migration/017779-21kthreadcore11:00:290
149950,0migration/015979-21idleruntime09:20:250
149950,0migration/015337-21kthreadcore10:40:280
149950,0migration/012778-21munin-node09:35:310
149950,0migration/011737-21taskset12:19:530
77969944,0cyclictest0-21swapper/208:20:112
77969943,0cyclictest5814-21awk11:35:252
77969943,0cyclictest3556-21lldpd10:36:102
77969943,0cyclictest3556-21lldpd08:11:092
77969943,0cyclictest3556-21lldpd07:58:092
77969943,0cyclictest3556-21lldpd07:36:392
77969943,0cyclictest3556-21lldpd07:12:092
77969943,0cyclictest3556-21lldpd07:04:392
77969943,0cyclictest3556-21lldpd06:57:092
77969943,0cyclictest30414-21awk11:10:252
77969943,0cyclictest23192-21awk07:30:262
77969943,0cyclictest18449-21awk08:15:252
77959944,0cyclictest0-21swapper/110:34:201
77959943,0cyclictest6513-21awk10:55:261
77959943,0cyclictest3556-21lldpd11:30:401
77959943,0cyclictest3556-21lldpd10:42:401
77959943,0cyclictest3556-21lldpd07:02:391
77959943,0cyclictest3514-21snmpd08:50:261
77959943,0cyclictest3514-21snmpd07:31:261
77959943,0cyclictest3514-21snmpd07:13:261
77959943,0cyclictest3514-21snmpd06:56:561
77959943,0cyclictest3241-21irqbalance11:55:491
77959943,0cyclictest20578-21sadc11:45:111
77959943,0cyclictest12799-21awk08:35:261
77959943,0cyclictest10802-21awk07:45:261
77949944,0cyclictest0-21swapper/011:18:400
77949944,0cyclictest0-21swapper/011:10:090
77949944,0cyclictest0-21swapper/010:51:420
77949944,0cyclictest0-21swapper/010:27:450
77949943,0cyclictest4080-21awk07:40:250
77949943,0cyclictest3556-21lldpd11:11:400
77949943,0cyclictest3556-21lldpd09:31:100
77949943,0cyclictest3241-21irqbalance12:21:090
77949943,0cyclictest31986-21awk09:50:250
77949943,0cyclictest28998-21sed07:10:280
77949943,0cyclictest24116-21awk07:55:270
77949943,0cyclictest22075-21awk11:25:250
77949943,0cyclictest19477-21awk08:40:280
77949943,0cyclictest16427-21kworker/0:210:15:160
77949943,0cyclictest15363-21awk09:00:270
77949943,0cyclictest14366-21kworker/0:011:35:280
77949943,0cyclictest12784-21awk08:35:260
77949940,0cyclictest0-21swapper/011:53:310
77949940,0cyclictest0-21swapper/011:43:540
339940,0migration/38597-21kthreadcore10:55:273
339940,0migration/37186-21kthreadcore07:40:283
339940,0migration/3705-21kthreadcore07:35:293
339940,0migration/325007-21hddtemp_smartct08:20:253
339940,0migration/319380-21sensors_volt11:00:343
339940,0migration/316788-21kthreadcore11:40:303
339940,0migration/316555-21kthreadcore10:20:293
29725040,0irq/27-eth0-tx-4640-21ssh10:11:082
29725040,0irq/27-eth0-tx-3040-21ssh11:30:532
29725040,0irq/27-eth0-tx-21209-21ssh11:25:192
29725040,0irq/27-eth0-tx-14653-21ssh10:00:182
29725040,0irq/27-eth0-tx-0-21swapper/212:05:162
29725040,0irq/27-eth0-tx-0-21swapper/211:55:342
29725040,0irq/27-eth0-tx-0-21swapper/211:52:132
29725040,0irq/27-eth0-tx-0-21swapper/211:20:322
29725040,0irq/27-eth0-tx-0-21swapper/211:15:122
29725040,0irq/27-eth0-tx-0-21swapper/211:05:582
29725040,0irq/27-eth0-tx-0-21swapper/211:00:232
29725040,0irq/27-eth0-tx-0-21swapper/210:15:292
29725040,0irq/27-eth0-tx-0-21swapper/210:05:332
29725040,0irq/27-eth0-tx-0-21swapper/209:55:222
29725040,0irq/27-eth0-tx-0-21swapper/209:40:282
29725040,0irq/27-eth0-tx-0-21swapper/008:50:220
29725040,0irq/27-eth0-tx-0-21swapper/007:50:210
29725040,0irq/27-eth0-tx-0-21swapper/007:50:090
29725040,0irq/27-eth0-tx-0-21swapper/007:00:270
29725040,0irq/27-eth0-tx-0-21swapper/006:55:230
29715040,0irq/26-eth0-rx-0-21swapper/309:45:303
29715040,0irq/26-eth0-rx-0-21swapper/309:25:223
29715040,0irq/26-eth0-rx-0-21swapper/308:05:253
29715040,0irq/26-eth0-rx-0-21swapper/307:10:293
259940,0migration/29699-21fschecks_time07:20:252
259940,0migration/28298-21kthreadcore10:55:272
259940,0migration/27482-21fschecks_time09:15:242
259940,0migration/2584-21kthreadcore08:00:292
259940,0migration/25610-21kthreadcore08:05:282
259940,0migration/24014-21hddtemp_smartct07:40:252
259940,0migration/232584-21kthreadcore09:50:262
259940,0migration/227700-21kthreadcore09:45:282
259940,0migration/222101-21hddtemp_smartct07:05:252
259940,0migration/216549-21latency_hist07:50:112
259940,0migration/216072-21kthreadcore08:35:282
259940,0migration/214357-21latency_hist09:00:112
259940,0migration/21303-21kthreadcore08:50:282
259940,0migration/210151-21cpuspeed_turbos07:45:232
249940,0watchdog/217469-21kthreadcore07:25:262
249940,0watchdog/20-21swapper/210:45:292
249940,0watchdog/20-21swapper/210:40:292
179940,0migration/18578-21runrttasks07:18:001
179940,0migration/132201-21kthreadcore08:00:291
179940,0migration/128444-21kthreadcore08:20:281
179940,0migration/126453-21kthreadcore09:05:261
179940,0migration/124773-21kthreadcore07:55:291
179940,0migration/124752-21kthreadcore09:25:271
179940,0migration/12355-21kthreadcore11:10:281
179940,0migration/121737-21fschecks_count11:25:241
179940,0migration/119434-21kthreadcore07:50:271
179940,0migration/119412-21taskset12:02:591
179940,0migration/117723-21kthreadcore10:00:281
179940,0migration/116210-21kthreadcore09:00:291
179940,0migration/114869-21timerwakeupswit07:20:341
179940,0migration/110695-21munin-node08:30:301
169940,0watchdog/15469-21ssh09:31:251
169940,0watchdog/132287-21kthreadcore10:50:291
169940,0watchdog/128326-21tr08:45:291
169940,0watchdog/117572-21aten_r1power_cu08:15:211
169940,0watchdog/10-21swapper/111:50:211
169940,0watchdog/10-21swapper/110:45:291
169940,0watchdog/10-21swapper/110:35:291
169940,0watchdog/10-21swapper/109:52:451
169940,0watchdog/10-21swapper/109:21:451
169940,0watchdog/10-21swapper/108:40:291
169940,0watchdog/10-21swapper/107:40:291
149940,0migration/08592-21runrttasks07:18:090
149940,0migration/018443-21timerwakeupswit12:00:340
149940,0migration/014738-21df_inode10:20:250
77969932,0cyclictest8009-21sensors07:15:322
77959933,0cyclictest0-21swapper/108:26:471
77959933,0cyclictest0-21swapper/108:06:461
77959932,0cyclictest3514-21snmpd11:23:411
77959932,0cyclictest21809-21if_eth1.211:45:261
77959932,0cyclictest20608-21stty12:05:221
77959932,0cyclictest16563-21awk07:25:241
77959932,0cyclictest13259-21sed12:20:281
77959930,0cyclictest0-21swapper/108:10:231
77949933,0cyclictest23976-21kworker/0:007:25:170
77949933,0cyclictest23976-21kworker/0:007:05:130
77949933,0cyclictest16427-21kworker/0:210:35:140
77949933,0cyclictest16427-21kworker/0:209:15:160
77949933,0cyclictest16427-21kworker/0:208:20:130
77949933,0cyclictest14366-21kworker/0:011:55:120
339930,0migration/328588-21taskset07:33:423
339930,0migration/313377-21kthreadcore08:10:303
29715030,0irq/26-eth0-rx-0-21swapper/308:35:223
29715030,0irq/26-eth0-rx-0-21swapper/307:50:223
29715030,0irq/26-eth0-rx-0-21swapper/307:15:223
249930,0watchdog/228325-21kthreadcore08:45:292
249930,0watchdog/20-21swapper/208:30:252
169930,0watchdog/15973-21diskmemload10:10:451
169930,0watchdog/15973-21diskmemload09:55:131
169930,0watchdog/10-21swapper/112:10:481
169930,0watchdog/10-21swapper/109:40:531
29715020,0irq/26-eth0-rx-0-21swapper/308:25:203
29715020,0irq/26-eth0-rx-0-21swapper/307:55:573
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional