You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 19:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Fri Mar 27, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
141623826,0sleep30-21swapper/306:56:483
140523322,0sleep00-21swapper/006:56:410
151023223,0sleep10-21swapper/106:57:541
143022723,0sleep20-21swapper/206:56:592
339960,0migration/34577-21sh11:22:343
339960,0migration/34381-21sh11:43:123
339960,0migration/330943-21sh09:36:363
339960,0migration/322871-21sh09:52:253
339960,0migration/322641-21runrttasks09:10:493
339960,0migration/321471-21sh10:52:263
29715060,0irq/26-eth0-rx-6226-21ssh10:44:403
29715060,0irq/26-eth0-rx-4436-21munin-node12:25:213
29715060,0irq/26-eth0-rx-12507-21python10:45:333
29715060,0irq/26-eth0-rx-0-21swapper/312:12:313
17779960,0cyclictest0-21swapper/210:19:532
17779960,0cyclictest0-21swapper/208:35:212
17769960,0cyclictest32279-21diskmemload09:49:071
17759960,0cyclictest2134-21kthreadcore09:40:270
149960,0migration/031319-21sh09:58:540
149960,0migration/023910-21sh09:34:290
149960,0migration/022012-21pmu-power09:10:290
149960,0migration/021216-21sh11:34:320
149960,0migration/015139-21sh11:10:250
4150,0ktimersoftd/00-21swapper/011:25:270
339950,0migration/38486-21sshd07:04:443
339950,0migration/34801-21kthreadcore09:40:283
339950,0migration/329744-21kthreadcore09:15:283
339950,0migration/328739-21taskset11:16:543
339950,0migration/326320-21kthreadcore10:15:273
339950,0migration/325884-21aten_r1power_cu08:55:213
339950,0migration/322834-21taskset09:31:173
339950,0migration/316343-21kthreadcore08:45:293
339950,0migration/314083-21munin-node09:05:323
339950,0migration/31308-21kthreadcore11:00:273
339950,0migration/311942-21taskset08:41:043
339950,0migration/310655-21kthreadcore07:05:273
29725050,0irq/27-eth0-tx-3892-21munin-node07:50:260
29725050,0irq/27-eth0-tx-29582-21munin-node07:45:320
29725050,0irq/27-eth0-tx-28649-21munin-node07:20:320
29725050,0irq/27-eth0-tx-24535-21munin-node09:15:332
29725050,0irq/27-eth0-tx-21847-21uname09:50:312
29725050,0irq/27-eth0-tx-20620-21ssh11:11:212
29725050,0irq/27-eth0-tx-15136-21ssh10:09:312
29725050,0irq/27-eth0-tx-14684-21munin-node10:50:222
29725050,0irq/27-eth0-tx-10597-21munin-node07:55:340
29725050,0irq/27-eth0-tx-0-21swapper/212:20:302
29725050,0irq/27-eth0-tx-0-21swapper/007:38:070
29715050,0irq/26-eth0-rx-952-21kthreadcore10:00:283
29715050,0irq/26-eth0-rx-7358-21sh10:25:223
29715050,0irq/26-eth0-rx-7090-21if_err_eth111:05:243
29715050,0irq/26-eth0-rx-3422-21sh12:01:483
29715050,0irq/26-eth0-rx-32463-21if_eth110:20:263
29715050,0irq/26-eth0-rx-30226-21ssh10:59:553
29715050,0irq/26-eth0-rx-26471-21kthreadcore07:40:293
29715050,0irq/26-eth0-rx-21633-21if_err_eth1.212:15:253
29715050,0irq/26-eth0-rx-17553-21df08:00:243
29715050,0irq/26-eth0-rx-10524-21if_eth007:30:263
29715050,0irq/26-eth0-rx-0-21swapper/312:21:043
29715050,0irq/26-eth0-rx-0-21swapper/312:05:273
29715050,0irq/26-eth0-rx-0-21swapper/311:50:273
29715050,0irq/26-eth0-rx-0-21swapper/311:47:423
29715050,0irq/26-eth0-rx-0-21swapper/311:37:403
29715050,0irq/26-eth0-rx-0-21swapper/311:25:293
29715050,0irq/26-eth0-rx-0-21swapper/309:47:443
29715050,0irq/26-eth0-rx-0-21swapper/309:27:323
29715050,0irq/26-eth0-rx-0-21swapper/309:22:083
29715050,0irq/26-eth0-rx-0-21swapper/309:04:403
27150,0ktimersoftd/20-21swapper/211:02:272
259950,0migration/26627-21latency_hist10:45:112
259950,0migration/223717-21sh09:33:542
259950,0migration/21958-21latency_hist07:00:112
259950,0migration/219088-21munin-node11:50:322
259950,0migration/210087-21kthreadcore09:05:272
249950,0watchdog/222266-21kthreadcore08:00:292
17779955,0cyclictest32279-21diskmemload09:38:442
17779954,0cyclictest3241-21irqbalance12:08:592
17779950,0cyclictest0-21swapper/209:26:172
17779950,0cyclictest0-21swapper/207:30:342
17769955,0cyclictest0-21swapper/110:49:491
17769955,0cyclictest0-21swapper/110:19:421
17769955,0cyclictest0-21swapper/108:55:121
17769950,0cyclictest0-21swapper/111:48:471
17769950,0cyclictest0-21swapper/110:50:361
17769950,0cyclictest0-21swapper/110:34:311
179950,0migration/19282-21munin-node09:25:251
179950,0migration/18140-21taskset07:00:431
179950,0migration/13767-21kthreadcore10:00:291
179950,0migration/131339-21hwlatdetect08:10:241
179950,0migration/130265-21switchtime09:35:341
179950,0migration/122650-21sh09:10:511
179950,0migration/121997-21switchtime07:35:321
169950,0watchdog/10-21swapper/108:25:211
149950,0migration/08470-21irqrtprio10:25:260
149950,0migration/07837-21irqcore10:45:270
149950,0migration/07137-21kthreadcore11:45:280
149950,0migration/0573-21kthreadcore12:00:270
149950,0migration/05623-21timerandwakeup10:00:340
149950,0migration/0328-21munin-node08:35:260
149950,0migration/032708-21kthreadcore11:00:260
149950,0migration/031419-21munin-node08:10:240
149950,0migration/027635-21kthreadcore08:55:270
149950,0migration/026486-21kthreadcore08:05:270
149950,0migration/026069-21irqrtprio08:30:260
149950,0migration/024421-21taskset09:35:180
149950,0migration/023386-21latency_hist10:15:110
149950,0migration/021925-21kthreadcore08:50:280
149950,0migration/02056-21kthreadcore10:20:280
149950,0migration/017935-21kthreadcore11:50:270
149950,0migration/016981-21kthreadcore12:10:270
149950,0migration/014649-21sh10:50:140
149950,0migration/013423-21sh11:08:450
149950,0migration/011353-21kthreadcore07:05:280
149950,0migration/010422-21kthreadcore08:40:280
149950,0migration/010314-21missed_timers12:05:290
339940,0migration/35359-21kthreadcore07:25:273
339940,0migration/332143-21kthreadcore08:10:273
339940,0migration/330181-21fschecks_time07:45:243
29725040,0irq/27-eth0-tx-8698-21fschecks_time09:45:242
29725040,0irq/27-eth0-tx-12722-21open_files10:25:302
29725040,0irq/27-eth0-tx-0-21swapper/212:25:302
29725040,0irq/27-eth0-tx-0-21swapper/212:10:252
29725040,0irq/27-eth0-tx-0-21swapper/212:01:132
29725040,0irq/27-eth0-tx-0-21swapper/211:45:132
29725040,0irq/27-eth0-tx-0-21swapper/211:35:132
29725040,0irq/27-eth0-tx-0-21swapper/211:25:262
29725040,0irq/27-eth0-tx-0-21swapper/211:20:132
29725040,0irq/27-eth0-tx-0-21swapper/211:15:212
29725040,0irq/27-eth0-tx-0-21swapper/211:05:182
29725040,0irq/27-eth0-tx-0-21swapper/210:56:302
29725040,0irq/27-eth0-tx-0-21swapper/210:40:172
29725040,0irq/27-eth0-tx-0-21swapper/210:35:262
29725040,0irq/27-eth0-tx-0-21swapper/210:30:412
29725040,0irq/27-eth0-tx-0-21swapper/210:10:122
29725040,0irq/27-eth0-tx-0-21swapper/210:00:242
29725040,0irq/27-eth0-tx-0-21swapper/209:55:212
29725040,0irq/27-eth0-tx-0-21swapper/007:40:310
29715040,0irq/26-eth0-rx-0-21swapper/311:55:353
29715040,0irq/26-eth0-rx-0-21swapper/311:30:243
29715040,0irq/26-eth0-rx-0-21swapper/311:10:213
29715040,0irq/26-eth0-rx-0-21swapper/310:35:223
29715040,0irq/26-eth0-rx-0-21swapper/310:30:393
29715040,0irq/26-eth0-rx-0-21swapper/310:12:023
29715040,0irq/26-eth0-rx-0-21swapper/310:05:443
29715040,0irq/26-eth0-rx-0-21swapper/309:55:373
29715040,0irq/26-eth0-rx-0-21swapper/308:25:273
29715040,0irq/26-eth0-rx-0-21swapper/307:50:263
29715040,0irq/26-eth0-rx-0-21swapper/307:10:313
259940,0migration/26010-21irqcore08:15:262
259940,0migration/231610-21aten_r1power_fr10:20:222
259940,0migration/230612-21aten2.4-expect08:10:212
259940,0migration/230503-21munin-node11:40:242
259940,0migration/225090-21kthreadcore07:40:282
259940,0migration/224945-21switchtime08:50:332
259940,0migration/223680-21kthreadcore12:15:282
259940,0migration/222886-21kthreadcore11:55:272
259940,0migration/214935-21kthreadcore07:55:292
259940,0migration/21414-21kthreadcore07:20:292
249940,0watchdog/232632-21munin-node09:20:292
249940,0watchdog/231242-21netstat08:55:292
249940,0watchdog/216369-21stty07:35:212
249940,0watchdog/20-21swapper/209:10:252
249940,0watchdog/20-21swapper/209:00:252
17779943,0cyclictest4744-21awk07:50:242
17779943,0cyclictest3556-21lldpd09:41:382
17779943,0cyclictest3556-21lldpd08:30:072
17779943,0cyclictest3556-21lldpd07:16:372
17779943,0cyclictest3556-21lldpd07:07:072
17779943,0cyclictest3514-21snmpd08:44:482
17779943,0cyclictest3514-21snmpd08:21:472
17779943,0cyclictest3514-21snmpd08:05:472
17779943,0cyclictest16347-21awk07:10:252
17779943,0cyclictest14721-21awk11:30:252
17779943,0cyclictest13515-21awk08:45:272
17769943,0cyclictest9399-21sadc07:30:111
17769943,0cyclictest5744-21awk08:15:251
17769943,0cyclictest5612-21sadc08:40:111
17769943,0cyclictest3556-21lldpd11:36:391
17769943,0cyclictest3514-21snmpd08:43:181
17769943,0cyclictest3514-21snmpd08:00:021
17769943,0cyclictest3241-21irqbalance09:41:591
17769943,0cyclictest3241-21irqbalance09:00:291
17769943,0cyclictest30561-21awk07:45:261
17769943,0cyclictest29682-21awk12:20:261
17769943,0cyclictest25496-21awk09:15:261
17769943,0cyclictest23192-21awk11:15:251
17769943,0cyclictest17014-21awk09:50:241
17769943,0cyclictest15088-21awk11:10:251
17769943,0cyclictest1169-21awk09:20:271
17759944,0cyclictest0-21swapper/010:44:280
17759944,0cyclictest0-21swapper/009:22:100
17759943,0cyclictest9402-21awk09:25:250
17759943,0cyclictest4862-21munin-node08:15:330
17759943,0cyclictest3556-21lldpd12:24:400
17759943,0cyclictest3556-21lldpd11:58:400
17759943,0cyclictest2884-21awk07:00:260
17759943,0cyclictest22998-21awk07:15:270
17759943,0cyclictest21648-21awk12:15:250
17759943,0cyclictest10491-21awk07:30:260
179940,0migration/16728-21kthreadcore12:25:261
179940,0migration/16674-21if_eth011:25:271
179940,0migration/15486-21taskset10:21:001
179940,0migration/13851-21latency_hist07:50:111
179940,0migration/130537-21kthreadcore07:20:281
179940,0migration/128562-21timerwakeupswit10:55:331
179940,0migration/128449-21pmu-power07:40:321
179940,0migration/127650-21kthreadcore08:30:271
179940,0migration/126038-21kthreadcore10:35:271
179940,0migration/123867-21kthreadcore08:50:281
179940,0migration/122657-21kthreadcore11:55:271
179940,0migration/122175-21sh10:11:541
179940,0migration/118188-21kthreadcore09:30:281
179940,0migration/114481-21gltestperf11:30:241
179940,0migration/110855-21kthreadcore10:25:281
169940,0watchdog/16373-40yum-updatesd-he10:45:051
169940,0watchdog/13316-21ssh11:40:331
169940,0watchdog/1208142sleep107:10:301
169940,0watchdog/113444-21ssh10:05:331
169940,0watchdog/10-21swapper/108:45:291
149940,0migration/05197-21kthreadcore09:00:270
149940,0migration/04255-21kthreadcore07:25:270
149940,0migration/02792-21needreboot11:40:280
149940,0migration/023260-21aten2.4-expect10:35:210
149940,0migration/017212-21kthreadcore08:45:290
35130,0ktimersoftd/30-21swapper/308:24:473
29725030,0irq/27-eth0-tx-11611-21aten2.4-expect08:20:230
29725030,0irq/27-eth0-tx-0-21swapper/008:00:230
29725030,0irq/27-eth0-tx-0-21swapper/007:10:240
29715030,0irq/26-eth0-rx-0-21swapper/308:35:213
29715030,0irq/26-eth0-rx-0-21swapper/308:32:113
29715030,0irq/26-eth0-rx-0-21swapper/308:15:273
29715030,0irq/26-eth0-rx-0-21swapper/307:58:113
29715030,0irq/26-eth0-rx-0-21swapper/307:35:213
29715030,0irq/26-eth0-rx-0-21swapper/307:20:243
29715030,0irq/26-eth0-rx-0-21swapper/307:15:243
17779932,0cyclictest3786-21awk07:25:252
17779932,0cyclictest3514-21snmpd07:47:172
17779932,0cyclictest25716-21awk08:30:252
17769933,0cyclictest12461-21awk08:20:261
17769932,0cyclictest9668-21awk07:05:261
17769932,0cyclictest3514-21snmpd07:33:471
17769932,0cyclictest3241-21irqbalance11:20:291
17769932,0cyclictest21663-21awk12:15:261
17769932,0cyclictest18553-21sensors12:10:311
17769931,0cyclictest18-21rcuc/111:50:281
17769931,0cyclictest18-21rcuc/108:00:251
17769930,0cyclictest5500-21munin-node12:05:241
17759933,0cyclictest8936-21kworker/0:110:30:260
17759933,0cyclictest8936-21kworker/0:110:06:360
17759933,0cyclictest8936-21kworker/0:109:45:260
17759933,0cyclictest30741-21kworker/0:012:25:160
17759933,0cyclictest30741-21kworker/0:011:35:140
17759933,0cyclictest30741-21kworker/0:010:55:180
17759933,0cyclictest2775-21kworker/0:109:15:280
17759933,0cyclictest2775-21kworker/0:109:05:240
17759933,0cyclictest2775-21kworker/0:108:27:020
17759932,0cyclictest25051-21kthreadcore10:15:270
17759930,0cyclictest30824-21perl11:20:230
17759930,0cyclictest27806-21port_sshpriv11:15:310
17759930,0cyclictest0-21swapper/009:50:270
179930,0migration/129935-21runrttasks08:05:441
179930,0migration/129180-21sh12:00:161
169930,0watchdog/16180-21ssh11:05:171
169930,0watchdog/10-21swapper/111:00:211
169930,0watchdog/10-21swapper/109:55:211
169930,0watchdog/10-21swapper/109:09:131
169930,0watchdog/10-21swapper/107:16:581
29715020,0irq/26-eth0-rx-0-21swapper/308:50:203
29715020,0irq/26-eth0-rx-0-21swapper/308:05:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional