You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-08 - 14:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Mon Jun 08, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450870,0irq/25-eth10-21swapper/306:48:283
1882823525,0sleep10-21swapper/106:50:531
1764923322,0sleep00-21swapper/006:48:350
1872923127,0sleep20-21swapper/206:49:422
339960,0migration/39244-21sh09:47:033
339960,0migration/37283-21sh12:05:143
339960,0migration/3666-21sh11:03:093
339960,0migration/331982-21sh11:40:543
339960,0migration/324766-21sh09:55:283
339960,0migration/323152-21sh11:54:033
339960,0migration/316616-21taskset10:51:533
339960,0migration/316405-21sh09:28:553
259960,0migration/210173-21idleruntime10:48:312
191079966,0cyclictest17298-21diskmemload09:16:481
191069960,0cyclictest0-21swapper/011:09:370
149960,0migration/09499-21sh09:27:020
149960,0migration/07682-21sh11:45:480
149960,0migration/032481-21sh09:39:000
149960,0migration/020347-21irqcore06:53:340
149960,0migration/01590-21sh09:22:410
149960,0migration/015661-21sh12:11:150
149960,0migration/014854-21latency10:28:340
4150,0ktimersoftd/00-21swapper/009:05:520
339950,0migration/332712-21taskset09:39:403
339950,0migration/33127-21latency_hist08:18:173
339950,0migration/32889-21kthreadcore09:03:333
339950,0migration/328527-21missed_timers08:33:363
339950,0migration/328439-21kthreadcore09:58:333
339950,0migration/327775-21munin-node07:23:323
339950,0migration/326644-21irqcore10:38:333
339950,0migration/326522-21cpu09:18:293
339950,0migration/326060-21cpuspeed_turbos10:18:293
339950,0migration/325604-21missed_timers07:18:363
339950,0migration/32455-21cpuspeed_turbos07:53:283
339950,0migration/323746-21sshd11:14:283
339950,0migration/319628-21kthreadcore08:28:333
339950,0migration/318254-21fschecks_count10:13:303
339950,0migration/317031-21kthreadcore07:13:343
339950,0migration/316232-21fschecks_time08:03:303
339950,0migration/315516-21taskset12:10:513
339950,0migration/314906-21timerandwakeup11:28:413
339950,0migration/313748-21kthreadcore08:23:353
339950,0migration/312030-21kthreadcore09:08:333
29725050,0irq/27-eth0-tx-32354-21ssh10:19:542
29725050,0irq/27-eth0-tx-18036-21munin-node09:13:292
29725050,0irq/27-eth0-tx-16698-21ssh10:31:432
29725050,0irq/27-eth0-tx-10868-21munin-node08:48:400
29725050,0irq/27-eth0-tx-0-21swapper/211:30:122
29725050,0irq/27-eth0-tx-0-21swapper/210:16:412
29725050,0irq/27-eth0-tx-0-21swapper/209:53:302
29725050,0irq/27-eth0-tx-0-21swapper/209:28:322
29725050,0irq/27-eth0-tx-0-21swapper/008:43:280
29725050,0irq/27-eth0-tx-0-21swapper/007:43:330
29715050,0irq/26-eth0-rx-5315-21sed09:23:323
29715050,0irq/26-eth0-rx-3593-21kthreadcore10:43:353
29715050,0irq/26-eth0-rx-27571-21cat11:58:333
29715050,0irq/26-eth0-rx-26770-21sed08:58:333
29715050,0irq/26-eth0-rx-13599-21kthreadcore10:28:333
29715050,0irq/26-eth0-rx-10935-21if_eth1.209:48:323
29715050,0irq/26-eth0-rx-10420-21perl10:08:293
29715050,0irq/26-eth0-rx-0-21swapper/312:20:223
29715050,0irq/26-eth0-rx-0-21swapper/311:43:323
29715050,0irq/26-eth0-rx-0-21swapper/311:33:293
29715050,0irq/26-eth0-rx-0-21swapper/311:25:313
29715050,0irq/26-eth0-rx-0-21swapper/310:53:403
29715050,0irq/26-eth0-rx-0-21swapper/310:03:323
29715050,0irq/26-eth0-rx-0-21swapper/308:56:373
259950,0migration/29845-21latency_hist08:23:172
259950,0migration/29350-21kthreadcore07:08:352
259950,0migration/232349-21munin-node09:38:412
259950,0migration/232088-21sh11:00:092
259950,0migration/231822-21sh12:21:442
259950,0migration/230689-21sh11:58:392
259950,0migration/22915-21kthreadcore11:43:332
259950,0migration/226774-21munin-node10:38:332
259950,0migration/226710-21kthreadcore11:18:332
259950,0migration/224775-21sh10:36:452
259950,0migration/223404-21sh11:54:472
259950,0migration/21999-21kthreadcore12:03:342
259950,0migration/217391-21sh09:12:242
259950,0migration/216997-21sh11:13:142
249950,0watchdog/232258-21ssh11:41:422
249950,0watchdog/214887-21grep09:48:352
191089955,0cyclictest17298-21diskmemload10:23:182
191089954,0cyclictest2207-21munin-node07:53:412
191089950,0cyclictest0-21swapper/212:15:042
191089950,0cyclictest0-21swapper/209:07:372
191079955,0cyclictest0-21swapper/112:16:511
191079955,0cyclictest0-21swapper/111:41:041
191079955,0cyclictest0-21swapper/111:33:581
191079955,0cyclictest0-21swapper/110:53:461
191079955,0cyclictest0-21swapper/110:14:301
191079955,0cyclictest0-21swapper/109:51:011
191079950,0cyclictest0-21swapper/110:27:071
191079950,0cyclictest0-21swapper/109:59:221
191069955,0cyclictest0-21swapper/012:13:570
191069955,0cyclictest0-21swapper/010:59:410
191069955,0cyclictest0-21swapper/010:43:180
191069954,0cyclictest0-21swapper/010:08:370
191069953,0cyclictest9607-21kworker/0:211:38:070
179950,0migration/115361-21gltestperf07:38:311
169950,0watchdog/111652-21hwlatdetect08:48:311
149950,0migration/09872-21idleruntime11:28:320
149950,0migration/08235-21sh11:06:150
149950,0migration/04773-21kthreadcore10:03:320
149950,0migration/032527-21kthreadcore08:13:330
149950,0migration/031705-21sh12:21:250
149950,0migration/031268-21runrttasks11:38:500
149950,0migration/029431-21kthreadcore08:58:340
149950,0migration/027874-21kthreadcore11:18:340
149950,0migration/026067-21cpuspeed_turbos10:18:290
149950,0migration/025953-21kthreadcore08:08:340
149950,0migration/025120-21taskset09:56:280
149950,0migration/024831-21kthreadcore08:33:340
149950,0migration/024455-21taskset10:35:490
149950,0migration/022450-21kthreadcore10:13:340
149950,0migration/022413-21kthreadcore11:13:340
149950,0migration/020563-21kthreadcore09:13:320
149950,0migration/020427-21kthreadcore10:53:320
149950,0migration/02002-21kthreadcore08:38:350
149950,0migration/01902-21aten_r1power_en09:43:260
149950,0migration/017663-21aten_r1power_po08:53:290
149950,0migration/016434-21sh09:09:590
149950,0migration/016169-21sh09:48:500
149950,0migration/01593-21taskset07:48:570
149950,0migration/011955-21kthreadcore10:48:340
8215040,0irq/24-0000:00:0-21swapper/207:28:302
8215040,0irq/24-0000:00:0-21swapper/207:03:172
339940,0migration/36660-21taskset07:07:453
339940,0migration/32936-21kthreadcore10:23:333
339940,0migration/32812-21kthreadcore07:28:323
339940,0migration/327987-21kthreadcore06:58:333
339940,0migration/327442-21taskset07:44:583
339940,0migration/318673-21kthreadcore12:13:333
339940,0migration/31303-21taskset07:48:413
29725040,0irq/27-eth0-tx-7355-21ssh11:24:132
29725040,0irq/27-eth0-tx-3105-21if_eth1.209:23:302
29725040,0irq/27-eth0-tx-23651-21ssh10:53:542
29725040,0irq/27-eth0-tx-14852-21ssh12:08:562
29725040,0irq/27-eth0-tx-0-21swapper/211:33:332
29725040,0irq/27-eth0-tx-0-21swapper/211:03:312
29725040,0irq/27-eth0-tx-0-21swapper/210:43:212
29725040,0irq/27-eth0-tx-0-21swapper/210:03:222
29725040,0irq/27-eth0-tx-0-21swapper/209:43:342
29725040,0irq/27-eth0-tx-0-21swapper/209:33:282
29725040,0irq/27-eth0-tx-0-21swapper/208:58:322
29725040,0irq/27-eth0-tx-0-21swapper/008:03:340
29725040,0irq/27-eth0-tx-0-21swapper/007:13:400
29715040,0irq/26-eth0-rx-14388-21ntpq07:58:353
29715040,0irq/26-eth0-rx-0-21swapper/311:49:343
29715040,0irq/26-eth0-rx-0-21swapper/311:23:113
29715040,0irq/26-eth0-rx-0-21swapper/311:08:313
29715040,0irq/26-eth0-rx-0-21swapper/311:03:253
29715040,0irq/26-eth0-rx-0-21swapper/310:33:423
29715040,0irq/26-eth0-rx-0-21swapper/309:33:283
29715040,0irq/26-eth0-rx-0-21swapper/309:14:183
29715040,0irq/26-eth0-rx-0-21swapper/308:08:343
259940,0migration/29133-21irqrtprio07:33:322
259940,0migration/29128-21cpuspeed_turbos11:48:292
259940,0migration/231023-21kthreadcore07:48:352
259940,0migration/230850-21sh09:18:352
259940,0migration/224111-21kthreadcore08:08:332
259940,0migration/222337-21kthreadcore11:13:342
259940,0migration/216597-21aten_r1power_en08:28:272
259940,0migration/215250-21kthreadcore07:13:332
259940,0migration/21034-21kthreadcore08:38:342
249940,0watchdog/20-21swapper/208:48:312
249940,0watchdog/20-21swapper/208:33:312
191089943,0cyclictest9796-21awk07:58:302
191089943,0cyclictest4134-21awk08:18:322
191089943,0cyclictest3556-21lldpd08:54:082
191089943,0cyclictest3514-21snmpd10:08:302
191089943,0cyclictest3241-21irqbalance09:58:452
191089943,0cyclictest3241-21irqbalance06:53:362
191089943,0cyclictest26901-21awk06:58:322
191089943,0cyclictest15528-21awk07:38:332
191079944,0cyclictest0-21swapper/111:47:221
191079944,0cyclictest0-21swapper/107:45:121
191079943,0cyclictest9928-21awk11:28:321
191079943,0cyclictest9841-21awk07:58:311
191079943,0cyclictest3556-21lldpd11:04:101
191079943,0cyclictest3556-21lldpd10:19:101
191079943,0cyclictest3556-21lldpd10:05:091
191079943,0cyclictest3556-21lldpd09:29:381
191079943,0cyclictest3556-21lldpd08:48:081
191079943,0cyclictest3556-21lldpd08:38:381
191079943,0cyclictest3556-21lldpd07:18:371
191079943,0cyclictest3514-21snmpd10:38:301
191079943,0cyclictest3241-21irqbalance11:55:141
191079943,0cyclictest3241-21irqbalance09:03:251
191079943,0cyclictest3064-21awk07:53:301
191079943,0cyclictest29713-21awk08:13:301
191079943,0cyclictest27804-21awk07:23:321
191079943,0cyclictest2761-21awk09:43:301
191079943,0cyclictest27252-21awk09:18:321
191079943,0cyclictest26431-21awk08:58:321
191079943,0cyclictest25535-21awk12:18:311
191079943,0cyclictest1492-21awk12:03:331
191069943,0cyclictest26902-21awk09:58:300
191069943,0cyclictest21253-21awk07:18:330
191069943,0cyclictest10741-21awk08:23:320
179940,0migration/19816-21munin-node10:08:271
179940,0migration/15923-21kthreadcore08:18:341
179940,0migration/15590-21kthreadcore07:28:331
179940,0migration/13851-21kthreadcore09:23:321
179940,0migration/127726-21pmu-power08:08:371
179940,0migration/119346-21aten_r1power_cu06:53:281
179940,0migration/118948-21kthreadcore11:13:321
179940,0migration/118819-21irqrtprio10:33:331
179940,0migration/118704-21kthreadcore08:28:331
179940,0migration/11869-21munin-node10:43:321
179940,0migration/118311-21aten_r1power_po09:33:271
179940,0migration/118154-21aten_r1power_vo09:53:271
179940,0migration/11039-21aten_r1power_vo11:23:281
169940,0watchdog/19616-21df_inode11:08:261
169940,0watchdog/132747-21ssh11:02:021
169940,0watchdog/130677-21sensors11:58:381
169940,0watchdog/129813-21kthreadcore11:18:341
169940,0watchdog/115921-21ssh10:49:541
169940,0watchdog/114944-21sed10:28:351
169940,0watchdog/114468-21if_err_eth107:13:311
169940,0watchdog/10-21swapper/109:38:351
169940,0watchdog/10-21swapper/108:33:311
169940,0watchdog/10-21swapper/107:08:351
169940,0watchdog/10-21swapper/107:03:311
149940,0migration/06846-21sh12:03:570
149940,0migration/04117-21kthreadcore10:23:330
149940,0migration/030875-21kthreadcore06:58:340
149940,0migration/029151-21kthreadcore11:58:340
149940,0migration/014690-21timerandwakeup07:58:390
29725030,0irq/27-eth0-tx-0-21swapper/008:18:280
29715030,0irq/26-eth0-rx-0-21swapper/308:43:213
29715030,0irq/26-eth0-rx-0-21swapper/308:13:223
29715030,0irq/26-eth0-rx-0-21swapper/307:42:233
29715030,0irq/26-eth0-rx-0-21swapper/307:08:293
29715030,0irq/26-eth0-rx-0-21swapper/306:54:503
249930,0watchdog/227106-21timerwakeupswit07:43:392
191089932,0cyclictest3556-21lldpd08:43:382
191089932,0cyclictest3514-21snmpd07:18:292
191089932,0cyclictest15758-21egrep08:03:282
191079932,0cyclictest8896-21awk07:33:311
191079932,0cyclictest3556-21lldpd08:24:381
191079932,0cyclictest29528-21kthreadcore07:48:351
191079932,0cyclictest26925-21awk06:58:321
191069933,0cyclictest9607-21kworker/0:211:53:170
191069933,0cyclictest9607-21kworker/0:211:48:310
191069933,0cyclictest9607-21kworker/0:211:23:240
191069933,0cyclictest9607-21kworker/0:210:38:340
191069933,0cyclictest9607-21kworker/0:209:33:220
191069933,0cyclictest9607-21kworker/0:208:28:280
191069933,0cyclictest9607-21kworker/0:207:53:180
191069933,0cyclictest9607-21kworker/0:207:38:180
191069933,0cyclictest9607-21kworker/0:207:08:190
191069933,0cyclictest9607-21kworker/0:207:03:310
191069932,0cyclictest3514-21snmpd07:33:290
191069932,0cyclictest27819-21awk07:23:320
191069932,0cyclictest1209-21munin-node07:28:280
179930,0migration/121844-21kthreadcore08:53:341
169930,0watchdog/10-21swapper/112:08:341
169930,0watchdog/10-21swapper/111:48:341
169930,0watchdog/10-21swapper/109:08:351
169930,0watchdog/10-21swapper/108:03:391
149930,0migration/010161-21sh09:28:180
339920,0migration/311873-21iostat_ios08:48:333
29715020,0irq/26-eth0-rx-0-21swapper/308:38:293
29715020,0irq/26-eth0-rx-0-21swapper/307:33:293
191089921,0cyclictest29100-21cpuspeed_turbos08:13:282
191089920,0cyclictest26722-21latency_hist07:23:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional