You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-21 - 20:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Fri Aug 21, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450690,0irq/25-eth10-21swapper/306:46:103
378624024,0sleep10-21swapper/106:43:131
382223423,0sleep00-21swapper/006:43:400
381923425,0sleep20-21swapper/206:43:382
41179966,0cyclictest3514-21snmpd09:58:572
41159960,0cyclictest0-21swapper/010:30:020
339960,0migration/36025-21sh11:30:573
339960,0migration/34172-21sh11:47:213
339960,0migration/329516-21sh11:22:593
339960,0migration/328118-21munin-node11:41:353
339960,0migration/324897-21latency07:46:313
339960,0migration/324840-21sh10:00:373
339960,0migration/321751-21taskset11:18:283
339960,0migration/318467-21sh09:16:133
339960,0migration/317538-21sh09:35:513
339960,0migration/311767-21munin-node08:51:313
29715060,0irq/26-eth0-rx-22789-21unixbench_multi10:16:343
149960,0migration/014039-21munin-run11:36:130
149960,0migration/013051-21sh11:55:230
8215050,0irq/24-0000:00:5079-21ls07:11:132
41169955,0cyclictest2279-21diskmemload11:08:261
41169955,0cyclictest0-21swapper/112:10:241
41169955,0cyclictest0-21swapper/109:08:181
41169954,0cyclictest715-21ssh09:45:021
41169950,0cyclictest0-21swapper/111:59:311
41169950,0cyclictest0-21swapper/111:59:311
41169950,0cyclictest0-21swapper/111:39:481
41169950,0cyclictest0-21swapper/111:11:161
41169950,0cyclictest0-21swapper/110:25:331
41169950,0cyclictest0-21swapper/109:15:141
41159955,0cyclictest7844-21sensors09:26:330
41159955,0cyclictest0-21swapper/010:11:540
41159950,0cyclictest0-21swapper/009:01:170
41159950,0cyclictest0-21swapper/008:55:270
41159950,0cyclictest0-21swapper/007:16:260
4150,0ktimersoftd/00-21swapper/010:45:390
4150,0ktimersoftd/00-21swapper/009:08:320
35150,0ktimersoftd/30-21swapper/309:08:323
339950,0migration/39819-21kthreadcore11:31:323
339950,0migration/39075-21idleruntime08:26:283
339950,0migration/37209-21latency_hist08:01:133
339950,0migration/36968-21fschecks_time07:36:263
339950,0migration/35971-21taskset11:08:283
339950,0migration/3503-21kthreadcore12:06:283
339950,0migration/34865-21munin-node06:46:263
339950,0migration/34601-21kthreadcore10:06:293
339950,0migration/33299-21kernelversion09:26:283
339950,0migration/331479-21taskset07:28:503
339950,0migration/329206-21latency_hist12:06:133
339950,0migration/327812-21irqcore09:01:303
339950,0migration/324378-21timerandwakeup07:21:363
339950,0migration/323872-21munin-node11:01:243
339950,0migration/321837-21munin-node10:56:383
339950,0migration/319537-21munin-node08:56:293
339950,0migration/315938-21kthreadcore08:06:293
339950,0migration/313924-21munin-node11:56:243
339950,0migration/313924-21munin-node11:56:243
339950,0migration/31150-21kthreadcore07:06:293
339950,0migration/311431-21taskset12:12:153
339950,0migration/310761-21irqrtprio09:51:283
29725050,0irq/27-eth0-tx-794-21munin-node10:06:352
29725050,0irq/27-eth0-tx-31929-21munin-node07:31:330
29725050,0irq/27-eth0-tx-20459-21ssh11:36:422
29725050,0irq/27-eth0-tx-19100-21tune2fs09:16:282
29725050,0irq/27-eth0-tx-13591-21munin-node11:56:302
29725050,0irq/27-eth0-tx-13591-21munin-node11:56:302
29725050,0irq/27-eth0-tx-0-21swapper/211:56:022
29725050,0irq/27-eth0-tx-0-21swapper/211:49:192
29725050,0irq/27-eth0-tx-0-21swapper/211:42:572
29725050,0irq/27-eth0-tx-0-21swapper/210:24:402
29725050,0irq/27-eth0-tx-0-21swapper/008:28:400
29725050,0irq/27-eth0-tx-0-21swapper/007:40:080
29715050,0irq/26-eth0-rx-9379-21rm08:49:073
29715050,0irq/26-eth0-rx-6559-21runrttasks09:38:083
29715050,0irq/26-eth0-rx-6263-21timerwakeupswit10:26:343
29715050,0irq/26-eth0-rx-24528-21df_abs10:41:243
29715050,0irq/26-eth0-rx-20396-21uptime11:36:363
29715050,0irq/26-eth0-rx-15488-21ssh10:13:113
29715050,0irq/26-eth0-rx-12869-21cut10:31:303
29715050,0irq/26-eth0-rx-11394-21kthreadcore11:11:293
29715050,0irq/26-eth0-rx-0-21swapper/307:11:253
27150,0ktimersoftd/20-21swapper/209:16:092
27150,0ktimersoftd/20-21swapper/209:08:322
259950,0migration/28299-21sh09:26:512
259950,0migration/26561-21irqrtprio07:11:302
259950,0migration/24664-21sh12:10:532
259950,0migration/228654-21rt-features11:21:342
259950,0migration/224529-21cpuspeed_turbos07:01:242
259950,0migration/223821-21sh10:41:032
259950,0migration/221892-21sshd11:18:552
259950,0migration/216435-21munin-node08:51:372
259950,0migration/215591-21open_files09:31:312
259950,0migration/214071-21latency_hist11:36:132
249950,0watchdog/27425-21aten_r1power_vo08:01:232
249950,0watchdog/2406-21chrt09:01:512
179950,0migration/132503-21munin-node10:46:251
179950,0migration/130892-21munin-node10:01:321
179950,0migration/118244-21idleruntime09:56:261
179950,0migration/115472-21kthreadcore07:41:301
149950,0migration/07304-21aten_r1power_vo11:11:230
149950,0migration/06214-21kthreadcore06:46:290
149950,0migration/06075-21taskset10:47:060
149950,0migration/05867-21fschecks_time07:11:270
149950,0migration/0348-21latency_hist07:56:130
149950,0migration/029228-21kthreadcore07:26:290
149950,0migration/028592-21kthreadcore09:41:300
149950,0migration/02762-21cpuspeed_turbos08:46:230
149950,0migration/026604-21kthreadcore08:36:310
149950,0migration/024619-21kthreadcore07:46:310
149950,0migration/02417-21kthreadcore11:26:300
149950,0migration/022132-21kthreadcore08:56:310
149950,0migration/020981-21sh11:38:140
149950,0migration/020541-21munin-node08:31:340
149950,0migration/017054-21kthreadcore07:41:300
149950,0migration/017053-21kthreadcore11:16:280
149950,0migration/016237-21kthreadcore11:56:290
149950,0migration/016237-21kthreadcore11:56:290
149950,0migration/016128-21kthreadcore06:51:310
149950,0migration/014127-21sh10:52:220
149950,0migration/011463-21kthreadcore10:31:300
8215040,0irq/24-0000:00:0-21swapper/206:51:132
41179943,0cyclictest9212-21awk08:26:292
41179943,0cyclictest3514-21snmpd11:06:212
41179943,0cyclictest3514-21snmpd08:18:512
41179943,0cyclictest3241-21irqbalance11:02:112
41179943,0cyclictest3241-21irqbalance10:32:012
41179943,0cyclictest3241-21irqbalance08:56:212
41179943,0cyclictest17684-21awk10:16:272
41179940,0cyclictest0-21swapper/210:01:212
41169944,0cyclictest2279-21diskmemload10:39:071
41169944,0cyclictest0-21swapper/108:56:381
41169943,0cyclictest5192-21awk06:46:271
41169943,0cyclictest3531-21awk08:46:261
41169943,0cyclictest3241-21irqbalance12:12:311
41169943,0cyclictest3241-21irqbalance09:34:211
41169943,0cyclictest3241-21irqbalance07:46:321
41169943,0cyclictest2884-21awk09:26:271
41169943,0cyclictest27306-21awk09:21:271
41169943,0cyclictest24996-21awk10:41:261
41169943,0cyclictest24478-21awk11:01:261
41169943,0cyclictest22402-21awk12:01:251
41169943,0cyclictest1696-21awk10:06:271
41169943,0cyclictest16616-21awk10:56:281
41169943,0cyclictest15934-21sadc10:36:131
41169943,0cyclictest13321-21sadc11:56:121
41159944,0cyclictest0-21swapper/011:24:070
41159943,0cyclictest3556-21lldpd12:04:300
41159943,0cyclictest3241-21irqbalance10:37:410
41159943,0cyclictest3241-21irqbalance10:22:310
41159943,0cyclictest3241-21irqbalance09:58:310
41159943,0cyclictest3241-21irqbalance09:51:310
41159943,0cyclictest31903-21awk07:06:270
41159943,0cyclictest26164-21awk10:01:260
41159943,0cyclictest23120-21awk11:41:280
41159943,0cyclictest18645-21awk06:56:270
41159943,0cyclictest1776-21awk10:06:270
41159940,0cyclictest0-21swapper/012:07:140
339940,0migration/35636-21runrttasks07:31:473
339940,0migration/330708-21kthreadcore07:51:303
339940,0migration/318411-21gltestperf06:56:263
339940,0migration/318080-21kthreadcore08:31:303
339940,0migration/313025-21kthreadcore06:51:303
29725040,0irq/27-eth0-tx-8826-21ssh08:47:042
29725040,0irq/27-eth0-tx-6559-21runrttasks09:21:172
29725040,0irq/27-eth0-tx-2279-21diskmemload11:11:212
29725040,0irq/27-eth0-tx-21880-21ssh10:56:462
29725040,0irq/27-eth0-tx-0-21swapper/212:01:272
29725040,0irq/27-eth0-tx-0-21swapper/210:46:342
29725040,0irq/27-eth0-tx-0-21swapper/210:42:382
29725040,0irq/27-eth0-tx-0-21swapper/209:51:242
29725040,0irq/27-eth0-tx-0-21swapper/209:48:042
29725040,0irq/27-eth0-tx-0-21swapper/209:41:152
29725040,0irq/27-eth0-tx-0-21swapper/008:41:240
29725040,0irq/27-eth0-tx-0-21swapper/008:21:270
29725040,0irq/27-eth0-tx-0-21swapper/008:13:370
29725040,0irq/27-eth0-tx-0-21swapper/007:01:350
29715040,0irq/26-eth0-rx-6346-21fschecks_time11:51:253
29715040,0irq/26-eth0-rx-0-21swapper/310:53:133
29715040,0irq/26-eth0-rx-0-21swapper/310:46:183
29715040,0irq/26-eth0-rx-0-21swapper/310:38:293
29715040,0irq/26-eth0-rx-0-21swapper/310:21:333
29715040,0irq/26-eth0-rx-0-21swapper/310:01:283
29715040,0irq/26-eth0-rx-0-21swapper/309:46:243
29715040,0irq/26-eth0-rx-0-21swapper/309:41:543
29715040,0irq/26-eth0-rx-0-21swapper/309:21:483
29715040,0irq/26-eth0-rx-0-21swapper/309:11:303
29715040,0irq/26-eth0-rx-0-21swapper/307:16:283
259940,0migration/29023-21munin-node10:11:242
259940,0migration/26368-21aten_r1power_fr07:36:242
259940,0migration/26020-21kthreadcore06:46:292
259940,0migration/25513-21fschecks_count12:11:232
259940,0migration/229716-21kthreadcore07:26:302
259940,0migration/225594-21kthreadcore08:11:312
259940,0migration/22271-21kthreadcore07:31:312
259940,0migration/222209-21kthreadcore06:56:292
259940,0migration/221729-21cpu08:36:252
259940,0migration/220725-21kthreadcore07:21:302
259940,0migration/219610-21kthreadcore09:36:292
259940,0migration/217918-21kthreadcore08:06:302
249940,0watchdog/22962-21kthreadcore11:26:312
249940,0watchdog/21270-21interrupts10:26:272
249940,0watchdog/20-21swapper/210:51:192
249940,0watchdog/20-21swapper/207:59:552
249940,0watchdog/20-21swapper/207:41:272
179940,0migration/12770-21kthreadcore11:46:291
179940,0migration/127269-21kthreadcore11:21:311
179940,0migration/127255-21fschecks_time09:01:271
179940,0migration/126862-21kthreadcore07:26:291
179940,0migration/126307-21aten_r1power_cu07:51:241
179940,0migration/126297-21switchtime08:11:361
179940,0migration/12397-21kthreadcore07:56:281
179940,0migration/122903-21kthreadcore09:16:321
179940,0migration/122797-21kthreadcore09:36:301
179940,0migration/116838-21kthreadcore11:16:281
179940,0migration/115722-21kthreadcore08:51:321
179940,0migration/11564-21aten_r1power_fr08:21:231
179940,0migration/112819-21kthreadcore09:51:291
179940,0migration/112552-21kthreadcore06:51:291
179940,0migration/110303-21kthreadcore11:31:321
169940,0watchdog/18767-21ssh10:51:271
169940,0watchdog/18416-21ssh09:48:431
169940,0watchdog/17426-21aten_r1power_vo08:01:231
169940,0watchdog/14764-21ssh11:27:031
169940,0watchdog/122368-21basename08:36:271
169940,0watchdog/113004-21kthreadcore08:26:311
169940,0watchdog/10-21swapper/111:41:301
169940,0watchdog/10-21swapper/110:26:271
169940,0watchdog/10-21swapper/110:11:271
169940,0watchdog/10-21swapper/107:06:241
149940,0migration/04947-21latency_hist12:11:130
149940,0migration/023040-21runrttasks11:00:170
149940,0migration/022298-21netstat10:16:300
149940,0migration/021881-21kthreadcore09:16:320
149940,0migration/020821-21kthreadcore09:36:290
149940,0migration/012369-21kthreadcore09:11:290
41179933,0cyclictest12927-21awk07:16:272
41179932,0cyclictest3514-21snmpd08:24:212
41179932,0cyclictest32041-21timerandwakeup07:51:352
41179930,0cyclictest18947-21tr08:31:312
41169933,0cyclictest0-21swapper/107:01:141
41169932,0cyclictest28009-21grep08:16:261
41169932,0cyclictest187142cut07:21:251
41169932,0cyclictest15763-21awk08:31:281
41169932,0cyclictest12020-21cut07:16:231
41169930,0cyclictest23445-21sh10:18:101
41169930,0cyclictest17846-21grep08:06:301
41169930,0cyclictest1444-21kthreadcore07:31:311
41169930,0cyclictest0-21swapper/107:11:311
41159933,0cyclictest8155-21kworker/0:009:46:200
41159933,0cyclictest8155-21kworker/0:008:16:160
41159933,0cyclictest8155-21kworker/0:008:06:180
41159933,0cyclictest8155-21kworker/0:008:01:280
41159933,0cyclictest8155-21kworker/0:007:56:210
41159933,0cyclictest8155-21kworker/0:007:21:190
41159932,0cyclictest975-21grep11:46:290
41159932,0cyclictest3514-21snmpd09:31:210
41159932,0cyclictest32415-21awk11:06:260
41159932,0cyclictest3241-21irqbalance09:21:410
41159932,0cyclictest24514-21if_err_eth1.311:01:270
29715030,0irq/26-eth0-rx-0-21swapper/308:41:323
29715030,0irq/26-eth0-rx-0-21swapper/308:36:243
29715030,0irq/26-eth0-rx-0-21swapper/308:21:273
29715030,0irq/26-eth0-rx-0-21swapper/308:16:193
29715030,0irq/26-eth0-rx-0-21swapper/308:14:343
29715030,0irq/26-eth0-rx-0-21swapper/307:44:023
29715030,0irq/26-eth0-rx-0-21swapper/307:01:423
249930,0watchdog/20-21swapper/208:42:192
249930,0watchdog/20-21swapper/207:46:552
169930,0watchdog/10-21swapper/108:42:191
169930,0watchdog/10-21swapper/106:56:241
41169921,0cyclictest3241-21irqbalance07:36:221
29715020,0irq/26-eth0-rx-0-21swapper/307:56:343
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional