You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-01 - 15:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Tue Sep 01, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450570,0irq/25-eth10-21swapper/306:40:533
630024736,0sleep00-21swapper/006:41:180
629723424,0sleep20-21swapper/206:41:162
643123322,0sleep10-21swapper/106:42:511
6716991212,0cyclictest11787-21awk08:25:261
339970,0migration/318555-21sh09:30:553
67179965,0cyclictest1593-21fschecks_count07:05:242
67179960,0cyclictest0-21swapper/210:50:322
67169960,0cyclictest0-21swapper/109:35:251
339960,0migration/39460-21sh10:27:493
339960,0migration/3810-21needreboot07:25:303
339960,0migration/3432-21latency10:00:283
339960,0migration/325556-21sh10:16:383
339960,0migration/325116-21sh10:58:573
339960,0migration/317883-21sh10:12:243
339960,0migration/315081-21kthreadcore06:50:273
339960,0migration/311825-21sh09:29:293
29715060,0irq/26-eth0-rx-9818-21iostat_ios11:30:253
29715060,0irq/26-eth0-rx-27825-21ssh08:56:453
29715060,0irq/26-eth0-rx-10599-21tune2fs10:50:233
27160,0ktimersoftd/20-21swapper/212:13:002
8215050,0irq/24-0000:00:4950-21crond08:45:102
67179955,0cyclictest0-21swapper/210:35:432
67179955,0cyclictest0-21swapper/210:21:132
67169955,0cyclictest0-21swapper/108:20:311
67169955,0cyclictest0-21swapper/107:00:261
67169954,0cyclictest22174-21awk07:20:271
67169950,0cyclictest0-21swapper/110:46:211
67169950,0cyclictest0-21swapper/110:29:581
67159955,0cyclictest0-21swapper/009:43:360
67159955,0cyclictest0-21swapper/009:07:110
67159955,0cyclictest0-21swapper/008:56:560
67159954,0cyclictest28738-21awk07:25:260
67159950,0cyclictest0-21swapper/011:37:250
67159950,0cyclictest0-21swapper/011:23:420
67159950,0cyclictest0-21swapper/011:17:240
67159950,0cyclictest0-21swapper/010:42:050
67159950,0cyclictest0-21swapper/009:27:500
4150,0ktimersoftd/00-21swapper/011:59:390
4150,0ktimersoftd/00-21swapper/009:32:520
339950,0migration/38646-21munin-node11:50:223
339950,0migration/37344-21munin-node06:45:233
339950,0migration/37270-21munin-node11:05:343
339950,0migration/35358-21kthreadcore10:05:263
339950,0migration/35317-21munin-node12:05:303
339950,0migration/35317-21munin-node12:05:303
339950,0migration/331275-21kthreadcore09:40:273
339950,0migration/331266-21needreboot11:00:283
339950,0migration/330456-21munin-node09:00:273
339950,0migration/326704-21kthreadcore08:35:263
339950,0migration/326054-21idleruntime11:20:243
339950,0migration/324720-21kthreadcore07:20:293
339950,0migration/317934-21kthreadcore07:40:273
339950,0migration/314085-21kthreadcore09:50:273
339950,0migration/310692-21needreboot08:45:283
339950,0migration/310478-21taskset10:30:133
29725050,0irq/27-eth0-tx-9435-21ssh10:05:512
29725050,0irq/27-eth0-tx-3514-21snmpd10:32:362
29725050,0irq/27-eth0-tx-23372-21kthreadcore09:35:282
29725050,0irq/27-eth0-tx-0-21swapper/211:08:362
29725050,0irq/27-eth0-tx-0-21swapper/210:10:302
29725050,0irq/27-eth0-tx-0-21swapper/209:00:412
29725050,0irq/27-eth0-tx-0-21swapper/006:45:330
29715050,0irq/26-eth0-rx-31780-21missed_timers10:40:293
29715050,0irq/26-eth0-rx-28619-21cut10:20:263
29715050,0irq/26-eth0-rx-27718-21ssh09:39:363
29715050,0irq/26-eth0-rx-26997-21munin-node07:00:213
29715050,0irq/26-eth0-rx-22841-21ntp_offset11:15:313
29715050,0irq/26-eth0-rx-22596-21kthreadcore10:35:283
29715050,0irq/26-eth0-rx-21669-21hwlatdetect09:15:223
29715050,0irq/26-eth0-rx-0-21swapper/312:00:363
29715050,0irq/26-eth0-rx-0-21swapper/311:40:313
29715050,0irq/26-eth0-rx-0-21swapper/311:25:173
29715050,0irq/26-eth0-rx-0-21swapper/310:45:193
29715050,0irq/26-eth0-rx-0-21swapper/309:55:113
29715050,0irq/26-eth0-rx-0-21swapper/309:45:153
29715050,0irq/26-eth0-rx-0-21swapper/309:20:573
29715050,0irq/26-eth0-rx-0-21swapper/309:08:213
27150,0ktimersoftd/20-21swapper/211:46:402
259950,0migration/22340-21unixbench-2d07:50:352
259950,0migration/22150-21taskset09:41:182
259950,0migration/215613-21irqcore07:15:262
259950,0migration/214649-21sh11:51:272
259950,0migration/214612-21switchtime07:35:332
259950,0migration/214180-21munin-node08:50:262
249950,0watchdog/216806-21kthreadcore09:10:282
179950,0migration/16999-21sh11:05:311
179950,0migration/16178-21sh12:06:231
179950,0migration/16178-21sh12:06:231
179950,0migration/130253-21munin-node08:15:231
179950,0migration/127621-21sh08:56:091
179950,0migration/124827-21kthreadcore07:45:271
179950,0migration/123062-21kthreadcore10:35:281
179950,0migration/113235-21missed_timers07:10:301
169950,0watchdog/132428-21grep10:20:281
169950,0watchdog/125799-21aten_r1power_cu11:00:201
169950,0watchdog/124471-21missed_timers10:15:281
169950,0watchdog/113952-21grep07:35:291
149950,0migration/07288-21taskset12:09:410
149950,0migration/07288-21taskset12:09:410
149950,0migration/025002-21kthreadcore06:55:290
149950,0migration/02367-21irqrtprio07:05:270
149950,0migration/022594-21munin-node07:45:230
149950,0migration/015913-21sh11:33:400
67179944,0cyclictest0-21swapper/211:10:242
67179943,0cyclictest3556-21lldpd09:05:372
67179943,0cyclictest3556-21lldpd08:12:072
67179943,0cyclictest3556-21lldpd07:56:072
67179943,0cyclictest3556-21lldpd07:35:072
67179943,0cyclictest30694-21awk08:15:252
67179943,0cyclictest26080-21awk11:20:242
67179943,0cyclictest21134-21awk06:55:262
67179943,0cyclictest14547-21awk06:50:262
67179943,0cyclictest12677-21awk09:50:252
67169944,0cyclictest0-21swapper/111:28:271
67169943,0cyclictest8618-21awk12:10:241
67169943,0cyclictest3514-21snmpd12:02:331
67169943,0cyclictest3514-21snmpd08:03:321
67169943,0cyclictest3514-21snmpd07:52:471
67169943,0cyclictest3514-21snmpd07:25:171
67169943,0cyclictest3514-21snmpd07:05:171
67169943,0cyclictest3241-21irqbalance10:44:181
67169943,0cyclictest3241-21irqbalance09:16:281
67169943,0cyclictest29071-21awk09:40:251
67169943,0cyclictest28497-21awk10:00:251
67169943,0cyclictest20955-21sadc08:55:101
67169943,0cyclictest14595-21awk06:50:261
67169943,0cyclictest13868-21awk09:10:261
67169943,0cyclictest13191-21awk09:30:241
67169943,0cyclictest11520-21awk10:30:251
67169943,0cyclictest10289-21awk11:10:251
67169940,0cyclictest0-21swapper/110:12:561
67159944,0cyclictest0-21swapper/012:03:070
67159944,0cyclictest0-21swapper/011:49:240
67159944,0cyclictest0-21swapper/010:52:580
67159944,0cyclictest0-21swapper/009:35:430
67159944,0cyclictest0-21swapper/006:50:100
67159943,0cyclictest4346-21cut07:55:260
67159943,0cyclictest4074-21awk10:05:240
67159943,0cyclictest3556-21lldpd10:36:370
67159943,0cyclictest3556-21lldpd08:32:070
67159943,0cyclictest3556-21lldpd08:25:070
67159943,0cyclictest3514-21snmpd10:22:320
67159943,0cyclictest3514-21snmpd09:05:020
67159943,0cyclictest3241-21irqbalance11:25:180
67159943,0cyclictest3241-21irqbalance10:01:580
67159943,0cyclictest3241-21irqbalance09:58:280
67159943,0cyclictest3241-21irqbalance09:45:280
67159943,0cyclictest3241-21irqbalance08:10:190
67159943,0cyclictest3241-21irqbalance07:10:190
67159943,0cyclictest3241-21irqbalance07:00:290
67159943,0cyclictest29762-21awk07:50:270
67159943,0cyclictest25668-21sort11:40:260
67159943,0cyclictest21872-21awk09:15:230
67159943,0cyclictest2170-21awk11:05:260
67159943,0cyclictest20013-21awk10:15:240
67159943,0cyclictest18824-21awk10:55:240
67159943,0cyclictest12120-21awk10:10:280
67159943,0cyclictest10742-21awk08:00:250
67159941,0cyclictest0-21swapper/008:36:230
67159940,0cyclictest16551-21munin-node08:05:240
67159940,0cyclictest15380-21idleruntime-cro12:15:100
339940,0migration/37953-21cpu12:10:213
339940,0migration/35291-21irqcore08:20:253
339940,0migration/34898-21kthreadcore11:45:283
339940,0migration/33589-21kthreadcore07:05:283
339940,0migration/325460-21kthreadcore08:10:293
339940,0migration/316443-21latency_hist08:05:103
339940,0migration/313666-21gltestperf09:10:243
29725040,0irq/27-eth0-tx-25178-21ntp_offset09:55:272
29725040,0irq/27-eth0-tx-23470-21ssh11:15:432
29725040,0irq/27-eth0-tx-16117-21ssh11:55:122
29725040,0irq/27-eth0-tx-0-21swapper/212:01:392
29725040,0irq/27-eth0-tx-0-21swapper/211:35:102
29725040,0irq/27-eth0-tx-0-21swapper/211:30:222
29725040,0irq/27-eth0-tx-0-21swapper/211:26:472
29725040,0irq/27-eth0-tx-0-21swapper/210:56:312
29725040,0irq/27-eth0-tx-0-21swapper/210:45:212
29725040,0irq/27-eth0-tx-0-21swapper/210:25:182
29725040,0irq/27-eth0-tx-0-21swapper/210:15:372
29725040,0irq/27-eth0-tx-0-21swapper/210:00:242
29725040,0irq/27-eth0-tx-0-21swapper/209:45:132
29725040,0irq/27-eth0-tx-0-21swapper/209:16:252
29725040,0irq/27-eth0-tx-0-21swapper/208:46:532
29725040,0irq/27-eth0-tx-0-21swapper/008:40:310
29725040,0irq/27-eth0-tx-0-21swapper/008:15:320
29715040,0irq/26-eth0-rx-0-21swapper/311:55:203
29715040,0irq/26-eth0-rx-0-21swapper/311:35:343
29715040,0irq/26-eth0-rx-0-21swapper/311:14:433
29715040,0irq/26-eth0-rx-0-21swapper/308:50:113
29715040,0irq/26-eth0-rx-0-21swapper/308:40:293
29715040,0irq/26-eth0-rx-0-21swapper/307:10:233
259940,0migration/28437-21kthreadcore06:45:262
259940,0migration/28061-21kthreadcore08:20:272
259940,0migration/25053-21fschecks_time09:25:242
259940,0migration/230744-21kthreadcore11:00:272
259940,0migration/229334-21kthreadcore07:00:272
259940,0migration/229093-21cpuspeed_turbos09:20:232
259940,0migration/228035-21timerwakeupswit07:45:332
259940,0migration/22413-21kthreadcore12:05:272
259940,0migration/22413-21kthreadcore12:05:272
259940,0migration/221839-21fschecks_time07:20:242
259940,0migration/218892-21kthreadcore08:05:282
259940,0migration/215059-21kthreadcore09:30:262
249940,0watchdog/225236-21grep08:55:282
249940,0watchdog/20-21swapper/211:40:242
249940,0watchdog/20-21swapper/210:40:242
179940,0migration/19435-21ksmtuned07:57:521
179940,0migration/16462-21kthreadcore07:30:261
179940,0migration/13987-21taskset09:03:101
179940,0migration/131103-21kthreadcore09:20:281
179940,0migration/124352-21cpu08:35:211
179940,0migration/121555-21kthreadcore10:55:271
179940,0migration/120517-21cpuspeed_turbos06:55:241
179940,0migration/119036-21kthreadcore11:55:241
179940,0migration/11850-21kthreadcore11:45:271
179940,0migration/116636-21latency_hist11:35:101
179940,0migration/116316-21hddtemp_smartct07:40:231
179940,0migration/115301-21runrttasks11:31:471
179940,0migration/111814-21aten_r1power_fr09:50:211
179940,0migration/111037-21switchtime08:45:321
169940,0watchdog/15678-21cut09:25:281
169940,0watchdog/13101-21ssh10:05:201
169940,0watchdog/129472-21sshd08:13:321
169940,0watchdog/125356-21head11:40:241
169940,0watchdog/118855-21kthreadcore11:15:281
169940,0watchdog/116506-21ssh10:51:521
169940,0watchdog/111122-21ssh09:05:361
169940,0watchdog/11-21init07:15:211
169940,0watchdog/10-21swapper/109:45:281
149940,0migration/08571-21munin-node10:25:330
149940,0migration/06926-21kthreadcore08:45:260
149940,0migration/031013-21kthreadcore09:20:280
149940,0migration/02831-21if_eth010:45:260
149940,0migration/016340-21kthreadcore09:50:270
149940,0migration/011813-21kthreadcore11:10:270
8215030,0irq/24-0000:00:0-21swapper/208:30:262
67179933,0cyclictest3556-21lldpd07:42:072
67179932,0cyclictest25116-21awk08:35:242
67179930,0cyclictest28251-21diskstats07:25:242
67169932,0cyclictest3514-21snmpd06:45:171
67159932,0cyclictest9783-21awk07:35:260
67159932,0cyclictest6052-21kthreadcore07:30:260
67159932,0cyclictest3556-21lldpd11:04:360
67159932,0cyclictest21924-21grep07:20:240
67159932,0cyclictest16232-21sensors10:30:310
67159932,0cyclictest13724-21sh09:10:240
67159930,0cyclictest0-21swapper/007:40:280
67159930,0cyclictest0-21swapper/007:15:310
29715030,0irq/26-eth0-rx-0-21swapper/308:30:303
29715030,0irq/26-eth0-rx-0-21swapper/308:25:343
29715030,0irq/26-eth0-rx-0-21swapper/308:16:003
29715030,0irq/26-eth0-rx-0-21swapper/308:07:443
29715030,0irq/26-eth0-rx-0-21swapper/307:58:433
29715030,0irq/26-eth0-rx-0-21swapper/307:45:223
29715030,0irq/26-eth0-rx-0-21swapper/307:19:333
29715030,0irq/26-eth0-rx-0-21swapper/306:55:113
249930,0watchdog/210763-21kthreadcore07:10:292
249930,0watchdog/20-21swapper/208:04:442
169930,0watchdog/10-21swapper/111:50:241
169930,0watchdog/10-21swapper/111:20:281
169930,0watchdog/10-21swapper/109:55:201
169930,0watchdog/10-21swapper/108:31:561
169930,0watchdog/10-21swapper/108:05:121
149930,0migration/019707-21sh08:51:420
149930,0migration/012415-21kthreadcore11:50:270
67179920,0cyclictest0-21swapper/208:25:222
67169921,0cyclictest30670-21latency_hist08:40:101
67159920,0cyclictest0-21swapper/008:25:100
29715020,0irq/26-eth0-rx-0-21swapper/307:50:233
29715020,0irq/26-eth0-rx-0-21swapper/307:35:223
29715020,0irq/26-eth0-rx-0-21swapper/307:30:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional