You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-11 - 11:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Fri Sep 11, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450970,0irq/25-eth10-21swapper/318:42:183
2591726766,0sleep10-21swapper/118:40:091
2613225251,0sleep00-21swapper/018:42:360
2597223324,0sleep20-21swapper/218:40:462
339960,0migration/329427-21sh22:26:183
339960,0migration/324123-21taskset20:40:153
339960,0migration/32320-21latency19:59:333
339960,0migration/319632-21sh23:42:513
339960,0migration/313743-21sh22:38:353
339960,0migration/311403-21sh23:36:543
339960,0migration/310350-21sh23:55:253
29715060,0irq/26-eth0-rx-5277-21sensors21:49:353
29715060,0irq/26-eth0-rx-20335-21users22:39:403
29715060,0irq/26-eth0-rx-17379-21cut23:19:323
29715060,0irq/26-eth0-rx-0-21swapper/321:22:043
263419960,0cyclictest0-21swapper/121:14:381
263409960,0cyclictest0-21swapper/023:28:240
149960,0migration/028961-21munin-node23:29:280
35150,0ktimersoftd/30-21swapper/322:05:203
339950,0migration/38722-21aten_r1power_vo21:14:293
339950,0migration/3813-21kthreadcore23:09:333
339950,0migration/37268-21runrttasks21:32:453
339950,0migration/36948-21sh22:14:263
339950,0migration/35839-21kthreadcore18:49:333
339950,0migration/35401-21kthreadcore20:04:323
339950,0migration/34532-21taskset22:51:463
339950,0migration/330991-21kthreadcore19:09:333
339950,0migration/32951-21munin-node19:14:323
339950,0migration/32860-21kthreadcore22:29:353
339950,0migration/326869-21latency23:04:373
339950,0migration/325894-21kthreadcore23:24:343
339950,0migration/324621-21fschecks_time21:44:293
339950,0migration/324264-21kthreadcore22:44:323
339950,0migration/323400-21fschecks_time19:54:293
339950,0migration/322143-21munin-node19:04:323
339950,0migration/315843-21taskset19:48:133
339950,0migration/315686-21latency20:09:343
339950,0migration/315119-21latency_hist19:24:163
339950,0migration/31496-21kthreadcore20:24:343
339950,0migration/313565-21munin-node18:54:403
339950,0migration/312292-21munin-node20:34:303
339950,0migration/312092-21kthreadcore19:19:323
29725050,0irq/27-eth0-tx-6351-21python21:09:392
29725050,0irq/27-eth0-tx-5695-21ssh22:33:282
29725050,0irq/27-eth0-tx-32254-21if_eth1.222:09:322
29725050,0irq/27-eth0-tx-22810-21basename22:24:302
29725050,0irq/27-eth0-tx-15093-21ssh21:59:062
29725050,0irq/27-eth0-tx-0-21swapper/222:40:232
29725050,0irq/27-eth0-tx-0-21swapper/222:22:412
29725050,0irq/27-eth0-tx-0-21swapper/221:02:562
29725050,0irq/27-eth0-tx-0-21swapper/020:14:220
29715050,0irq/26-eth0-rx-17146-21fschecks_count20:59:293
29715050,0irq/26-eth0-rx-12257-21df_abs23:59:283
29715050,0irq/26-eth0-rx-10627-21kthreadcore21:54:333
29715050,0irq/26-eth0-rx-0-21swapper/323:49:163
29715050,0irq/26-eth0-rx-0-21swapper/323:47:203
29715050,0irq/26-eth0-rx-0-21swapper/323:32:033
29715050,0irq/26-eth0-rx-0-21swapper/322:19:353
29715050,0irq/26-eth0-rx-0-21swapper/322:00:503
263429955,0cyclictest0-21swapper/223:44:262
263429955,0cyclictest0-21swapper/221:26:002
263429950,0cyclictest0-21swapper/223:54:412
263429950,0cyclictest0-21swapper/200:10:272
263419955,0cyclictest24491-21diskmemload23:43:081
263419955,0cyclictest0-21swapper/122:59:281
263419955,0cyclictest0-21swapper/121:39:321
263419950,0cyclictest0-21swapper/123:22:481
263419950,0cyclictest0-21swapper/121:02:011
263419950,0cyclictest0-21swapper/100:11:411
263409955,0cyclictest0-21swapper/023:48:250
263409955,0cyclictest0-21swapper/023:41:290
263409955,0cyclictest0-21swapper/022:57:020
263409955,0cyclictest0-21swapper/021:23:510
263409955,0cyclictest0-21swapper/000:12:140
263409950,0cyclictest0-21swapper/023:58:400
263409950,0cyclictest0-21swapper/022:43:000
259950,0migration/21933-21irqcore18:49:312
259950,0migration/213771-21kthreadcore23:59:322
249950,0watchdog/231846-21latency18:44:352
249950,0watchdog/231762-21tr22:49:302
179950,0migration/130650-21munin-node19:59:321
179950,0migration/130070-21aten_r1power_cu22:49:241
179950,0migration/126790-21kthreadcore21:44:321
179950,0migration/122211-21kthreadcore20:39:341
179950,0migration/117414-21kthreadcore19:24:331
179950,0migration/114612-21latency_hist22:19:151
179950,0migration/11133-21kthreadcore22:29:341
179950,0migration/111029-21taskset20:32:341
149950,0migration/07659-21timerandwakeup19:14:380
149950,0migration/05925-21kthreadcore19:39:340
149950,0migration/030388-21sh21:45:340
149950,0migration/029502-21kthreadcore21:04:340
149950,0migration/024365-21kthreadcore19:29:320
149950,0migration/022921-21sh22:44:290
149950,0migration/013854-21kthreadcore19:44:330
149950,0migration/013255-21kthreadcore20:34:320
8215040,0irq/24-0000:00:0-21swapper/223:24:302
339940,0migration/38611-21kthreadcore20:29:333
339940,0migration/329224-21kthreadcore20:44:323
339940,0migration/324339-21fschecks_time20:19:293
339940,0migration/318854-21kthreadcore21:39:333
339940,0migration/310148-21kthreadcore22:54:323
29725040,0irq/27-eth0-tx-7690-21ssh22:14:292
29725040,0irq/27-eth0-tx-23757-21munin-node20:19:300
29725040,0irq/27-eth0-tx-2296-21ssh23:50:192
29725040,0irq/27-eth0-tx-0-21swapper/223:39:302
29725040,0irq/27-eth0-tx-0-21swapper/223:29:252
29725040,0irq/27-eth0-tx-0-21swapper/223:20:162
29725040,0irq/27-eth0-tx-0-21swapper/223:14:282
29725040,0irq/27-eth0-tx-0-21swapper/223:11:342
29725040,0irq/27-eth0-tx-0-21swapper/222:54:272
29725040,0irq/27-eth0-tx-0-21swapper/222:47:002
29725040,0irq/27-eth0-tx-0-21swapper/221:34:372
29725040,0irq/27-eth0-tx-0-21swapper/221:29:212
29725040,0irq/27-eth0-tx-0-21swapper/221:19:342
29725040,0irq/27-eth0-tx-0-21swapper/221:14:272
29725040,0irq/27-eth0-tx-0-21swapper/220:54:242
29725040,0irq/27-eth0-tx-0-21swapper/220:49:202
29725040,0irq/27-eth0-tx-0-21swapper/020:29:290
29725040,0irq/27-eth0-tx-0-21swapper/019:54:350
29725040,0irq/27-eth0-tx-0-21swapper/018:44:280
29715040,0irq/26-eth0-rx-0-21swapper/323:14:253
29715040,0irq/26-eth0-rx-0-21swapper/323:01:053
29715040,0irq/26-eth0-rx-0-21swapper/322:09:333
29715040,0irq/26-eth0-rx-0-21swapper/321:34:353
29715040,0irq/26-eth0-rx-0-21swapper/321:24:233
29715040,0irq/26-eth0-rx-0-21swapper/321:12:103
29715040,0irq/26-eth0-rx-0-21swapper/321:05:193
29715040,0irq/26-eth0-rx-0-21swapper/320:54:593
29715040,0irq/26-eth0-rx-0-21swapper/320:49:333
29715040,0irq/26-eth0-rx-0-21swapper/300:09:273
29715040,0irq/26-eth0-rx-0-21swapper/300:04:323
263429944,0cyclictest0-21swapper/219:44:292
263429943,0cyclictest9390-21awk19:19:302
263429943,0cyclictest7159-21awk22:34:302
263429943,0cyclictest5614-21awk20:29:312
263429943,0cyclictest3556-21lldpd22:59:282
263429943,0cyclictest3556-21lldpd22:04:272
263429943,0cyclictest3556-21lldpd20:38:582
263429943,0cyclictest3556-21lldpd20:09:272
263429943,0cyclictest3556-21lldpd20:05:272
263429943,0cyclictest3556-21lldpd19:36:262
263429943,0cyclictest3556-21lldpd19:24:262
263429943,0cyclictest25616-21awk21:04:302
263429943,0cyclictest24923-21awk21:44:312
263429943,0cyclictest16901-21awk21:39:312
263429943,0cyclictest15179-21awk18:59:302
263429941,0cyclictest0-21swapper/221:59:272
263419944,0cyclictest0-21swapper/123:37:181
263419944,0cyclictest0-21swapper/123:18:041
263419944,0cyclictest0-21swapper/121:52:181
263419943,0cyclictest9009-21awk21:34:321
263419943,0cyclictest8359-21awk21:54:301
263419943,0cyclictest3556-21lldpd21:59:581
263419943,0cyclictest3556-21lldpd19:52:271
263419943,0cyclictest3556-21lldpd19:18:561
263419943,0cyclictest3514-21snmpd23:55:071
263419943,0cyclictest25329-21awk21:24:301
263419943,0cyclictest21862-21sadc22:44:151
263419943,0cyclictest21860-21awk23:24:321
263419943,0cyclictest17988-21awk20:14:301
263409944,0cyclictest23003-21kworker/0:223:09:310
263409944,0cyclictest0-21swapper/023:06:580
263409943,0cyclictest7275-21awk22:34:310
263409943,0cyclictest3556-21lldpd22:59:580
263409943,0cyclictest3556-21lldpd20:47:580
263409943,0cyclictest3556-21lldpd20:24:280
263409943,0cyclictest3556-21lldpd19:59:270
263409943,0cyclictest3556-21lldpd19:34:260
263409943,0cyclictest3514-21snmpd19:09:510
263409943,0cyclictest32723-21awk21:49:280
263409943,0cyclictest3241-21irqbalance23:37:240
263409943,0cyclictest3241-21irqbalance23:14:240
263409943,0cyclictest3241-21irqbalance21:59:340
263409943,0cyclictest3241-21irqbalance21:42:040
263409943,0cyclictest3241-21irqbalance21:09:340
263409943,0cyclictest3241-21irqbalance20:40:040
263409943,0cyclictest3241-21irqbalance20:10:440
263409943,0cyclictest3241-21irqbalance20:04:340
263409943,0cyclictest3241-21irqbalance19:04:250
263409943,0cyclictest3241-21irqbalance18:59:450
263409943,0cyclictest3241-21irqbalance18:54:250
263409943,0cyclictest3241-21irqbalance18:50:050
263409943,0cyclictest3241-21irqbalance00:09:130
263409943,0cyclictest31549-21awk22:29:310
263409943,0cyclictest23653-21awk22:24:340
263409943,0cyclictest13862-21awk23:19:290
263409943,0cyclictest1207-21awk20:49:310
259940,0migration/29355-21kthreadcore18:54:322
259940,0migration/25061-21kthreadcore19:39:342
259940,0migration/231115-21fschecks_time20:24:302
259940,0migration/229890-21kthreadcore19:09:332
259940,0migration/229510-21aten_r1power_cu19:59:262
259940,0migration/229045-21runrttasks19:56:522
259940,0migration/227833-21kthreadcore20:44:312
259940,0migration/22595-21kthreadcore21:49:312
259940,0migration/225724-21kthreadcore23:04:362
259940,0migration/22545-21hddtemp_smartct19:14:292
259940,0migration/220753-21if_eth000:04:302
259940,0migration/216210-21aten_r1power_en19:49:282
249940,0watchdog/227310-21open_files19:29:342
249940,0watchdog/220871-21munin-node19:04:342
249940,0watchdog/20-21swapper/223:34:332
179940,0migration/19168-21kthreadcore22:54:321
179940,0migration/18913-21munin-node19:19:281
179940,0migration/15197-21kthreadcore20:04:321
179940,0migration/14011-21taskset23:33:481
179940,0migration/13587-21runrttasks23:10:481
179940,0migration/129236-21gltestperf19:34:301
179940,0migration/126279-21kthreadcore19:29:321
179940,0migration/125110-21kthreadcore22:24:361
179940,0migration/123670-21kthreadcore19:04:331
179940,0migration/118840-21kthreadcore22:19:341
179940,0migration/118059-21kthreadcore21:19:321
179940,0migration/116779-21taskset20:13:161
179940,0migration/112751-21kthreadcore20:34:321
179940,0migration/111818-21munin-node22:34:351
179940,0migration/110675-21kthreadcore18:54:331
169940,0watchdog/1998-21fschecks_time20:49:301
169940,0watchdog/16652-21ssh21:30:541
169940,0watchdog/132246-21python18:44:391
169940,0watchdog/131915-21munin-node22:09:301
169940,0watchdog/129641-21ssh22:05:101
169940,0watchdog/129285-21if_eth123:49:291
169940,0watchdog/129022-21ssh22:46:541
169940,0watchdog/116723-21kthreadcore23:59:331
169940,0watchdog/116081-21ssh20:58:261
169940,0watchdog/10-21swapper/120:46:021
169940,0watchdog/10-21swapper/119:45:301
149940,0migration/09232-21fschecks_time21:14:300
149940,0migration/03801-21kthreadcore21:29:320
149940,0migration/031320-21sh21:26:460
149940,0migration/030715-21fschecks_time22:49:260
149940,0migration/021015-21kthreadcore19:49:350
149940,0migration/018098-21runrttasks23:59:500
149940,0migration/017937-21kthreadcore19:24:330
149940,0migration/014543-21sh21:35:410
149940,0migration/010793-21kthreadcore19:19:320
29715030,0irq/26-eth0-rx-0-21swapper/319:49:283
29715030,0irq/26-eth0-rx-0-21swapper/319:44:163
29715030,0irq/26-eth0-rx-0-21swapper/318:59:263
29715030,0irq/26-eth0-rx-0-21swapper/318:48:493
263429933,0cyclictest3556-21lldpd20:19:282
263429932,0cyclictest19041-21if_eth1.220:39:312
263429932,0cyclictest18314-21irqrtprio20:14:322
263419933,0cyclictest3556-21lldpd23:44:281
263419933,0cyclictest3556-21lldpd00:07:281
263419932,0cyclictest7310-21sadc18:54:161
263419932,0cyclictest3672-21awk19:39:311
263419932,0cyclictest28466-21awk19:09:311
263419932,0cyclictest25069-21kthreadcore20:19:321
263419932,0cyclictest23216-21df_inode19:54:281
263419932,0cyclictest16959-21kthreadcore18:59:321
263419932,0cyclictest1427-21awk21:09:321
263409933,0cyclictest3556-21lldpd22:09:270
263409933,0cyclictest23003-21kworker/0:221:54:410
263409933,0cyclictest23003-21kworker/0:220:59:330
263409933,0cyclictest1724-21kworker/0:223:50:140
263409932,0cyclictest9564-21awk20:54:330
263409932,0cyclictest20727-21timerandwakeup22:19:390
263409932,0cyclictest12655-21sensors22:14:370
263409931,0cyclictest0-21swapper/022:04:540
169930,0watchdog/121637-21telnet23:04:291
169930,0watchdog/10-21swapper/121:06:141
169930,0watchdog/10-21swapper/120:24:341
329920,0watchdog/30-21swapper/319:29:353
29715020,0irq/26-eth0-rx-0-21swapper/320:14:233
29715020,0irq/26-eth0-rx-0-21swapper/319:34:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional