You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-31 - 04:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Fri Jul 31, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450350,0irq/25-eth10-21swapper/318:43:193
1633023526,0sleep20-21swapper/218:46:252
1621723430,0sleep00-21swapper/018:45:070
1620323228,0sleep10-21swapper/118:44:561
16562991212,0cyclictest0-21swapper/020:50:140
165649973,0cyclictest18504-21sadc19:38:162
339960,0migration/39682-21sh23:47:533
339960,0migration/3870-21munin-node22:58:353
339960,0migration/323261-21munin-node21:33:323
339960,0migration/310489-21runrttasks23:07:023
29715060,0irq/26-eth0-rx-18391-21diskstats23:53:283
29715060,0irq/26-eth0-rx-17626-21awk23:31:163
29715060,0irq/26-eth0-rx-13724-21tune2fs22:08:293
29715060,0irq/26-eth0-rx-0-21swapper/323:39:163
165639965,0cyclictest0-21swapper/122:48:271
165629960,0cyclictest0-21swapper/023:26:530
149960,0migration/010631-21missed_timers22:03:340
8215050,0irq/24-0000:00:6434-21cat21:03:162
4150,0ktimersoftd/00-21swapper/022:27:170
339950,0migration/39148-21kthreadcore20:18:313
339950,0migration/38536-21kthreadcore22:23:343
339950,0migration/37243-21hddtemp_smartct21:23:313
339950,0migration/37047-21taskset20:17:293
339950,0migration/332600-21munin-node20:33:353
339950,0migration/331865-21latency_hist19:48:163
339950,0migration/32851-21munin-node20:38:333
339950,0migration/326747-21idleruntime23:58:313
339950,0migration/325689-21taskset23:36:423
339950,0migration/323881-21fschecks_count18:53:303
339950,0migration/321933-21cpuspeed_turbos21:53:273
339950,0migration/320476-21hwlatdetect20:03:303
339950,0migration/319313-21fschecks_time19:38:303
339950,0migration/319263-21taskset20:01:123
339950,0migration/317923-21taskset23:10:223
339950,0migration/317394-21taskset00:13:263
339950,0migration/314053-21aten_r1power_cu20:23:263
339950,0migration/313961-21kthreadcore23:48:373
339950,0migration/31159-21kthreadcore20:58:333
29725050,0irq/27-eth0-tx-9326-21ssh23:25:082
29725050,0irq/27-eth0-tx-7108-21fschecks_time21:23:302
29725050,0irq/27-eth0-tx-549-21munin-node20:13:380
29725050,0irq/27-eth0-tx-3514-21snmpd19:48:310
29725050,0irq/27-eth0-tx-25796-21df_inode19:43:280
29725050,0irq/27-eth0-tx-22843-21munin-node21:13:372
29725050,0irq/27-eth0-tx-18562-21munin-node23:33:332
29725050,0irq/27-eth0-tx-15591-21kthreadcore22:28:332
29725050,0irq/27-eth0-tx-0-21swapper/223:44:392
29725050,0irq/27-eth0-tx-0-21swapper/222:23:222
29725050,0irq/27-eth0-tx-0-21swapper/222:10:312
29725050,0irq/27-eth0-tx-0-21swapper/222:07:432
29725050,0irq/27-eth0-tx-0-21swapper/221:37:462
29725050,0irq/27-eth0-tx-0-21swapper/020:43:410
29725050,0irq/27-eth0-tx-0-21swapper/019:38:290
29725050,0irq/27-eth0-tx-0-21swapper/019:18:250
29715050,0irq/26-eth0-rx-3388-21open_inodes21:38:383
29715050,0irq/26-eth0-rx-27474-21kthreadcore21:13:353
29715050,0irq/26-eth0-rx-21130-21runrttasks22:13:263
29715050,0irq/26-eth0-rx-19149-21ssh22:30:183
29715050,0irq/26-eth0-rx-1410-21sshd23:20:273
29715050,0irq/26-eth0-rx-0-21swapper/323:23:593
29715050,0irq/26-eth0-rx-0-21swapper/322:53:303
29715050,0irq/26-eth0-rx-0-21swapper/322:38:403
29715050,0irq/26-eth0-rx-0-21swapper/322:33:283
29715050,0irq/26-eth0-rx-0-21swapper/321:59:093
29715050,0irq/26-eth0-rx-0-21swapper/321:59:093
29715050,0irq/26-eth0-rx-0-21swapper/321:48:283
29715050,0irq/26-eth0-rx-0-21swapper/321:43:363
29715050,0irq/26-eth0-rx-0-21swapper/321:32:053
29715050,0irq/26-eth0-rx-0-21swapper/321:08:223
29715050,0irq/26-eth0-rx-0-21swapper/320:53:353
29715050,0irq/26-eth0-rx-0-21swapper/320:48:343
29715050,0irq/26-eth0-rx-0-21swapper/320:28:273
29715050,0irq/26-eth0-rx-0-21swapper/319:28:373
29715050,0irq/26-eth0-rx-0-21swapper/319:23:273
29715050,0irq/26-eth0-rx-0-21swapper/300:05:353
259950,0migration/24407-21timerandwakeup21:18:392
259950,0migration/224403-21latency_hist19:18:162
259950,0migration/224206-21kthreadcore22:13:322
259950,0migration/223439-21kthreadcore20:03:332
259950,0migration/218534-21sh22:50:112
259950,0migration/212279-21sh21:44:392
259950,0migration/210644-21fschecks_count23:48:322
249950,0watchdog/230745-21needreboot19:43:342
249950,0watchdog/212951-21ssh21:04:062
19150,0ktimersoftd/10-21swapper/123:47:151
165649955,0cyclictest0-21swapper/223:41:012
165649955,0cyclictest0-21swapper/222:20:172
165649955,0cyclictest0-21swapper/220:33:332
165649954,0cyclictest30941-21awk18:58:312
165649950,0cyclictest0-21swapper/223:53:562
165649950,0cyclictest0-21swapper/221:42:462
165649950,0cyclictest0-21swapper/221:10:362
165639955,0cyclictest0-21swapper/123:14:181
165639955,0cyclictest0-21swapper/121:10:131
165639950,0cyclictest0-21swapper/123:54:021
165629955,0cyclictest0-21swapper/021:42:490
165629955,0cyclictest0-21swapper/000:05:210
165629950,0cyclictest0-21swapper/023:53:030
165629950,0cyclictest0-21swapper/022:32:290
165629950,0cyclictest0-21swapper/022:13:250
169950,0watchdog/118738-21munin-node19:38:301
149950,0migration/09517-21kthreadcore21:43:340
149950,0migration/0866-21kthreadcore21:18:330
149950,0migration/08624-21irqrtprio20:18:310
149950,0migration/07725-21kthreadcore23:03:350
149950,0migration/0633-21missed_timers22:58:340
149950,0migration/05693-21kernelversion19:03:320
149950,0migration/028785-21timerandwakeup21:13:400
149950,0migration/028483-21kthreadcore20:08:320
149950,0migration/025317-21taskset23:35:340
149950,0migration/023192-21munin-node00:13:390
149950,0migration/02311-21kthreadcore20:58:340
149950,0migration/022498-21kthreadcore22:33:330
149950,0migration/022226-21taskset21:33:250
149950,0migration/02022-21fschecks_count20:38:300
149950,0migration/020066-21taskset20:24:110
149950,0migration/019799-21taskset22:53:220
149950,0migration/015608-21kthreadcore19:58:330
149950,0migration/014970-21kthreadcore19:08:350
149950,0migration/011699-21kthreadcore00:08:330
149950,0migration/011010-21runrttasks22:46:270
149950,0migration/01018-21taskset20:34:470
339940,0migration/38160-21kthreadcore19:03:333
339940,0migration/34895-21if_eth122:43:333
339940,0migration/331528-21kthreadcore18:58:323
339940,0migration/310678-21kthreadcore20:43:323
29725040,0irq/27-eth0-tx-9437-21ssh00:08:212
29725040,0irq/27-eth0-tx-5507-21aten2.4-expect19:28:270
29725040,0irq/27-eth0-tx-3183-21ssh23:03:272
29725040,0irq/27-eth0-tx-29658-21ssh21:58:262
29725040,0irq/27-eth0-tx-29658-21ssh21:58:262
29725040,0irq/27-eth0-tx-0-21swapper/222:45:252
29725040,0irq/27-eth0-tx-0-21swapper/222:38:312
29725040,0irq/27-eth0-tx-0-21swapper/221:54:222
29725040,0irq/27-eth0-tx-0-21swapper/221:48:302
29725040,0irq/27-eth0-tx-0-21swapper/220:50:352
29725040,0irq/27-eth0-tx-0-21swapper/200:13:272
29715040,0irq/26-eth0-rx-0-21swapper/323:13:433
29715040,0irq/26-eth0-rx-0-21swapper/322:48:283
29715040,0irq/26-eth0-rx-0-21swapper/322:20:223
29715040,0irq/26-eth0-rx-0-21swapper/322:04:273
29715040,0irq/26-eth0-rx-0-21swapper/321:18:273
29715040,0irq/26-eth0-rx-0-21swapper/321:04:523
29715040,0irq/26-eth0-rx-0-21swapper/319:53:283
29715040,0irq/26-eth0-rx-0-21swapper/319:13:273
29715040,0irq/26-eth0-rx-0-21swapper/319:11:523
29715040,0irq/26-eth0-rx-0-21swapper/300:09:593
259940,0migration/28431-21aten_r1power_po20:43:272
259940,0migration/28289-21if_eth120:18:302
259940,0migration/232386-21kernelversion19:23:322
259940,0migration/232319-21cpuspeed_turbos19:48:282
259940,0migration/229559-21kthreadcore20:08:332
259940,0migration/22367-21kthreadcore20:13:322
259940,0migration/222681-21latency_hist20:53:162
259940,0migration/22051-21fschecks_count20:38:302
259940,0migration/220430-21aten2.4-expect22:33:272
259940,0migration/217788-21irqcore18:48:312
259940,0migration/216654-21kthreadcore21:28:332
259940,0migration/216397-21sensors_fan23:28:362
249940,0watchdog/229119-21cut23:58:332
249940,0watchdog/22750-21kernelversion00:03:332
249940,0watchdog/214085-21aten2.4-expect20:23:262
249940,0watchdog/20-21swapper/223:08:342
249940,0watchdog/20-21swapper/222:53:342
249940,0watchdog/20-21swapper/219:08:352
249940,0watchdog/20-21swapper/219:03:352
179940,0migration/18054-21kthreadcore21:23:351
179940,0migration/129809-21kthreadcore20:08:331
179940,0migration/129159-21timerandwakeup18:53:401
179940,0migration/128256-21fschecks_time22:58:281
179940,0migration/11866-21cpuspeed_turbos20:38:291
179940,0migration/111196-21kthreadcore19:53:331
165649943,0cyclictest3556-21lldpd19:32:222
165649943,0cyclictest3556-21lldpd18:53:222
165649943,0cyclictest28575-21awk22:58:302
165649943,0cyclictest27975-21awk23:18:302
165649943,0cyclictest20123-21awk23:13:302
165649943,0cyclictest19577-21awk19:38:312
165639943,0cyclictest3556-21lldpd22:31:251
165639943,0cyclictest3556-21lldpd22:01:551
165639943,0cyclictest3556-21lldpd22:01:551
165639943,0cyclictest3556-21lldpd18:59:521
165639943,0cyclictest3514-21snmpd23:38:371
165639943,0cyclictest3514-21snmpd23:18:221
165639943,0cyclictest3514-21snmpd23:08:071
165639943,0cyclictest3514-21snmpd22:20:221
165639943,0cyclictest3514-21snmpd22:15:221
165639943,0cyclictest3514-21snmpd21:51:071
165639943,0cyclictest3514-21snmpd19:49:071
165639943,0cyclictest3514-21snmpd19:43:221
165639943,0cyclictest3241-21irqbalance23:09:241
165639943,0cyclictest3241-21irqbalance22:06:341
165639943,0cyclictest3241-21irqbalance21:28:541
165639943,0cyclictest3241-21irqbalance20:33:241
165639943,0cyclictest31100-21awk21:38:321
165639943,0cyclictest29891-21sadc21:38:161
165639943,0cyclictest26867-21awk23:58:311
165639943,0cyclictest26108-21sadc20:08:161
165639943,0cyclictest21622-21awk20:28:311
165639943,0cyclictest20809-21awk22:53:321
165639943,0cyclictest1472-21awk20:13:301
165639943,0cyclictest11114-21awk23:48:351
165639943,0cyclictest10364-21awk00:08:311
165639943,0cyclictest10357-21sadc23:28:151
165629944,0cyclictest0-21swapper/021:33:030
165629943,0cyclictest3556-21lldpd23:08:250
165629943,0cyclictest3556-21lldpd22:51:550
165629943,0cyclictest3514-21snmpd23:15:070
165629943,0cyclictest3241-21irqbalance21:25:240
165629943,0cyclictest3241-21irqbalance21:06:140
165629943,0cyclictest30620-21sadc20:58:160
165629943,0cyclictest29855-21awk22:18:300
165629943,0cyclictest29823-21sadc18:58:160
165629943,0cyclictest26768-21awk23:58:310
165629943,0cyclictest18836-21awk23:53:300
165629943,0cyclictest15645-21awk21:08:310
165629943,0cyclictest14660-21awk21:48:300
165629943,0cyclictest11561-21awk23:28:300
169940,0watchdog/129244-21rm21:14:221
169940,0watchdog/123049-21proc_pri00:13:371
169940,0watchdog/119676-21kthreadcore20:48:341
169940,0watchdog/114759-21diskmemload21:18:341
169940,0watchdog/113754-21nfs4_client20:43:341
169940,0watchdog/112777-21kthreadcore19:08:351
169940,0watchdog/110173-21kthreadcore21:43:341
169940,0watchdog/10-21swapper/122:38:381
169940,0watchdog/10-21swapper/122:33:301
169940,0watchdog/10-21swapper/122:23:341
169940,0watchdog/10-21swapper/122:08:341
169940,0watchdog/10-21swapper/120:23:261
169940,0watchdog/10-21swapper/119:33:341
169940,0watchdog/10-21swapper/119:03:351
149940,0migration/0858-21kthreadcore22:38:380
149940,0migration/03839-21kthreadcore19:23:340
149940,0migration/032337-21kthreadcore21:58:320
149940,0migration/032337-21kthreadcore21:58:320
149940,0migration/023817-21kthreadcore20:28:320
149940,0migration/020606-21kthreadcore19:13:330
149940,0migration/010149-21kthreadcore19:53:320
29715030,0irq/26-eth0-rx-0-21swapper/320:08:273
29715030,0irq/26-eth0-rx-0-21swapper/319:50:213
29715030,0irq/26-eth0-rx-0-21swapper/319:22:083
29715030,0irq/26-eth0-rx-0-21swapper/318:48:303
179930,0migration/116467-21munin-node23:28:381
179930,0migration/113059-21sh19:58:271
165649932,0cyclictest7281-21awk19:53:302
165649932,0cyclictest3556-21lldpd19:13:222
165649932,0cyclictest27110-21latency_hist20:33:162
165639933,0cyclictest3556-21lldpd20:22:221
165639932,0cyclictest3822-21latency_hist22:43:151
165639932,0cyclictest3514-21snmpd20:58:221
165639932,0cyclictest3514-21snmpd20:55:221
165639932,0cyclictest3514-21snmpd00:03:221
165639932,0cyclictest32040-21awk19:23:311
165639932,0cyclictest20741-21kthreadcore18:48:331
165639930,0cyclictest0-21swapper/119:13:241
165629933,0cyclictest7984-21kworker/0:218:58:240
165629933,0cyclictest30834-21kworker/0:021:53:270
165629933,0cyclictest30834-21kworker/0:020:03:210
165629933,0cyclictest30834-21kworker/0:019:33:260
165629933,0cyclictest21190-21kworker/0:123:38:170
165629932,0cyclictest16778-21cut18:48:260
165629930,0cyclictest27498-21diskstats23:18:280
165629930,0cyclictest13544-21diskstats22:08:280
169930,0watchdog/10-21swapper/123:33:331
169930,0watchdog/10-21swapper/121:53:261
169930,0watchdog/10-21swapper/121:03:341
149930,0migration/02234-21sh23:43:290
29715020,0irq/26-eth0-rx-0-21swapper/319:33:303
249920,0watchdog/20-21swapper/219:58:182
165639920,0cyclictest0-21swapper/119:18:161
169920,0watchdog/10-21swapper/119:28:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional