You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-22 - 11:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sat Aug 22, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450870,0irq/25-eth10-21swapper/318:43:313
574223525,0sleep20-21swapper/218:45:402
573123422,0sleep10-21swapper/118:45:311
554422622,0sleep00-21swapper/018:43:180
29715070,0irq/26-eth0-rx-16384-21ssh22:32:523
8215060,0irq/24-0000:00:22083-21perf20:11:102
58629960,0cyclictest0-21swapper/100:14:161
58619965,0cyclictest3214-21sh21:26:100
58619960,0cyclictest0-21swapper/023:08:520
339960,0migration/39385-21sh22:08:513
339960,0migration/37224-21sh23:07:293
339960,0migration/323453-21sh23:18:323
339960,0migration/322576-21sh23:37:503
339960,0migration/318503-21sh21:34:073
339960,0migration/311015-21sh21:08:533
339960,0migration/310365-21sh21:49:553
29715060,0irq/26-eth0-rx-9353-21which21:26:323
29715060,0irq/26-eth0-rx-7603-21cat19:56:283
29715060,0irq/26-eth0-rx-0-21swapper/300:02:193
149960,0migration/03813-21kthreadcore23:46:270
149960,0migration/03257-21sh21:04:490
149960,0migration/014098-21sh23:52:420
149960,0migration/01341-21sh21:42:010
58639955,0cyclictest8630-21netstat21:46:292
58639955,0cyclictest0-21swapper/223:01:122
58639955,0cyclictest0-21swapper/222:53:482
58639955,0cyclictest0-21swapper/222:26:032
58639954,0cyclictest7843-21awk00:11:242
58639950,0cyclictest0-21swapper/221:43:382
58639950,0cyclictest0-21swapper/220:47:022
58629955,0cyclictest0-21swapper/122:42:221
58629955,0cyclictest0-21swapper/121:10:081
58629954,0cyclictest23442-21tr19:21:271
58629950,0cyclictest0-21swapper/123:37:131
58629950,0cyclictest0-21swapper/121:52:421
58629950,0cyclictest0-21swapper/121:35:401
58619955,0cyclictest3989-21diskmemload23:21:190
5520250,0sleep08255-21kthreadcore20:46:260
339950,0migration/39344-21kthreadcore18:46:273
339950,0migration/34026-21kthreadcore19:06:273
339950,0migration/329665-21kthreadcore23:21:263
339950,0migration/328873-21kthreadcore19:26:263
339950,0migration/328829-21munin-node19:51:263
339950,0migration/328634-21irqrtprio21:41:273
339950,0migration/328291-21munin-node20:11:323
339950,0migration/325497-21taskset18:57:343
339950,0migration/325079-21taskset21:16:273
339950,0migration/320728-21irqrtprio21:36:263
339950,0migration/317618-21kthreadcore19:41:283
339950,0migration/316734-21kthreadcore20:51:283
339950,0migration/316312-21timerandwakeup22:11:323
339950,0migration/310271-21irqcore22:51:263
29725050,0irq/27-eth0-tx-6690-21load22:46:282
29725050,0irq/27-eth0-tx-5151-21ssh00:06:352
29725050,0irq/27-eth0-tx-17488-21ssh22:14:232
29725050,0irq/27-eth0-tx-0-21swapper/223:52:462
29725050,0irq/27-eth0-tx-0-21swapper/223:48:292
29725050,0irq/27-eth0-tx-0-21swapper/223:12:562
29725050,0irq/27-eth0-tx-0-21swapper/221:59:182
29725050,0irq/27-eth0-tx-0-21swapper/221:38:522
29725050,0irq/27-eth0-tx-0-21swapper/020:45:500
29725050,0irq/27-eth0-tx-0-21swapper/020:36:190
29725050,0irq/27-eth0-tx-0-21swapper/020:21:240
29725050,0irq/27-eth0-tx-0-21swapper/020:01:210
29715050,0irq/26-eth0-rx-6559-21runrttasks23:35:353
29715050,0irq/26-eth0-rx-5046-21grep00:06:323
29715050,0irq/26-eth0-rx-32534-21munin-node23:26:223
29715050,0irq/26-eth0-rx-29450-21sed21:01:253
29715050,0irq/26-eth0-rx-25691-21needreboot20:56:293
29715050,0irq/26-eth0-rx-17539-21needreboot21:11:293
29715050,0irq/26-eth0-rx-16630-21iostat_ios20:06:263
29715050,0irq/26-eth0-rx-16591-21ntp_offset21:51:303
29715050,0irq/26-eth0-rx-15941-21ssh23:14:543
29715050,0irq/26-eth0-rx-11078-21cut19:11:263
29715050,0irq/26-eth0-rx-0-21swapper/323:58:033
29715050,0irq/26-eth0-rx-0-21swapper/323:55:193
29715050,0irq/26-eth0-rx-0-21swapper/323:41:273
29715050,0irq/26-eth0-rx-0-21swapper/323:01:203
29715050,0irq/26-eth0-rx-0-21swapper/322:41:473
29715050,0irq/26-eth0-rx-0-21swapper/322:36:313
29715050,0irq/26-eth0-rx-0-21swapper/322:26:263
29715050,0irq/26-eth0-rx-0-21swapper/322:16:223
29715050,0irq/26-eth0-rx-0-21swapper/322:01:263
29715050,0irq/26-eth0-rx-0-21swapper/321:57:093
29715050,0irq/26-eth0-rx-0-21swapper/321:24:213
29715050,0irq/26-eth0-rx-0-21swapper/320:47:583
259950,0migration/29562-21fschecks_time20:01:232
259950,0migration/28688-21runrttasks22:06:422
259950,0migration/26202-21kthreadcore21:06:312
259950,0migration/228453-21kthreadcore22:41:272
259950,0migration/22661-21sh21:24:342
259950,0migration/224255-21sh23:20:582
259950,0migration/222723-21kthreadcore22:36:272
259950,0migration/22123-21kthreadcore19:06:262
259950,0migration/21917-21kernelversion23:06:262
259950,0migration/218868-21sh21:35:132
259950,0migration/21521-21unixbench_singl19:51:342
259950,0migration/212354-21kthreadcore19:36:272
259950,0migration/210909-21kthreadcore23:31:252
179950,0migration/18279-21kthreadcore18:46:261
179950,0migration/15392-21kthreadcore23:06:271
179950,0migration/123691-21latency22:16:261
179950,0migration/118300-21kthreadcore19:16:271
179950,0migration/117758-21kthreadcore23:56:261
179950,0migration/114398-21kthreadcore20:26:281
179950,0migration/11251-21kthreadcore00:06:251
169950,0watchdog/117499-21cat20:51:281
149950,0migration/09945-21irqrtprio23:11:250
149950,0migration/09709-21kthreadcore19:36:260
149950,0migration/0923-21taskset22:46:090
149950,0migration/08852-21kthreadcore19:11:250
149950,0migration/05194-21kthreadcore21:26:270
149950,0migration/04273-21kthreadcore22:06:250
149950,0migration/027891-21kthreadcore22:21:250
149950,0migration/027806-21idleruntime19:26:240
149950,0migration/026120-21taskset21:38:000
149950,0migration/026036-21taskset19:01:120
149950,0migration/025776-21taskset21:58:350
149950,0migration/024766-21kthreadcore20:11:250
149950,0migration/020839-21fschecks_count19:21:230
149950,0migration/020592-21kthreadcore20:06:290
149950,0migration/020489-21kthreadcore22:36:260
149950,0migration/020217-21kthreadcore22:16:250
149950,0migration/020115-21aten_r1power_po21:16:200
149950,0migration/019643-21kthreadcore20:31:270
149950,0migration/019332-21taskset21:14:580
149950,0migration/017861-21kthreadcore19:16:270
149950,0migration/017532-21missed_timers20:51:290
149950,0migration/016384-21sh22:54:330
149950,0migration/015620-21kthreadcore22:11:270
149950,0migration/012945-21kthreadcore23:31:260
149950,0migration/010414-21taskset21:07:050
58639943,0cyclictest972-21awk23:26:232
58639943,0cyclictest3514-21snmpd20:30:512
58639943,0cyclictest3514-21snmpd20:15:062
58639943,0cyclictest3514-21snmpd19:42:062
58639943,0cyclictest3514-21snmpd19:36:062
58639943,0cyclictest27902-21awk19:26:252
58639943,0cyclictest2778-21awk22:26:252
58639943,0cyclictest24191-21awk20:36:242
58639943,0cyclictest21230-21awk19:21:242
58639943,0cyclictest16403-21awk23:56:242
58639940,0cyclictest0-21swapper/220:00:032
58629944,0cyclictest0-21swapper/123:49:411
58629944,0cyclictest0-21swapper/121:28:531
58629944,0cyclictest0-21swapper/121:22:441
58629944,0cyclictest0-21swapper/120:01:231
58629943,0cyclictest9614-21awk23:11:241
58629943,0cyclictest3556-21lldpd23:16:361
58629943,0cyclictest3556-21lldpd22:37:361
58629943,0cyclictest3556-21lldpd22:01:361
58629943,0cyclictest3556-21lldpd21:42:361
58629943,0cyclictest3556-21lldpd21:13:051
58629943,0cyclictest3556-21lldpd21:02:051
58629943,0cyclictest3556-21lldpd20:15:351
58629943,0cyclictest3556-21lldpd19:54:341
58629943,0cyclictest3556-21lldpd19:10:341
58629943,0cyclictest27000-21awk19:01:221
58629943,0cyclictest17450-21awk20:31:241
58629940,0cyclictest0-21swapper/119:00:321
58619943,0cyclictest3241-21irqbalance23:16:180
58619943,0cyclictest3241-21irqbalance21:51:580
58619943,0cyclictest3241-21irqbalance21:50:180
58619943,0cyclictest3241-21irqbalance00:15:380
58619943,0cyclictest3071-21awk19:56:250
58619943,0cyclictest29800-21awk20:16:250
58619943,0cyclictest24823-21awk23:41:240
58619943,0cyclictest21362-21kworker/0:019:49:060
58619943,0cyclictest21179-21awk20:56:250
58619943,0cyclictest10772-21awk20:26:250
339940,0migration/329408-21fschecks_count20:16:233
339940,0migration/326914-21fschecks_time22:21:223
339940,0migration/325989-21sendmail_mailtr19:21:313
339940,0migration/318972-21kthreadcore22:56:273
339940,0migration/317166-21kthreadcore19:16:273
339940,0migration/312511-21kthreadcore19:36:273
29725040,0irq/27-eth0-tx-0-21swapper/223:36:232
29725040,0irq/27-eth0-tx-0-21swapper/222:57:212
29725040,0irq/27-eth0-tx-0-21swapper/222:01:242
29725040,0irq/27-eth0-tx-0-21swapper/221:51:182
29725040,0irq/27-eth0-tx-0-21swapper/221:26:212
29725040,0irq/27-eth0-tx-0-21swapper/221:17:222
29725040,0irq/27-eth0-tx-0-21swapper/221:02:062
29725040,0irq/27-eth0-tx-0-21swapper/220:51:112
29725040,0irq/27-eth0-tx-0-21swapper/019:31:220
29725040,0irq/27-eth0-tx-0-21swapper/019:06:260
29725040,0irq/27-eth0-tx-0-21swapper/018:56:250
29725040,0irq/27-eth0-tx-0-21swapper/018:46:330
29715040,0irq/26-eth0-rx-0-21swapper/323:48:283
29715040,0irq/26-eth0-rx-0-21swapper/322:47:383
29715040,0irq/26-eth0-rx-0-21swapper/320:31:283
29715040,0irq/26-eth0-rx-0-21swapper/300:11:393
259940,0migration/27847-21idleruntime19:11:232
259940,0migration/2783-21kthreadcore20:41:262
259940,0migration/228278-21kthreadcore23:41:272
259940,0migration/224197-21kthreadcore19:46:252
259940,0migration/224126-21fschecks_time00:01:222
259940,0migration/221480-21kthreadcore18:56:262
259940,0migration/220254-21kthreadcore22:16:252
259940,0migration/217696-21kthreadcore19:16:272
259940,0migration/210628-21kthreadcore18:46:272
249940,0watchdog/225586-21if_eth1.323:21:242
249940,0watchdog/222437-21cat20:31:322
249940,0watchdog/20-21swapper/222:31:242
249940,0watchdog/20-21swapper/221:11:282
249940,0watchdog/20-21swapper/220:56:162
179940,0migration/19988-21sendmail_mailtr20:46:301
179940,0migration/19688-21kthreadcore23:51:251
179940,0migration/19585-21taskset20:25:181
179940,0migration/18875-21munin-node21:46:311
179940,0migration/15985-21kthreadcore22:26:271
179940,0migration/14438-21kthreadcore19:56:271
179940,0migration/1424-21kthreadcore20:16:281
179940,0migration/128625-21kthreadcore00:01:261
179940,0migration/12830-21fschecks_count22:06:221
179940,0migration/126896-21kthreadcore23:01:251
179940,0migration/12612-21kthreadcore19:31:261
179940,0migration/123954-21kthreadcore21:16:261
179940,0migration/123283-21kthreadcore20:56:271
179940,0migration/122115-21kthreadcore22:56:281
179940,0migration/115255-21kthreadcore22:11:271
179940,0migration/114188-21kthreadcore18:51:271
179940,0migration/113865-21kthreadcore22:31:241
169940,0watchdog/19888-21perl22:51:241
169940,0watchdog/18183-21chrt22:48:481
169940,0watchdog/18089-21sed19:11:251
169940,0watchdog/17562-21ssh23:30:161
169940,0watchdog/1443-21unixbench_multi19:26:331
169940,0watchdog/125682-21ssh21:36:441
169940,0watchdog/125588-21if_eth1.323:21:241
169940,0watchdog/124329-21latency21:56:281
169940,0watchdog/10-21swapper/123:42:481
169940,0watchdog/10-21swapper/123:31:201
169940,0watchdog/10-21swapper/120:06:281
149940,0migration/07587-21sendmail_mailqu22:26:300
149940,0migration/019955-21kthreadcore23:56:260
149940,0migration/01882-21fschecks_time22:46:230
149940,0migration/018248-21irqcore22:56:260
149940,0migration/014076-21kthreadcore18:51:270
58639930,0cyclictest0-21swapper/218:51:282
58629932,0cyclictest3514-21snmpd19:40:381
58629932,0cyclictest30885-21awk20:41:241
58629932,0cyclictest22310-21irqcore19:46:241
58629930,0cyclictest27053-21hddtemp_smartct22:21:231
58629930,0cyclictest15344-21perl19:41:241
58619933,0cyclictest8326-21kworker/0:200:06:110
58619933,0cyclictest8326-21kworker/0:200:01:110
58619933,0cyclictest21362-21kworker/0:023:36:210
58619933,0cyclictest21362-21kworker/0:023:26:130
58619933,0cyclictest21362-21kworker/0:023:01:130
58619933,0cyclictest21362-21kworker/0:022:31:130
58619933,0cyclictest21362-21kworker/0:022:01:150
58619933,0cyclictest21362-21kworker/0:021:31:150
58619933,0cyclictest21362-21kworker/0:019:51:120
58619933,0cyclictest21362-21kworker/0:019:41:140
29715030,0irq/26-eth0-rx-0-21swapper/320:41:273
29715030,0irq/26-eth0-rx-0-21swapper/320:36:193
29715030,0irq/26-eth0-rx-0-21swapper/320:26:003
29715030,0irq/26-eth0-rx-0-21swapper/320:01:203
29715030,0irq/26-eth0-rx-0-21swapper/319:46:303
29715030,0irq/26-eth0-rx-0-21swapper/319:31:303
29715030,0irq/26-eth0-rx-0-21swapper/319:01:433
29715030,0irq/26-eth0-rx-0-21swapper/318:51:223
249930,0watchdog/20-21swapper/220:16:242
249930,0watchdog/20-21swapper/219:01:252
169930,0watchdog/10-21swapper/120:36:241
29715020,0irq/26-eth0-rx-0-21swapper/320:27:043
249920,0watchdog/20-21swapper/220:21:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional