You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-19 - 07:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun Jul 19, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450640,0irq/25-eth10-21swapper/318:44:493
1587123827,0sleep10-21swapper/118:44:481
1648423323,0sleep20-21swapper/218:48:252
1622422622,0sleep00-21swapper/018:45:230
8215060,0irq/24-0000:00:26242-21sadc23:49:232
339960,0migration/331814-21sh23:30:493
339960,0migration/331370-21sh23:12:523
339960,0migration/327797-21sh22:13:353
339960,0migration/318315-21latency22:24:433
339960,0migration/318315-21latency22:24:433
339960,0migration/315817-21sh23:22:413
29715060,0irq/26-eth0-rx-26866-21df23:49:363
29715060,0irq/26-eth0-rx-11282-21if_eth021:44:383
166419960,0cyclictest0-21swapper/121:57:171
166409966,0cyclictest0-21swapper/023:12:470
166409960,0cyclictest0-21swapper/021:39:370
149960,0migration/022509-21sh21:10:050
149960,0migration/022155-21sh23:05:590
149960,0migration/011399-21sh00:18:060
8215050,0irq/24-0000:00:0-21swapper/220:19:242
339950,0migration/39741-21munin-node19:04:453
339950,0migration/33596-21kthreadcore21:39:403
339950,0migration/332090-21kthreadcore18:59:413
339950,0migration/331066-21latency_hist19:24:253
339950,0migration/328683-21cpuspeed_turbos22:14:363
339950,0migration/327600-21munin-node21:54:343
339950,0migration/327567-21aten2.4-expect20:34:363
339950,0migration/326957-21taskset20:31:573
339950,0migration/323465-21latency_hist18:54:253
339950,0migration/323043-21latency19:14:413
339950,0migration/32139-21kthreadcore20:14:423
339950,0migration/321367-21sh22:29:333
339950,0migration/319113-21munin-node19:39:373
339950,0migration/317674-21kthreadcore20:49:423
339950,0migration/316820-21fschecks_time21:09:383
339950,0migration/316661-21kthreadcore19:34:423
339950,0migration/316515-21missed_timers19:09:433
339950,0migration/316321-21sshd23:40:473
339950,0migration/311669-21taskset19:31:533
339950,0migration/310145-21munin-node22:19:433
29725050,0irq/27-eth0-tx-9902-21cpu23:39:362
29725050,0irq/27-eth0-tx-559-21cut22:14:422
29725050,0irq/27-eth0-tx-5157-21fschecks_time22:19:362
29725050,0irq/27-eth0-tx-32048-21ssh23:31:222
29725050,0irq/27-eth0-tx-31546-21cut00:09:402
29725050,0irq/27-eth0-tx-29733-21ssh20:55:252
29725050,0irq/27-eth0-tx-21708-21df22:29:372
29725050,0irq/27-eth0-tx-18769-21munin-node21:49:382
29725050,0irq/27-eth0-tx-18095-21ssh00:02:012
29725050,0irq/27-eth0-tx-17562-21fschecks_time23:24:382
29725050,0irq/27-eth0-tx-14899-21diskmemload21:32:382
29725050,0irq/27-eth0-tx-13507-21kthreadcore21:44:412
29725050,0irq/27-eth0-tx-13493-21grep22:24:382
29725050,0irq/27-eth0-tx-13493-21grep22:24:382
29725050,0irq/27-eth0-tx-13442-21ssh23:00:092
29725050,0irq/27-eth0-tx-12754-21kthreadcore21:24:442
29725050,0irq/27-eth0-tx-12126-21munin-node19:34:410
29725050,0irq/27-eth0-tx-0-21swapper/223:54:412
29725050,0irq/27-eth0-tx-0-21swapper/222:04:502
29725050,0irq/27-eth0-tx-0-21swapper/221:34:352
29725050,0irq/27-eth0-tx-0-21swapper/221:22:182
29725050,0irq/27-eth0-tx-0-21swapper/221:12:342
29725050,0irq/27-eth0-tx-0-21swapper/221:02:162
29725050,0irq/27-eth0-tx-0-21swapper/020:25:490
29725050,0irq/27-eth0-tx-0-21swapper/019:08:500
29725050,0irq/27-eth0-tx-0-21swapper/018:59:400
29715050,0irq/26-eth0-rx-6424-21python21:19:433
29715050,0irq/26-eth0-rx-6353-21kthreadcore23:34:423
29715050,0irq/26-eth0-rx-6088-21grep21:59:433
29715050,0irq/26-eth0-rx-32253-21ssh23:14:273
29715050,0irq/26-eth0-rx-28816-21tr21:14:423
29715050,0irq/26-eth0-rx-26229-21munin-node19:44:393
29715050,0irq/26-eth0-rx-26154-21ps23:49:113
29715050,0irq/26-eth0-rx-26140-21runrttasks21:52:373
29715050,0irq/26-eth0-rx-25183-21munin-node00:04:473
29715050,0irq/26-eth0-rx-25117-21cat22:49:403
29715050,0irq/26-eth0-rx-24338-21iostat20:54:433
29715050,0irq/26-eth0-rx-22631-21python23:24:473
29715050,0irq/26-eth0-rx-18155-21ssh00:02:093
29715050,0irq/26-eth0-rx-0-21swapper/322:54:423
29715050,0irq/26-eth0-rx-0-21swapper/322:34:283
29715050,0irq/26-eth0-rx-0-21swapper/322:04:413
29715050,0irq/26-eth0-rx-0-21swapper/321:34:413
29715050,0irq/26-eth0-rx-0-21swapper/321:24:443
29715050,0irq/26-eth0-rx-0-21swapper/321:06:343
29715050,0irq/26-eth0-rx-0-21swapper/321:01:033
29715050,0irq/26-eth0-rx-0-21swapper/300:16:503
259950,0migration/27918-21timerwakeupswit21:39:472
259950,0migration/26638-21taskset22:59:002
259950,0migration/24867-21taskset19:25:362
259950,0migration/23929-21fschecks_time21:59:392
259950,0migration/224570-21fschecks_time23:09:382
259950,0migration/221759-21sh20:51:162
259950,0migration/21955-21kthreadcore18:59:422
259950,0migration/214250-21sh22:44:312
249950,0watchdog/225448-21idleruntime21:14:382
179950,0migration/122193-21sh23:24:431
179950,0migration/119355-21kthreadcore21:29:411
179950,0migration/119145-21latency_hist00:04:231
179950,0migration/115808-21cpuspeed_turbos23:04:361
179950,0migration/110279-21runrttasks22:19:441
166419954,0cyclictest3241-21irqbalance20:47:231
166419950,0cyclictest0-21swapper/121:27:391
166409955,0cyclictest0-21swapper/021:24:290
166409955,0cyclictest0-21swapper/000:09:040
166409954,0cyclictest5520-21cut20:39:420
166409953,0cyclictest15947-21kworker/0:123:41:350
166409950,0cyclictest0-21swapper/022:26:360
166409950,0cyclictest0-21swapper/022:26:360
166409950,0cyclictest0-21swapper/022:05:380
166409950,0cyclictest0-21swapper/021:19:540
166409950,0cyclictest0-21swapper/019:39:290
169950,0watchdog/18536-21rm23:37:181
169950,0watchdog/14877-21cut20:14:431
169950,0watchdog/125884-21tr23:09:421
169950,0watchdog/119366-21tr20:49:431
149950,0migration/09976-21kthreadcore21:04:430
149950,0migration/09632-21irqrtprio23:19:410
149950,0migration/09311-21sh23:56:070
149950,0migration/06846-21sh22:39:400
149950,0migration/05344-21timerwakeupswit20:59:470
149950,0migration/04172-21kthreadcore20:14:420
149950,0migration/031037-21sh22:54:300
149950,0migration/028235-21kthreadcore20:09:410
149950,0migration/025588-21kthreadcore18:54:430
149950,0migration/025258-21fschecks_time21:14:380
149950,0migration/025158-21latency_hist23:29:230
149950,0migration/025033-21fschecks_time19:19:370
149950,0migration/023744-21kthreadcore21:49:420
149950,0migration/022686-21kthreadcore20:04:410
149950,0migration/021873-21kthreadcore19:14:410
149950,0migration/02183-21taskset00:11:220
149950,0migration/021352-21taskset20:49:560
149950,0migration/021259-21latency_hist22:29:240
149950,0migration/01591-21kthreadcore19:24:430
149950,0migration/012147-21irqcore23:59:410
149950,0migration/01064-21irqcore23:14:420
339940,0migration/39894-21kthreadcore20:44:413
339940,0migration/315125-21kthreadcore19:59:423
29725040,0irq/27-eth0-tx-3790-21ssh00:14:282
29725040,0irq/27-eth0-tx-0-21swapper/223:50:072
29725040,0irq/27-eth0-tx-0-21swapper/223:19:332
29725040,0irq/27-eth0-tx-0-21swapper/223:15:562
29725040,0irq/27-eth0-tx-0-21swapper/223:04:412
29725040,0irq/27-eth0-tx-0-21swapper/222:50:022
29725040,0irq/27-eth0-tx-0-21swapper/222:34:352
29725040,0irq/27-eth0-tx-0-21swapper/221:54:512
29725040,0irq/27-eth0-tx-0-21swapper/221:06:582
29725040,0irq/27-eth0-tx-0-21swapper/200:05:312
29725040,0irq/27-eth0-tx-0-21swapper/020:19:380
29725040,0irq/27-eth0-tx-0-21swapper/019:49:380
29725040,0irq/27-eth0-tx-0-21swapper/019:09:460
29725040,0irq/27-eth0-tx-0-21swapper/018:49:360
29715040,0irq/26-eth0-rx-15541-21munin-node23:04:383
29715040,0irq/26-eth0-rx-0-21swapper/323:54:373
29715040,0irq/26-eth0-rx-0-21swapper/322:59:483
29715040,0irq/26-eth0-rx-0-21swapper/322:44:573
29715040,0irq/26-eth0-rx-0-21swapper/322:40:043
29715040,0irq/26-eth0-rx-0-21swapper/321:29:323
29715040,0irq/26-eth0-rx-0-21swapper/320:24:353
29715040,0irq/26-eth0-rx-0-21swapper/300:09:403
259940,0migration/28028-21kthreadcore19:29:432
259940,0migration/24292-21kthreadcore20:39:422
259940,0migration/24124-21kthreadcore19:49:442
259940,0migration/232425-21runrttasks20:09:512
259940,0migration/230255-21timerandwakeup19:19:472
259940,0migration/227935-21kthreadcore18:54:432
259940,0migration/225302-21kthreadcore20:29:432
259940,0migration/222027-21kthreadcore20:04:412
259940,0migration/219232-21fschecks_count19:39:382
259940,0migration/218672-21kthreadcore18:49:412
259940,0migration/214827-21runrttasks20:24:372
259940,0migration/214211-21kthreadcore19:34:412
259940,0migration/212697-21runrttasks19:57:352
259940,0migration/211845-21kthreadcore20:19:422
249940,0watchdog/28989-21kthreadcore22:39:422
179940,0migration/19549-21irqcore23:19:401
179940,0migration/19114-21kthreadcore00:14:411
179940,0migration/1771-21kthreadcore19:24:431
179940,0migration/15530-21aten2.4-expect19:29:381
179940,0migration/14301-21irqcore21:59:421
179940,0migration/129135-21fschecks_time22:14:371
179940,0migration/127185-21kthreadcore19:44:411
179940,0migration/126300-21latency_hist20:09:251
179940,0migration/11873-21kthreadcore18:59:421
179940,0migration/118584-21fschecks_count23:44:371
179940,0migration/115661-21timerandwakeup23:39:491
179940,0migration/112895-21taskset22:41:501
179940,0migration/11276-21kthreadcore20:59:411
179940,0migration/111617-21irqrtprio21:44:391
166429943,0cyclictest3241-21irqbalance22:10:022
166429940,0cyclictest14899-21diskmemload23:34:332
166419944,0cyclictest0-21swapper/123:00:111
166419944,0cyclictest0-21swapper/122:24:431
166419944,0cyclictest0-21swapper/122:24:431
166419943,0cyclictest5439-21awk19:04:421
166419943,0cyclictest483-21awk19:49:411
166419943,0cyclictest3556-21lldpd23:49:381
166419943,0cyclictest3556-21lldpd22:11:061
166419943,0cyclictest3556-21lldpd22:05:361
166419943,0cyclictest3556-21lldpd21:37:061
166419943,0cyclictest3556-21lldpd18:51:361
166419943,0cyclictest3514-21snmpd23:15:501
166419943,0cyclictest3514-21snmpd21:04:491
166419943,0cyclictest3514-21snmpd20:54:491
166419943,0cyclictest3241-21irqbalance20:40:431
166419943,0cyclictest3241-21irqbalance20:35:031
166419943,0cyclictest3241-21irqbalance20:33:231
166419943,0cyclictest31937-21awk22:54:401
166419943,0cyclictest30630-21awk22:34:391
166419943,0cyclictest19695-21awk19:39:401
166419943,0cyclictest19658-21awk21:49:391
166419940,0cyclictest0-21swapper/121:18:491
166409944,0cyclictest0-21swapper/022:44:250
166409944,0cyclictest0-21swapper/022:36:220
166409944,0cyclictest0-21swapper/021:59:380
166409943,0cyclictest3514-21snmpd23:50:050
166409943,0cyclictest27410-21munin-node20:34:420
166409943,0cyclictest24955-21sadc23:29:230
169940,0watchdog/1439-21ssh23:33:221
169940,0watchdog/124455-21munin-node19:19:351
169940,0watchdog/122658-21ssh21:10:261
169940,0watchdog/115066-21ssh22:44:381
169940,0watchdog/110176-21ssh23:58:101
169940,0watchdog/10-21swapper/122:49:381
169940,0watchdog/10-21swapper/121:20:021
169940,0watchdog/10-21swapper/100:09:421
169940,0watchdog/10-21swapper/100:04:421
149940,0migration/08239-21kthreadcore22:19:400
149940,0migration/06992-21fschecks_time19:54:360
149940,0migration/05632-21kthreadcore23:34:420
149940,0migration/031122-21kthreadcore22:14:410
149940,0migration/030021-21kthreadcore21:34:420
149940,0migration/027987-21hwlatdetect21:54:360
149940,0migration/027844-21kthreadcore22:49:410
149940,0migration/025813-21df_abs19:44:370
149940,0migration/014321-21diskmemload23:02:150
35130,0ktimersoftd/30-21swapper/320:09:173
29715030,0irq/26-eth0-rx-0-21swapper/320:40:013
29715030,0irq/26-eth0-rx-0-21swapper/320:10:143
29715030,0irq/26-eth0-rx-0-21swapper/319:54:373
29715030,0irq/26-eth0-rx-0-21swapper/319:19:353
166429932,0cyclictest26754-21tail19:44:412
166429930,0cyclictest13921-21ntp_states20:44:452
166429930,0cyclictest0-21swapper/220:38:522
166429930,0cyclictest0-21swapper/219:59:402
166419932,0cyclictest7419-21awk19:54:391
166419932,0cyclictest3556-21lldpd19:15:051
166419932,0cyclictest25378-21sensors20:04:451
166419932,0cyclictest18793-21cat19:59:471
166419932,0cyclictest17789-21sensors19:34:461
166419932,0cyclictest14807-21grep20:24:371
166419932,0cyclictest12015-21awk19:09:401
166419932,0cyclictest10986-21tr20:19:421
166409933,0cyclictest4612-21kworker/0:220:44:260
166409933,0cyclictest4612-21kworker/0:220:29:280
166409933,0cyclictest4612-21kworker/0:219:59:300
166409933,0cyclictest4612-21kworker/0:219:29:280
166409933,0cyclictest15947-21kworker/0:123:44:330
166409933,0cyclictest15947-21kworker/0:122:09:270
166409933,0cyclictest15947-21kworker/0:121:44:360
166409933,0cyclictest15947-21kworker/0:121:29:360
166409933,0cyclictest15947-21kworker/0:120:54:360
169930,0watchdog/10-21swapper/122:29:381
169930,0watchdog/10-21swapper/121:39:381
329920,0watchdog/30-21swapper/318:49:363
29715020,0irq/26-eth0-rx-0-21swapper/320:19:393
29715020,0irq/26-eth0-rx-0-21swapper/319:49:383
249920,0watchdog/20-21swapper/219:14:312
249920,0watchdog/20-21swapper/219:09:272
166429920,0cyclictest0-21swapper/219:04:252
169920,0watchdog/10-21swapper/118:54:271
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional