You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-19 - 11:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Fri Jun 19, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450530,0irq/25-eth10-21swapper/318:51:003
304450530,0irq/25-eth10-21swapper/318:51:003
2327124435,0sleep10-21swapper/118:50:101
2327124435,0sleep10-21swapper/118:50:101
2311423728,0sleep20-21swapper/218:48:232
2311423728,0sleep20-21swapper/218:48:232
2323923422,0sleep00-21swapper/018:49:490
2323923422,0sleep00-21swapper/018:49:490
235229983,0cyclictest3514-21snmpd22:04:500
235229983,0cyclictest23140-21awk21:12:320
27170,0ktimersoftd/213797-21gltestperf23:47:312
235229973,0cyclictest13219-21awk19:32:300
235229972,0cyclictest32176-21awk19:22:310
235229972,0cyclictest30249-21awk23:37:320
235229972,0cyclictest29673-21awk00:17:310
235229972,0cyclictest1806-21awk20:12:320
235229972,0cyclictest12307-21awk19:07:320
235229970,0cyclictest3546-21diskmemload22:58:280
339960,0migration/328803-21sh21:13:483
339960,0migration/328269-21sh21:53:043
339960,0migration/319758-21sh00:10:223
339960,0migration/313623-21munin-node23:27:293
339960,0migration/313551-21cpuspeed_turbos23:07:283
339960,0migration/311209-21sh00:03:433
29715060,0irq/26-eth0-rx-28898-21ssh21:34:183
29715060,0irq/26-eth0-rx-26354-21gltestperf19:42:293
235249966,0cyclictest21662-21diskmemload23:39:192
235239960,0cyclictest18614-21kthreadcore21:27:341
235229964,0cyclictest0-21swapper/000:03:380
235229962,0cyclictest7582-21sensors20:37:390
235229962,0cyclictest3514-21snmpd22:27:240
235229962,0cyclictest3232-21sensors22:17:390
235229962,0cyclictest13354-21idleruntime-cro22:27:160
235229960,0cyclictest27440-21ssh20:52:380
235229960,0cyclictest13324-21munin-node19:57:340
235229960,0cyclictest11310-21sed21:42:340
235229960,0cyclictest0-21swapper/019:42:280
235229960,0cyclictest0-21swapper/019:12:280
235229960,0cyclictest0-21swapper/019:02:290
8215050,0irq/24-0000:00:25417-21ls19:42:172
339950,0migration/3691-21kthreadcore21:37:343
339950,0migration/36295-21fschecks_time21:02:293
339950,0migration/34535-21sh22:40:483
339950,0migration/33634-21pmu-power21:17:373
339950,0migration/33243-21pmu-power21:57:373
339950,0migration/331442-21kthreadcore23:17:343
339950,0migration/328408-21munin-node20:32:323
339950,0migration/326821-21munin-node23:32:363
339950,0migration/32547-21kthreadcore19:47:343
339950,0migration/322084-21irqrtprio20:27:343
339950,0migration/321361-21kthreadcore19:12:333
339950,0migration/320061-21sh22:28:323
339950,0migration/317016-21kthreadcore22:07:333
339950,0migration/315127-21kthreadcore22:47:343
339950,0migration/313721-21taskset21:26:533
339950,0migration/313528-21irqrtprio19:32:323
29725050,0irq/27-eth0-tx-5171-21munin-node23:02:382
29725050,0irq/27-eth0-tx-5139-21munin-node23:22:392
29725050,0irq/27-eth0-tx-4736-21munin-node00:02:312
29725050,0irq/27-eth0-tx-3514-21snmpd23:44:332
29725050,0irq/27-eth0-tx-30227-21munin-node21:37:352
29725050,0irq/27-eth0-tx-29524-21ssh21:56:402
29725050,0irq/27-eth0-tx-21344-21munin-node23:12:292
29725050,0irq/27-eth0-tx-19789-21ssh22:48:262
29725050,0irq/27-eth0-tx-0-21swapper/223:58:502
29725050,0irq/27-eth0-tx-0-21swapper/223:00:322
29725050,0irq/27-eth0-tx-0-21swapper/222:39:502
29725050,0irq/27-eth0-tx-0-21swapper/222:13:492
29725050,0irq/27-eth0-tx-0-21swapper/220:57:322
29715050,0irq/26-eth0-rx-8055-21cat21:42:333
29715050,0irq/26-eth0-rx-7525-21cut23:22:343
29715050,0irq/26-eth0-rx-3726-21ssh00:00:113
29715050,0irq/26-eth0-rx-29137-21forks00:17:293
29715050,0irq/26-eth0-rx-26551-21switchtime00:12:383
29715050,0irq/26-eth0-rx-23758-21kthreadcore22:32:343
29715050,0irq/26-eth0-rx-20948-21iostat20:02:313
29715050,0irq/26-eth0-rx-19726-21python21:47:383
29715050,0irq/26-eth0-rx-14033-21cut21:07:293
29715050,0irq/26-eth0-rx-11268-21netstat22:02:363
29715050,0irq/26-eth0-rx-11195-21kthreadcore20:17:343
29715050,0irq/26-eth0-rx-0-21swapper/323:51:403
29715050,0irq/26-eth0-rx-0-21swapper/323:43:353
29715050,0irq/26-eth0-rx-0-21swapper/323:41:423
29715050,0irq/26-eth0-rx-0-21swapper/323:16:013
29715050,0irq/26-eth0-rx-0-21swapper/323:07:123
29715050,0irq/26-eth0-rx-0-21swapper/322:53:443
29715050,0irq/26-eth0-rx-0-21swapper/322:43:143
29715050,0irq/26-eth0-rx-0-21swapper/321:31:323
29715050,0irq/26-eth0-rx-0-21swapper/321:01:063
29715050,0irq/26-eth0-rx-0-21swapper/320:22:353
27150,0ktimersoftd/20-21swapper/221:23:032
259950,0migration/232519-21unixbench_multi20:07:402
259950,0migration/232348-21aten_r1power_cu19:47:282
259950,0migration/227615-21kthreadcore19:17:332
259950,0migration/225773-21timerwakeupswit20:02:382
259950,0migration/223734-21kthreadcore23:52:332
259950,0migration/22301-21unixbench-2d00:17:392
259950,0migration/222290-21aten_r1power_fr21:12:282
259950,0migration/219607-21switchtime22:07:382
259950,0migration/217423-21kthreadcore23:27:352
235249955,0cyclictest21662-21diskmemload21:06:322
235249955,0cyclictest0-21swapper/222:02:212
235249950,0cyclictest0-21swapper/222:54:232
235249950,0cyclictest0-21swapper/222:30:152
235249950,0cyclictest0-21swapper/221:21:222
235239955,0cyclictest21662-21diskmemload21:33:061
235239955,0cyclictest0-21swapper/122:00:411
235239955,0cyclictest0-21swapper/120:59:591
235239950,0cyclictest0-21swapper/121:44:081
235239950,0cyclictest0-21swapper/121:14:481
235229955,0cyclictest0-21swapper/022:46:320
235229955,0cyclictest0-21swapper/022:00:210
235229955,0cyclictest0-21swapper/020:59:200
235229953,0cyclictest0-21swapper/023:04:490
235229950,0cyclictest0-21swapper/023:54:390
235229950,0cyclictest0-21swapper/023:28:000
19150,0ktimersoftd/10-21swapper/123:29:551
179950,0migration/19718-21irqcore20:42:331
179950,0migration/129440-21latency_hist22:37:161
179950,0migration/119641-21sh23:49:031
179950,0migration/110842-21munin-node23:42:441
8215040,0irq/24-0000:00:30127-21dump-pmu-power19:02:132
8215040,0irq/24-0000:00:0-21swapper/219:52:372
339940,0migration/35757-21cpuspeed_turbos22:22:283
339940,0migration/332286-21if_eth1.219:22:323
339940,0migration/331961-21missed_timers20:07:353
339940,0migration/326755-21kthreadcore22:12:353
339940,0migration/31918-21kthreadcore22:17:353
339940,0migration/315901-21kthreadcore19:57:333
339940,0migration/311631-21kthreadcore20:42:343
29725040,0irq/27-eth0-tx-6261-21df_abs21:42:282
29725040,0irq/27-eth0-tx-5388-21aten2.4-expect22:42:262
29725040,0irq/27-eth0-tx-20189-21ssh21:07:442
29725040,0irq/27-eth0-tx-0-21swapper/223:32:282
29725040,0irq/27-eth0-tx-0-21swapper/223:17:202
29725040,0irq/27-eth0-tx-0-21swapper/223:07:212
29725040,0irq/27-eth0-tx-0-21swapper/222:17:232
29715040,0irq/26-eth0-rx-0-21swapper/323:52:353
29715040,0irq/26-eth0-rx-0-21swapper/322:58:523
29715040,0irq/26-eth0-rx-0-21swapper/320:54:293
29715040,0irq/26-eth0-rx-0-21swapper/319:52:273
29715040,0irq/26-eth0-rx-0-21swapper/318:57:363
29715040,0irq/26-eth0-rx-0-21swapper/318:52:333
259940,0migration/27884-21unixbench_singl20:37:402
259940,0migration/27153-21runrttasks20:15:062
259940,0migration/25584-21aten_r1power_en22:22:272
259940,0migration/23683-21kthreadcore19:22:342
259940,0migration/221898-21runrttasks20:52:252
259940,0migration/217607-21latency19:32:332
259940,0migration/216876-21kthreadcore21:27:342
259940,0migration/215286-21kthreadcore19:07:342
259940,0migration/21474-21runrttasks20:35:552
249940,0watchdog/229978-21ssh21:57:192
249940,0watchdog/214063-21kthreadcore00:07:342
249940,0watchdog/214037-21ssh21:47:272
235249944,0cyclictest0-21swapper/219:57:292
235249943,0cyclictest9470-21awk20:42:322
235249943,0cyclictest6545-21awk19:27:302
235249943,0cyclictest5591-21awk19:02:302
235249943,0cyclictest3556-21lldpd20:29:222
235249943,0cyclictest24583-21awk18:52:312
235249943,0cyclictest23143-21awk21:32:302
235249943,0cyclictest22627-21awk22:32:322
235249943,0cyclictest21606-21awk00:12:302
235249943,0cyclictest16139-21awk20:47:322
235239944,0cyclictest0-21swapper/122:39:191
235239943,0cyclictest6042-21awk23:02:311
235239943,0cyclictest3556-21lldpd23:32:211
235239943,0cyclictest3556-21lldpd23:07:211
235239943,0cyclictest3556-21lldpd22:22:211
235239943,0cyclictest3556-21lldpd21:37:511
235239943,0cyclictest3556-21lldpd21:19:511
235239943,0cyclictest3556-21lldpd20:32:521
235239943,0cyclictest31286-21awk18:57:311
235239943,0cyclictest22692-21awk22:12:321
235239943,0cyclictest22306-21awk22:52:311
235229944,0cyclictest0-21swapper/023:26:160
235229944,0cyclictest0-21swapper/023:13:490
235229944,0cyclictest0-21swapper/022:41:010
235229943,0cyclictest3514-21snmpd23:36:050
235229943,0cyclictest3514-21snmpd21:35:350
235229943,0cyclictest3514-21snmpd20:32:200
235229943,0cyclictest3514-21snmpd18:56:490
235229943,0cyclictest3241-21irqbalance23:43:350
235229943,0cyclictest3241-21irqbalance22:35:550
235229943,0cyclictest3241-21irqbalance22:12:450
235229943,0cyclictest3241-21irqbalance22:08:150
235229943,0cyclictest3241-21irqbalance21:47:450
235229943,0cyclictest3241-21irqbalance21:21:250
235229943,0cyclictest3241-21irqbalance21:08:050
235229943,0cyclictest3241-21irqbalance20:47:250
235229943,0cyclictest3241-21irqbalance20:43:450
235229943,0cyclictest3241-21irqbalance20:28:150
235229943,0cyclictest3241-21irqbalance20:17:350
235229943,0cyclictest3241-21irqbalance20:07:350
235229943,0cyclictest3241-21irqbalance20:03:350
235229943,0cyclictest3241-21irqbalance19:52:250
235229943,0cyclictest3241-21irqbalance19:48:450
235229943,0cyclictest3241-21irqbalance19:37:260
235229943,0cyclictest31109-21awk21:37:310
235229943,0cyclictest14427-21awk22:47:330
235229943,0cyclictest14233-21munin-node20:22:330
235229943,0cyclictest13685-21awk00:07:330
235229943,0cyclictest0-21swapper/021:28:580
235229941,0cyclictest0-21swapper/019:27:270
179940,0migration/17663-21kthreadcore19:02:321
179940,0migration/17131-21fschecks_count19:52:291
179940,0migration/16303-21munin-node21:22:281
179940,0migration/16269-21fschecks_time21:02:291
179940,0migration/14700-21turbostat23:42:161
179940,0migration/131062-21kthreadcore22:57:331
179940,0migration/129954-21aten_r1power_fr22:17:291
179940,0migration/128489-21kthreadcore19:17:341
179940,0migration/128131-21sh23:55:171
179940,0migration/127923-21kthreadcore18:52:341
179940,0migration/125925-21kthreadcore20:27:351
179940,0migration/125240-21kthreadcore00:12:331
179940,0migration/122663-21fschecks_time21:52:301
179940,0migration/117606-21taskset19:10:291
179940,0migration/116302-21kthreadcore21:07:351
179940,0migration/116086-21kthreadcore19:57:331
179940,0migration/114466-21runrttasks22:27:301
179940,0migration/110798-21kthreadcore19:27:331
169940,0watchdog/1956-21kthreadcore23:17:341
169940,0watchdog/16559-21runrttasks19:22:311
169940,0watchdog/13492-21ssh00:20:381
169940,0watchdog/128100-21ssh23:14:181
169940,0watchdog/120057-21kthreadcore20:47:351
169940,0watchdog/114454-21awk20:22:271
169940,0watchdog/10-21swapper/123:57:341
169940,0watchdog/10-21swapper/123:22:341
169940,0watchdog/10-21swapper/100:07:341
339930,0migration/310804-21runrttasks19:03:433
29715030,0irq/26-eth0-rx-0-21swapper/320:49:593
29715030,0irq/26-eth0-rx-0-21swapper/320:12:283
29715030,0irq/26-eth0-rx-0-21swapper/319:37:273
29715030,0irq/26-eth0-rx-0-21swapper/319:20:183
29715030,0irq/26-eth0-rx-0-21swapper/319:07:253
235249933,0cyclictest3556-21lldpd20:17:522
235249933,0cyclictest3556-21lldpd19:12:222
235249932,0cyclictest15349-21cut20:22:312
235249930,0cyclictest25562-21ls19:42:172
235239933,0cyclictest3556-21lldpd19:35:521
235239932,0cyclictest925-21irqcore19:47:331
235239932,0cyclictest7588-21sensors20:37:391
235239932,0cyclictest3556-21lldpd22:02:221
235239932,0cyclictest3556-21lldpd19:42:521
235239932,0cyclictest3556-21lldpd19:13:221
235239932,0cyclictest3514-21snmpd22:07:211
235239932,0cyclictest22880-21awk20:52:331
235239932,0cyclictest11333-21sort22:42:391
235239931,0cyclictest5477-21gltestperf00:02:301
235239930,0cyclictest11897-21grep20:17:341
235229933,0cyclictest0-21swapper/021:03:070
235229932,0cyclictest6559-21runrttasks23:10:410
235229932,0cyclictest6067-21munin-node21:22:300
235229932,0cyclictest3556-21lldpd23:20:510
235229932,0cyclictest3241-21irqbalance23:57:240
235229932,0cyclictest31334-21awk18:57:320
235229932,0cyclictest22847-21awk21:52:310
235229932,0cyclictest21576-21awk00:12:290
235229932,0cyclictest13936-21awk23:47:320
179930,0migration/124999-21kthreadcore20:02:331
169930,0watchdog/115552-21grep22:47:351
169930,0watchdog/10-21swapper/121:47:271
169930,0watchdog/10-21swapper/120:12:311
169930,0watchdog/10-21swapper/120:07:191
329920,0watchdog/38413-21grep19:27:323
29715020,0irq/26-eth0-rx-0-21swapper/320:37:563
235239921,0cyclictest18916-21latency_hist19:37:171
235229921,0cyclictest24991-21cpuspeed_turbos19:17:280
235229920,0cyclictest0-21swapper/022:52:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional