You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-27 - 10:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Wed May 27, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2266824332,0sleep00-21swapper/018:50:160
2291123632,0sleep10-21swapper/118:53:051
304450350,0irq/25-eth10-21swapper/318:50:253
2281523525,0sleep20-21swapper/218:52:022
230979976,0cyclictest7737-40yum-updatesd-he20:41:480
339960,0migration/34992-21sh21:22:543
339960,0migration/34606-21sh22:23:293
339960,0migration/327975-21sh23:17:473
339960,0migration/327736-21sh22:56:223
339960,0migration/327184-21sh23:56:233
339960,0migration/32334-21sh00:20:383
339960,0migration/319899-21sh23:53:383
339960,0migration/315420-21kthreadcore00:09:423
29725060,0irq/27-eth0-tx-0-21swapper/222:38:492
29715060,0irq/26-eth0-rx-6559-21runrttasks22:49:003
29715060,0irq/26-eth0-rx-20551-21python20:49:513
29715060,0irq/26-eth0-rx-0-21swapper/323:19:453
231009965,0cyclictest12706-21cut19:34:422
231009960,0cyclictest21316-21diskmemload22:39:462
230979965,0cyclictest196762sleep022:09:560
230979965,0cyclictest12593-21ssh21:26:250
230979960,0cyclictest0-21swapper/022:17:590
4150,0ktimersoftd/00-21swapper/022:55:110
4150,0ktimersoftd/00-21swapper/021:16:450
339950,0migration/37376-21kthreadcore19:29:433
339950,0migration/329765-21munin-node19:19:473
339950,0migration/327768-21kthreadcore19:44:453
339950,0migration/327768-21kthreadcore19:44:453
339950,0migration/324855-21kthreadcore21:54:443
339950,0migration/32408-21taskset00:00:183
339950,0migration/321881-21kthreadcore20:04:473
339950,0migration/320010-21taskset23:12:563
339950,0migration/316422-21kthreadcore21:49:433
339950,0migration/314491-21kthreadcore19:59:453
339950,0migration/31113-21fschecks_time20:14:423
29725050,0irq/27-eth0-tx-4786-21ssh23:44:412
29725050,0irq/27-eth0-tx-27598-21munin-node21:14:492
29725050,0irq/27-eth0-tx-19963-21sshd21:49:562
29725050,0irq/27-eth0-tx-12491-21munin-node23:49:452
29725050,0irq/27-eth0-tx-0-21swapper/222:14:392
29725050,0irq/27-eth0-tx-0-21swapper/200:21:282
29725050,0irq/27-eth0-tx-0-21swapper/200:16:032
29715050,0irq/26-eth0-rx-9296-21grep22:24:443
29715050,0irq/26-eth0-rx-5674-21munin-node21:44:403
29715050,0irq/26-eth0-rx-27371-21taskset00:17:313
29715050,0irq/26-eth0-rx-25991-21cut21:14:463
29715050,0irq/26-eth0-rx-20990-21taskset21:12:493
29715050,0irq/26-eth0-rx-0-21swapper/323:48:353
29715050,0irq/26-eth0-rx-0-21swapper/323:37:533
29715050,0irq/26-eth0-rx-0-21swapper/323:31:013
29715050,0irq/26-eth0-rx-0-21swapper/323:24:373
29715050,0irq/26-eth0-rx-0-21swapper/323:04:403
29715050,0irq/26-eth0-rx-0-21swapper/323:02:333
29715050,0irq/26-eth0-rx-0-21swapper/322:39:503
29715050,0irq/26-eth0-rx-0-21swapper/322:37:123
29715050,0irq/26-eth0-rx-0-21swapper/322:14:453
29715050,0irq/26-eth0-rx-0-21swapper/322:13:213
29715050,0irq/26-eth0-rx-0-21swapper/322:08:463
29715050,0irq/26-eth0-rx-0-21swapper/321:42:433
29715050,0irq/26-eth0-rx-0-21swapper/321:29:413
29715050,0irq/26-eth0-rx-0-21swapper/321:24:383
29715050,0irq/26-eth0-rx-0-21swapper/320:59:003
29715050,0irq/26-eth0-rx-0-21swapper/320:44:433
27150,0ktimersoftd/20-21swapper/222:54:542
259950,0migration/23586-21sh23:01:542
259950,0migration/23176-21munin-node18:59:492
259950,0migration/231178-21kthreadcore23:39:442
259950,0migration/229094-21sh21:37:442
259950,0migration/228508-21taskset20:57:082
259950,0migration/22845-21sh23:20:382
259950,0migration/217996-21missed_timers23:29:452
259950,0migration/215201-21kthreadcore23:09:442
259950,0migration/215035-21aten_r1power_vo20:49:402
259950,0migration/21184-21taskset20:38:502
249950,0watchdog/25872-21diskstats22:04:422
231009955,0cyclictest0-21swapper/223:59:422
231009955,0cyclictest0-21swapper/223:15:432
231009955,0cyclictest0-21swapper/223:05:092
231009955,0cyclictest0-21swapper/221:57:312
231009950,0cyclictest0-21swapper/221:49:102
231009950,0cyclictest0-21swapper/221:25:312
230989954,0cyclictest3556-21lldpd00:17:001
230979955,0cyclictest0-21swapper/023:57:460
230979955,0cyclictest0-21swapper/023:12:030
230979955,0cyclictest0-21swapper/021:12:520
230979955,0cyclictest0-21swapper/019:54:400
230979955,0cyclictest0-21swapper/019:39:510
230979950,0cyclictest0-21swapper/021:48:200
230979950,0cyclictest0-21swapper/020:34:050
230979950,0cyclictest0-21swapper/000:13:230
179950,0migration/14107-21sh23:03:241
179950,0migration/131697-21kthreadcore23:39:441
179950,0migration/131267-21kthreadcore20:59:451
179950,0migration/128266-21turbostat23:59:271
179950,0migration/127491-21timerandwakeup20:54:521
179950,0migration/125412-21kthreadcore23:14:441
179950,0migration/116573-21kthreadcore21:29:441
179950,0migration/113451-21taskset21:09:271
179950,0migration/113071-21cpuspeed_turbos23:09:391
179950,0migration/110885-21taskset23:25:241
179950,0migration/110137-21kthreadcore22:44:451
149950,0migration/08239-21kthreadcore23:04:440
149950,0migration/04635-21sh21:42:180
149950,0migration/031649-21kthreadcore21:19:460
149950,0migration/029099-21sh20:58:440
149950,0migration/02863-21timerwakeupswit22:39:500
149950,0migration/02438-21unixbench-2d23:19:510
149950,0migration/013428-21taskset20:22:110
149950,0migration/011765-21sh23:48:140
35140,0ktimersoftd/30-21swapper/319:36:573
339940,0migration/332275-21taskset20:10:213
339940,0migration/330936-21kthreadcore20:34:463
339940,0migration/328432-21kthreadcore18:54:463
339940,0migration/315490-21kthreadcore20:24:453
29725040,0irq/27-eth0-tx-5289-21telnet19:29:370
29725040,0irq/27-eth0-tx-29984-21munin-node21:39:422
29725040,0irq/27-eth0-tx-21047-21forks23:34:412
29725040,0irq/27-eth0-tx-13291-21munin-node22:29:402
29725040,0irq/27-eth0-tx-12344-21telnet00:09:362
29725040,0irq/27-eth0-tx-0-21swapper/223:54:412
29725040,0irq/27-eth0-tx-0-21swapper/223:25:212
29725040,0irq/27-eth0-tx-0-21swapper/222:49:372
29725040,0irq/27-eth0-tx-0-21swapper/222:24:352
29725040,0irq/27-eth0-tx-0-21swapper/222:09:292
29725040,0irq/27-eth0-tx-0-21swapper/221:30:182
29725040,0irq/27-eth0-tx-0-21swapper/221:19:412
29725040,0irq/27-eth0-tx-0-21swapper/221:05:132
29725040,0irq/27-eth0-tx-0-21swapper/200:04:392
29725040,0irq/27-eth0-tx-0-21swapper/020:34:410
29725040,0irq/27-eth0-tx-0-21swapper/019:59:390
29725040,0irq/27-eth0-tx-0-21swapper/019:04:420
29725040,0irq/27-eth0-tx-0-21swapper/018:54:440
29715040,0irq/26-eth0-rx-16178-21kthreadcore22:49:453
29715040,0irq/26-eth0-rx-0-21swapper/323:39:503
29715040,0irq/26-eth0-rx-0-21swapper/322:31:173
29715040,0irq/26-eth0-rx-0-21swapper/322:01:443
29715040,0irq/26-eth0-rx-0-21swapper/321:34:413
29715040,0irq/26-eth0-rx-0-21swapper/321:04:593
29715040,0irq/26-eth0-rx-0-21swapper/320:59:573
29715040,0irq/26-eth0-rx-0-21swapper/300:05:243
259940,0migration/25612-21fschecks_time22:44:402
259940,0migration/23568-21kthreadcore20:39:462
259940,0migration/232050-21timerwakeupswit20:09:512
259940,0migration/231578-21kthreadcore22:19:432
259940,0migration/230876-21latency_hist19:24:292
259940,0migration/230494-21munin-node20:59:432
259940,0migration/221913-21kthreadcore20:29:442
259940,0migration/220681-21kthreadcore19:39:442
259940,0migration/216968-21kthreadcore19:59:452
259940,0migration/216633-21kthreadcore21:09:452
259940,0migration/21283-21kthreadcore19:49:452
249940,0watchdog/20-21swapper/219:29:432
231009943,0cyclictest3556-21lldpd20:25:592
231009943,0cyclictest3556-21lldpd20:08:292
231009943,0cyclictest3556-21lldpd19:57:592
231009943,0cyclictest3514-21snmpd21:59:422
231009943,0cyclictest3514-21snmpd20:45:422
231009943,0cyclictest3514-21snmpd19:25:122
231009943,0cyclictest3514-21snmpd19:10:122
231009943,0cyclictest1309-21awk20:14:432
230989943,0cyclictest6856-21awk21:24:421
230989943,0cyclictest6335-21awk22:04:441
230989943,0cyclictest3556-21lldpd23:31:011
230989943,0cyclictest3556-21lldpd22:50:011
230989943,0cyclictest3556-21lldpd22:39:001
230989943,0cyclictest3556-21lldpd22:21:311
230989943,0cyclictest3556-21lldpd21:59:311
230989943,0cyclictest3556-21lldpd00:05:001
230989943,0cyclictest3556-21lldpd00:03:001
230989943,0cyclictest3514-21snmpd21:35:121
230989943,0cyclictest3514-21snmpd21:15:421
230989943,0cyclictest30956-21awk21:39:431
230989943,0cyclictest29280-21awk00:19:431
230989942,0cyclictest11954-21awk19:09:431
230979943,0cyclictest5174-21awk00:04:420
230979943,0cyclictest3556-21lldpd20:13:590
230979943,0cyclictest3556-21lldpd19:15:280
230979943,0cyclictest3514-21snmpd23:25:580
230979943,0cyclictest3514-21snmpd22:44:580
230979943,0cyclictest3514-21snmpd22:35:130
230979943,0cyclictest3514-21snmpd22:27:570
230979943,0cyclictest3514-21snmpd21:54:420
230979943,0cyclictest3514-21snmpd21:29:570
230979943,0cyclictest3514-21snmpd20:49:270
230979943,0cyclictest3241-21irqbalance22:29:560
230979943,0cyclictest3241-21irqbalance21:34:560
230979943,0cyclictest3241-21irqbalance21:06:270
230979943,0cyclictest320-21awk19:49:430
230979943,0cyclictest29528-21awk23:39:420
230979943,0cyclictest29201-21awk00:19:430
230979943,0cyclictest21528-21sadc21:54:280
230979943,0cyclictest21518-21awk23:34:430
230979943,0cyclictest13980-21awk22:49:430
179940,0migration/17216-21taskset20:19:281
179940,0migration/15583-21munin-node23:04:411
179940,0migration/14100-21open_inodes19:24:481
179940,0migration/132058-21timerwakeupswit20:09:511
179940,0migration/130378-21irqcore22:39:431
179940,0migration/130274-21runrttasks21:19:401
179940,0migration/130186-21kthreadcore20:34:461
179940,0migration/127728-21kthreadcore19:44:451
179940,0migration/127728-21kthreadcore19:44:451
179940,0migration/125359-21kthreadcore20:29:461
179940,0migration/125041-21kthreadcore21:54:441
179940,0migration/121858-21kthreadcore19:39:441
179940,0migration/120516-21latency_hist23:34:271
179940,0migration/118564-21kthreadcore20:24:461
179940,0migration/116740-21kthreadcore21:09:451
179940,0migration/116050-21kthreadcore19:34:461
179940,0migration/115125-21kthreadcore22:09:441
179940,0migration/113387-21irqcore00:09:411
179940,0migration/111972-21taskset21:45:081
179940,0migration/111037-21taskset23:46:101
169940,0watchdog/124350-21cut22:54:461
169940,0watchdog/121637-21aten_r1power_po22:14:381
169940,0watchdog/121251-21grep20:04:471
169940,0watchdog/119766-21kthreadcore20:49:461
169940,0watchdog/119075-21switchtime22:29:501
169940,0watchdog/10-21swapper/119:54:431
169940,0watchdog/10-21swapper/119:04:431
149940,0migration/05073-21sh22:04:110
149940,0migration/030039-21aten_r1power_en18:59:390
149940,0migration/023191-21kthreadcore23:14:440
149940,0migration/020145-21runrttasks20:27:070
149940,0migration/017298-21taskset19:13:270
149940,0migration/016466-21kthreadcore20:49:450
149940,0migration/015929-21kthreadcore19:34:460
149940,0migration/011690-21sh22:04:580
4130,0ktimersoftd/020241-21runrttasks00:14:320
29725030,0irq/27-eth0-tx-0-21swapper/020:04:410
29715030,0irq/26-eth0-rx-0-21swapper/320:39:403
29715030,0irq/26-eth0-rx-0-21swapper/320:29:403
29715030,0irq/26-eth0-rx-0-21swapper/320:24:163
29715030,0irq/26-eth0-rx-0-21swapper/319:51:123
29715030,0irq/26-eth0-rx-0-21swapper/319:39:473
29715030,0irq/26-eth0-rx-0-21swapper/319:14:393
29715030,0irq/26-eth0-rx-0-21swapper/319:04:433
29715030,0irq/26-eth0-rx-0-21swapper/319:01:493
259930,0migration/223156-21pmu-power19:14:482
249930,0watchdog/20-21swapper/219:04:432
231009932,0cyclictest8070-21awk20:19:432
231009932,0cyclictest26099-21awk19:44:432
231009932,0cyclictest26099-21awk19:44:432
231009932,0cyclictest25241-21kthreadcore18:54:452
230989932,0cyclictest9122-21awk20:44:441
230989932,0cyclictest374-21awk19:49:441
230989932,0cyclictest28569-21grep19:19:451
230989932,0cyclictest18557-21awk19:14:431
230989932,0cyclictest18233-21sensors23:49:521
230979932,0cyclictest3731-21sh21:00:430
230979932,0cyclictest3556-21lldpd23:02:310
230979932,0cyclictest3514-21snmpd23:29:580
230979932,0cyclictest3514-21snmpd22:19:570
230979932,0cyclictest26271-21cut19:44:440
230979932,0cyclictest26271-21cut19:44:440
230979932,0cyclictest24321-21basename19:19:390
230979930,0cyclictest2697-21ssh00:01:060
230979930,0cyclictest16877-21cut23:49:480
179930,0migration/116000-21kthreadcore19:59:451
169930,0watchdog/14409-21cut20:39:461
169930,0watchdog/121316-21diskmemload22:24:301
169930,0watchdog/10-21swapper/123:19:421
169930,0watchdog/10-21swapper/121:49:381
169930,0watchdog/10-21swapper/119:29:431
169930,0watchdog/10-21swapper/118:58:151
149930,0migration/030909-21latency_hist19:24:290
149930,0migration/01643-21irqrtprio20:14:450
29715020,0irq/26-eth0-rx-0-21swapper/319:54:393
29715020,0irq/26-eth0-rx-0-21swapper/319:24:393
29715020,0irq/26-eth0-rx-0-21swapper/319:09:343
230989921,0cyclictest30104-21telnet18:59:391
169920,0watchdog/10-21swapper/120:14:311
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional