You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 08:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sat Dec 20, 2025 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1537323925,0sleep00-21swapper/019:05:050
1557423525,0sleep30-21swapper/319:07:283
1539923526,0sleep20-21swapper/219:05:232
1559623324,0sleep10-21swapper/119:07:421
158099976,0cyclictest15654-21munin-node23:04:341
339960,0migration/38328-21munin-node21:04:363
339960,0migration/332536-21sh22:14:393
339960,0migration/318441-21munin-node20:44:393
339960,0migration/315460-21sh21:28:123
339960,0migration/311214-21taskset00:15:083
339960,0migration/310284-21sh23:56:343
29715060,0irq/26-eth0-rx-22831-21cpu21:14:343
259960,0migration/24489-21sh22:54:432
158109966,0cyclictest0-21swapper/223:34:452
158099965,0cyclictest2624-21cut19:44:401
158099960,0cyclictest0-21swapper/121:29:401
158099960,0cyclictest0-21swapper/100:14:341
158089960,0cyclictest0-21swapper/021:20:480
8215050,0irq/24-0000:00:16885-21cat19:34:222
339950,0migration/35957-21taskset20:35:303
339950,0migration/35757-21aten_r1power_vo20:14:353
339950,0migration/35739-21aten_r1power_en22:39:333
339950,0migration/35140-21kthreadcore20:59:393
339950,0migration/331224-21munin-node22:54:343
339950,0migration/330905-21kernelversion22:34:383
339950,0migration/330239-21kthreadcore23:49:373
339950,0migration/328329-21taskset22:32:063
339950,0migration/325541-21munin-node20:49:413
339950,0migration/324418-21kthreadcore22:49:363
339950,0migration/32195-21munin-node19:19:373
339950,0migration/319220-21irqrtprio19:59:383
339950,0migration/319200-21taskset22:25:403
339950,0migration/315771-21munin-node23:04:323
339950,0migration/314160-21kthreadcore19:54:393
339950,0migration/31399-21kthreadcore21:19:373
339950,0migration/312205-21munin-node00:34:433
339950,0migration/31146-21if_eth1.223:14:383
29725050,0irq/27-eth0-tx-28729-21munin-node00:09:332
29725050,0irq/27-eth0-tx-2784-21ssh22:16:562
29725050,0irq/27-eth0-tx-26827-21processes22:29:432
29725050,0irq/27-eth0-tx-26530-21munin-node21:54:352
29725050,0irq/27-eth0-tx-22596-21munin-node22:49:342
29725050,0irq/27-eth0-tx-16314-21perl23:04:342
29725050,0irq/27-eth0-tx-16212-21rm21:29:212
29725050,0irq/27-eth0-tx-14002-21kthreadcore22:24:382
29725050,0irq/27-eth0-tx-13347-21munin-node00:19:432
29725050,0irq/27-eth0-tx-12504-21ssh00:18:072
29725050,0irq/27-eth0-tx-0-21swapper/223:33:382
29725050,0irq/27-eth0-tx-0-21swapper/222:21:562
29725050,0irq/27-eth0-tx-0-21swapper/221:48:422
29715050,0irq/26-eth0-rx-3751-21cut21:39:373
29715050,0irq/26-eth0-rx-28741-21kthreadcore23:29:383
29715050,0irq/26-eth0-rx-27784-21irqrtprio21:54:373
29715050,0irq/26-eth0-rx-24310-21ssh23:09:333
29715050,0irq/26-eth0-rx-23387-21ssh21:31:423
29715050,0irq/26-eth0-rx-23309-21kthreadcore22:09:393
29715050,0irq/26-eth0-rx-23309-21kthreadcore22:09:393
29715050,0irq/26-eth0-rx-20455-21kthreadcore20:24:373
29715050,0irq/26-eth0-rx-19900-21ssh00:20:483
29715050,0irq/26-eth0-rx-19036-21tr23:44:343
29715050,0irq/26-eth0-rx-11268-21munin-node23:39:373
29715050,0irq/26-eth0-rx-10685-21irqcore21:44:373
29715050,0irq/26-eth0-rx-0-21swapper/323:34:323
29715050,0irq/26-eth0-rx-0-21swapper/323:28:113
29715050,0irq/26-eth0-rx-0-21swapper/322:59:553
29715050,0irq/26-eth0-rx-0-21swapper/322:44:223
29715050,0irq/26-eth0-rx-0-21swapper/321:49:333
29715050,0irq/26-eth0-rx-0-21swapper/300:04:513
29715050,0irq/26-eth0-rx-0-21swapper/300:01:033
259950,0migration/24872-21munin-node21:19:422
259950,0migration/23714-21munin-node00:29:452
259950,0migration/229125-21sh21:15:382
259950,0migration/227053-21sh00:06:122
259950,0migration/222419-21fschecks_time00:24:342
259950,0migration/214012-21sh21:25:112
259950,0migration/213003-21sh22:59:432
249950,0watchdog/26314-21ssh00:34:232
249950,0watchdog/230004-21entropy22:34:352
249950,0watchdog/227694-21grep20:04:402
249950,0watchdog/210410-21kthreadcore22:39:392
249950,0watchdog/20-21swapper/221:04:392
179950,0migration/16115-21timerandwakeup23:14:461
179950,0migration/130032-21sh21:17:261
179950,0migration/129838-21cpuspeed_turbos22:34:341
179950,0migration/126028-21sendmail_mailqu00:04:421
179950,0migration/126011-21fschecks_count20:29:351
179950,0migration/123223-21kthreadcore20:24:381
179950,0migration/122556-21latency_hist19:14:221
179950,0migration/121343-21kthreadcore22:09:381
179950,0migration/121343-21kthreadcore22:09:381
179950,0migration/113902-21fschecks_time20:44:351
158109955,0cyclictest0-21swapper/222:13:522
158109955,0cyclictest0-21swapper/222:13:522
158109954,0cyclictest14233-21cut20:44:372
158109950,0cyclictest0-21swapper/222:03:092
158099955,0cyclictest0-21swapper/123:44:281
158099950,0cyclictest0-21swapper/121:48:071
158089955,0cyclictest0-21swapper/021:12:550
158089950,0cyclictest0-21swapper/000:05:340
8215040,0irq/24-0000:00:0-21swapper/223:44:202
8215040,0irq/24-0000:00:0-21swapper/221:09:212
8215040,0irq/24-0000:00:0-21swapper/219:44:222
339940,0migration/39182-21kthreadcore22:19:363
339940,0migration/326319-21kernelversion21:34:383
339940,0migration/32531-21diskmemload21:59:263
339940,0migration/324502-21kthreadcore19:14:403
339940,0migration/317281-21cpuspeed_turbos19:34:363
29725040,0irq/27-eth0-tx-967-21ssh23:49:542
29725040,0irq/27-eth0-tx-13992-21diskmemload22:44:222
29725040,0irq/27-eth0-tx-0-21swapper/223:59:252
29725040,0irq/27-eth0-tx-0-21swapper/223:39:222
29725040,0irq/27-eth0-tx-0-21swapper/223:24:242
29725040,0irq/27-eth0-tx-0-21swapper/223:09:222
29725040,0irq/27-eth0-tx-0-21swapper/221:39:472
29725040,0irq/27-eth0-tx-0-21swapper/221:34:272
29715040,0irq/26-eth0-rx-0-21swapper/323:19:223
29715040,0irq/26-eth0-rx-0-21swapper/322:04:473
29715040,0irq/26-eth0-rx-0-21swapper/321:10:533
29715040,0irq/26-eth0-rx-0-21swapper/320:19:353
29715040,0irq/26-eth0-rx-0-21swapper/300:31:023
29715040,0irq/26-eth0-rx-0-21swapper/300:25:183
29715040,0irq/26-eth0-rx-0-21swapper/300:09:313
259940,0migration/25144-21latency20:34:402
259940,0migration/24602-21latency_hist19:49:222
259940,0migration/225670-21aten_r1power_fr20:29:342
259940,0migration/225343-21kthreadcore19:14:402
259940,0migration/21515-21kthreadcore19:44:402
259940,0migration/21109-21kthreadcore19:19:372
249940,0watchdog/218841-21smartctl21:49:352
249940,0watchdog/217505-21kthreadcore19:09:362
249940,0watchdog/217349-21df19:34:362
249940,0watchdog/20-21swapper/220:59:232
249940,0watchdog/20-21swapper/220:39:362
249940,0watchdog/20-21swapper/219:59:402
179940,0migration/14575-21kthreadcore21:39:371
179940,0migration/132038-21kthreadcore00:29:401
179940,0migration/127226-21fschecks_time20:54:361
179940,0migration/122726-21if_eth1.200:24:361
179940,0migration/117696-21fschecks_count23:24:351
179940,0migration/116757-21kthreadcore22:44:381
179940,0migration/114684-21kthreadcore22:24:381
179940,0migration/112185-21kthreadcore21:24:381
179940,0migration/110210-21kthreadcore23:19:371
169940,0watchdog/17938-21perl22:59:351
169940,0watchdog/17850-21uname20:39:361
169940,0watchdog/126099-21kthreadcore22:29:391
169940,0watchdog/117070-21tr20:19:401
169940,0watchdog/114394-21kthreadcore19:54:401
169940,0watchdog/110959-21ssh23:58:071
169940,0watchdog/110409-21kthreadcore22:39:391
169940,0watchdog/10-21swapper/123:39:431
169940,0watchdog/10-21swapper/119:14:401
158109944,0cyclictest0-21swapper/220:24:372
158109944,0cyclictest0-21swapper/220:14:222
158109943,0cyclictest9704-21awk23:19:362
158109943,0cyclictest4112-21awk23:54:332
158109943,0cyclictest3514-21snmpd23:14:242
158109943,0cyclictest13247-21awk20:19:372
158109943,0cyclictest12027-21awk22:04:352
158099944,0cyclictest0-21swapper/121:58:311
158099943,0cyclictest8403-21awk21:04:371
158099943,0cyclictest7402-21awk00:34:361
158099943,0cyclictest5027-21awk22:19:331
158099943,0cyclictest4535-21awk19:24:361
158099943,0cyclictest3514-21snmpd22:14:391
158099943,0cyclictest3514-21snmpd21:51:091
158099943,0cyclictest3514-21snmpd21:23:091
158099943,0cyclictest3514-21snmpd21:14:091
158099943,0cyclictest3514-21snmpd20:18:091
158099943,0cyclictest3514-21snmpd19:59:391
158099943,0cyclictest3514-21snmpd19:52:541
158099943,0cyclictest3514-21snmpd19:42:091
158099943,0cyclictest3514-21snmpd19:34:391
158099943,0cyclictest3241-21irqbalance23:09:591
158099943,0cyclictest3241-21irqbalance22:54:291
158099943,0cyclictest3241-21irqbalance21:34:301
158099943,0cyclictest3241-21irqbalance00:00:191
158099943,0cyclictest29680-21awk00:09:361
158099943,0cyclictest26478-21awk23:29:351
158099943,0cyclictest23460-21awk22:49:341
158099943,0cyclictest1674-21awk20:59:371
158099943,0cyclictest12052-21awk22:04:351
158089944,0cyclictest0-21swapper/023:33:240
158089944,0cyclictest0-21swapper/023:00:170
158089944,0cyclictest0-21swapper/021:25:420
158089943,0cyclictest3556-21lldpd22:14:430
158089943,0cyclictest3556-21lldpd19:49:430
158089943,0cyclictest3556-21lldpd19:19:420
158089943,0cyclictest3556-21lldpd00:37:130
158089943,0cyclictest3556-21lldpd00:31:130
158089943,0cyclictest3556-21lldpd00:26:430
158089943,0cyclictest3514-21snmpd23:56:240
158089943,0cyclictest3514-21snmpd23:28:540
158089943,0cyclictest3514-21snmpd23:20:240
158089943,0cyclictest3514-21snmpd23:15:540
158089943,0cyclictest3514-21snmpd22:33:390
158089943,0cyclictest3514-21snmpd22:20:240
158089943,0cyclictest3514-21snmpd21:15:240
158089943,0cyclictest3514-21snmpd21:04:540
158089943,0cyclictest3514-21snmpd20:46:240
158089943,0cyclictest3514-21snmpd20:34:540
158089943,0cyclictest3514-21snmpd20:25:240
158089943,0cyclictest3514-21snmpd20:14:240
158089943,0cyclictest3514-21snmpd19:59:240
158089943,0cyclictest3514-21snmpd19:11:240
158089943,0cyclictest3241-21irqbalance23:35:390
158089943,0cyclictest3241-21irqbalance22:44:290
158089943,0cyclictest3241-21irqbalance22:39:490
158089943,0cyclictest3241-21irqbalance22:36:390
158089943,0cyclictest3241-21irqbalance21:59:390
158089943,0cyclictest3241-21irqbalance21:54:290
158089943,0cyclictest3241-21irqbalance19:45:500
158089943,0cyclictest29629-21awk00:09:350
158089943,0cyclictest27983-21awk23:49:340
158089943,0cyclictest23477-21awk22:49:340
158089943,0cyclictest18942-21awk21:49:360
158089943,0cyclictest14245-21awk00:19:370
158089943,0cyclictest13175-21awk20:19:370
158089943,0cyclictest12735-21awk23:59:380
158089943,0cyclictest11172-21awk23:39:370
158089943,0cyclictest11158-21awk19:29:360
158089943,0cyclictest10482-21awk21:44:360
158089942,0cyclictest25900-21awk21:34:370
158089942,0cyclictest18640-21cat23:04:370
158089942,0cyclictest10086-21sadc19:29:220
158089941,0cyclictest0-21swapper/020:14:080
158089940,0cyclictest6941-21awk22:59:200
158089940,0cyclictest23647-21munin-node19:39:370
158089940,0cyclictest11320-21munin-node19:54:350
158089940,0cyclictest0-21swapper/023:11:020
158089940,0cyclictest0-21swapper/020:50:230
158089940,0cyclictest0-21swapper/020:44:040
8215030,0irq/24-0000:00:0-21swapper/220:49:352
29715030,0irq/26-eth0-rx-0-21swapper/320:55:303
29715030,0irq/26-eth0-rx-0-21swapper/320:40:343
29715030,0irq/26-eth0-rx-0-21swapper/320:30:293
29715030,0irq/26-eth0-rx-0-21swapper/320:09:333
29715030,0irq/26-eth0-rx-0-21swapper/320:04:363
29715030,0irq/26-eth0-rx-0-21swapper/319:41:393
29715030,0irq/26-eth0-rx-0-21swapper/319:29:373
29715030,0irq/26-eth0-rx-0-21swapper/319:26:543
259930,0migration/229312-21kthreadcore20:54:402
169930,0watchdog/10-21swapper/121:59:511
169930,0watchdog/10-21swapper/120:34:401
158109933,0cyclictest32110-21awk20:09:362
158109932,0cyclictest4496-21awk19:24:362
158109932,0cyclictest12204-21awk19:54:372
158099933,0cyclictest2566-21awk23:34:351
158099932,0cyclictest3514-21snmpd20:49:391
158099932,0cyclictest32125-21awk20:09:361
158099932,0cyclictest29626-21tr19:19:321
158099932,0cyclictest25497-21awk20:04:371
158099932,0cyclictest14335-21awk00:19:381
158099930,0cyclictest0-21swapper/123:50:221
158089933,0cyclictest3878-21kworker/0:222:24:280
158089933,0cyclictest3878-21kworker/0:222:09:300
158089933,0cyclictest3878-21kworker/0:222:09:300
158089933,0cyclictest3878-21kworker/0:221:39:220
158089933,0cyclictest3878-21kworker/0:221:29:310
158089933,0cyclictest26073-21kworker/0:100:14:220
158089932,0cyclictest3241-21irqbalance23:44:290
158089932,0cyclictest3241-21irqbalance22:04:290
158089932,0cyclictest17978-21awk19:34:390
158089931,0cyclictest27030-21kthreadcore20:04:390
158089930,0cyclictest22672-21munin-node19:14:370
158089930,0cyclictest1187-21diskstats20:59:350
158089930,0cyclictest0-21swapper/020:29:220
29715020,0irq/26-eth0-rx-0-21swapper/319:49:353
29715020,0irq/26-eth0-rx-0-21swapper/319:44:283
29715020,0irq/26-eth0-rx-0-21swapper/319:09:363
169920,0watchdog/10-21swapper/119:29:241
158089920,0cyclictest0-21swapper/020:54:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional