You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-26 - 01:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Fri Jun 26, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450350,0irq/25-eth10-21swapper/318:47:133
1682223322,0sleep00-21swapper/018:49:340
1674723324,0sleep20-21swapper/218:48:442
1677023127,0sleep10-21swapper/118:48:591
4160,0ktimersoftd/00-21swapper/020:56:400
339960,0migration/38345-21munin-node20:21:483
339960,0migration/331401-21sh21:19:323
339960,0migration/331390-21sh23:00:593
339960,0migration/330734-21sh23:40:453
339960,0migration/321201-21munin-node23:11:543
339960,0migration/314489-21sh22:08:053
339960,0migration/313947-21sh23:07:363
339960,0migration/313908-21sh22:47:013
339960,0migration/313785-21sh00:09:483
29725060,0irq/27-eth0-tx-7802-21munin-node20:21:570
29725060,0irq/27-eth0-tx-26794-21munin-node20:11:490
29715060,0irq/26-eth0-rx-31738-21diskstats23:41:533
27160,0ktimersoftd/20-21swapper/220:56:402
170679960,0cyclictest0-21swapper/223:09:302
170679960,0cyclictest0-21swapper/221:56:592
149960,0migration/0995-21kthreadcore00:01:540
149960,0migration/07016-21sh21:05:310
149960,0migration/01782-21sh20:41:360
35150,0ktimersoftd/30-21swapper/300:00:543
339950,0migration/37912-21kthreadcore19:06:533
339950,0migration/37900-21aten_r1power_fr22:26:463
339950,0migration/3729-21munin-node22:01:533
339950,0migration/36864-21aten_r1power_cu19:56:473
339950,0migration/332012-21latency_hist22:01:363
339950,0migration/331431-21munin-node00:01:503
339950,0migration/328621-21kthreadcore19:46:533
339950,0migration/326009-21kthreadcore18:56:533
339950,0migration/325344-21taskset19:43:213
339950,0migration/324526-21fschecks_time22:36:513
339950,0migration/324026-21timerwakeupswit19:17:003
339950,0migration/321693-21munin-node21:51:553
339950,0migration/321620-21runrttasks20:52:053
339950,0migration/321165-21munin-node20:06:523
339950,0migration/315248-21hwlatdetect20:26:513
339950,0migration/314125-21sh21:07:323
339950,0migration/31397-21kthreadcore23:21:523
29725050,0irq/27-eth0-tx-8093-21df21:06:482
29725050,0irq/27-eth0-tx-800-21iostat_ios22:01:532
29725050,0irq/27-eth0-tx-30558-21munin-node19:01:550
29725050,0irq/27-eth0-tx-23837-21munin-node22:56:492
29725050,0irq/27-eth0-tx-23535-21ssh22:15:592
29725050,0irq/27-eth0-tx-2309-21grep23:01:532
29725050,0irq/27-eth0-tx-16809-21ssh22:31:532
29725050,0irq/27-eth0-tx-10127-21kthreadcore21:46:552
29725050,0irq/27-eth0-tx-0-21swapper/222:41:492
29725050,0irq/27-eth0-tx-0-21swapper/221:52:282
29725050,0irq/27-eth0-tx-0-21swapper/200:18:022
29725050,0irq/27-eth0-tx-0-21swapper/200:08:212
29725050,0irq/27-eth0-tx-0-21swapper/020:51:520
29725050,0irq/27-eth0-tx-0-21swapper/019:26:570
29715050,0irq/26-eth0-rx-9953-21kthreadcore21:26:533
29715050,0irq/26-eth0-rx-4631-21cut21:01:543
29715050,0irq/26-eth0-rx-31554-40yum-updatesd-he21:40:113
29715050,0irq/26-eth0-rx-29273-21kthreadcore22:16:543
29715050,0irq/26-eth0-rx-23623-21ssh23:16:433
29715050,0irq/26-eth0-rx-2340-21tr23:01:533
29715050,0irq/26-eth0-rx-2273-21cut21:21:523
29715050,0irq/26-eth0-rx-18277-21kthreadcore23:31:523
29715050,0irq/26-eth0-rx-16034-21telnet22:11:473
29715050,0irq/26-eth0-rx-14636-21kthreadcore19:11:523
29715050,0irq/26-eth0-rx-13407-21uptime23:27:003
29715050,0irq/26-eth0-rx-0-21swapper/323:47:003
29715050,0irq/26-eth0-rx-0-21swapper/322:51:493
29715050,0irq/26-eth0-rx-0-21swapper/322:43:083
29715050,0irq/26-eth0-rx-0-21swapper/322:32:313
29715050,0irq/26-eth0-rx-0-21swapper/322:22:133
29715050,0irq/26-eth0-rx-0-21swapper/321:11:533
29715050,0irq/26-eth0-rx-0-21swapper/319:21:473
29715050,0irq/26-eth0-rx-0-21swapper/300:16:533
259950,0migration/27728-21latency_hist20:21:362
259950,0migration/26848-21sh23:26:012
259950,0migration/26538-21latency_hist00:06:362
259950,0migration/225416-21kthreadcore22:36:552
259950,0migration/224647-21gltestperf18:56:502
259950,0migration/223515-21sh21:35:082
259950,0migration/215225-21sh22:10:122
259950,0migration/215218-21latency_hist23:31:362
259950,0migration/214189-21sh23:50:002
249950,0watchdog/221587-21sensors_temp22:51:582
19150,0ktimersoftd/10-21swapper/120:56:401
170679950,0cyclictest0-21swapper/223:46:332
170679950,0cyclictest0-21swapper/223:15:292
170679950,0cyclictest0-21swapper/220:52:012
170669955,0cyclictest0-21swapper/123:48:021
170669955,0cyclictest0-21swapper/123:10:401
170669955,0cyclictest0-21swapper/122:52:231
170669955,0cyclictest0-21swapper/121:51:511
170669955,0cyclictest0-21swapper/120:54:371
170669955,0cyclictest0-21swapper/119:11:401
170669954,0cyclictest3514-21snmpd21:32:411
170669950,0cyclictest0-21swapper/123:39:411
170669950,0cyclictest0-21swapper/122:49:231
170669950,0cyclictest0-21swapper/122:40:051
170669950,0cyclictest0-21swapper/121:23:001
170669950,0cyclictest0-21swapper/121:14:571
170659950,0cyclictest0-21swapper/023:12:300
149950,0migration/09634-21kthreadcore21:46:550
149950,0migration/09398-21kthreadcore19:31:540
149950,0migration/09111-21kthreadcore00:06:530
149950,0migration/08958-21irqcore22:26:510
149950,0migration/08435-21idleruntime23:06:510
149950,0migration/07722-21taskset21:06:410
149950,0migration/06347-21taskset21:42:330
149950,0migration/04628-21kthreadcore22:41:530
149950,0migration/03920-21kthreadcore20:16:540
149950,0migration/031645-21timerwakeupswit19:46:590
149950,0migration/030635-21sh22:58:490
149950,0migration/027613-21kthreadcore18:56:540
149950,0migration/027177-21kthreadcore22:36:550
149950,0migration/026987-21kthreadcore21:16:530
149950,0migration/026385-21kthreadcore23:56:530
149950,0migration/023834-21irqcore00:16:520
149950,0migration/023728-21kthreadcore19:41:530
149950,0migration/023382-21kthreadcore20:31:510
149950,0migration/020830-21fschecks_time20:06:490
149950,0migration/018892-21ksmtuned19:41:120
149950,0migration/017636-21kthreadcore20:01:530
149950,0migration/010722-21kthreadcore22:06:530
8215040,0irq/24-0000:00:13309-21cat20:01:362
8215040,0irq/24-0000:00:0-21swapper/220:06:502
8215040,0irq/24-0000:00:0-21swapper/219:26:362
4140,0ktimersoftd/00-21swapper/022:32:130
339940,0migration/3769-21taskset20:16:273
339940,0migration/31709-21kthreadcore19:51:533
29725040,0irq/27-eth0-tx-31757-21ssh21:01:382
29725040,0irq/27-eth0-tx-0-21swapper/223:56:502
29725040,0irq/27-eth0-tx-0-21swapper/223:26:422
29725040,0irq/27-eth0-tx-0-21swapper/222:26:422
29725040,0irq/27-eth0-tx-0-21swapper/222:22:452
29725040,0irq/27-eth0-tx-0-21swapper/222:17:362
29725040,0irq/27-eth0-tx-0-21swapper/221:23:042
29725040,0irq/27-eth0-tx-0-21swapper/020:26:520
29725040,0irq/27-eth0-tx-0-21swapper/019:57:000
29725040,0irq/27-eth0-tx-0-21swapper/019:06:470
29715040,0irq/26-eth0-rx-19819-21kthreadcore21:31:543
29715040,0irq/26-eth0-rx-0-21swapper/323:51:453
29715040,0irq/26-eth0-rx-0-21swapper/321:47:083
29715040,0irq/26-eth0-rx-0-21swapper/321:41:383
29715040,0irq/26-eth0-rx-0-21swapper/320:59:513
29715040,0irq/26-eth0-rx-0-21swapper/319:36:533
29715040,0irq/26-eth0-rx-0-21swapper/300:11:443
259940,0migration/228160-21df_abs20:36:472
259940,0migration/227904-21kthreadcore21:16:542
259940,0migration/223472-21cpu23:36:472
259940,0migration/220396-21kthreadcore21:11:542
259940,0migration/216657-21kthreadcore19:11:532
249940,0watchdog/231707-21unixbench-2d19:46:592
249940,0watchdog/20-21swapper/220:31:472
249940,0watchdog/20-21swapper/220:01:472
249940,0watchdog/20-21swapper/219:36:592
249940,0watchdog/20-21swapper/219:16:552
170679943,0cyclictest890-21awk21:41:522
170679943,0cyclictest6785-21awk19:31:512
170679943,0cyclictest3514-21snmpd20:46:552
170679943,0cyclictest3514-21snmpd20:16:552
170679943,0cyclictest3514-21snmpd19:51:402
170679943,0cyclictest3514-21snmpd19:42:402
170679943,0cyclictest3514-21snmpd19:24:102
170679943,0cyclictest3514-21snmpd19:06:552
170679943,0cyclictest3514-21snmpd18:52:102
170679943,0cyclictest3241-21irqbalance22:46:442
170679943,0cyclictest25265-21awk21:36:512
170679943,0cyclictest24298-21cut23:16:482
170679943,0cyclictest15982-21awk23:51:522
170679943,0cyclictest15702-21awk00:11:522
170679940,0cyclictest8221-21munin-node21:26:502
170669944,0cyclictest0-21swapper/123:04:411
170669943,0cyclictest8803-21awk22:06:511
170669943,0cyclictest8187-21awk23:26:511
170669943,0cyclictest420-21awk22:41:511
170669943,0cyclictest3556-21lldpd22:29:211
170669943,0cyclictest3556-21lldpd20:10:191
170669943,0cyclictest3556-21lldpd19:23:481
170669943,0cyclictest3514-21snmpd23:21:421
170669943,0cyclictest3514-21snmpd23:13:421
170669943,0cyclictest3514-21snmpd22:56:411
170669943,0cyclictest3514-21snmpd22:02:111
170669943,0cyclictest3514-21snmpd21:49:411
170669943,0cyclictest3514-21snmpd21:42:111
170669943,0cyclictest3514-21snmpd21:07:101
170669943,0cyclictest3514-21snmpd20:19:251
170669943,0cyclictest3514-21snmpd19:59:251
170669943,0cyclictest3514-21snmpd19:36:551
170669943,0cyclictest3514-21snmpd19:33:401
170669943,0cyclictest3514-21snmpd19:06:251
170669943,0cyclictest3514-21snmpd00:07:121
170669943,0cyclictest3241-21irqbalance23:31:541
170669943,0cyclictest3241-21irqbalance21:56:451
170669943,0cyclictest3241-21irqbalance21:26:451
170669943,0cyclictest3241-21irqbalance20:37:551
170669943,0cyclictest3241-21irqbalance20:21:551
170669943,0cyclictest32335-21ls19:26:491
170669943,0cyclictest31996-21awk00:01:521
170669943,0cyclictest2911-21awk20:41:511
170669943,0cyclictest27648-21awk20:11:511
170669943,0cyclictest23589-21awk00:16:501
170669943,0cyclictest22025-21awk20:31:501
170669943,0cyclictest17056-21irqcore22:11:521
170669943,0cyclictest15587-21awk00:11:511
170669943,0cyclictest15298-21awk20:26:511
170659943,0cyclictest9651-21awk20:46:520
170659943,0cyclictest9644-21kworker/0:122:11:530
170659943,0cyclictest9199-21awk21:26:520
170659943,0cyclictest3556-21lldpd23:50:210
170659943,0cyclictest3556-21lldpd20:41:500
170659943,0cyclictest3514-21snmpd22:50:110
170659943,0cyclictest3514-21snmpd21:12:100
170659943,0cyclictest31034-21sadc23:41:360
170659943,0cyclictest17154-21awk21:31:510
170659943,0cyclictest15602-21awk00:11:520
170659941,0cyclictest0-21swapper/019:51:480
179940,0migration/1815-21hddtemp_smartct19:51:501
179940,0migration/13102-21kthreadcore22:21:521
169940,0watchdog/131859-21fschecks_count23:41:541
169940,0watchdog/130264-21sed21:36:581
169940,0watchdog/118269-21kthreadcore22:31:541
169940,0watchdog/115724-21fschecks_time23:51:501
169940,0watchdog/111869-21kthreadcore20:46:551
169940,0watchdog/10-21swapper/122:16:501
169940,0watchdog/10-21swapper/120:01:471
169940,0watchdog/10-21swapper/119:16:551
149940,0migration/06829-21runrttasks22:24:340
149940,0migration/04414-21kthreadcore23:21:530
149940,0migration/026160-21kthreadcore21:36:530
149940,0migration/025050-21if_err_eth021:56:510
149940,0migration/013357-21kthreadcore19:11:520
339930,0migration/37800-21switchtime20:41:583
339930,0migration/319724-21runrttasks20:04:163
339930,0migration/31229-21kthreadcore19:26:523
29725030,0irq/27-eth0-tx-24922-21aten2.4-expect19:21:470
29715030,0irq/26-eth0-rx-0-21swapper/320:48:193
29715030,0irq/26-eth0-rx-0-21swapper/320:38:213
29715030,0irq/26-eth0-rx-0-21swapper/320:31:473
29715030,0irq/26-eth0-rx-0-21swapper/319:33:053
29715030,0irq/26-eth0-rx-0-21swapper/319:01:473
29715030,0irq/26-eth0-rx-0-21swapper/318:53:283
170679932,0cyclictest3514-21snmpd19:05:402
170679932,0cyclictest2735-21expr20:41:502
170679931,0cyclictest0-21swapper/220:26:542
170669933,0cyclictest0-21swapper/123:16:401
170669932,0cyclictest27759-21cut18:56:541
170659933,0cyclictest9644-21kworker/0:123:51:410
170659933,0cyclictest9644-21kworker/0:123:41:410
170659933,0cyclictest9644-21kworker/0:123:31:450
170659933,0cyclictest9644-21kworker/0:123:26:390
170659933,0cyclictest9644-21kworker/0:123:16:370
170659933,0cyclictest9644-21kworker/0:123:01:430
170659933,0cyclictest9644-21kworker/0:122:51:530
170659933,0cyclictest9644-21kworker/0:122:16:410
170659933,0cyclictest9644-21kworker/0:122:01:380
170659933,0cyclictest9644-21kworker/0:121:51:460
170659933,0cyclictest9644-21kworker/0:121:21:380
170659933,0cyclictest9644-21kworker/0:119:16:580
170659933,0cyclictest9644-21kworker/0:118:51:420
169930,0watchdog/16559-21runrttasks19:06:551
169930,0watchdog/126716-21munin-node19:46:511
169930,0watchdog/10-21swapper/123:56:421
169930,0watchdog/10-21swapper/121:16:431
169930,0watchdog/10-21swapper/121:04:031
169930,0watchdog/10-21swapper/118:51:471
29715020,0irq/26-eth0-rx-0-21swapper/320:16:443
249920,0watchdog/20-21swapper/220:11:392
170669920,0cyclictest19094-21sed19:41:361
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional