You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-14 - 04:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Fri Aug 14, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27286210298,0sleep30-21swapper/318:46:003
2101723524,0sleep00-21swapper/018:42:010
2710123323,0sleep10-21swapper/118:43:501
2724922622,0sleep20-21swapper/218:45:352
274409976,0cyclictest30463-21ssh22:30:141
274409970,0cyclictest0-21swapper/122:07:131
339960,0migration/35668-21sh22:56:063
339960,0migration/33992-21sh23:35:083
339960,0migration/32420-21sh00:13:493
339960,0migration/314476-21sh22:19:483
29725060,0irq/27-eth0-tx-0-21swapper/221:48:212
29715060,0irq/26-eth0-rx-20973-21ntpdc22:22:163
29715060,0irq/26-eth0-rx-1146-21kthreadcore23:52:143
274409965,0cyclictest24657-21hwlatdetect19:57:091
274399965,0cyclictest0-21swapper/020:52:140
149960,0migration/07980-21sh21:35:350
149960,0migration/03444-21kthreadcore21:52:120
149960,0migration/031472-21munin-node22:52:100
149960,0migration/014374-21sh22:19:290
8215050,0irq/24-0000:00:3647-21latency_hist19:41:562
8215050,0irq/24-0000:00:20544-21latency_hist23:46:552
339950,0migration/37958-21diskmemload21:35:303
339950,0migration/37673-21taskset21:56:323
339950,0migration/35858-21kthreadcore20:52:143
339950,0migration/331515-21taskset22:11:473
339950,0migration/331223-21needreboot20:47:163
339950,0migration/33076-21ntp_kernel_pll_23:12:143
339950,0migration/329907-21munin-node21:47:143
339950,0migration/329579-21aten_r1power_en19:37:083
339950,0migration/32783-21kthreadcore20:02:133
339950,0migration/327367-21latency23:07:143
339950,0migration/326700-21switchtime23:47:173
339950,0migration/325107-21kthreadcore22:27:123
339950,0migration/322969-21irqcore19:07:123
339950,0migration/318704-21kthreadcore19:27:133
339950,0migration/317527-21idleruntime21:42:103
339950,0migration/317237-21kthreadcore22:42:123
339950,0migration/315623-21kthreadcore23:42:163
339950,0migration/313867-21kthreadcore20:37:103
29725050,0irq/27-eth0-tx-9346-21munin-node21:17:092
29725050,0irq/27-eth0-tx-6232-21munin-node22:57:102
29725050,0irq/27-eth0-tx-28011-21unixbench-2d23:07:192
29725050,0irq/27-eth0-tx-20814-21munin-node23:47:092
29725050,0irq/27-eth0-tx-15869-21iostat_ios22:42:112
29725050,0irq/27-eth0-tx-11098-21ntp_offset23:17:142
29725050,0irq/27-eth0-tx-0-21swapper/223:39:022
29725050,0irq/27-eth0-tx-0-21swapper/223:34:202
29725050,0irq/27-eth0-tx-0-21swapper/222:05:212
29725050,0irq/27-eth0-tx-0-21swapper/221:54:062
29725050,0irq/27-eth0-tx-0-21swapper/221:12:082
29725050,0irq/27-eth0-tx-0-21swapper/020:47:020
29725050,0irq/27-eth0-tx-0-21swapper/019:22:120
29715050,0irq/26-eth0-rx-8682-21kthreadcore23:37:133
29715050,0irq/26-eth0-rx-23420-21grep22:47:093
29715050,0irq/26-eth0-rx-21755-21df_abs23:27:073
29715050,0irq/26-eth0-rx-15062-21crond19:01:563
29715050,0irq/26-eth0-rx-13638-21sh23:22:073
29715050,0irq/26-eth0-rx-11970-21diskstats20:12:093
29715050,0irq/26-eth0-rx-0-21swapper/322:57:223
29715050,0irq/26-eth0-rx-0-21swapper/322:37:063
29715050,0irq/26-eth0-rx-0-21swapper/322:35:293
29715050,0irq/26-eth0-rx-0-21swapper/322:12:153
29715050,0irq/26-eth0-rx-0-21swapper/322:02:093
29715050,0irq/26-eth0-rx-0-21swapper/321:57:133
29715050,0irq/26-eth0-rx-0-21swapper/321:37:133
29715050,0irq/26-eth0-rx-0-21swapper/321:27:163
29715050,0irq/26-eth0-rx-0-21swapper/321:24:073
29715050,0irq/26-eth0-rx-0-21swapper/321:13:403
29715050,0irq/26-eth0-rx-0-21swapper/321:10:363
29715050,0irq/26-eth0-rx-0-21swapper/320:59:353
29715050,0irq/26-eth0-rx-0-21swapper/300:09:553
29715050,0irq/26-eth0-rx-0-21swapper/300:01:593
274419955,0cyclictest25566-21diskmemload21:39:532
274419955,0cyclictest0-21swapper/221:57:332
274419953,0cyclictest5723-21awk20:07:102
274419950,0cyclictest0-21swapper/222:15:312
274409955,0cyclictest0-21swapper/123:38:211
274409955,0cyclictest0-21swapper/121:22:551
274409955,0cyclictest0-21swapper/100:04:211
274409950,0cyclictest0-21swapper/123:53:101
274399950,0cyclictest0-21swapper/020:02:150
259950,0migration/231718-21munin-node22:32:082
259950,0migration/231237-21fschecks_time20:02:082
259950,0migration/224708-21latency_hist20:21:562
259950,0migration/224014-21aten_r1power_vo19:57:072
259950,0migration/223435-21fschecks_time22:47:092
259950,0migration/222009-21sh22:23:422
259950,0migration/220582-21sh23:03:232
259950,0migration/216656-21runrttasks19:47:482
259950,0migration/213780-21kthreadcore20:12:132
249950,0watchdog/23669-21sed22:52:142
249950,0watchdog/227336-21tr21:07:142
249950,0watchdog/212777-21diskstats00:02:092
19150,0ktimersoftd/10-21swapper/123:25:441
169950,0watchdog/110079-21fschecks_time20:57:101
149950,0migration/06518-21kthreadcore19:42:100
149950,0migration/0472-21latency_hist21:31:560
149950,0migration/04106-21latency_hist23:56:550
149950,0migration/030253-21sh22:29:350
149950,0migration/029389-21aten_r1power_po23:32:040
149950,0migration/02842-21sh23:12:120
149950,0migration/028330-21kthreadcore21:07:140
149950,0migration/027735-21taskset23:28:040
149950,0migration/027533-21taskset00:10:370
149950,0migration/024642-21munin-node19:57:090
149950,0migration/024356-21kthreadcore23:47:110
149950,0migration/023334-21kthreadcore19:07:130
149950,0migration/02177-21kthreadcore22:12:130
149950,0migration/020191-21kthreadcore22:02:130
149950,0migration/019181-21kthreadcore22:22:140
149950,0migration/017753-21mdstat20:37:120
149950,0migration/017701-21kthreadcore23:42:160
149950,0migration/01721-21kthreadcore22:32:120
149950,0migration/016305-21sh20:59:270
149950,0migration/015410-21fschecks_time22:42:080
149950,0migration/014830-21kthreadcore00:02:130
149950,0migration/014510-21sh21:58:100
4140,0ktimersoftd/00-21swapper/019:12:410
339940,0migration/39250-21kthreadcore20:32:123
339940,0migration/39147-21taskset19:19:433
339940,0migration/332080-21kthreadcore19:12:133
339940,0migration/331061-21taskset20:24:443
339940,0migration/32934-21irqcore18:52:133
339940,0migration/318588-21kthreadcore19:52:133
339940,0migration/314500-21kthreadcore19:47:133
339940,0migration/310414-21if_err_eth019:22:113
29725040,0irq/27-eth0-tx-7459-21ssh22:17:012
29725040,0irq/27-eth0-tx-23550-21ssh21:22:492
29725040,0irq/27-eth0-tx-1256-21ssh20:52:052
29725040,0irq/27-eth0-tx-0-21swapper/223:57:052
29725040,0irq/27-eth0-tx-0-21swapper/223:52:122
29725040,0irq/27-eth0-tx-0-21swapper/223:22:022
29725040,0irq/27-eth0-tx-0-21swapper/222:27:102
29725040,0irq/27-eth0-tx-0-21swapper/222:07:052
29725040,0irq/27-eth0-tx-0-21swapper/221:27:102
29725040,0irq/27-eth0-tx-0-21swapper/221:02:052
29725040,0irq/27-eth0-tx-0-21swapper/020:27:030
29725040,0irq/27-eth0-tx-0-21swapper/020:17:080
29725040,0irq/27-eth0-tx-0-21swapper/020:12:190
29725040,0irq/27-eth0-tx-0-21swapper/018:52:200
29715040,0irq/26-eth0-rx-0-21swapper/323:58:353
29715040,0irq/26-eth0-rx-0-21swapper/323:17:063
29715040,0irq/26-eth0-rx-0-21swapper/323:02:383
29715040,0irq/26-eth0-rx-0-21swapper/321:17:153
29715040,0irq/26-eth0-rx-0-21swapper/321:02:153
29715040,0irq/26-eth0-rx-0-21swapper/320:42:093
29715040,0irq/26-eth0-rx-0-21swapper/319:42:063
29715040,0irq/26-eth0-rx-0-21swapper/319:02:083
274419943,0cyclictest4788-21awk19:42:082
274419943,0cyclictest3556-21lldpd19:35:492
274419943,0cyclictest3514-21snmpd22:36:582
274419943,0cyclictest3514-21snmpd21:33:422
274419943,0cyclictest3514-21snmpd20:37:272
274419943,0cyclictest30925-21awk23:12:102
274419943,0cyclictest28630-21awk18:47:122
274419943,0cyclictest21184-21awk00:07:102
274419943,0cyclictest17464-21tail21:42:102
274419943,0cyclictest17083-21awk19:27:112
274419943,0cyclictest12229-21sadc20:36:562
274419943,0cyclictest10308-21awk20:57:112
274409944,0cyclictest1282-21ps21:52:111
274409944,0cyclictest0-21swapper/123:18:291
274409944,0cyclictest0-21swapper/123:08:231
274409944,0cyclictest0-21swapper/123:05:521
274409944,0cyclictest0-21swapper/122:04:421
274409944,0cyclictest0-21swapper/121:27:581
274409943,0cyclictest7790-21awk22:37:091
274409943,0cyclictest7358-21grep21:12:201
274409943,0cyclictest3556-21lldpd23:48:181
274409943,0cyclictest3556-21lldpd23:45:481
274409943,0cyclictest3556-21lldpd23:01:481
274409943,0cyclictest3556-21lldpd22:12:181
274409943,0cyclictest3556-21lldpd21:37:181
274409943,0cyclictest3556-21lldpd19:17:491
274409943,0cyclictest3514-21snmpd21:46:571
274409943,0cyclictest3241-21irqbalance23:57:341
274409943,0cyclictest3241-21irqbalance21:57:241
274409943,0cyclictest3241-21irqbalance21:21:341
274409943,0cyclictest3241-21irqbalance20:07:041
274409943,0cyclictest3241-21irqbalance19:47:041
274409943,0cyclictest3241-21irqbalance19:32:251
274409943,0cyclictest3241-21irqbalance19:27:351
274409943,0cyclictest3241-21irqbalance19:22:151
274409943,0cyclictest3241-21irqbalance19:12:051
274409943,0cyclictest3241-21irqbalance19:08:251
274409943,0cyclictest3241-21irqbalance19:02:551
274409943,0cyclictest21209-21awk00:07:101
274409943,0cyclictest18398-21awk21:02:131
274409943,0cyclictest15747-21awk22:42:101
274409940,0cyclictest17644-21munin-node19:52:091
274399943,0cyclictest3556-21lldpd22:59:480
274399943,0cyclictest3556-21lldpd21:51:480
274399943,0cyclictest24766-21awk22:07:100
274399943,0cyclictest23733-21awk19:32:100
274399943,0cyclictest22897-21awk23:07:100
274399943,0cyclictest17185-21awk19:27:120
274399943,0cyclictest16150-21awk19:02:110
274399942,0cyclictest17247-21munin-node19:52:090
274399940,0cyclictest0-21swapper/021:17:270
274399940,0cyclictest0-21swapper/000:00:470
27140,0ktimersoftd/20-21swapper/219:12:412
259940,0migration/24907-21kthreadcore19:17:122
259940,0migration/226992-21irqrtprio20:47:132
259940,0migration/222311-21df_abs19:07:092
259940,0migration/221653-21cpuspeed_turbos23:27:072
249940,0watchdog/221960-21kthreadcore19:52:142
249940,0watchdog/221178-21kthreadcore20:42:142
249940,0watchdog/20-21swapper/220:22:142
249940,0watchdog/20-21swapper/219:02:142
249940,0watchdog/20-21swapper/218:52:152
249940,0watchdog/20-21swapper/200:12:092
179940,0migration/18107-21taskset21:35:571
179940,0migration/127289-21kthreadcore21:07:141
179940,0migration/123501-21kthreadcore23:27:111
179940,0migration/120383-21kthreadcore20:17:121
179940,0migration/11644-21kthreadcore23:32:111
179940,0migration/11160-21kthreadcore20:02:121
179940,0migration/110356-21kthreadcore22:17:131
169940,0watchdog/16674-21cut19:42:101
169940,0watchdog/15228-21kthreadcore18:52:151
169940,0watchdog/130849-21if_eth023:12:091
169940,0watchdog/126330-21kthreadcore20:22:141
169940,0watchdog/121110-21cut21:42:141
169940,0watchdog/116531-21cut20:12:141
169940,0watchdog/116084-21perl22:22:101
169940,0watchdog/114351-21cut20:37:101
169940,0watchdog/10-21swapper/120:47:141
169940,0watchdog/10-21swapper/120:42:141
169940,0watchdog/10-21swapper/119:37:141
149940,0migration/05743-21diskmemload23:37:100
149940,0migration/05436-21fschecks_time20:07:090
149940,0migration/04978-21kthreadcore21:12:140
149940,0migration/030859-21kthreadcore00:12:140
149940,0migration/025377-21kthreadcore22:47:130
149940,0migration/020624-21kthreadcore20:42:140
149940,0migration/020043-21kthreadcore21:22:150
149940,0migration/013978-21missed_timers18:57:150
149940,0migration/012969-21kthreadcore19:47:130
339930,0migration/329240-21missed_timers19:57:133
29715030,0irq/26-eth0-rx-0-21swapper/320:28:023
29715030,0irq/26-eth0-rx-0-21swapper/320:17:173
29715030,0irq/26-eth0-rx-0-21swapper/320:07:143
29715030,0irq/26-eth0-rx-0-21swapper/319:32:073
29715030,0irq/26-eth0-rx-0-21swapper/318:47:063
274419932,0cyclictest9475-21awk18:57:112
274409933,0cyclictest0-21swapper/120:52:101
274409932,0cyclictest6603-21basename20:32:091
274409932,0cyclictest3514-21snmpd22:32:281
274409932,0cyclictest23427-21fschecks_time22:47:091
274399933,0cyclictest8879-21kworker/0:220:31:590
274399933,0cyclictest8879-21kworker/0:220:21:590
274399933,0cyclictest8879-21kworker/0:219:36:580
274399933,0cyclictest8879-21kworker/0:219:16:580
274399933,0cyclictest8879-21kworker/0:218:47:020
274399933,0cyclictest31534-21kworker/0:023:21:590
274399933,0cyclictest31534-21kworker/0:023:01:570
274399933,0cyclictest31534-21kworker/0:022:37:010
274399933,0cyclictest31534-21kworker/0:021:42:010
274399933,0cyclictest31534-21kworker/0:021:37:090
274399933,0cyclictest31534-21kworker/0:021:01:590
274399932,0cyclictest6524-21awk23:17:100
249930,0watchdog/20-21swapper/220:27:062
169930,0watchdog/10-21swapper/122:52:141
169930,0watchdog/10-21swapper/120:27:061
169930,0watchdog/10-21swapper/118:57:141
169930,0watchdog/10-21swapper/118:47:191
169930,0watchdog/10-21swapper/100:12:091
274419921,0cyclictest9344-21latency_hist19:21:562
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional