You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 01:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sat Jun 20, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1869827975,0sleep10-21swapper/118:50:381
304450400,0irq/25-eth10-21swapper/318:51:203
1852823324,0sleep20-21swapper/218:48:392
1848423120,0sleep00-21swapper/018:48:090
339970,0migration/323856-21sh21:54:103
339960,0migration/38197-21taskset00:07:193
339960,0migration/37258-21sh21:03:323
29725060,0irq/27-eth0-tx-22648-21munin-node20:32:200
149960,0migration/09456-21timerandwakeup20:42:330
149960,0migration/07138-21sh00:04:580
149960,0migration/031120-21timerwakeupswit21:57:320
149960,0migration/016221-21taskset21:50:210
149960,0migration/015274-21sh22:08:040
149960,0migration/014968-21taskset23:08:290
149960,0migration/01092-21fschecks_time22:42:230
8215050,0irq/24-0000:00:16203-21latency_hist23:32:102
4150,0ktimersoftd/00-21swapper/022:56:150
4150,0ktimersoftd/00-21swapper/022:56:150
339950,0migration/39949-21taskset20:45:323
339950,0migration/38946-21kthreadcore19:07:283
339950,0migration/3767-21runrttasks22:02:203
339950,0migration/37476-21aten_r1power_po19:32:213
339950,0migration/37403-21taskset22:24:043
339950,0migration/3435-21munin-node19:47:323
339950,0migration/330991-21sh23:18:123
339950,0migration/330384-21kthreadcore19:22:283
339950,0migration/328539-21kthreadcore20:57:283
339950,0migration/327164-21kthreadcore22:17:263
339950,0migration/32675-21kthreadcore23:02:273
339950,0migration/324717-21latency_hist22:57:113
339950,0migration/323401-21sh20:53:493
339950,0migration/321813-21kthreadcore23:12:273
339950,0migration/321738-21aten_r1power_fr20:07:223
339950,0migration/320318-21taskset19:40:363
339950,0migration/31978-21munin-node19:52:233
339950,0migration/319199-21kthreadcore22:32:263
339950,0migration/319191-21kthreadcore21:32:283
339950,0migration/317554-21munin-node22:52:233
339950,0migration/317554-21munin-node22:52:233
339950,0migration/314987-21munin-node20:22:323
339950,0migration/314381-21timerwakeupswit23:27:323
339950,0migration/31072-21aten_r1power_cu21:22:213
29725050,0irq/27-eth0-tx-6376-21munin-node19:07:270
29725050,0irq/27-eth0-tx-575-21munin-node19:27:240
29725050,0irq/27-eth0-tx-30183-21munin-node23:57:322
29725050,0irq/27-eth0-tx-25319-21munin-node21:37:222
29725050,0irq/27-eth0-tx-23000-21chrt23:33:372
29725050,0irq/27-eth0-tx-2098-21irqstats22:02:262
29725050,0irq/27-eth0-tx-15907-21ssh21:29:102
29725050,0irq/27-eth0-tx-0-21swapper/020:52:220
29725050,0irq/27-eth0-tx-0-21swapper/020:37:300
29725050,0irq/27-eth0-tx-0-21swapper/020:02:350
29725050,0irq/27-eth0-tx-0-21swapper/019:47:240
29715050,0irq/26-eth0-rx-9796-21fschecks_time21:27:243
29715050,0irq/26-eth0-rx-27326-21grep21:17:273
29715050,0irq/26-eth0-rx-21868-21ps19:42:273
29715050,0irq/26-eth0-rx-19229-21grep23:52:283
29715050,0irq/26-eth0-rx-16339-21ssh21:50:413
29715050,0irq/26-eth0-rx-14623-21ssh23:48:013
29715050,0irq/26-eth0-rx-13175-21kthreadcore20:47:293
29715050,0irq/26-eth0-rx-10205-21irqrtprio22:07:273
29715050,0irq/26-eth0-rx-1001-21if_err_eth123:42:243
29715050,0irq/26-eth0-rx-0-21swapper/323:57:283
29715050,0irq/26-eth0-rx-0-21swapper/323:38:473
29715050,0irq/26-eth0-rx-0-21swapper/322:40:043
29715050,0irq/26-eth0-rx-0-21swapper/321:57:173
29715050,0irq/26-eth0-rx-0-21swapper/321:39:113
29715050,0irq/26-eth0-rx-0-21swapper/321:14:453
29715050,0irq/26-eth0-rx-0-21swapper/321:07:263
29715050,0irq/26-eth0-rx-0-21swapper/300:19:223
29715050,0irq/26-eth0-rx-0-21swapper/300:02:223
27150,0ktimersoftd/216736-21diskmemload22:56:152
27150,0ktimersoftd/216736-21diskmemload22:56:152
249950,0watchdog/25864-21missed_timers23:02:292
189079955,0cyclictest0-21swapper/123:45:411
189079955,0cyclictest0-21swapper/123:18:151
189079955,0cyclictest0-21swapper/121:23:571
189079955,0cyclictest0-21swapper/121:08:211
189079950,0cyclictest0-21swapper/122:38:031
189079950,0cyclictest0-21swapper/122:28:261
189079950,0cyclictest0-21swapper/121:54:231
189079950,0cyclictest0-21swapper/121:45:241
189079950,0cyclictest0-21swapper/121:06:371
189069955,0cyclictest0-21swapper/023:55:410
189069955,0cyclictest0-21swapper/023:32:590
189069955,0cyclictest0-21swapper/023:26:120
189069955,0cyclictest0-21swapper/023:02:240
189069955,0cyclictest0-21swapper/022:58:180
189069950,0cyclictest0-21swapper/022:35:270
189069950,0cyclictest0-21swapper/022:24:050
179950,0migration/18981-21latency_hist21:47:111
179950,0migration/1477-21latency_hist22:22:111
179950,0migration/127901-21kthreadcore18:57:271
179950,0migration/121974-21unixbench_singl20:27:351
179950,0migration/11513-21if_eth1.322:42:251
179950,0migration/110833-21fschecks_count20:47:251
169950,0watchdog/129615-21kthreadcore23:37:291
169950,0watchdog/115908-21ssh23:31:211
149950,0migration/0983-21cpuspeed_turbos21:02:220
149950,0migration/08985-21latency_hist21:27:110
149950,0migration/08575-21latency_hist22:47:110
149950,0migration/0787-21munin-node22:02:210
149950,0migration/07172-21kthreadcore20:17:280
149950,0migration/05906-21taskset19:04:430
149950,0migration/032527-21sh21:01:260
149950,0migration/032139-21ksmtuned21:19:110
149950,0migration/030828-21sh23:17:440
149950,0migration/028544-21taskset20:12:230
149950,0migration/027219-21munin-node20:07:320
149950,0migration/026846-21kthreadcore22:37:270
149950,0migration/026440-21fschecks_time18:57:230
149950,0migration/025139-21latency_hist21:37:110
149950,0migration/023669-21kthreadcore19:42:280
149950,0migration/023052-21munin-node21:12:300
149950,0migration/02226-21sh21:42:260
149950,0migration/019600-21kthreadcore21:52:280
149950,0migration/018109-21kthreadcore19:37:280
149950,0migration/015234-21runrttasks23:49:450
149950,0migration/014455-21unixbench-2d23:27:320
149950,0migration/014380-21taskset22:27:300
8215040,0irq/24-0000:00:0-21swapper/219:12:112
339940,0migration/39943-21kthreadcore19:57:283
339940,0migration/330478-21irqcore20:37:283
339940,0migration/321427-21kthreadcore18:52:273
339940,0migration/320991-21kthreadcore20:27:293
339940,0migration/318401-21kthreadcore00:12:263
339940,0migration/315189-21kthreadcore19:12:283
339940,0migration/31469-21kthreadcore19:02:273
339940,0migration/31416-21fschecks_count21:42:233
339940,0migration/310598-21kthreadcore22:47:263
29725040,0irq/27-eth0-tx-25945-21if_eth1.222:17:242
29725040,0irq/27-eth0-tx-24535-21ssh23:37:182
29725040,0irq/27-eth0-tx-23538-21ssh22:33:592
29725040,0irq/27-eth0-tx-22682-21ssh00:13:352
29725040,0irq/27-eth0-tx-0-21swapper/223:23:272
29725040,0irq/27-eth0-tx-0-21swapper/223:17:312
29725040,0irq/27-eth0-tx-0-21swapper/222:58:442
29725040,0irq/27-eth0-tx-0-21swapper/222:51:052
29725040,0irq/27-eth0-tx-0-21swapper/222:42:252
29725040,0irq/27-eth0-tx-0-21swapper/222:27:232
29725040,0irq/27-eth0-tx-0-21swapper/222:12:212
29725040,0irq/27-eth0-tx-0-21swapper/222:08:022
29725040,0irq/27-eth0-tx-0-21swapper/221:47:482
29725040,0irq/27-eth0-tx-0-21swapper/221:42:202
29725040,0irq/27-eth0-tx-0-21swapper/221:32:232
29725040,0irq/27-eth0-tx-0-21swapper/221:12:162
29725040,0irq/27-eth0-tx-0-21swapper/221:07:132
29725040,0irq/27-eth0-tx-0-21swapper/221:02:232
29725040,0irq/27-eth0-tx-0-21swapper/220:58:422
29725040,0irq/27-eth0-tx-0-21swapper/200:17:442
29725040,0irq/27-eth0-tx-0-21swapper/200:07:222
29725040,0irq/27-eth0-tx-0-21swapper/020:22:290
29715040,0irq/26-eth0-rx-0-21swapper/323:32:223
29715040,0irq/26-eth0-rx-0-21swapper/323:22:243
29715040,0irq/26-eth0-rx-0-21swapper/323:08:403
29715040,0irq/26-eth0-rx-0-21swapper/322:42:443
29715040,0irq/26-eth0-rx-0-21swapper/322:28:153
29715040,0irq/26-eth0-rx-0-21swapper/322:12:203
29715040,0irq/26-eth0-rx-0-21swapper/320:12:313
29715040,0irq/26-eth0-rx-0-21swapper/319:27:283
259940,0migration/25353-21latency19:02:292
259940,0migration/23904-21kthreadcore21:22:272
259940,0migration/229699-21munin-node20:37:242
259940,0migration/223396-21runrttasks21:52:512
259940,0migration/220799-21aten_r1power_po19:42:222
259940,0migration/220630-21kthreadcore18:52:262
259940,0migration/216362-21taskset23:52:202
259940,0migration/215719-21kthreadcore19:37:282
249940,0watchdog/232219-21timerwakeupswit19:22:342
249940,0watchdog/226993-21sed20:07:292
249940,0watchdog/21033-21ssh23:42:252
249940,0watchdog/20-21swapper/223:07:292
249940,0watchdog/20-21swapper/221:17:212
249940,0watchdog/20-21swapper/220:42:292
189099943,0cyclictest986-21awk00:02:252
189099943,0cyclictest9306-21awk23:47:262
189099943,0cyclictest9242-21awk19:57:272
189099943,0cyclictest3556-21lldpd22:39:022
189099943,0cyclictest3556-21lldpd20:53:302
189099943,0cyclictest3556-21lldpd20:28:302
189099943,0cyclictest3556-21lldpd20:03:302
189099943,0cyclictest3556-21lldpd19:51:302
189099943,0cyclictest3514-21snmpd20:47:562
189099943,0cyclictest3514-21snmpd19:56:112
189099943,0cyclictest26200-21awk21:57:252
189099943,0cyclictest17436-21awk23:12:242
189099943,0cyclictest1590-21awk22:22:242
189079944,0cyclictest0-21swapper/123:59:151
189079944,0cyclictest0-21swapper/123:25:021
189079944,0cyclictest0-21swapper/100:20:131
189079944,0cyclictest0-21swapper/100:15:291
189079943,0cyclictest9790-21awk22:07:251
189079943,0cyclictest9518-21awk23:07:261
189079943,0cyclictest933-21awk00:02:251
189079943,0cyclictest8593-21sed20:17:331
189079943,0cyclictest3556-21lldpd19:37:301
189079943,0cyclictest3514-21snmpd22:47:411
189079943,0cyclictest3514-21snmpd22:12:411
189079943,0cyclictest3514-21snmpd20:23:111
189079943,0cyclictest3514-21snmpd20:09:261
189079943,0cyclictest3514-21snmpd20:00:411
189079943,0cyclictest3514-21snmpd19:53:561
189079943,0cyclictest3514-21snmpd19:45:411
189079943,0cyclictest3514-21snmpd00:08:561
189079943,0cyclictest25759-21awk20:57:251
189079943,0cyclictest18237-21awk21:32:261
189079943,0cyclictest1582-21awk19:27:261
189069944,0cyclictest0-21swapper/022:20:180
189069943,0cyclictest9058-21awk00:07:250
189069943,0cyclictest3556-21lldpd18:57:000
189069943,0cyclictest17051-21awk00:12:240
189069942,0cyclictest4563-21kworker/0:223:41:180
189069940,0cyclictest16755-21idleruntime-cro20:52:110
179940,0migration/13529-21kthreadcore19:02:281
179940,0migration/130074-21kthreadcore19:22:281
179940,0migration/129714-21kthreadcore19:47:281
179940,0migration/126672-21kthreadcore22:57:251
179940,0migration/123302-21fschecks_time20:32:231
179940,0migration/122982-21taskset22:52:531
179940,0migration/122982-21taskset22:52:531
179940,0migration/122411-21missed_timers20:52:291
179940,0migration/120326-21kthreadcore22:32:261
179940,0migration/118271-21kthreadcore23:12:261
179940,0migration/116424-21aten_r1power_en23:52:221
179940,0migration/116316-21kernelversion20:02:281
179940,0migration/114524-21kthreadcore19:12:271
179940,0migration/11396-21kthreadcore20:37:291
179940,0migration/110022-21taskset20:46:231
169940,0watchdog/19214-21ssh21:27:211
169940,0watchdog/131823-21ssh22:19:251
169940,0watchdog/126216-21iostat21:57:251
169940,0watchdog/125502-21ssh21:17:211
169940,0watchdog/125274-21diskmemload21:37:131
169940,0watchdog/116571-21cut23:32:211
169940,0watchdog/10-21swapper/123:04:171
169940,0watchdog/10-21swapper/119:17:221
149940,0migration/028572-21kthreadcore21:37:280
149940,0migration/025104-21fschecks_time23:57:240
149940,0migration/025050-21missed_timers19:17:280
149940,0migration/014327-21kthreadcore21:27:280
149940,0migration/011526-21kthreadcore19:32:270
8215030,0irq/24-0000:00:0-21swapper/219:07:252
29715030,0irq/26-eth0-rx-0-21swapper/320:17:223
29715030,0irq/26-eth0-rx-0-21swapper/320:02:333
29715030,0irq/26-eth0-rx-0-21swapper/319:17:243
29715030,0irq/26-eth0-rx-0-21swapper/318:57:223
259930,0migration/24842-21kthreadcore19:27:282
259930,0migration/211722-21kthreadcore20:22:272
249930,0watchdog/20-21swapper/219:17:222
189099933,0cyclictest3556-21lldpd19:32:302
189099932,0cyclictest3556-21lldpd20:18:002
189099932,0cyclictest29177-21awk20:12:262
189099932,0cyclictest28322-21sensors20:32:302
189099930,0cyclictest26745-21if_eth118:57:252
189079933,0cyclictest0-21swapper/120:12:131
189079932,0cyclictest9200-21awk23:47:261
189079932,0cyclictest8335-21awk19:32:251
189079932,0cyclictest12212-21cat19:07:341
189069933,0cyclictest4563-21kworker/0:223:42:240
189069933,0cyclictest4563-21kworker/0:223:12:120
189069933,0cyclictest4563-21kworker/0:222:12:140
189069933,0cyclictest4563-21kworker/0:221:07:120
189069933,0cyclictest4563-21kworker/0:220:27:250
189069933,0cyclictest4563-21kworker/0:219:57:150
189069933,0cyclictest4563-21kworker/0:219:52:250
189069933,0cyclictest4563-21kworker/0:219:12:190
189069933,0cyclictest17161-21kworker/0:000:17:140
189069930,0cyclictest0-21swapper/019:22:240
1706230,0sleep10-21swapper/122:02:261
169930,0watchdog/10-21swapper/121:12:171
169930,0watchdog/10-21swapper/118:52:261
29715020,0irq/26-eth0-rx-0-21swapper/320:32:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional