You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 06:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Thu May 21, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
164723725,0sleep20-21swapper/218:50:442
200023624,0sleep10-21swapper/118:54:511
304450350,0irq/25-eth10-21swapper/318:51:273
173123524,0sleep00-21swapper/018:51:420
339970,0migration/318476-21kthreadcore23:05:173
20949970,0cyclictest31580-21kthreadcore19:40:201
339960,0migration/38198-21sh21:38:303
339960,0migration/331652-21sh21:31:033
339960,0migration/331543-21sh23:14:233
339960,0migration/329387-21sh00:10:283
339960,0migration/325070-21latency_hist21:30:023
339960,0migration/323467-21taskset21:46:113
339960,0migration/322911-21sh22:05:273
339960,0migration/315492-21sh22:22:563
259960,0migration/21784-21idleruntime21:15:152
20949966,0cyclictest32692-21diskmemload23:00:241
20939960,0cyclictest0-21swapper/019:15:120
149960,0migration/06751-21sh22:15:430
149960,0migration/032039-21sh23:15:110
149960,0migration/016589-21sh21:44:310
8215050,0irq/24-0000:00:0-21swapper/219:10:032
339950,0migration/39432-21taskset19:21:033
339950,0migration/38155-21switchtime18:55:203
339950,0migration/37222-21runrttasks22:37:503
339950,0migration/332650-21sh21:13:513
339950,0migration/332038-21taskset22:34:233
339950,0migration/330692-21gltestperf19:40:163
339950,0migration/330036-21irqcore19:15:173
339950,0migration/328587-21mdstat19:35:193
339950,0migration/32844-21kthreadcore21:15:233
339950,0migration/325093-21kthreadcore23:50:183
339950,0migration/324931-21gltestperf20:00:163
339950,0migration/324292-21taskset21:08:353
339950,0migration/321633-21kthreadcore20:20:193
339950,0migration/321533-21timerwakeupswit19:05:263
339950,0migration/321109-21switchtime00:05:243
339950,0migration/319973-21kthreadcore23:45:193
339950,0migration/318063-21taskset20:17:243
339950,0migration/31508-21kthreadcore22:55:193
339950,0migration/313963-21irqcore20:40:183
339950,0migration/313013-21kthreadcore19:50:213
339950,0migration/31162-21kthreadcore23:55:173
339950,0migration/311515-21munin-node20:35:183
339950,0migration/310717-21kthreadcore22:00:183
29725050,0irq/27-eth0-tx-6979-21munin-node00:20:212
29725050,0irq/27-eth0-tx-31327-21awk21:10:262
29725050,0irq/27-eth0-tx-31257-21munin-node00:15:132
29725050,0irq/27-eth0-tx-24021-21munin-node23:10:232
29725050,0irq/27-eth0-tx-0-21swapper/223:41:022
29725050,0irq/27-eth0-tx-0-21swapper/221:27:422
29725050,0irq/27-eth0-tx-0-21swapper/200:14:022
29725050,0irq/27-eth0-tx-0-21swapper/020:55:380
29725050,0irq/27-eth0-tx-0-21swapper/020:40:310
29725050,0irq/27-eth0-tx-0-21swapper/020:37:310
29725050,0irq/27-eth0-tx-0-21swapper/020:19:320
29725050,0irq/27-eth0-tx-0-21swapper/020:15:020
29725050,0irq/27-eth0-tx-0-21swapper/019:45:140
29725050,0irq/27-eth0-tx-0-21swapper/019:34:020
29715050,0irq/26-eth0-rx-8097-21ssh22:19:363
29715050,0irq/26-eth0-rx-5265-21grep20:55:213
29715050,0irq/26-eth0-rx-4600-21awk20:05:593
29715050,0irq/26-eth0-rx-32048-21munin-node23:15:153
29715050,0irq/26-eth0-rx-16716-21fschecks_count22:45:153
29715050,0irq/26-eth0-rx-0-21swapper/323:35:083
29715050,0irq/26-eth0-rx-0-21swapper/323:30:203
29715050,0irq/26-eth0-rx-0-21swapper/323:25:503
29715050,0irq/26-eth0-rx-0-21swapper/323:00:203
29715050,0irq/26-eth0-rx-0-21swapper/322:44:123
29715050,0irq/26-eth0-rx-0-21swapper/322:10:213
29715050,0irq/26-eth0-rx-0-21swapper/321:55:213
29715050,0irq/26-eth0-rx-0-21swapper/321:20:223
29715050,0irq/26-eth0-rx-0-21swapper/321:03:073
29715050,0irq/26-eth0-rx-0-21swapper/319:10:193
29715050,0irq/26-eth0-rx-0-21swapper/300:15:143
29715050,0irq/26-eth0-rx-0-21swapper/300:02:213
259950,0migration/232049-21munin-node23:15:132
259950,0migration/221940-21kthreadcore19:55:202
259950,0migration/219660-21kthreadcore23:45:192
259950,0migration/217454-21latency_hist19:55:032
259950,0migration/216643-21latency_hist19:30:032
259950,0migration/211781-21latency_hist20:15:032
259950,0migration/210486-21kthreadcore23:00:202
249950,0watchdog/213793-21ssh00:01:402
20989954,0cyclictest1118-21awk22:35:162
20989950,0cyclictest0-21swapper/223:55:032
20989950,0cyclictest0-21swapper/223:06:392
20989950,0cyclictest0-21swapper/222:42:512
20949955,0cyclictest0-21swapper/123:25:091
20949955,0cyclictest0-21swapper/122:26:111
20949955,0cyclictest0-21swapper/121:09:251
20949955,0cyclictest0-21swapper/100:12:171
20949950,0cyclictest0-21swapper/121:11:371
20939955,0cyclictest0-21swapper/022:38:530
20939955,0cyclictest0-21swapper/021:04:080
20939950,0cyclictest0-21swapper/021:52:510
20939950,0cyclictest0-21swapper/000:07:110
179950,0migration/17388-21sh21:15:491
149950,0migration/09266-21irqrtprio23:00:190
149950,0migration/08375-21kthreadcore00:20:180
149950,0migration/08070-21taskset21:17:340
149950,0migration/05650-21kthreadcore19:20:190
149950,0migration/04796-21kthreadcore22:55:200
149950,0migration/030411-21munin-node22:10:230
149950,0migration/02911-21kthreadcore21:55:190
149950,0migration/028164-21kthreadcore20:25:260
149950,0migration/028164-21kthreadcore20:25:260
149950,0migration/025563-21kthreadcore23:10:180
149950,0migration/025410-21kthreadcore23:50:190
149950,0migration/024580-21sh00:10:170
149950,0migration/022730-21taskset23:07:060
149950,0migration/021957-21mdstat22:25:200
149950,0migration/021912-21sh23:46:130
149950,0migration/020728-21kthreadcore20:20:190
149950,0migration/018343-21kthreadcore19:05:200
149950,0migration/017466-21fschecks_time22:05:150
149950,0migration/016026-21kthreadcore19:50:220
149950,0migration/011598-21kthreadcore00:00:180
8215040,0irq/24-0000:00:0-21swapper/222:50:022
339940,0migration/35983-21kthreadcore19:45:203
339940,0migration/331108-21diskmemload21:50:253
339940,0migration/32623-21kthreadcore20:30:193
339940,0migration/314090-21kthreadcore21:40:193
29725040,0irq/27-eth0-tx-31906-21aten2.4-expect20:30:130
29725040,0irq/27-eth0-tx-310-21munin-node22:15:142
29725040,0irq/27-eth0-tx-23560-21ssh23:50:132
29725040,0irq/27-eth0-tx-15754-21ssh23:25:122
29725040,0irq/27-eth0-tx-0-21swapper/223:30:022
29725040,0irq/27-eth0-tx-0-21swapper/221:55:082
29725040,0irq/27-eth0-tx-0-21swapper/221:50:252
29725040,0irq/27-eth0-tx-0-21swapper/221:45:222
29725040,0irq/27-eth0-tx-0-21swapper/221:40:082
29725040,0irq/27-eth0-tx-0-21swapper/221:35:172
29725040,0irq/27-eth0-tx-0-21swapper/221:30:022
29725040,0irq/27-eth0-tx-0-21swapper/221:06:092
29725040,0irq/27-eth0-tx-0-21swapper/221:00:132
29725040,0irq/27-eth0-tx-0-21swapper/020:50:140
29715040,0irq/26-eth0-rx-0-21swapper/323:40:583
29715040,0irq/26-eth0-rx-0-21swapper/323:20:103
29715040,0irq/26-eth0-rx-0-21swapper/322:53:073
29715040,0irq/26-eth0-rx-0-21swapper/322:25:103
29715040,0irq/26-eth0-rx-0-21swapper/320:50:173
29715040,0irq/26-eth0-rx-0-21swapper/320:10:193
29715040,0irq/26-eth0-rx-0-21swapper/319:55:163
29715040,0irq/26-eth0-rx-0-21swapper/300:20:033
259940,0migration/27831-21aten_r1power_en23:20:122
259940,0migration/27524-21kthreadcore19:45:202
259940,0migration/26981-21kthreadcore18:55:162
259940,0migration/2540-21aten_r1power_en20:55:152
259940,0migration/229515-21kthreadcore22:30:192
259940,0migration/227623-21kthreadcore20:50:192
259940,0migration/219044-21kthreadcore22:25:192
259940,0migration/216227-21sh22:45:082
259940,0migration/213329-21kthreadcore21:20:232
259940,0migration/210936-21kthreadcore22:20:192
249940,0watchdog/2587-21hddtemp_smartct22:55:162
249940,0watchdog/25535-21users20:30:252
249940,0watchdog/229922-21kthreadcore22:10:202
249940,0watchdog/20-21swapper/222:00:082
249940,0watchdog/20-21swapper/220:25:252
249940,0watchdog/20-21swapper/220:25:252
20989943,0cyclictest7155-21awk20:35:152
20989943,0cyclictest4221-21awk19:20:172
20989943,0cyclictest3556-21lldpd22:05:022
20989943,0cyclictest3556-21lldpd19:26:022
20989943,0cyclictest3556-21lldpd00:06:032
20989943,0cyclictest32531-21grep23:35:152
20989943,0cyclictest31737-21awk20:05:182
20989943,0cyclictest30806-21awk19:40:172
20989943,0cyclictest25207-21awk20:00:172
20989943,0cyclictest23198-21awk19:10:172
20989942,0cyclictest19461-21awk20:20:172
20949944,0cyclictest0-21swapper/123:30:591
20949944,0cyclictest0-21swapper/122:46:131
20949944,0cyclictest0-21swapper/121:36:321
20949943,0cyclictest9264-21grep19:20:251
20949943,0cyclictest9256-21awk22:40:171
20949943,0cyclictest8236-21awk00:00:161
20949943,0cyclictest5961-21sadc20:35:031
20949943,0cyclictest3556-21lldpd21:23:321
20949943,0cyclictest3514-21snmpd23:50:061
20949943,0cyclictest3514-21snmpd19:27:051
20949943,0cyclictest3241-21irqbalance22:35:101
20949943,0cyclictest3241-21irqbalance21:26:511
20949943,0cyclictest3241-21irqbalance20:50:211
20949943,0cyclictest3241-21irqbalance20:46:011
20949943,0cyclictest3241-21irqbalance20:44:511
20949943,0cyclictest3241-21irqbalance19:55:411
20949943,0cyclictest3241-21irqbalance19:53:111
20949943,0cyclictest3241-21irqbalance00:20:501
20949943,0cyclictest31841-21awk20:05:181
20949943,0cyclictest26198-21awk20:25:241
20949943,0cyclictest26198-21awk20:25:241
20949943,0cyclictest26021-21awk21:50:171
20949943,0cyclictest25426-21awk22:30:161
20949943,0cyclictest25205-21cut22:10:161
20949943,0cyclictest25110-21awk20:00:171
20949943,0cyclictest16168-21awk00:05:161
20949943,0cyclictest10032-21awk19:00:171
20939944,0cyclictest0-21swapper/022:53:050
20939944,0cyclictest0-21swapper/022:43:370
20939943,0cyclictest3514-21snmpd23:25:210
20939943,0cyclictest3514-21snmpd22:00:060
20939943,0cyclictest3241-21irqbalance23:30:200
20939943,0cyclictest3241-21irqbalance22:31:100
20939943,0cyclictest32389-21awk23:55:150
20939943,0cyclictest32210-21awk00:15:160
20939943,0cyclictest17775-21awk21:05:170
20939943,0cyclictest1765-21awk21:35:160
20939943,0cyclictest10131-21awk21:20:200
179940,0migration/14812-21munin-node00:15:231
179940,0migration/13022-21kthreadcore21:55:191
179940,0migration/124188-21kthreadcore19:10:191
179940,0migration/120392-21kthreadcore23:45:201
179940,0migration/117369-21gltestperf19:30:151
179940,0migration/111604-21kthreadcore22:00:181
179940,0migration/111565-21kthreadcore22:20:191
179940,0migration/11113-21fschecks_time20:55:171
179940,0migration/110141-21kthreadcore21:00:201
169940,0watchdog/16922-21ssh23:18:241
169940,0watchdog/15862-21ssh23:57:001
169940,0watchdog/15302-21sed22:55:201
169940,0watchdog/125331-21aten_r1power_cu21:30:131
169940,0watchdog/124735-21ssh21:49:521
169940,0watchdog/115952-21ssh23:05:041
169940,0watchdog/115760-40yum-updatesd-he21:42:081
169940,0watchdog/10-21swapper/123:40:201
169940,0watchdog/10-21swapper/122:07:281
169940,0watchdog/10-21swapper/119:35:171
149940,0migration/022482-21aten_r1power_po19:10:140
149940,0migration/01950-21kthreadcore20:05:200
149940,0migration/018132-21irqcore21:45:170
29725030,0irq/27-eth0-tx-0-21swapper/019:55:140
29715030,0irq/26-eth0-rx-0-21swapper/320:45:283
29715030,0irq/26-eth0-rx-0-21swapper/320:25:133
29715030,0irq/26-eth0-rx-0-21swapper/320:25:133
29715030,0irq/26-eth0-rx-0-21swapper/319:25:143
259930,0migration/218298-21netstat20:40:212
249930,0watchdog/20-21swapper/219:35:172
249930,0watchdog/20-21swapper/219:01:012
20989932,0cyclictest31578-21kthreadcore19:15:182
20989932,0cyclictest26000-21crond20:50:032
20949932,0cyclictest5249-21awk19:45:181
20949932,0cyclictest3514-21snmpd20:16:201
20949932,0cyclictest3514-21snmpd19:15:051
20949932,0cyclictest3514-21snmpd19:09:201
20949932,0cyclictest32759-21awk23:35:171
20949932,0cyclictest3187-21awk18:55:131
20949932,0cyclictest24487-21cpuspeed_turbos22:50:141
20949932,0cyclictest19367-21awk20:20:161
20949932,0cyclictest1270-21awk22:15:161
20939933,0cyclictest24212-21kworker/0:122:45:110
20939933,0cyclictest24212-21kworker/0:121:25:060
20939933,0cyclictest24212-21kworker/0:121:10:060
20939933,0cyclictest24212-21kworker/0:120:45:160
20939933,0cyclictest24212-21kworker/0:120:00:060
20939933,0cyclictest23460-21kworker/0:219:40:080
20939933,0cyclictest23460-21kworker/0:219:00:100
20939933,0cyclictest23460-21kworker/0:218:55:080
20939933,0cyclictest16541-21kworker/0:223:40:170
20939933,0cyclictest16541-21kworker/0:223:35:230
20939933,0cyclictest0-21swapper/019:25:080
20939932,0cyclictest7706-21sed23:20:020
20939932,0cyclictest24204-21awk19:35:160
20939931,0cyclictest8449-21cat22:20:020
20939931,0cyclictest0-21swapper/021:30:190
179930,0migration/16948-21gltestperf20:35:141
169930,0watchdog/10-21swapper/123:23:361
169930,0watchdog/10-21swapper/123:10:161
169930,0watchdog/10-21swapper/120:10:131
339920,0migration/39475-21diskstats19:00:143
29715020,0irq/26-eth0-rx-0-21swapper/319:30:283
20989921,0cyclictest11648-21latency_hist20:15:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional