You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 08:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Thu Sep 24, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2572227675,0sleep00-21swapper/018:41:240
2559726766,0sleep20-21swapper/218:39:542
304450630,0irq/25-eth10-21swapper/318:42:183
2560625041,0sleep10-21swapper/118:40:011
339960,0migration/36318-21sh21:51:443
339960,0migration/35986-21sh22:12:303
339960,0migration/33801-21sh22:49:093
339960,0migration/328393-21sh00:08:173
339960,0migration/326830-21munin-node23:03:193
339960,0migration/322225-21latency_hist22:23:023
339960,0migration/319829-21sh22:59:363
29725060,0irq/27-eth0-tx-3271-21munin-node20:03:170
29715060,0irq/26-eth0-rx-5376-21memory20:48:223
29715060,0irq/26-eth0-rx-14710-21grep22:18:133
29715060,0irq/26-eth0-rx-0-21swapper/322:31:263
259369960,0cyclictest24060-21diskmemload21:33:250
149960,0migration/07359-21sh21:11:390
149960,0migration/027076-21sh23:23:580
149960,0migration/023276-21sh21:00:440
4150,0ktimersoftd/00-21swapper/019:23:020
339950,0migration/39009-21kthreadcore23:33:183
339950,0migration/38677-21kthreadcore22:33:193
339950,0migration/37582-21fschecks_count18:53:153
339950,0migration/36576-21taskset18:50:003
339950,0migration/35144-21ntp_kernel_pll_21:28:203
339950,0migration/33239-21latency_hist20:03:023
339950,0migration/331121-21kthreadcore23:08:193
339950,0migration/326603-21taskset23:44:123
339950,0migration/323197-21cpuspeed_turbos22:03:143
339950,0migration/322407-21kthreadcore23:23:183
339950,0migration/322282-21taskset21:40:223
339950,0migration/320904-21munin-node00:03:183
339950,0migration/31847-21taskset19:35:153
339950,0migration/317001-21hddtemp_smartct20:58:153
339950,0migration/314766-21munin-node19:43:243
339950,0migration/313327-21kthreadcore20:08:173
339950,0migration/31321-21taskset19:13:103
339950,0migration/310503-21kthreadcore21:13:183
339950,0migration/310121-21timerwakeupswit20:28:263
29725050,0irq/27-eth0-tx-3919-21kthreadcore21:48:212
29725050,0irq/27-eth0-tx-29895-21ssh20:43:240
29725050,0irq/27-eth0-tx-22470-21ssh22:02:332
29725050,0irq/27-eth0-tx-19615-21munin-node00:03:122
29725050,0irq/27-eth0-tx-19271-21ssh00:02:502
29725050,0irq/27-eth0-tx-0-21swapper/223:57:502
29725050,0irq/27-eth0-tx-0-21swapper/223:23:322
29725050,0irq/27-eth0-tx-0-21swapper/222:53:182
29725050,0irq/27-eth0-tx-0-21swapper/222:14:562
29725050,0irq/27-eth0-tx-0-21swapper/222:14:562
29725050,0irq/27-eth0-tx-0-21swapper/221:15:102
29725050,0irq/27-eth0-tx-0-21swapper/020:28:380
29725050,0irq/27-eth0-tx-0-21swapper/019:18:080
29725050,0irq/27-eth0-tx-0-21swapper/018:43:080
29715050,0irq/26-eth0-rx-5935-21fschecks_time22:53:133
29715050,0irq/26-eth0-rx-22140-21uptime21:18:253
29715050,0irq/26-eth0-rx-0-21swapper/323:52:383
29715050,0irq/26-eth0-rx-0-21swapper/323:32:133
29715050,0irq/26-eth0-rx-0-21swapper/323:21:543
29715050,0irq/26-eth0-rx-0-21swapper/322:38:423
29715050,0irq/26-eth0-rx-0-21swapper/322:14:263
29715050,0irq/26-eth0-rx-0-21swapper/322:14:263
29715050,0irq/26-eth0-rx-0-21swapper/321:58:183
29715050,0irq/26-eth0-rx-0-21swapper/321:43:233
29715050,0irq/26-eth0-rx-0-21swapper/321:37:363
29715050,0irq/26-eth0-rx-0-21swapper/321:25:323
29715050,0irq/26-eth0-rx-0-21swapper/321:09:253
29715050,0irq/26-eth0-rx-0-21swapper/320:53:203
29715050,0irq/26-eth0-rx-0-21swapper/320:45:263
259389955,0cyclictest0-21swapper/223:02:422
259389955,0cyclictest0-21swapper/220:46:382
259389954,0cyclictest310-21munin-node18:48:242
259389950,0cyclictest0-21swapper/222:42:402
259389950,0cyclictest0-21swapper/222:06:532
259389950,0cyclictest0-21swapper/221:57:072
259369955,0cyclictest0-21swapper/021:03:560
259369954,0cyclictest23177-21perf21:43:020
259369950,0cyclictest0-21swapper/022:52:150
259369950,0cyclictest0-21swapper/022:26:520
259369950,0cyclictest0-21swapper/022:18:120
259369950,0cyclictest0-21swapper/000:10:170
259950,0migration/231381-21sh21:27:062
259950,0migration/231188-21latency_hist21:48:022
259950,0migration/228960-21cpuspeed_turbos23:28:132
259950,0migration/224149-21latency_hist21:03:022
259950,0migration/221753-21kthreadcore20:13:192
259950,0migration/217907-21cpuspeed_turbos20:38:152
249950,0watchdog/210441-21ntp_states23:13:232
179950,0migration/15872-21timerandwakeup20:48:261
179950,0migration/126387-21cpuspeed_turbos18:43:131
179950,0migration/110104-21kthreadcore20:53:201
169950,0watchdog/19743-21unixbench-2d23:53:231
169950,0watchdog/18058-21munin-node19:18:241
149950,0migration/09863-21kthreadcore21:13:170
149950,0migration/0912-21taskset19:11:070
149950,0migration/08585-21df_abs20:53:140
149950,0migration/05748-21if_eth023:13:190
149950,0migration/04265-21aten_r1power_cu23:33:110
149950,0migration/031985-21fschecks_count21:48:170
149950,0migration/031829-21kthreadcore19:33:200
149950,0migration/029192-21unixbench-2d20:18:230
149950,0migration/029156-21aten_r1power_vo19:58:130
149950,0migration/028647-21sh23:28:040
149950,0migration/024623-21fschecks_time21:23:180
149950,0migration/023775-21kthreadcore00:03:190
149950,0migration/022305-21irqcore23:03:170
149950,0migration/019097-21kthreadcore22:38:190
149950,0migration/018200-21fschecks_time20:38:160
149950,0migration/015724-21taskset19:48:060
149950,0migration/014691-21kthreadcore23:38:190
149950,0migration/013952-21taskset21:55:410
149950,0migration/013666-21kthreadcore20:08:170
149950,0migration/012712-21munin-node23:58:170
149950,0migration/012502-21taskset22:34:390
149950,0migration/01246-21kthreadcore21:28:170
339940,0migration/35680-21if_err_eth023:13:183
339940,0migration/34350-21fschecks_time23:53:143
339940,0migration/33390-21timerandwakeup20:23:263
339940,0migration/332301-21kthreadcore19:58:183
339940,0migration/329712-21taskset20:22:543
339940,0migration/317817-21irqrtprio20:13:173
339940,0migration/314076-21users19:18:273
29725040,0irq/27-eth0-tx-3524-21sshd20:13:490
29725040,0irq/27-eth0-tx-28308-21ssh23:48:122
29725040,0irq/27-eth0-tx-22541-21ssh21:19:352
29725040,0irq/27-eth0-tx-14415-21munin-node22:18:172
29725040,0irq/27-eth0-tx-0-21swapper/223:18:432
29725040,0irq/27-eth0-tx-0-21swapper/223:09:442
29725040,0irq/27-eth0-tx-0-21swapper/222:43:142
29725040,0irq/27-eth0-tx-0-21swapper/222:08:122
29725040,0irq/27-eth0-tx-0-21swapper/221:41:132
29725040,0irq/27-eth0-tx-0-21swapper/221:33:172
29725040,0irq/27-eth0-tx-0-21swapper/220:48:082
29725040,0irq/27-eth0-tx-0-21swapper/020:23:380
29725040,0irq/27-eth0-tx-0-21swapper/019:53:170
29715040,0irq/26-eth0-rx-16731-21cut18:58:183
29715040,0irq/26-eth0-rx-0-21swapper/323:58:133
29715040,0irq/26-eth0-rx-0-21swapper/323:39:223
29715040,0irq/26-eth0-rx-0-21swapper/322:43:213
29715040,0irq/26-eth0-rx-0-21swapper/321:56:093
29715040,0irq/26-eth0-rx-0-21swapper/321:05:253
29715040,0irq/26-eth0-rx-0-21swapper/319:48:143
259389944,0cyclictest0-21swapper/223:33:172
259389943,0cyclictest3514-21snmpd22:48:422
259389943,0cyclictest3514-21snmpd19:39:572
259389943,0cyclictest3514-21snmpd19:11:272
259389943,0cyclictest3241-21irqbalance20:22:202
259389943,0cyclictest27030-21awk18:43:162
259389943,0cyclictest14652-21awk18:58:162
259389943,0cyclictest13162-21awk23:38:172
259379944,0cyclictest0-21swapper/122:28:461
259379943,0cyclictest3556-21lldpd23:48:121
259379943,0cyclictest3556-21lldpd23:33:121
259379943,0cyclictest3556-21lldpd23:14:091
259379943,0cyclictest3556-21lldpd23:03:091
259379943,0cyclictest3556-21lldpd22:57:391
259379943,0cyclictest3556-21lldpd21:58:091
259379943,0cyclictest3556-21lldpd20:44:381
259379943,0cyclictest3556-21lldpd19:53:081
259379943,0cyclictest3556-21lldpd19:08:081
259379943,0cyclictest3556-21lldpd00:08:121
259379943,0cyclictest3514-21snmpd23:29:121
259379943,0cyclictest3514-21snmpd22:06:121
259379943,0cyclictest3514-21snmpd21:39:121
259379943,0cyclictest3514-21snmpd00:03:121
259379943,0cyclictest31764-21awk22:08:161
259379943,0cyclictest18194-21grep20:38:161
259379943,0cyclictest11809-21awk20:33:141
259379943,0cyclictest1004-21awk21:08:171
259379940,0cyclictest0-21swapper/122:13:091
259379940,0cyclictest0-21swapper/122:13:091
259369943,0cyclictest3556-21lldpd22:13:090
259369943,0cyclictest3556-21lldpd22:13:090
259369943,0cyclictest3514-21snmpd22:43:120
259369943,0cyclictest3514-21snmpd18:58:120
259369943,0cyclictest3241-21irqbalance23:55:590
259369943,0cyclictest3241-21irqbalance23:48:090
259369943,0cyclictest3241-21irqbalance23:45:590
259369943,0cyclictest3241-21irqbalance22:30:500
259369943,0cyclictest3241-21irqbalance22:02:100
259369943,0cyclictest3241-21irqbalance21:48:000
259369943,0cyclictest3241-21irqbalance20:48:200
259369943,0cyclictest23900-21awk22:03:170
259369943,0cyclictest1345-21awk18:48:180
259369941,0cyclictest0-21swapper/020:33:110
259940,0migration/28194-21kthreadcore22:33:182
259940,0migration/2637-21kthreadcore22:28:162
259940,0migration/26139-21kthreadcore20:03:212
259940,0migration/25639-21kthreadcore20:28:192
259940,0migration/23734-21kthreadcore19:13:192
259940,0migration/23014-21kthreadcore21:08:182
259940,0migration/226133-21kthreadcore19:53:192
259940,0migration/22597-21kthreadcore21:28:172
259940,0migration/224365-21taskset21:03:062
259940,0migration/222389-21irqcore23:03:172
259940,0migration/221652-21cpuspeed_turbos19:28:142
259940,0migration/216844-21irqcore19:48:182
259940,0migration/215052-21cpuspeed_turbos19:23:142
259940,0migration/213468-21needreboot19:18:232
259940,0migration/211288-21kthreadcore20:53:212
249940,0watchdog/231269-21kthreadcore20:23:202
249940,0watchdog/228791-21gltestperf19:33:162
249940,0watchdog/220784-21perl23:43:112
249940,0watchdog/20-21swapper/218:56:122
249940,0watchdog/20-21swapper/200:08:192
179940,0migration/19199-21aten_r1power_vo19:43:131
179940,0migration/18072-21fschecks_count21:33:171
179940,0migration/17488-21kthreadcore19:38:231
179940,0migration/16705-21hwlatdetect22:33:161
179940,0migration/15866-21kthreadcore19:13:201
179940,0migration/13606-21kthreadcore21:28:171
179940,0migration/132631-21munin-node21:48:191
179940,0migration/129779-21aten_r1power_cu22:48:111
179940,0migration/128996-21kthreadcore21:23:231
179940,0migration/128023-21latency_hist19:33:021
179940,0migration/127673-21kthreadcore21:03:231
179940,0migration/125666-21kthreadcore20:18:171
179940,0migration/123100-21latency_hist20:18:021
179940,0migration/123087-21kthreadcore19:03:211
179940,0migration/122907-21irqcore22:43:211
179940,0migration/122904-21kthreadcore23:23:181
179940,0migration/116898-21kthreadcore23:18:171
179940,0migration/116803-21kthreadcore22:18:181
179940,0migration/115597-21kthreadcore22:38:181
179940,0migration/115425-21fschecks_time19:23:161
179940,0migration/114336-21fschecks_time18:58:151
179940,0migration/113470-21kthreadcore23:58:181
179940,0migration/112155-21kthreadcore21:53:181
179940,0migration/111653-21kthreadcore20:08:161
169940,0watchdog/1357-21kthreadcore23:08:191
169940,0watchdog/127833-21ssh22:23:241
169940,0watchdog/123534-21ssh21:22:361
169940,0watchdog/123334-21kthreadcore23:43:151
169940,0watchdog/122194-21hwlatdetect19:28:161
169940,0watchdog/120734-21ssh23:02:191
169940,0watchdog/115911-21kthreadcore23:38:191
169940,0watchdog/10-21swapper/121:43:241
169940,0watchdog/10-21swapper/121:00:121
169940,0watchdog/10-21swapper/120:28:241
149940,0migration/08677-21kthreadcore22:53:170
149940,0migration/032377-21kthreadcore22:08:170
149940,0migration/031976-21kthreadcore23:08:190
149940,0migration/022124-21kthreadcore19:03:210
149940,0migration/016030-21kthreadcore22:58:170
149940,0migration/015305-21kthreadcore23:18:170
339930,0migration/32740-21diskstats19:38:183
29725030,0irq/27-eth0-tx-0-21swapper/019:28:140
29715030,0irq/26-eth0-rx-0-21swapper/320:38:143
29715030,0irq/26-eth0-rx-0-21swapper/319:53:243
29715030,0irq/26-eth0-rx-0-21swapper/319:28:143
29715030,0irq/26-eth0-rx-0-21swapper/319:08:143
29715030,0irq/26-eth0-rx-0-21swapper/319:03:273
259389932,0cyclictest3514-21snmpd19:46:572
259389932,0cyclictest3514-21snmpd19:03:122
259389932,0cyclictest13750-21kthreadcore20:08:172
259389932,0cyclictest11911-21awk20:33:152
259389930,0cyclictest22923-21tune2fs22:23:182
259379932,0cyclictest9791-21ls20:08:021
259379932,0cyclictest6065-21sensors18:48:241
259379932,0cyclictest15734-21munin-node19:48:201
259379932,0cyclictest13858-21sensors21:13:221
259379931,0cyclictest0-21swapper/119:58:191
259369933,0cyclictest26384-21kworker/0:021:18:130
259369933,0cyclictest26384-21kworker/0:019:43:130
259369933,0cyclictest26384-21kworker/0:019:38:230
259369932,0cyclictest7962-21awk18:53:170
259369932,0cyclictest26384-21kworker/0:019:13:210
249930,0watchdog/20-21swapper/219:58:242
179930,0migration/131840-21kthreadcore20:23:201
169930,0watchdog/10-21swapper/118:53:201
29715020,0irq/26-eth0-rx-0-21swapper/320:33:183
29715020,0irq/26-eth0-rx-0-21swapper/319:23:133
29715020,0irq/26-eth0-rx-0-21swapper/318:43:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional