You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 21:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Wed May 20, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2690823627,0sleep30-21swapper/306:50:343
2725823422,0sleep00-21swapper/006:54:390
2725523425,0sleep20-21swapper/206:54:372
2369323026,0sleep10-21swapper/106:50:241
339960,0migration/323863-21munin-node10:30:283
339960,0migration/317320-21aten_r1power_fr11:10:163
339960,0migration/316643-21sh10:27:393
339960,0migration/316385-21sh09:06:033
339960,0migration/315376-21latency10:05:233
29715060,0irq/26-eth0-rx-25158-21cpu11:35:153
29715060,0irq/26-eth0-rx-1594-21ssh09:39:373
273729960,0cyclictest8969-21munin-node11:25:252
273729960,0cyclictest0-21swapper/211:21:282
273699960,0cyclictest0-21swapper/008:40:260
27160,0ktimersoftd/20-21swapper/206:55:302
149960,0migration/031355-21latency10:15:220
4150,0ktimersoftd/00-21swapper/009:40:200
4150,0ktimersoftd/00-21swapper/009:40:200
339950,0migration/39273-21taskset10:03:503
339950,0migration/37686-21munin-node09:40:233
339950,0migration/37686-21munin-node09:40:233
339950,0migration/37484-21taskset12:23:523
339950,0migration/34003-21kthreadcore09:20:223
339950,0migration/33355-21kthreadcore12:00:203
339950,0migration/325439-21kthreadcore07:15:233
339950,0migration/323314-21munin-node08:00:303
339950,0migration/318934-21kthreadcore07:10:233
339950,0migration/318138-21fschecks_time10:50:193
339950,0migration/316442-21latency_hist12:10:043
339950,0migration/315721-21sh09:45:233
339950,0migration/315698-21taskset07:31:083
339950,0migration/312943-21kthreadcore09:25:223
339950,0migration/312368-21kthreadcore07:05:223
339950,0migration/312354-21gltestperf08:20:163
29725050,0irq/27-eth0-tx-542-21seq09:57:212
29725050,0irq/27-eth0-tx-27375-21if_eth1.209:35:202
29725050,0irq/27-eth0-tx-18212-21munin-node09:50:252
29725050,0irq/27-eth0-tx-0-21swapper/211:35:262
29725050,0irq/27-eth0-tx-0-21swapper/209:45:212
29725050,0irq/27-eth0-tx-0-21swapper/007:46:150
29715050,0irq/26-eth0-rx-7102-21ssh11:20:323
29715050,0irq/26-eth0-rx-5559-21tr10:20:213
29715050,0irq/26-eth0-rx-32566-21ssh08:56:463
29715050,0irq/26-eth0-rx-15152-21ssh11:46:173
29715050,0irq/26-eth0-rx-13730-21cut10:45:243
29715050,0irq/26-eth0-rx-10206-21iostat11:05:203
29715050,0irq/26-eth0-rx-0-21swapper/312:15:213
29715050,0irq/26-eth0-rx-0-21swapper/311:52:413
29715050,0irq/26-eth0-rx-0-21swapper/311:25:213
29715050,0irq/26-eth0-rx-0-21swapper/311:15:223
29715050,0irq/26-eth0-rx-0-21swapper/311:00:223
29715050,0irq/26-eth0-rx-0-21swapper/310:38:343
29715050,0irq/26-eth0-rx-0-21swapper/310:10:463
29715050,0irq/26-eth0-rx-0-21swapper/309:58:183
29715050,0irq/26-eth0-rx-0-21swapper/309:51:043
29715050,0irq/26-eth0-rx-0-21swapper/309:33:013
29715050,0irq/26-eth0-rx-0-21swapper/309:17:533
29715050,0irq/26-eth0-rx-0-21swapper/309:11:583
273729955,0cyclictest0-21swapper/211:17:322
273729955,0cyclictest0-21swapper/211:12:292
273729955,0cyclictest0-21swapper/210:40:482
273729954,0cyclictest3514-21snmpd11:32:172
273729954,0cyclictest2752-21awk10:00:192
273729950,0cyclictest0-21swapper/212:04:122
273729950,0cyclictest0-21swapper/211:51:162
273729950,0cyclictest0-21swapper/209:22:172
273709955,0cyclictest0-21swapper/111:00:281
273709955,0cyclictest0-21swapper/110:18:221
273709955,0cyclictest0-21swapper/109:41:291
273709955,0cyclictest0-21swapper/109:41:291
273709955,0cyclictest0-21swapper/109:01:171
273709950,0cyclictest0-21swapper/111:42:341
273709950,0cyclictest0-21swapper/110:26:251
273709950,0cyclictest0-21swapper/109:25:051
273709950,0cyclictest0-21swapper/107:05:241
273699955,0cyclictest25652-21diskmemload10:24:000
273699955,0cyclictest0-21swapper/012:11:030
273699955,0cyclictest0-21swapper/011:58:080
273699950,0cyclictest0-21swapper/012:22:340
273699950,0cyclictest0-21swapper/012:04:360
273699950,0cyclictest0-21swapper/010:32:030
259950,0migration/230254-21missed_timers11:55:232
259950,0migration/21598-21taskset10:20:112
179950,0migration/19627-21munin-node07:50:261
179950,0migration/15463-21kthreadcore10:00:221
179950,0migration/126954-21irqcore08:55:201
179950,0migration/122931-21sendmail_mailqu08:00:261
179950,0migration/117786-21kthreadcore08:45:251
179950,0migration/116462-21unixbench_singl09:25:281
179950,0migration/11568-21gltestperf11:20:181
179950,0migration/115436-21timerwakeupswit07:30:281
169950,0watchdog/12555-21grep07:00:201
169950,0watchdog/122752-21if_err_eth007:15:201
169950,0watchdog/11624-21ssh09:19:151
149950,0migration/0979-21timerandwakeup06:55:300
149950,0migration/09563-21aten_r1power_fr10:45:180
149950,0migration/07894-21sh11:02:110
149950,0migration/07782-21sh11:43:090
149950,0migration/03751-21kthreadcore11:20:220
149950,0migration/032120-21taskset12:19:480
149950,0migration/031846-21pmu-power09:55:240
149950,0migration/029389-21hwlatdetect07:20:190
149950,0migration/026484-21irqrtprio11:15:200
149950,0migration/026113-21kthreadcore08:05:220
149950,0migration/025999-21latency_hist09:55:050
149950,0migration/025092-21taskset09:32:050
149950,0migration/02385-21fschecks_time09:00:180
149950,0migration/02341-21sh09:20:170
149950,0migration/021889-21kthreadcore11:50:220
149950,0migration/020277-21irqcore08:50:210
149950,0migration/018912-21kthreadcore07:35:230
149950,0migration/017455-21sh09:48:390
149950,0migration/016049-21unixbench-2d10:05:280
149950,0migration/01564-21kthreadcore08:35:220
149950,0migration/015401-21kthreadcore08:45:240
149950,0migration/012206-21kthreadcore11:05:220
8215040,0irq/24-0000:00:0-21swapper/207:10:062
339940,0migration/38283-21kthreadcore07:50:223
339940,0migration/330174-21fschecks_time07:45:183
339940,0migration/330104-21kthreadcore10:15:223
339940,0migration/32764-21kthreadcore11:40:223
339940,0migration/327573-21kthreadcore08:30:223
339940,0migration/325610-21kthreadcore07:40:233
339940,0migration/320596-21kthreadcore08:50:223
339940,0migration/316216-21kthreadcore08:45:243
29725040,0irq/27-eth0-tx-9566-21ssh11:45:192
29725040,0irq/27-eth0-tx-10973-21ssh09:05:192
29725040,0irq/27-eth0-tx-0-21swapper/212:16:402
29725040,0irq/27-eth0-tx-0-21swapper/212:05:122
29725040,0irq/27-eth0-tx-0-21swapper/210:51:042
29725040,0irq/27-eth0-tx-0-21swapper/210:45:112
29725040,0irq/27-eth0-tx-0-21swapper/210:36:022
29725040,0irq/27-eth0-tx-0-21swapper/210:25:152
29725040,0irq/27-eth0-tx-0-21swapper/210:15:172
29725040,0irq/27-eth0-tx-0-21swapper/210:10:382
29725040,0irq/27-eth0-tx-0-21swapper/210:09:182
29725040,0irq/27-eth0-tx-0-21swapper/209:40:142
29725040,0irq/27-eth0-tx-0-21swapper/209:40:142
29725040,0irq/27-eth0-tx-0-21swapper/209:15:062
29725040,0irq/27-eth0-tx-0-21swapper/209:10:192
29725040,0irq/27-eth0-tx-0-21swapper/209:00:232
29725040,0irq/27-eth0-tx-0-21swapper/008:55:090
29725040,0irq/27-eth0-tx-0-21swapper/008:00:210
29725040,0irq/27-eth0-tx-0-21swapper/007:15:170
29715040,0irq/26-eth0-rx-6559-21runrttasks08:10:183
29715040,0irq/26-eth0-rx-0-21swapper/312:05:413
29715040,0irq/26-eth0-rx-0-21swapper/311:55:083
29715040,0irq/26-eth0-rx-0-21swapper/311:30:563
29715040,0irq/26-eth0-rx-0-21swapper/310:55:163
29715040,0irq/26-eth0-rx-0-21swapper/310:42:553
29715040,0irq/26-eth0-rx-0-21swapper/309:01:373
29715040,0irq/26-eth0-rx-0-21swapper/307:56:513
29715040,0irq/26-eth0-rx-0-21swapper/307:39:223
29715040,0irq/26-eth0-rx-0-21swapper/307:00:203
273729943,0cyclictest3767-21awk07:25:202
273729943,0cyclictest3556-21lldpd08:00:232
273729943,0cyclictest3514-21snmpd11:40:172
273729943,0cyclictest3514-21snmpd08:20:462
273729943,0cyclictest3514-21snmpd07:58:012
273729943,0cyclictest3241-21irqbalance07:51:042
273729943,0cyclictest3241-21irqbalance07:45:142
273729943,0cyclictest3241-21irqbalance07:20:542
273729943,0cyclictest3241-21irqbalance07:15:442
273729943,0cyclictest26394-21awk10:55:202
273729943,0cyclictest2009-21awk11:00:192
273729943,0cyclictest19118-21awk08:25:212
273729943,0cyclictest11282-21awk09:25:202
273729943,0cyclictest10464-21awk07:30:202
273729943,0cyclictest10185-21awk11:05:202
273709944,0cyclictest0-21swapper/110:36:401
273709943,0cyclictest3556-21lldpd11:12:571
273709943,0cyclictest3556-21lldpd10:53:271
273709943,0cyclictest3556-21lldpd08:20:241
273709943,0cyclictest32452-21awk08:35:201
273709943,0cyclictest3241-21irqbalance11:30:431
273709943,0cyclictest3241-21irqbalance10:41:331
273709943,0cyclictest3241-21irqbalance09:36:141
273709943,0cyclictest31100-21sed11:35:261
273709943,0cyclictest18740-21awk10:30:201
273709943,0cyclictest10925-21awk10:05:211
273709943,0cyclictest10922-21awk09:05:191
273699944,0cyclictest21529-21kworker/0:112:05:200
273699944,0cyclictest21529-21kworker/0:111:32:400
273699944,0cyclictest21529-21kworker/0:110:02:220
273699944,0cyclictest0-21swapper/008:20:150
273699943,0cyclictest9867-21awk11:25:190
273699943,0cyclictest9696-21awk11:45:200
273699943,0cyclictest3556-21lldpd09:07:540
273699943,0cyclictest3556-21lldpd08:12:230
273699943,0cyclictest3514-21snmpd10:27:470
273699943,0cyclictest2770-21awk07:00:210
273699943,0cyclictest2223-21awk10:40:190
273699943,0cyclictest21529-21kworker/0:109:19:530
273699943,0cyclictest19073-21awk08:25:200
273699941,0cyclictest18135-21munin-run09:30:050
27140,0ktimersoftd/20-21swapper/208:41:552
259940,0migration/28317-21runrttasks07:04:392
259940,0migration/26235-21kthreadcore08:15:222
259940,0migration/227863-21kthreadcore08:55:212
259940,0migration/22049-21kthreadcore12:20:222
259940,0migration/218250-21kthreadcore12:10:222
259940,0migration/218169-21munin-node10:30:172
259940,0migration/217318-21kthreadcore08:45:252
259940,0migration/216283-21runrttasks07:35:172
259940,0migration/21443-21kthreadcore08:35:222
249940,0watchdog/224905-21munin-node08:30:202
249940,0watchdog/218393-21munin-node09:30:272
249940,0watchdog/21295-21kthreadcore08:10:242
249940,0watchdog/20-21swapper/207:40:242
179940,0migration/19753-21irqrtprio12:05:191
179940,0migration/16334-21kthreadcore08:15:221
179940,0migration/15394-21kthreadcore07:25:221
179940,0migration/13577-21kthreadcore12:20:221
179940,0migration/130063-21kthreadcore09:55:211
179940,0migration/129313-21kthreadcore11:15:211
179940,0migration/128761-21kthreadcore08:30:221
179940,0migration/128723-21kthreadcore08:05:221
179940,0migration/128397-21idleruntime06:55:221
179940,0migration/127878-21kthreadcore12:15:211
179940,0migration/125560-21hwlatdetect11:55:181
179940,0migration/124779-21taskset09:11:231
179940,0migration/120799-21sh09:30:221
179940,0migration/118866-21kthreadcore11:50:211
179940,0migration/118495-21fschecks_count10:10:171
179940,0migration/118250-21aten_r1power_cu08:25:171
179940,0migration/111706-21kthreadcore11:25:211
179940,0migration/110483-21kthreadcore08:40:231
179940,0migration/110243-21aten_r1power_en09:45:151
179940,0migration/110164-21kthreadcore11:45:221
169940,0watchdog/18931-21ssh10:23:351
169940,0watchdog/10-21swapper/108:10:241
149940,0migration/028327-21kthreadcore09:35:220
149940,0migration/021765-21kthreadcore09:10:210
149940,0migration/019778-21kthreadcore11:10:210
149940,0migration/017407-21latency_hist10:50:040
149940,0migration/015141-21latency_hist07:10:060
29725030,0irq/27-eth0-tx-0-21swapper/008:15:160
29725030,0irq/27-eth0-tx-0-21swapper/007:40:180
29725030,0irq/27-eth0-tx-0-21swapper/007:10:170
29715030,0irq/26-eth0-rx-0-21swapper/308:43:013
29715030,0irq/26-eth0-rx-0-21swapper/308:30:003
29715030,0irq/26-eth0-rx-0-21swapper/308:16:403
29715030,0irq/26-eth0-rx-0-21swapper/307:21:163
29715030,0irq/26-eth0-rx-0-21swapper/306:55:193
273729932,0cyclictest20087-21awk08:50:202
273729930,0cyclictest29384-21ntp_states08:05:242
273729930,0cyclictest0-21swapper/207:10:002
273709933,0cyclictest0-21swapper/110:46:261
273709932,0cyclictest3556-21lldpd09:50:271
273709932,0cyclictest30875-21sed07:45:211
273709932,0cyclictest20924-21sensors07:10:271
273709932,0cyclictest1356-21awk12:00:181
273709930,0cyclictest0-21swapper/107:59:281
273699933,0cyclictest21529-21kworker/0:110:55:160
273699933,0cyclictest21529-21kworker/0:110:35:120
273699933,0cyclictest21529-21kworker/0:110:10:160
273699933,0cyclictest10511-21awk07:30:200
273699932,0cyclictest4798-21awk07:50:190
273699932,0cyclictest3556-21lldpd07:25:220
273699932,0cyclictest26406-21kthreadcore11:35:190
19130,0ktimersoftd/125486-21sh10:55:131
179930,0migration/128594-21runrttasks07:20:081
169930,0watchdog/126040-21kthreadcore07:40:241
169930,0watchdog/10-21swapper/112:10:231
169930,0watchdog/10-21swapper/111:05:151
29715020,0irq/26-eth0-rx-0-21swapper/308:37:483
29715020,0irq/26-eth0-rx-0-21swapper/308:05:253
29715020,0irq/26-eth0-rx-0-21swapper/307:25:173
273709921,0cyclictest16196-21latency_hist07:35:061
273709921,0cyclictest0-21swapper/108:50:061
273699921,0cyclictest24955-21basename08:30:160
273699920,0cyclictest0-21swapper/007:55:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional