You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-02 - 05:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sun Aug 02, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450910,0irq/25-eth10-21swapper/318:45:013
1294027069,0sleep00-21swapper/018:46:150
757625756,0sleep10-21swapper/118:43:201
1270522622,0sleep20-21swapper/218:43:332
131689983,0cyclictest14259-21awk18:48:182
131689970,0cyclictest0-21swapper/200:17:492
131689970,0cyclictest0-21swapper/200:08:502
339960,0migration/329578-21munin-node20:33:263
339960,0migration/313619-21sh00:12:013
339960,0migration/31290-21sh22:02:423
29725060,0irq/27-eth0-tx-9630-21munin-node19:58:260
29715060,0irq/26-eth0-rx-25235-21cut23:38:223
29715060,0irq/26-eth0-rx-23403-21chrt20:29:523
149960,0migration/024847-21if_eth120:33:190
149960,0migration/022078-21taskset23:35:100
149960,0migration/01905-21taskset21:00:050
149960,0migration/017256-21sh22:12:350
149960,0migration/014841-21sh23:53:100
131689963,0cyclictest17239-21awk20:03:192
131679960,0cyclictest358-21kthreadcore20:13:201
35150,0ktimersoftd/30-21swapper/323:13:233
35150,0ktimersoftd/30-21swapper/323:13:233
339950,0migration/39050-21latency_hist22:28:043
339950,0migration/38342-21kthreadcore21:03:213
339950,0migration/332045-21munin-node23:43:223
339950,0migration/329774-21kthreadcore20:58:213
339950,0migration/328639-21timerandwakeup23:58:273
339950,0migration/326659-21latency_hist21:38:043
339950,0migration/325373-21kthreadcore20:08:233
339950,0migration/321579-21kthreadcore21:13:223
339950,0migration/320098-21fschecks_time20:53:193
339950,0migration/319738-21taskset18:52:323
339950,0migration/317558-21fschecks_count22:33:173
339950,0migration/314025-21unixbench-2d23:08:283
339950,0migration/312894-21kthreadcore20:23:223
339950,0migration/312284-21munin-node21:08:173
339950,0migration/311915-21munin-node20:48:183
339950,0migration/31132-21munin-node21:18:283
339950,0migration/31059-21fschecks_count22:43:183
29725050,0irq/27-eth0-tx-0-21swapper/020:13:140
29725050,0irq/27-eth0-tx-0-21swapper/019:47:540
29725050,0irq/27-eth0-tx-0-21swapper/019:28:250
29725050,0irq/27-eth0-tx-0-21swapper/019:02:450
29715050,0irq/26-eth0-rx-6948-21grep21:43:223
29715050,0irq/26-eth0-rx-6945-21ssh23:05:423
29715050,0irq/26-eth0-rx-6945-21ssh23:05:423
29715050,0irq/26-eth0-rx-30671-21kthreadcore18:58:233
29715050,0irq/26-eth0-rx-30022-21kthreadcore22:38:223
29715050,0irq/26-eth0-rx-21865-21cut21:53:223
29715050,0irq/26-eth0-rx-18143-21munin-node22:13:183
29715050,0irq/26-eth0-rx-1144-21cut20:38:203
29715050,0irq/26-eth0-rx-0-21swapper/323:49:373
29715050,0irq/26-eth0-rx-0-21swapper/323:35:093
29715050,0irq/26-eth0-rx-0-21swapper/323:28:203
29715050,0irq/26-eth0-rx-0-21swapper/322:23:263
29715050,0irq/26-eth0-rx-0-21swapper/322:19:343
29715050,0irq/26-eth0-rx-0-21swapper/321:28:063
29715050,0irq/26-eth0-rx-0-21swapper/319:17:093
19150,0ktimersoftd/16559-21runrttasks22:09:131
179950,0migration/16564-21proc_pri19:03:241
179950,0migration/15304-21timerandwakeup23:23:281
179950,0migration/124195-21munin-node23:18:161
179950,0migration/122313-21df_abs19:43:171
179950,0migration/120130-21timerandwakeup19:13:271
179950,0migration/114288-21taskset23:08:521
179950,0migration/111177-21cpuspeed_turbos21:28:151
179950,0migration/110939-21kthreadcore19:33:221
179950,0migration/110631-21switchtime20:43:281
149950,0migration/09175-21fschecks_time19:33:180
149950,0migration/09090-21taskset22:28:080
149950,0migration/08164-21munin-node21:43:260
149950,0migration/05716-21kthreadcore22:23:220
149950,0migration/0513-21aten_r1power_en22:43:160
149950,0migration/04489-21kthreadcore19:53:240
149950,0migration/04106-21kthreadcore23:43:260
149950,0migration/030835-21aten_r1power_vo00:03:150
149950,0migration/026851-21sh21:17:220
149950,0migration/026680-21kthreadcore22:58:240
149950,0migration/025541-21kthreadcore23:38:220
149950,0migration/024511-21sh21:53:480
149950,0migration/023007-21aten_r1power_fr20:08:170
149950,0migration/021323-21kthreadcore22:53:230
149950,0migration/021028-21kthreadcore20:28:220
149950,0migration/016528-21kthreadcore20:48:230
149950,0migration/01598-21taskset21:19:520
149950,0migration/015257-21taskset19:38:070
149950,0migration/014573-21sh23:09:430
149950,0migration/010489-21aten_r1power_po21:48:160
131689955,0cyclictest11341-21diskmemload00:02:222
131689955,0cyclictest0-21swapper/223:13:012
131689955,0cyclictest0-21swapper/222:41:012
131689950,0cyclictest0-21swapper/223:35:532
131689950,0cyclictest0-21swapper/223:26:352
131689950,0cyclictest0-21swapper/223:22:382
131689950,0cyclictest0-21swapper/219:22:132
131679955,0cyclictest0-21swapper/120:28:281
131679954,0cyclictest7488-21ps00:08:191
131679950,0cyclictest0-21swapper/123:16:031
131679950,0cyclictest0-21swapper/123:16:031
131679950,0cyclictest0-21swapper/123:07:511
131679950,0cyclictest0-21swapper/123:07:511
131679950,0cyclictest0-21swapper/121:45:341
131679950,0cyclictest0-21swapper/121:05:211
131669950,0cyclictest0-21swapper/022:06:490
131669950,0cyclictest0-21swapper/021:06:360
131669950,0cyclictest0-21swapper/020:56:590
131669950,0cyclictest0-21swapper/000:16:530
339940,0migration/34224-21timerandwakeup00:03:263
339940,0migration/328243-21kthreadcore22:58:253
339940,0migration/324192-21kthreadcore19:43:213
339940,0migration/322727-21kthreadcore18:53:233
339940,0migration/320685-21kthreadcore21:33:223
339940,0migration/318410-21kthreadcore22:53:223
339940,0migration/316775-21fschecks_count20:03:173
339940,0migration/312845-21kthreadcore19:33:223
339940,0migration/312016-21kthreadcore22:08:223
339940,0migration/310227-21kthreadcore19:08:203
29725040,0irq/27-eth0-tx-0-21swapper/223:28:182
29725040,0irq/27-eth0-tx-0-21swapper/221:48:212
29725040,0irq/27-eth0-tx-0-21swapper/221:25:422
29725040,0irq/27-eth0-tx-0-21swapper/221:08:252
29725040,0irq/27-eth0-tx-0-21swapper/221:03:132
29725040,0irq/27-eth0-tx-0-21swapper/020:28:000
29725040,0irq/27-eth0-tx-0-21swapper/020:03:070
29725040,0irq/27-eth0-tx-0-21swapper/019:23:200
29725040,0irq/27-eth0-tx-0-21swapper/019:18:230
29715040,0irq/26-eth0-rx-33452sleep320:15:073
29715040,0irq/26-eth0-rx-0-21swapper/323:53:333
29715040,0irq/26-eth0-rx-0-21swapper/323:24:053
29715040,0irq/26-eth0-rx-0-21swapper/323:18:173
29715040,0irq/26-eth0-rx-0-21swapper/322:49:303
29715040,0irq/26-eth0-rx-0-21swapper/322:03:483
29715040,0irq/26-eth0-rx-0-21swapper/321:48:153
29715040,0irq/26-eth0-rx-0-21swapper/321:26:503
29715040,0irq/26-eth0-rx-0-21swapper/320:43:213
29715040,0irq/26-eth0-rx-0-21swapper/319:23:163
29715040,0irq/26-eth0-rx-0-21swapper/300:13:163
249940,0watchdog/232550-21python21:38:262
249940,0watchdog/211341-21diskmemload21:53:222
249940,0watchdog/20-21swapper/223:13:222
249940,0watchdog/20-21swapper/223:13:222
249940,0watchdog/20-21swapper/221:13:232
249940,0watchdog/20-21swapper/220:43:232
249940,0watchdog/20-21swapper/220:23:232
249940,0watchdog/20-21swapper/219:58:192
179940,0migration/19467-21kthreadcore23:48:201
179940,0migration/132655-21kthreadcore19:48:251
179940,0migration/131407-21fschecks_time00:03:161
179940,0migration/125768-21aten_r1power_vo22:18:151
179940,0migration/125579-21kthreadcore20:08:231
179940,0migration/123189-21kthreadcore19:18:231
179940,0migration/120585-21kthreadcore21:53:211
179940,0migration/120554-21kthreadcore22:33:211
179940,0migration/120288-21idleruntime20:53:201
179940,0migration/118712-21kthreadcore20:03:211
179940,0migration/117326-21hwlatdetect22:53:201
179940,0migration/115667-21taskset19:58:381
179940,0migration/115582-21gltestperf23:53:181
179940,0migration/112863-21irqrtprio20:48:221
179940,0migration/110078-21kthreadcore22:48:211
169940,0watchdog/15000-21cut20:18:231
169940,0watchdog/132553-21ssh21:38:261
169940,0watchdog/123928-21perl23:38:181
169940,0watchdog/120800-21kthreadcore21:13:231
169940,0watchdog/114858-21tune2fs00:13:181
169940,0watchdog/114210-21ssh23:30:261
169940,0watchdog/111915-21kthreadcore20:23:231
169940,0watchdog/10-21swapper/123:33:221
169940,0watchdog/10-21swapper/122:43:221
149940,0migration/05827-21kthreadcore20:18:230
149940,0migration/027804-21kthreadcore22:38:210
149940,0migration/023991-21irqrtprio23:58:200
149940,0migration/015077-21kthreadcore18:48:190
149940,0migration/010342-21kthreadcore22:48:210
131689943,0cyclictest3556-21lldpd23:48:092
131689943,0cyclictest3556-21lldpd23:38:102
131689943,0cyclictest3556-21lldpd22:36:082
131689943,0cyclictest3556-21lldpd22:29:092
131689943,0cyclictest3556-21lldpd22:22:092
131689943,0cyclictest3556-21lldpd22:16:092
131689943,0cyclictest3556-21lldpd21:43:092
131689943,0cyclictest3556-21lldpd21:20:392
131689943,0cyclictest3556-21lldpd20:33:382
131689943,0cyclictest3556-21lldpd20:18:082
131689943,0cyclictest3556-21lldpd00:05:392
131689943,0cyclictest3514-21snmpd21:35:342
131689943,0cyclictest3241-21irqbalance23:43:222
131689943,0cyclictest3241-21irqbalance23:03:222
131689943,0cyclictest3241-21irqbalance23:03:222
131689943,0cyclictest3241-21irqbalance23:01:522
131689943,0cyclictest3241-21irqbalance22:26:422
131689943,0cyclictest3241-21irqbalance20:48:132
131689943,0cyclictest3241-21irqbalance20:38:132
131689943,0cyclictest3241-21irqbalance20:13:132
131689943,0cyclictest3241-21irqbalance20:08:132
131689943,0cyclictest3241-21irqbalance19:53:232
131689943,0cyclictest3241-21irqbalance19:43:332
131689943,0cyclictest3241-21irqbalance19:40:332
131689943,0cyclictest3241-21irqbalance19:34:032
131689943,0cyclictest3241-21irqbalance19:28:132
131689943,0cyclictest3241-21irqbalance19:24:232
131689943,0cyclictest3241-21irqbalance19:13:332
131689943,0cyclictest3241-21irqbalance19:09:432
131689943,0cyclictest3241-21irqbalance18:59:132
131689943,0cyclictest3241-21irqbalance18:56:432
131689943,0cyclictest29455-21awk19:48:222
131689943,0cyclictest27084-21awk21:58:192
131689943,0cyclictest20392-21awk20:53:212
131689943,0cyclictest1876-21awk19:03:192
131689943,0cyclictest18104-21awk20:28:192
131689943,0cyclictest17444-21awk22:53:202
131689943,0cyclictest1433-21awk22:43:202
131689943,0cyclictest11868-21awk21:28:192
131689943,0cyclictest0-21swapper/222:49:132
131679943,0cyclictest8628-21awk19:08:181
131679943,0cyclictest3921-21awk21:23:201
131679943,0cyclictest3556-21lldpd23:43:401
131679943,0cyclictest3556-21lldpd22:40:091
131679943,0cyclictest3556-21lldpd21:48:091
131679943,0cyclictest3556-21lldpd21:35:391
131679943,0cyclictest3556-21lldpd19:53:091
131679943,0cyclictest3556-21lldpd19:25:081
131679943,0cyclictest3514-21snmpd22:28:191
131679943,0cyclictest3514-21snmpd20:38:191
131679943,0cyclictest28525-21awk20:58:191
131679943,0cyclictest25361-21awk22:58:221
131679943,0cyclictest20983-21awk18:53:211
131679943,0cyclictest18604-21awk22:13:201
131679943,0cyclictest16107-21awk19:38:191
131679943,0cyclictest14244-21awk18:48:171
131679943,0cyclictest12300-21awk21:08:171
131679940,0cyclictest0-21swapper/121:59:261
131669944,0cyclictest0-21swapper/023:50:340
131669944,0cyclictest0-21swapper/023:23:360
131669944,0cyclictest0-21swapper/022:15:010
131669944,0cyclictest0-21swapper/021:24:250
131669943,0cyclictest7206-21awk00:08:180
131669943,0cyclictest3556-21lldpd19:11:390
131669943,0cyclictest3514-21snmpd23:17:190
131669943,0cyclictest3514-21snmpd23:17:190
131669943,0cyclictest3514-21snmpd21:10:340
131669943,0cyclictest3241-21irqbalance23:20:220
131669943,0cyclictest3241-21irqbalance22:35:520
131669943,0cyclictest26466-21awk22:18:180
131669943,0cyclictest20029-21munin-node18:53:190
131669943,0cyclictest1804-21awk19:03:190
131669943,0cyclictest15200-21awk19:13:200
131669940,0cyclictest0-21swapper/021:32:370
131669940,0cyclictest0-21swapper/020:38:070
29725030,0irq/27-eth0-tx-0-21swapper/222:08:092
29715030,0irq/26-eth0-rx-0-21swapper/319:58:183
29715030,0irq/26-eth0-rx-0-21swapper/319:55:423
29715030,0irq/26-eth0-rx-0-21swapper/319:48:203
29715030,0irq/26-eth0-rx-0-21swapper/319:28:173
29715030,0irq/26-eth0-rx-0-21swapper/319:18:243
169930,0watchdog/10-21swapper/123:58:061
169930,0watchdog/10-21swapper/121:18:191
131689933,0cyclictest3556-21lldpd20:58:092
131689932,0cyclictest7583-21sensors22:03:282
131689932,0cyclictest14919-21basename23:53:152
131679933,0cyclictest3556-21lldpd20:34:091
131679933,0cyclictest3556-21lldpd18:58:091
131679932,0cyclictest2688-21munin-node22:03:201
131679931,0cyclictest4707-21kthreadcore19:28:231
131679930,0cyclictest1756-21tune2fs22:23:181
131669933,0cyclictest5088-21kworker/0:020:43:100
131669933,0cyclictest5088-21kworker/0:019:48:120
131669933,0cyclictest25227-21kworker/0:121:58:160
131669933,0cyclictest25227-21kworker/0:121:33:180
131669933,0cyclictest22283-21kworker/0:023:28:070
131669933,0cyclictest22283-21kworker/0:023:03:150
131669933,0cyclictest22283-21kworker/0:023:03:150
131669930,0cyclictest0-21swapper/021:38:070
329920,0watchdog/30-21swapper/320:18:243
29715020,0irq/26-eth0-rx-15056-40yum-updatesd-he19:38:073
29715020,0irq/26-eth0-rx-0-21swapper/319:03:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional