You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 04:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Thu Jun 18, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2960023725,0sleep10-21swapper/118:51:221
304450350,0irq/25-eth10-21swapper/318:47:533
2967723525,0sleep20-21swapper/218:52:162
2941822622,0sleep00-21swapper/018:49:130
297579974,0cyclictest10825-21munin-run00:22:220
4160,0ktimersoftd/00-21swapper/020:56:550
339960,0migration/327819-21sh21:11:313
339960,0migration/327555-21sh22:11:133
339960,0migration/327111-21sh23:11:203
339960,0migration/320809-21df_abs21:27:333
339960,0migration/318759-21sh23:05:223
297579960,0cyclictest0-21swapper/023:26:130
297579960,0cyclictest0-21swapper/021:35:230
29725060,0irq/27-eth0-tx-24247-21munin-node19:12:370
29725060,0irq/27-eth0-tx-18602-21munin-node19:32:400
29715060,0irq/26-eth0-rx-18186-21ssh23:44:253
19160,0ktimersoftd/10-21swapper/120:56:551
149960,0migration/022747-21kthreadcore22:27:380
149960,0migration/018454-21sh22:44:050
149960,0migration/010574-21sh21:38:210
8215050,0irq/24-0000:00:11717-21cat22:42:222
4150,0ktimersoftd/00-21swapper/000:01:140
339950,0migration/3832-21taskset20:29:033
339950,0migration/35602-21df_abs19:22:363
339950,0migration/329442-21kthreadcore19:37:413
339950,0migration/325543-21munin-node19:57:443
339950,0migration/322731-21kthreadcore20:22:403
339950,0migration/319431-21kthreadcore20:42:393
339950,0migration/31924-21taskset20:53:143
339950,0migration/318354-21munin-node19:52:423
339950,0migration/31321-21kthreadcore19:42:383
339950,0migration/312742-21cpuspeed_turbos21:22:343
297599955,0cyclictest0-21swapper/221:22:482
297589955,0cyclictest27887-21diskmemload23:51:461
297589955,0cyclictest0-21swapper/123:41:031
297589955,0cyclictest0-21swapper/122:56:071
297589955,0cyclictest0-21swapper/119:17:461
297589955,0cyclictest0-21swapper/100:10:321
297589950,0cyclictest0-21swapper/123:03:031
297589950,0cyclictest0-21swapper/123:01:191
297589950,0cyclictest0-21swapper/121:14:161
297579955,0cyclictest0-21swapper/022:07:420
297579954,0cyclictest3833-21idleruntime-cro21:57:220
297579950,0cyclictest0-21swapper/023:30:000
297579950,0cyclictest0-21swapper/022:36:050
29725050,0irq/27-eth0-tx-7681-21kthreadcore20:57:402
29725050,0irq/27-eth0-tx-4363-21kthreadcore00:17:362
29725050,0irq/27-eth0-tx-3947-21munin-node22:17:422
29725050,0irq/27-eth0-tx-20352-21munin-node21:47:412
29725050,0irq/27-eth0-tx-19749-21munin-node23:07:412
29725050,0irq/27-eth0-tx-19547-21munin-node19:57:350
29725050,0irq/27-eth0-tx-17521-21ntp_kernel_err22:22:422
29725050,0irq/27-eth0-tx-1406-21ssh22:32:432
29725050,0irq/27-eth0-tx-1271-21ssh00:13:192
29725050,0irq/27-eth0-tx-0-21swapper/223:58:552
29725050,0irq/27-eth0-tx-0-21swapper/222:15:282
29725050,0irq/27-eth0-tx-0-21swapper/222:08:052
29725050,0irq/27-eth0-tx-0-21swapper/221:27:312
29725050,0irq/27-eth0-tx-0-21swapper/221:10:192
29725050,0irq/27-eth0-tx-0-21swapper/020:47:330
29725050,0irq/27-eth0-tx-0-21swapper/020:47:330
29725050,0irq/27-eth0-tx-0-21swapper/020:31:350
29725050,0irq/27-eth0-tx-0-21swapper/020:07:390
29715050,0irq/26-eth0-rx-6878-21cut23:17:383
29715050,0irq/26-eth0-rx-6559-21runrttasks00:00:183
29715050,0irq/26-eth0-rx-6050-21kthreadcore21:37:393
29715050,0irq/26-eth0-rx-5507-21irqrtprio21:17:383
29715050,0irq/26-eth0-rx-3690-21tune2fs00:17:333
29715050,0irq/26-eth0-rx-3662-21aten_r1power_cu22:57:323
29715050,0irq/26-eth0-rx-30826-21kthreadcore23:52:383
29715050,0irq/26-eth0-rx-26470-21ssh00:10:453
29715050,0irq/26-eth0-rx-22907-21kthreadcore23:27:383
29715050,0irq/26-eth0-rx-21429-21kthreadcore19:07:393
29715050,0irq/26-eth0-rx-2045-21ssh21:12:453
29715050,0irq/26-eth0-rx-18880-21ssh22:45:183
29715050,0irq/26-eth0-rx-16952-21cut22:02:393
29715050,0irq/26-eth0-rx-12779-21ps23:22:363
29715050,0irq/26-eth0-rx-0-21swapper/323:47:413
29715050,0irq/26-eth0-rx-0-21swapper/323:12:333
29715050,0irq/26-eth0-rx-0-21swapper/322:47:303
29715050,0irq/26-eth0-rx-0-21swapper/322:32:393
29715050,0irq/26-eth0-rx-0-21swapper/322:27:383
29715050,0irq/26-eth0-rx-0-21swapper/322:22:403
29715050,0irq/26-eth0-rx-0-21swapper/322:19:273
29715050,0irq/26-eth0-rx-0-21swapper/322:12:383
29715050,0irq/26-eth0-rx-0-21swapper/321:47:343
29715050,0irq/26-eth0-rx-0-21swapper/321:45:553
29715050,0irq/26-eth0-rx-0-21swapper/321:04:463
29715050,0irq/26-eth0-rx-0-21swapper/320:57:383
29715050,0irq/26-eth0-rx-0-21swapper/320:47:393
29715050,0irq/26-eth0-rx-0-21swapper/320:47:393
27150,0ktimersoftd/20-21swapper/220:56:552
259950,0migration/29516-21kthreadcore21:37:402
259950,0migration/27001-21latency_hist20:12:232
259950,0migration/232626-21kthreadcore21:52:402
259950,0migration/230910-21munin-node19:37:442
259950,0migration/228966-21kthreadcore23:52:382
259950,0migration/228076-21kthreadcore19:12:392
259950,0migration/225148-21latency_hist19:37:232
259950,0migration/221594-21kthreadcore19:57:372
259950,0migration/220496-21if_eth1.323:47:392
259950,0migration/220025-21aten2.4-expect22:47:342
259950,0migration/219416-21munin-node00:07:332
259950,0migration/210574-21munin-node19:22:422
249950,0watchdog/210346-21sed21:17:452
2270250,0sleep32277-21ssh23:35:123
19150,0ktimersoftd/10-21swapper/100:01:141
169950,0watchdog/119780-21cut23:27:321
149950,0migration/09460-21kthreadcore20:37:380
149950,0migration/08139-21kthreadcore23:17:390
149950,0migration/06488-21kthreadcore22:37:390
149950,0migration/04238-21latency_hist18:57:230
149950,0migration/029165-21fschecks_time21:12:360
149950,0migration/027692-21df_abs00:12:330
149950,0migration/027682-21taskset21:51:050
149950,0migration/027415-21latency_hist23:52:220
149950,0migration/027246-21taskset21:29:340
149950,0migration/022509-21kthreadcore23:47:410
149950,0migration/021589-21kthreadcore21:07:380
149950,0migration/021074-21fschecks_time20:22:360
149950,0migration/020089-21taskset20:20:200
149950,0migration/019843-21taskset22:47:240
149950,0migration/019394-21munin-node00:07:320
149950,0migration/017146-21munin-node00:02:440
149950,0migration/015120-21kthreadcore21:42:380
149950,0migration/014563-21kthreadcore21:02:380
149950,0migration/011946-21sh21:21:500
149950,0migration/011758-21sh22:01:550
339940,0migration/3942-21fschecks_count20:07:353
339940,0migration/39294-21kthreadcore21:57:393
339940,0migration/313286-21kthreadcore20:37:403
339940,0migration/313017-21kthreadcore19:02:413
297599943,0cyclictest3556-21lldpd19:07:422
297599943,0cyclictest12263-21awk00:02:372
297599943,0cyclictest11923-21awk19:02:392
297599941,0cyclictest0-21swapper/223:02:332
297589944,0cyclictest0-21swapper/122:23:011
297589943,0cyclictest5254-21awk18:57:371
297589943,0cyclictest3838-21hwlatdetect00:17:331
297589943,0cyclictest3556-21lldpd23:52:431
297589943,0cyclictest3514-21snmpd22:13:121
297589943,0cyclictest3514-21snmpd20:07:571
297589943,0cyclictest3241-21irqbalance22:32:411
297589943,0cyclictest3241-21irqbalance21:59:411
297589943,0cyclictest25155-21awk19:12:361
297589943,0cyclictest21438-21awk20:22:381
297589943,0cyclictest21225-21awk21:47:361
297589943,0cyclictest18452-21awk19:07:361
297589943,0cyclictest14782-21awk20:17:381
297589943,0cyclictest12831-21awk19:27:371
297589943,0cyclictest12717-21awk22:42:361
297579944,0cyclictest0-21swapper/023:43:050
297579943,0cyclictest3514-21snmpd23:39:270
297579943,0cyclictest3514-21snmpd23:33:420
297579943,0cyclictest24021-21sadc19:12:230
297579943,0cyclictest14788-21munin-node20:42:350
297579943,0cyclictest13879-21awk19:52:380
29725040,0irq/27-eth0-tx-6531-21ps23:37:392
29725040,0irq/27-eth0-tx-27887-21diskmemload23:12:472
29725040,0irq/27-eth0-tx-0-21swapper/223:42:402
29725040,0irq/27-eth0-tx-0-21swapper/223:32:382
29725040,0irq/27-eth0-tx-0-21swapper/223:28:522
29725040,0irq/27-eth0-tx-0-21swapper/223:22:282
29725040,0irq/27-eth0-tx-0-21swapper/223:17:242
29725040,0irq/27-eth0-tx-0-21swapper/222:57:252
29725040,0irq/27-eth0-tx-0-21swapper/222:27:392
29725040,0irq/27-eth0-tx-0-21swapper/222:02:312
29725040,0irq/27-eth0-tx-0-21swapper/221:57:482
29725040,0irq/27-eth0-tx-0-21swapper/221:32:252
29725040,0irq/27-eth0-tx-0-21swapper/221:12:252
29725040,0irq/27-eth0-tx-0-21swapper/221:02:292
29725040,0irq/27-eth0-tx-0-21swapper/020:12:350
29725040,0irq/27-eth0-tx-0-21swapper/019:42:340
29725040,0irq/27-eth0-tx-0-21swapper/019:37:390
29725040,0irq/27-eth0-tx-0-21swapper/019:17:350
29715040,0irq/26-eth0-rx-8134-21kthreadcore23:37:403
29715040,0irq/26-eth0-rx-0-21swapper/322:53:083
29715040,0irq/26-eth0-rx-0-21swapper/322:37:453
29715040,0irq/26-eth0-rx-0-21swapper/321:52:363
29715040,0irq/26-eth0-rx-0-21swapper/321:33:043
29715040,0irq/26-eth0-rx-0-21swapper/300:13:053
29715040,0irq/26-eth0-rx-0-21swapper/300:03:173
259940,0migration/27832-21kthreadcore22:37:392
259940,0migration/25532-21irqrtprio18:57:382
259940,0migration/231745-21munin-node19:17:372
259940,0migration/227038-21munin-node20:02:372
259940,0migration/219331-21perf19:57:232
259940,0migration/213578-21kthreadcore19:27:382
259940,0migration/212547-21cpuspeed_turbos21:42:332
249940,0watchdog/26231-21kthreadcore20:32:412
249940,0watchdog/2528-21kthreadcore22:52:402
249940,0watchdog/20-21swapper/220:12:372
179940,0migration/19487-21kthreadcore21:17:391
179940,0migration/19404-21runrttasks22:17:401
179940,0migration/19386-21kthreadcore21:37:401
179940,0migration/16852-21fschecks_time19:47:351
179940,0migration/1644-21missed_timers23:32:411
179940,0migration/15334-21kthreadcore23:17:381
179940,0migration/13807-21taskset18:54:441
179940,0migration/13459-21latency_hist20:57:231
179940,0migration/132408-21kthreadcore21:32:381
179940,0migration/130962-21kthreadcore20:02:411
179940,0migration/127334-21unixbench-2d20:47:451
179940,0migration/127334-21unixbench-2d20:47:451
179940,0migration/125469-21kthreadcore21:27:391
179940,0migration/125010-21kthreadcore22:47:411
179940,0migration/121366-21kthreadcore23:07:381
179940,0migration/120074-21aten_r1power_en22:27:321
179940,0migration/118995-21df_inode19:32:361
179940,0migration/117078-21kthreadcore21:22:391
179940,0migration/113942-21kthreadcore21:02:381
179940,0migration/112805-21latency_hist19:52:231
179940,0migration/112546-21irqrtprio00:02:381
169940,0watchdog/16232-21kthreadcore20:32:411
169940,0watchdog/132574-21munin-node20:27:411
169940,0watchdog/127887-21diskmemload23:44:401
169940,0watchdog/11557-21ssh00:14:081
169940,0watchdog/110461-21ssh22:39:161
169940,0watchdog/10-21swapper/123:22:361
169940,0watchdog/10-21swapper/123:12:241
169940,0watchdog/10-21swapper/121:07:451
149940,0migration/09044-21kthreadcore19:22:410
149940,0migration/04966-21kernelversion22:57:370
149940,0migration/030749-21kthreadcore23:12:380
149940,0migration/026458-21sh23:09:280
149940,0migration/016185-21kthreadcore19:02:420
149940,0migration/015098-21kthreadcore23:02:390
297599932,0cyclictest23409-21cut20:47:392
297599932,0cyclictest23409-21cut20:47:392
297599932,0cyclictest160792chrt20:42:382
297599932,0cyclictest14742-21awk20:17:372
297599932,0cyclictest1230-21kthreadcore19:42:382
297599932,0cyclictest1148-21sadc20:32:232
297599930,0cyclictest0-21swapper/220:40:362
297599930,0cyclictest0-21swapper/220:25:442
297589932,0cyclictest9085-21awk20:37:371
297589932,0cyclictest6979-21cut19:22:401
297589932,0cyclictest3241-21irqbalance22:02:311
297589932,0cyclictest29288-21awk21:52:371
297589932,0cyclictest20526-21awk19:57:361
297589932,0cyclictest15640-21awk20:42:361
297589930,0cyclictest20222-21ssh22:07:321
297579933,0cyclictest22675-21kworker/0:022:17:260
297579933,0cyclictest22675-21kworker/0:020:32:400
297579933,0cyclictest22675-21kworker/0:020:02:280
297579933,0cyclictest22675-21kworker/0:019:47:240
297579933,0cyclictest22675-21kworker/0:018:52:260
297579932,0cyclictest7578-21grep20:57:400
297579932,0cyclictest29180-21awk22:12:360
297579932,0cyclictest13369-21awk21:22:370
297579932,0cyclictest13180-21awk22:02:370
297579932,0cyclictest12807-21awk19:27:360
297579930,0cyclictest17770-21python22:22:450
29715030,0irq/26-eth0-rx-0-21swapper/320:15:523
29715030,0irq/26-eth0-rx-0-21swapper/320:02:423
29715030,0irq/26-eth0-rx-0-21swapper/319:47:323
29715030,0irq/26-eth0-rx-0-21swapper/319:37:003
29715030,0irq/26-eth0-rx-0-21swapper/319:27:333
29715030,0irq/26-eth0-rx-0-21swapper/319:17:343
29715030,0irq/26-eth0-rx-0-21swapper/319:13:593
29715030,0irq/26-eth0-rx-0-21swapper/318:57:333
29715030,0irq/26-eth0-rx-0-21swapper/318:52:413
259930,0migration/230043-21aten_r1power_fr18:52:342
169930,0watchdog/19907-21grep20:12:371
169930,0watchdog/10-21swapper/121:43:011
169930,0watchdog/10-21swapper/119:42:331
169930,0watchdog/10-21swapper/119:02:411
149930,0migration/01742-21sh22:52:510
297599920,0cyclictest0-21swapper/219:47:232
29715020,0irq/26-eth0-rx-0-21swapper/320:32:433
29715020,0irq/26-eth0-rx-0-21swapper/320:17:313
169920,0watchdog/10-21swapper/119:37:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional