You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-30 - 05:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Tue Jun 30, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450460,0irq/25-eth10-21swapper/318:46:243
3022423324,0sleep20-21swapper/218:50:182
3007422622,0sleep10-21swapper/118:48:331
3006022622,0sleep00-21swapper/018:48:240
303749974,0cyclictest21040-21munin-run21:26:130
339960,0migration/37879-21aten_r1power_en20:11:243
339960,0migration/34263-21sh22:36:053
339960,0migration/33533-21sh23:35:183
339960,0migration/331043-21fschecks_count18:51:283
339960,0migration/327992-21irqrtprio20:01:323
339960,0migration/327477-21sh23:08:503
339960,0migration/32142-21sh00:12:133
339960,0migration/312191-21sh22:20:173
339960,0migration/311848-21sh21:18:033
303769965,0cyclictest28178-21ls23:31:122
303769965,0cyclictest20162-21tr19:31:292
303769960,0cyclictest0-21swapper/223:11:482
303749966,0cyclictest0-21swapper/000:07:240
29715060,0irq/26-eth0-rx-3791-21sh22:14:183
8215050,0irq/24-0000:00:7599-21sadc20:11:142
339950,0migration/38709-21latency_hist20:36:143
339950,0migration/34372-21latency_hist22:56:123
339950,0migration/34281-21aten_r1power_vo23:36:233
339950,0migration/332282-21kthreadcore20:26:303
339950,0migration/328789-21kthreadcore19:36:313
339950,0migration/326537-21latency21:46:323
339950,0migration/324417-21taskset19:09:083
339950,0migration/32329-21timerwakeupswit22:51:363
339950,0migration/32004-21unixbench_multi23:51:393
339950,0migration/315300-21kthreadcore21:21:303
339950,0migration/313587-21munin-node21:41:273
339950,0migration/313101-21fschecks_count22:41:253
339950,0migration/312227-21aten_r1power_cu23:41:223
303769955,0cyclictest0-21swapper/223:33:242
303769955,0cyclictest0-21swapper/221:52:582
303769954,0cyclictest24292-21cut22:06:322
303769950,0cyclictest0-21swapper/223:59:432
303769950,0cyclictest0-21swapper/223:17:382
303769950,0cyclictest0-21swapper/221:18:262
303769950,0cyclictest0-21swapper/220:26:252
303749955,0cyclictest0-21swapper/023:03:050
303749955,0cyclictest0-21swapper/022:42:070
303749955,0cyclictest0-21swapper/021:57:010
303749955,0cyclictest0-21swapper/021:42:220
303749950,0cyclictest8589-21munin-run20:36:140
303749950,0cyclictest0-21swapper/023:44:140
303749950,0cyclictest0-21swapper/023:38:240
303749950,0cyclictest0-21swapper/023:14:450
303749950,0cyclictest0-21swapper/021:36:030
303749950,0cyclictest0-21swapper/020:46:140
303749950,0cyclictest0-21swapper/000:00:560
29725050,0irq/27-eth0-tx-8925-21kthreadcore22:16:312
29725050,0irq/27-eth0-tx-7449-21cat22:36:292
29725050,0irq/27-eth0-tx-21409-21basename23:06:272
29725050,0irq/27-eth0-tx-0-21swapper/222:33:552
29725050,0irq/27-eth0-tx-0-21swapper/222:01:252
29725050,0irq/27-eth0-tx-0-21swapper/221:05:062
29715050,0irq/26-eth0-rx-7423-21cat21:56:303
29715050,0irq/26-eth0-rx-5707-21tr23:56:273
29715050,0irq/26-eth0-rx-30229-21cut23:11:273
29715050,0irq/26-eth0-rx-28849-21ssh21:10:543
29715050,0irq/26-eth0-rx-266572sleep323:26:573
29715050,0irq/26-eth0-rx-20475-21aten2.4-expect23:46:303
29715050,0irq/26-eth0-rx-0-21swapper/323:21:293
29715050,0irq/26-eth0-rx-0-21swapper/323:18:473
29715050,0irq/26-eth0-rx-0-21swapper/322:29:423
29715050,0irq/26-eth0-rx-0-21swapper/322:22:053
29715050,0irq/26-eth0-rx-0-21swapper/321:36:273
29715050,0irq/26-eth0-rx-0-21swapper/321:36:273
29715050,0irq/26-eth0-rx-0-21swapper/321:35:053
29715050,0irq/26-eth0-rx-0-21swapper/321:11:573
29715050,0irq/26-eth0-rx-0-21swapper/321:06:063
29715050,0irq/26-eth0-rx-0-21swapper/320:56:303
29715050,0irq/26-eth0-rx-0-21swapper/320:55:023
27150,0ktimersoftd/20-21swapper/222:49:342
27150,0ktimersoftd/20-21swapper/221:22:422
259950,0migration/219850-21runrttasks22:24:062
179950,0migration/15883-21if_eth1.221:56:281
179950,0migration/15813-21aten_r1power_cu19:21:251
179950,0migration/128186-21idleruntime-cro23:31:121
179950,0migration/128146-21kthreadcore20:01:321
179950,0migration/12211-21missed_timers21:51:311
179950,0migration/120640-21sh21:25:081
179950,0migration/119576-21sh21:42:201
179950,0migration/115287-21kthreadcore19:51:291
149950,0migration/030237-21kthreadcore19:36:310
149950,0migration/023019-21kthreadcore21:26:300
149950,0migration/019862-21sh22:24:080
149950,0migration/01687-21timerandwakeup00:11:370
149950,0migration/013664-21kthreadcore20:36:320
149950,0migration/010746-21sh22:57:010
8215040,0irq/24-0000:00:0-21swapper/219:26:242
339940,0migration/38885-21kthreadcore19:21:313
339940,0migration/35946-21kthreadcore20:06:323
339940,0migration/34151-21kthreadcore19:16:323
339940,0migration/332016-21kthreadcore21:51:303
339940,0migration/326543-21runrttasks20:00:543
339940,0migration/31975-21kthreadcore19:41:313
339940,0migration/317436-21unixbench-2d19:01:383
339940,0migration/315532-21kthreadcore19:26:303
339940,0migration/310652-21unixbench_multi22:36:353
303769943,0cyclictest8812-21awk20:11:292
303769943,0cyclictest7808-21awk19:46:292
303769943,0cyclictest5322-21awk22:56:282
303769943,0cyclictest3556-21lldpd19:53:102
303769943,0cyclictest3556-21lldpd19:44:102
303769943,0cyclictest3556-21lldpd19:17:102
303769943,0cyclictest3556-21lldpd18:55:402
303769943,0cyclictest3514-21snmpd20:53:152
303769943,0cyclictest3010-21awk20:31:302
303769943,0cyclictest28562-21sadc20:51:142
303769943,0cyclictest21023-21awk19:56:262
303769943,0cyclictest12440-21awk19:01:292
303769940,0cyclictest5109-21munin-node21:36:272
303769940,0cyclictest5109-21munin-node21:36:272
303759944,0cyclictest0-21swapper/122:45:541
303759943,0cyclictest968-21awk19:41:291
303759943,0cyclictest5295-21awk20:56:291
303759943,0cyclictest3514-21snmpd23:48:001
303759943,0cyclictest3514-21snmpd23:16:151
303759943,0cyclictest3514-21snmpd20:34:451
303759943,0cyclictest3514-21snmpd20:29:001
303759943,0cyclictest3514-21snmpd18:51:151
303759943,0cyclictest3514-21snmpd00:05:151
303759943,0cyclictest3241-21irqbalance20:21:321
303759943,0cyclictest32401-21awk19:16:291
303759943,0cyclictest29812-21awk22:31:301
303759943,0cyclictest29627-21awk22:51:271
303759943,0cyclictest26698-21awk19:36:281
303759943,0cyclictest23011-21awk20:46:281
303759943,0cyclictest21047-21awk00:06:271
303759943,0cyclictest13892-21awk22:01:271
303759943,0cyclictest13821-21sed23:01:301
303759943,0cyclictest11314-21ssh22:38:151
303759940,0cyclictest28570-21diskmemload22:12:381
303749943,0cyclictest5718-21awk18:56:290
303749943,0cyclictest4746-21awk00:16:270
303749943,0cyclictest3241-21irqbalance21:36:220
303749943,0cyclictest3241-21irqbalance21:36:220
303749943,0cyclictest3241-21irqbalance21:16:520
303749943,0cyclictest3241-21irqbalance21:11:220
303749943,0cyclictest3241-21irqbalance21:06:320
303749943,0cyclictest3241-21irqbalance20:42:220
303749943,0cyclictest3241-21irqbalance19:21:320
303749943,0cyclictest3241-21irqbalance19:11:420
303749943,0cyclictest30587-21munin-node18:51:290
303749943,0cyclictest29770-21awk22:31:290
303749943,0cyclictest28741-21awk20:26:270
303749943,0cyclictest27609-21munin-plugin-st20:26:140
303749943,0cyclictest21855-21awk22:26:270
303749943,0cyclictest19114-21awk19:06:290
303749943,0cyclictest14462-21awk19:51:280
303749943,0cyclictest13918-21awk22:01:270
303749943,0cyclictest13367-21awk19:26:270
29725040,0irq/27-eth0-tx-0-21swapper/223:46:562
29725040,0irq/27-eth0-tx-0-21swapper/223:41:312
29725040,0irq/27-eth0-tx-0-21swapper/223:36:202
29725040,0irq/27-eth0-tx-0-21swapper/223:01:182
29725040,0irq/27-eth0-tx-0-21swapper/222:41:322
29725040,0irq/27-eth0-tx-0-21swapper/222:11:222
29725040,0irq/27-eth0-tx-0-21swapper/221:11:292
29725040,0irq/27-eth0-tx-0-21swapper/221:06:202
29725040,0irq/27-eth0-tx-0-21swapper/200:11:182
29725040,0irq/27-eth0-tx-0-21swapper/200:01:252
29725040,0irq/27-eth0-tx-0-21swapper/020:06:270
29725040,0irq/27-eth0-tx-0-21swapper/019:16:260
29715040,0irq/26-eth0-rx-21289-21ssh21:26:213
29715040,0irq/26-eth0-rx-19633-21kthreadcore20:41:313
29715040,0irq/26-eth0-rx-15261-21kthreadcore00:01:333
29715040,0irq/26-eth0-rx-0-21swapper/323:01:243
29715040,0irq/26-eth0-rx-0-21swapper/322:46:313
29715040,0irq/26-eth0-rx-0-21swapper/322:06:313
29715040,0irq/26-eth0-rx-0-21swapper/322:02:133
29715040,0irq/26-eth0-rx-0-21swapper/300:16:343
29715040,0irq/26-eth0-rx-0-21swapper/300:06:133
259940,0migration/28431-21kthreadcore18:56:322
259940,0migration/28036-21kthreadcore19:21:312
259940,0migration/229189-21taskset23:51:302
259940,0migration/228349-21kthreadcore19:11:312
259940,0migration/227605-21hwlatdetect20:01:302
259940,0migration/224999-21kthreadcore22:26:302
259940,0migration/224461-21kthreadcore21:46:312
259940,0migration/22240-21timerandwakeup22:51:352
259940,0migration/221630-21cpuspeed_turbos21:26:252
259940,0migration/220313-21aten_r1power_vo00:06:242
249940,0watchdog/24866-21grep20:56:282
249940,0watchdog/24677-21smartctl00:16:272
249940,0watchdog/232516-21kthreadcore21:31:312
249940,0watchdog/225623-21kthreadcore20:21:322
249940,0watchdog/221278-21kthreadcore19:06:322
249940,0watchdog/220617-21ssh21:45:192
249940,0watchdog/213653-21cut20:36:322
249940,0watchdog/2123592sleep223:21:192
249940,0watchdog/210848-21sort21:56:352
179940,0migration/18651-21kthreadcore00:16:311
179940,0migration/16987-21kthreadcore21:16:301
179940,0migration/16970-21munin-node19:46:251
179940,0migration/15161-21iostat23:36:271
179940,0migration/14628-21fschecks_time23:56:231
179940,0migration/130403-21irqcore21:11:291
179940,0migration/129887-21kthreadcore19:11:321
179940,0migration/128885-21aten_r1power_fr20:51:251
179940,0migration/123827-21kthreadcore22:46:301
179940,0migration/123721-21kthreadcore22:06:311
179940,0migration/122124-21kthreadcore23:06:301
179940,0migration/119506-21kernelversion19:06:311
179940,0migration/11841-21sh23:11:311
179940,0migration/118004-21kthreadcore22:21:311
179940,0migration/115185-21taskset20:40:501
169940,0watchdog/15711-21grep21:36:271
169940,0watchdog/15711-21grep21:36:271
169940,0watchdog/14105-21kthreadcore20:06:321
169940,0watchdog/13602-21ssh23:35:311
169940,0watchdog/121426-21irqstats19:56:281
169940,0watchdog/117821-21ntpq23:41:311
169940,0watchdog/116719-21tr19:01:321
169940,0watchdog/115401-21if_eth120:16:281
169940,0watchdog/11171-21mdstat00:11:311
169940,0watchdog/10-21swapper/122:30:551
169940,0watchdog/10-21swapper/121:46:311
169940,0watchdog/10-21swapper/121:04:591
169940,0watchdog/10-21swapper/120:11:361
149940,0migration/08115-21kernelversion19:46:300
149940,0migration/029544-21fschecks_count22:11:260
149940,0migration/029251-21hddtemp_smartct23:31:270
149940,0migration/028833-21kthreadcore20:01:330
149940,0migration/027011-21sh23:07:300
149940,0migration/025194-21kthreadcore21:46:310
149940,0migration/023271-21kthreadcore22:46:300
149940,0migration/022066-21kthreadcore19:56:280
149940,0migration/020813-21fschecks_count23:46:320
149940,0migration/02011-21munin-node20:51:340
149940,0migration/019742-21latency20:16:310
149940,0migration/019124-21runrttasks19:31:140
149940,0migration/018377-21timerwakeupswit23:21:350
149940,0migration/013718-21kthreadcore00:01:320
149940,0migration/011453-21latency_hist19:01:140
149940,0migration/010065-21pmu-power20:56:350
303769932,0cyclictest31471-21sensors19:36:352
303769932,0cyclictest15626-21stty20:41:252
303769932,0cyclictest15366-21awk20:16:272
303759933,0cyclictest5306-21awk22:56:281
303759932,0cyclictest30144-21hwlatdetect21:31:281
303759932,0cyclictest22260-21awk21:26:281
303759932,0cyclictest19138-21munin-node19:31:291
303759932,0cyclictest13322-21awk19:26:271
303749932,0cyclictest5617-21awk22:16:280
303749932,0cyclictest5271-21awk23:16:270
303749932,0cyclictest3514-21snmpd23:51:530
303749932,0cyclictest3514-21snmpd22:51:410
303749932,0cyclictest3514-21snmpd20:16:120
303749932,0cyclictest3241-21irqbalance23:26:210
303749932,0cyclictest2577-21sensors21:51:340
303749932,0cyclictest12743-21munin-node21:01:260
303749932,0cyclictest10735-21vmstat22:36:360
29725030,0irq/27-eth0-tx-0-21swapper/019:41:250
29715030,0irq/26-eth0-rx-0-21swapper/320:48:533
29715030,0irq/26-eth0-rx-0-21swapper/320:36:263
29715030,0irq/26-eth0-rx-0-21swapper/320:21:343
29715030,0irq/26-eth0-rx-0-21swapper/320:16:243
29715030,0irq/26-eth0-rx-0-21swapper/319:51:243
29715030,0irq/26-eth0-rx-0-21swapper/319:46:253
29715030,0irq/26-eth0-rx-0-21swapper/319:33:083
29715030,0irq/26-eth0-rx-0-21swapper/319:11:253
29715030,0irq/26-eth0-rx-0-21swapper/318:56:263
179930,0migration/123760-21kthreadcore21:06:311
169930,0watchdog/10-21swapper/123:51:271
169930,0watchdog/10-21swapper/123:21:191
169930,0watchdog/10-21swapper/122:17:231
169930,0watchdog/10-21swapper/120:41:321
303759921,0cyclictest0-21swapper/118:56:141
303749921,0cyclictest20925-21latency_hist22:06:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional