You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-12 - 14:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Wed Aug 12, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3252426463,0sleep10-21swapper/106:43:051
3259623726,0sleep30-21swapper/306:43:553
2649623623,0sleep00-21swapper/006:42:120
31622819,0sleep20-21swapper/206:46:062
4769960,0cyclictest20127-21unixbench_singl09:57:302
4759960,0cyclictest0-21swapper/109:54:091
4759960,0cyclictest0-21swapper/109:27:211
4759960,0cyclictest0-21swapper/108:55:391
4160,0ktimersoftd/00-21swapper/012:12:250
339960,0migration/39427-21kthreadcore09:12:223
339960,0migration/33092-21sh10:50:273
339960,0migration/327125-21sh11:06:143
339960,0migration/322168-21sh09:20:173
339960,0migration/318254-21sh10:58:173
339960,0migration/315982-21munin-node07:22:203
29715060,0irq/26-eth0-rx-30893-21cut11:47:233
29715060,0irq/26-eth0-rx-24258-21perl08:17:193
29715060,0irq/26-eth0-rx-15811-21perl08:57:193
149960,0migration/032637-21sh11:47:560
149960,0migration/012921-21sh09:54:270
149960,0migration/010670-21sh11:16:330
4769955,0cyclictest0-21swapper/211:57:292
4769955,0cyclictest0-21swapper/210:07:362
4769950,0cyclictest0-21swapper/210:59:192
4759955,0cyclictest0-21swapper/112:01:411
4759955,0cyclictest0-21swapper/111:45:181
4759955,0cyclictest0-21swapper/110:16:131
4759955,0cyclictest0-21swapper/109:08:161
4759950,0cyclictest0-21swapper/111:34:341
4759950,0cyclictest0-21swapper/111:26:221
4759950,0cyclictest0-21swapper/111:20:511
4759950,0cyclictest0-21swapper/107:05:271
4749955,0cyclictest18498-21kworker/0:108:57:220
4749955,0cyclictest0-21swapper/011:07:280
4749954,0cyclictest24839-21kworker/0:111:35:370
4150,0ktimersoftd/00-21swapper/010:27:530
339950,0migration/37137-21kthreadcore10:12:213
339950,0migration/3432-21timerwakeupswit11:27:283
339950,0migration/330973-21taskset08:44:513
339950,0migration/330266-21latency_hist09:47:043
339950,0migration/329700-21fschecks_count10:27:183
339950,0migration/329008-21taskset07:55:003
339950,0migration/32630-21latency_hist07:37:043
339950,0migration/326162-21kthreadcore09:22:223
339950,0migration/325640-21taskset12:07:153
339950,0migration/324824-21kthreadcore07:27:223
339950,0migration/323207-21kthreadcore07:02:233
339950,0migration/315409-21kthreadcore10:17:203
339950,0migration/315390-21munin-node06:57:223
339950,0migration/312434-21kernelversion11:17:213
29725050,0irq/27-eth0-tx-689-21munin-node06:47:230
29725050,0irq/27-eth0-tx-3710-21munin-node08:02:200
29725050,0irq/27-eth0-tx-31182-21diskmemload09:13:192
29725050,0irq/27-eth0-tx-29179-21munin-node10:27:192
29725050,0irq/27-eth0-tx-26933-21ssh11:27:122
29725050,0irq/27-eth0-tx-25703-21ssh11:24:052
29725050,0irq/27-eth0-tx-15141-21munin-node08:57:232
29725050,0irq/27-eth0-tx-13310-21ssh08:52:552
29725050,0irq/27-eth0-tx-0-21swapper/211:14:042
29725050,0irq/27-eth0-tx-0-21swapper/006:57:250
29715050,0irq/26-eth0-rx-9868-21ssh11:57:163
29715050,0irq/26-eth0-rx-9305-21if_err_eth1.207:17:193
29715050,0irq/26-eth0-rx-8837-21ssh12:17:033
29715050,0irq/26-eth0-rx-5603-21cut11:32:193
29715050,0irq/26-eth0-rx-4856-21taskset09:49:133
29715050,0irq/26-eth0-rx-4408-21cut10:52:173
29715050,0irq/26-eth0-rx-32136-21smartctl09:07:193
29715050,0irq/26-eth0-rx-30515-21kthreadcore11:07:203
29715050,0irq/26-eth0-rx-23504-21swap12:02:253
29715050,0irq/26-eth0-rx-23150-21sh09:02:053
29715050,0irq/26-eth0-rx-22382-21entropy10:02:183
29715050,0irq/26-eth0-rx-13669-21munin-node10:37:223
29715050,0irq/26-eth0-rx-0-21swapper/311:55:503
29715050,0irq/26-eth0-rx-0-21swapper/311:46:293
29715050,0irq/26-eth0-rx-0-21swapper/311:12:193
29715050,0irq/26-eth0-rx-0-21swapper/310:22:203
29715050,0irq/26-eth0-rx-0-21swapper/309:59:523
29715050,0irq/26-eth0-rx-0-21swapper/309:55:443
29715050,0irq/26-eth0-rx-0-21swapper/308:52:163
27150,0ktimersoftd/20-21swapper/211:34:282
27150,0ktimersoftd/20-21swapper/209:18:312
259950,0migration/26972-21latency_hist09:12:042
259950,0migration/219085-21fschecks_time11:42:212
259950,0migration/217756-21sh11:41:002
259950,0migration/215894-21hwlatdetect07:22:202
259950,0migration/215224-21timerandwakeup07:42:282
259950,0migration/21355-21kthreadcore09:47:202
259950,0migration/210533-21kthreadcore06:52:212
249950,0watchdog/219237-21ssh10:38:582
19150,0ktimersoftd/10-21swapper/111:38:501
19150,0ktimersoftd/10-21swapper/110:57:031
179950,0migration/17801-21switchtime11:52:271
179950,0migration/1731-21taskset11:49:381
179950,0migration/15437-21kthreadcore06:47:231
179950,0migration/12569-21taskset11:11:071
179950,0migration/119877-21kthreadcore07:22:241
179950,0migration/113069-21kthreadcore07:17:221
179950,0migration/110695-21taskset10:32:271
169950,0watchdog/115160-21ssh09:17:151
149950,0migration/08807-21kthreadcore08:27:220
149950,0migration/05939-21taskset09:09:400
149950,0migration/031795-21idleruntime09:27:180
149950,0migration/031618-21timerwakeupswit12:07:280
149950,0migration/030429-21taskset09:47:080
149950,0migration/029536-21sh10:06:490
149950,0migration/028514-21switchtime07:52:280
149950,0migration/027988-21fschecks_time07:07:180
149950,0migration/025606-21kthreadcore09:22:220
149950,0migration/02504-21fschecks_time11:52:170
149950,0migration/024946-21kthreadcore09:02:210
149950,0migration/022593-21kthreadcore11:42:250
149950,0migration/021933-21kthreadcore11:02:210
149950,0migration/021057-21kthreadcore07:47:220
149950,0migration/020706-21sh09:59:060
149950,0migration/020339-21taskset10:20:030
149950,0migration/016896-21sh12:00:220
149950,0migration/012163-21kthreadcore11:37:220
149950,0migration/010218-21hwlatdetect07:42:190
4769943,0cyclictest6294-21awk10:12:182
4769943,0cyclictest3556-21lldpd11:07:052
4769943,0cyclictest3556-21lldpd09:22:062
4769943,0cyclictest3556-21lldpd07:38:052
4769943,0cyclictest3514-21snmpd10:52:312
4769943,0cyclictest32272-21awk08:47:182
4769943,0cyclictest26530-21awk12:07:192
4769943,0cyclictest24101-21awk09:02:192
4769943,0cyclictest15053-21awk06:57:212
4759943,0cyclictest8343-21awk06:52:191
4759943,0cyclictest3514-21snmpd08:02:161
4759943,0cyclictest31389-21awk09:47:181
4759943,0cyclictest25588-21awk08:42:181
4759943,0cyclictest24615-21awk08:17:211
4759943,0cyclictest23497-21awk09:42:211
4759943,0cyclictest22236-21sort07:27:181
4759943,0cyclictest20706-21awk11:02:191
4759943,0cyclictest19014-21awk08:37:191
4759943,0cyclictest14852-21grep06:57:191
4759943,0cyclictest12249-21awk08:32:191
4749944,0cyclictest24839-21kworker/0:112:02:110
4749944,0cyclictest24839-21kworker/0:111:23:430
4749944,0cyclictest20359-21kworker/0:011:17:410
4749944,0cyclictest18498-21kworker/0:110:52:130
4749944,0cyclictest18498-21kworker/0:110:48:010
4749944,0cyclictest18498-21kworker/0:110:42:090
4749944,0cyclictest18498-21kworker/0:110:37:230
4749944,0cyclictest18498-21kworker/0:110:32:370
4749944,0cyclictest18498-21kworker/0:110:22:110
4749944,0cyclictest18498-21kworker/0:110:12:110
4749944,0cyclictest18498-21kworker/0:110:07:130
4749944,0cyclictest18498-21kworker/0:109:37:220
4749944,0cyclictest18498-21kworker/0:109:32:280
4749944,0cyclictest18498-21kworker/0:109:17:240
4749944,0cyclictest18498-21kworker/0:109:14:300
4749944,0cyclictest18498-21kworker/0:108:52:120
4749944,0cyclictest18498-21kworker/0:108:37:000
4749944,0cyclictest18498-21kworker/0:108:22:060
4749944,0cyclictest18498-21kworker/0:108:15:200
4749944,0cyclictest18498-21kworker/0:108:07:280
4749944,0cyclictest18498-21kworker/0:107:57:180
4749944,0cyclictest18498-21kworker/0:107:32:260
4749944,0cyclictest18498-21kworker/0:107:12:160
4749944,0cyclictest0-21swapper/009:42:200
4749943,0cyclictest3556-21lldpd10:57:060
4749943,0cyclictest32317-21awk08:47:190
4749940,0cyclictest23683-21munin-node08:17:190
35140,0ktimersoftd/30-21swapper/306:50:283
339940,0migration/3774-21kthreadcore10:07:203
339940,0migration/324298-21taskset08:39:353
339940,0migration/316051-21sendmail_mailtr08:07:253
339940,0migration/312980-21kthreadcore07:42:233
339940,0migration/31266-21runrttasks07:57:243
339940,0migration/310890-21df_inode11:37:183
29725040,0irq/27-eth0-tx-28370-21munin-node10:47:232
29725040,0irq/27-eth0-tx-0-21swapper/212:12:262
29725040,0irq/27-eth0-tx-0-21swapper/211:52:182
29725040,0irq/27-eth0-tx-0-21swapper/211:47:202
29725040,0irq/27-eth0-tx-0-21swapper/211:02:332
29725040,0irq/27-eth0-tx-0-21swapper/210:35:012
29725040,0irq/27-eth0-tx-0-21swapper/210:22:142
29725040,0irq/27-eth0-tx-0-21swapper/209:42:232
29725040,0irq/27-eth0-tx-0-21swapper/209:33:382
29725040,0irq/27-eth0-tx-0-21swapper/209:27:432
29725040,0irq/27-eth0-tx-0-21swapper/008:42:150
29725040,0irq/27-eth0-tx-0-21swapper/008:38:380
29725040,0irq/27-eth0-tx-0-21swapper/007:27:170
29725040,0irq/27-eth0-tx-0-21swapper/007:02:190
29715040,0irq/26-eth0-rx-24665-21pmu-power11:22:253
29715040,0irq/26-eth0-rx-0-21swapper/310:45:273
29715040,0irq/26-eth0-rx-0-21swapper/310:32:423
29715040,0irq/26-eth0-rx-0-21swapper/309:37:343
29715040,0irq/26-eth0-rx-0-21swapper/309:32:093
29715040,0irq/26-eth0-rx-0-21swapper/309:30:033
29715040,0irq/26-eth0-rx-0-21swapper/308:47:173
29715040,0irq/26-eth0-rx-0-21swapper/308:02:233
29715040,0irq/26-eth0-rx-0-21swapper/306:52:213
259940,0migration/27342-21irqrtprio09:52:212
259940,0migration/26691-21kthreadcore08:27:212
259940,0migration/25446-21kthreadcore07:12:212
259940,0migration/24317-21runrttasks08:25:462
259940,0migration/231496-21kthreadcore07:07:232
259940,0migration/22912-21kthreadcore06:47:222
259940,0migration/221749-21irqrtprio10:42:202
259940,0migration/219627-21kthreadcore12:02:192
259940,0migration/214501-21latency_hist09:37:042
249940,0watchdog/227900-21kthreadcore07:52:232
249940,0watchdog/216385-21grep11:17:222
249940,0watchdog/214246-21if_err_eth110:17:182
249940,0watchdog/211271-21if_err_eth1.308:07:192
249940,0watchdog/20-21swapper/210:02:222
249940,0watchdog/20-21swapper/208:12:192
249940,0watchdog/20-21swapper/208:02:232
249940,0watchdog/20-21swapper/207:57:232
249940,0watchdog/20-21swapper/207:17:232
179940,0migration/19519-21runrttasks07:42:171
179940,0migration/15050-21kthreadcore12:12:201
179940,0migration/132676-21kthreadcore10:07:201
179940,0migration/132530-21irqcore08:47:201
179940,0migration/130236-21idleruntime07:57:211
179940,0migration/129774-21kthreadcore07:32:191
179940,0migration/123519-21fschecks_count09:22:181
179940,0migration/122126-21aten_r1power_vo10:02:171
179940,0migration/118138-21kthreadcore07:47:211
179940,0migration/114689-21kernelversion10:17:201
179940,0migration/113788-21turbostat10:01:591
179940,0migration/112694-21aten_r1power_en10:37:171
169940,0watchdog/131888-21kthreadcore10:27:221
169940,0watchdog/12959-21ssh10:50:021
169940,0watchdog/126507-21kthreadcore10:22:221
169940,0watchdog/118284-21kthreadcore08:57:231
169940,0watchdog/115160-21fschecks_time09:37:181
169940,0watchdog/111697-21cut09:12:231
169940,0watchdog/10-21swapper/112:07:181
169940,0watchdog/10-21swapper/111:27:181
169940,0watchdog/10-21swapper/110:45:021
169940,0watchdog/10-21swapper/109:36:501
149940,0migration/06172-21kthreadcore07:37:230
149940,0migration/029243-21kthreadcore11:27:220
149940,0migration/012452-21kthreadcore06:52:220
4769933,0cyclictest18871-21awk08:37:182
4769932,0cyclictest3556-21lldpd08:17:062
4769932,0cyclictest3556-21lldpd07:48:362
4769932,0cyclictest3556-21lldpd07:32:052
4769932,0cyclictest22635-21awk07:27:202
4769932,0cyclictest21752-21awk07:02:212
4769930,0cyclictest0-21swapper/208:42:162
4759933,0cyclictest2552-21awk07:12:181
4759932,0cyclictest3482-21hwlatdetect07:37:201
4759932,0cyclictest23589-21awk07:52:191
4759932,0cyclictest22683-21sensors08:12:251
4759930,0cyclictest3540-21port_sshpriv08:22:241
4759930,0cyclictest27821-21df_inode07:07:181
4749933,0cyclictest18498-21kworker/0:107:22:060
4749933,0cyclictest18498-21kworker/0:107:17:060
339930,0migration/32988-21kernelversion07:12:203
29715030,0irq/26-eth0-rx-0-21swapper/308:35:133
29715030,0irq/26-eth0-rx-0-21swapper/307:47:153
29715030,0irq/26-eth0-rx-0-21swapper/307:34:463
29715030,0irq/26-eth0-rx-0-21swapper/307:07:163
259930,0migration/213976-21kthreadcore08:32:222
179930,0migration/125640-21kthreadcore09:02:211
179930,0migration/111030-21runrttasks08:30:461
169930,0watchdog/111273-21if_err_eth1.308:07:191
169930,0watchdog/10-21swapper/112:03:501
169930,0watchdog/10-21swapper/111:12:061
169930,0watchdog/10-21swapper/110:57:341
339920,0migration/330752-21diskstats08:22:173
329920,0watchdog/30-21swapper/308:13:443
29715020,0irq/26-eth0-rx-0-21swapper/308:28:363
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional