You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-14 - 12:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Fri Aug 14, 2026 00:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1478021250,3sleep214763-21ssh00:00:182
2530021240,6sleep22409199cyclictest19:10:342
544621200,2sleep00-21swapper/000:27:460
240899910916,87cyclictest0-21swapper/000:00:120
2409099994,60cyclictest15702-21smartpower00:00:341
102652960,5sleep12409099cyclictest23:15:241
2408999944,53cyclictest27917-21ssh00:15:320
2409199843,12cyclictest27904-21ntp_states00:15:312
79602830,2sleep30-21swapper/323:51:013
24089998071,3cyclictest7950irq/56-dwc_otg_23:15:180
2409099782,52cyclictest0-21swapper/120:00:161
24089997810,29cyclictest0-21swapper/019:40:170
7312770,6sleep32409299cyclictest23:42:563
24092997732,21cyclictest6283-21missed_timers23:10:263
24092997732,21cyclictest6283-21missed_timers23:10:263
2409099744,65cyclictest27917-21ssh00:15:321
2408999746,41cyclictest0-21swapper/023:45:180
24092997233,22cyclictest13549-21sh21:21:443
2409099721,54cyclictest0-21swapper/122:07:461
2409099721,51cyclictest11018-21irqstats23:55:221
2408999727,41cyclictest0-21swapper/019:25:100
2408999726,34cyclictest0-21swapper/000:30:090
2408999721,21cyclictest0-21swapper/022:50:170
2408999721,21cyclictest0-21swapper/022:50:170
24092997135,23cyclictest22807-21/usr/sbin/munin23:30:243
24092997124,23cyclictest0-21swapper/300:00:123
2409099711,56cyclictest0-21swapper/122:33:381
24092997032,12cyclictest27158-21sed20:45:333
2409099691,40cyclictest27310-21ssh21:38:511
2408999697,33cyclictest0-21swapper/020:50:090
24092996835,22cyclictest18899-21ssh22:07:213
2409099683,50cyclictest31925-21ssh21:44:431
2409099682,53cyclictest0-21swapper/123:42:121
2409099681,53cyclictest28113-21ssh22:18:591
2409099681,52cyclictest22524-21ssh21:32:381
2409099681,52cyclictest22524-21ssh21:32:381
2409099681,51cyclictest7944-21ntp_states00:30:291
2408999681,45cyclictest1872-21ls23:05:220
24092996727,8cyclictest2933-21apt-get00:25:193
24091996728,36cyclictest3461-21sed23:45:332
2409099672,45cyclictest13537-21/usr/sbin/munin20:10:291
2409099671,53cyclictest21297-21ssh00:07:391
2409099671,50cyclictest22532-21df23:30:201
2409099671,49cyclictest26215-21apt-get20:45:171
24092996635,15cyclictest12914-21/usr/sbin/munin20:05:303
24092996631,20cyclictest26236-21ssh00:14:073
24092996627,30cyclictest31958-21ssh23:02:073
2409199664,5cyclictest7750irq/56-dwc_otg00:30:232
24090996618,28cyclictest1180-21runrttasks22:13:151
2409099661,53cyclictest24973-21ssh00:11:491
2409099661,51cyclictest0-21swapper/121:27:051
2408999667,25cyclictest0-21swapper/020:05:100
2408999663,33cyclictest0-21swapper/023:20:190
24092996535,19cyclictest2829-21sed21:10:063
24092996534,15cyclictest7076-21cat21:15:053
24092996533,15cyclictest30589-21ssh00:19:323
24092996532,21cyclictest11412-21ssh23:55:283
24092996531,17cyclictest1406-21ssh23:05:103
24092996530,18cyclictest22703-21ssh21:32:583
24092996530,18cyclictest22703-21ssh21:32:583
24092996528,26cyclictest31312-21ssh22:22:173
2409099652,37cyclictest0-21swapper/123:49:501
2409099651,53cyclictest14767-21ssh00:39:311
2409099651,51cyclictest21922-21ssh23:30:001
2409099651,51cyclictest21922-21ssh23:30:001
2409099651,49cyclictest8412-21ssh23:13:161
2409099651,49cyclictest8412-21ssh23:13:161
2409099651,43cyclictest12727-21cat20:05:281
24092996433,19cyclictest20996-21diskstats22:10:213
24092996430,26cyclictest11372-21ssh23:16:073
24092996430,18cyclictest16203-21perl21:25:253
24092996426,18cyclictest12242-21ssh22:39:023
2409199642,19cyclictest4192-21munin-plugin-st19:45:042
2409099644,46cyclictest14549-21ssh22:01:581
2409099644,46cyclictest14549-21ssh22:01:581
2409099642,47cyclictest4107-21chrt21:50:091
2409099641,51cyclictest0-21swapper/122:39:241
24092996332,12cyclictest9827-21acpi20:00:163
24092996329,26cyclictest25524-21awk21:35:343
2409099631,50cyclictest13036-21ssh21:20:511
2409099631,47cyclictest29283-21runrttasks23:38:221
2409099631,44cyclictest1038-21ssh00:22:171
2409099631,44cyclictest1038-21ssh00:22:171
2408999638,26cyclictest11554-21ssh21:20:170
24089996324,19cyclictest23939-21latency_hist21:35:050
24089996324,19cyclictest23939-21latency_hist21:35:050
24089996316,26cyclictest24290-21wget21:35:190
24092996231,19cyclictest6868-21ssh21:53:033
24092996230,19cyclictest5821-21sensors22:30:303
24092996226,11cyclictest2432-21ssh21:47:313
2409099621,50cyclictest27597-21ssh22:56:431
2409099621,47cyclictest22291-21chrt20:34:331
2409099621,47cyclictest22291-21chrt20:34:331
2409099621,43cyclictest22725-21ssh22:50:351
2409099621,43cyclictest22725-21ssh22:50:351
2409099621,43cyclictest10337-21ssh21:18:351
2409099621,41cyclictest16790-21chrt22:44:491
2409099621,39cyclictest3631-21ssh21:10:261
2409099621,35cyclictest32731-21diskstats21:45:231
2408999621,7cyclictest27325-21grep20:45:350
24092996130,20cyclictest27626-21chrt22:56:463
24092996128,23cyclictest9910-21ssh00:33:113
24092996121,25cyclictest7950irq/56-dwc_otg_19:30:003
2409199611,4cyclictest7850irq/56-dwc_otg_19:35:042
2409099614,42cyclictest8679-21ssh23:52:201
2409099613,42cyclictest3036-21ssh22:27:201
24090996119,33cyclictest3263-21sh00:25:231
2409099611,41cyclictest16157-21rm23:22:011
2408999617,25cyclictest0-21swapper/019:45:160
2408999614,14cyclictest0-21swapper/019:55:150
2408999614,14cyclictest0-21swapper/019:55:150
24089996135,9cyclictest7750irq/56-dwc_otg00:10:150
24092996033,12cyclictest2330-21ssh22:26:023
24092996030,21cyclictest8705-21ssh21:15:463
24092996030,16cyclictest27464-21sh23:35:313
24092996029,20cyclictest30340-21ssh21:41:493
24092996029,16cyclictest22078-21sh00:09:053
24092996029,13cyclictest14236-21ssh00:38:323
24092996029,12cyclictest10018-21chrt21:56:153
24092996028,18cyclictest17210-21ssh22:45:103
24092996028,17cyclictest9607-21munin-run20:00:053
24092996028,17cyclictest9607-21munin-run20:00:053
24092996027,22cyclictest17496-21ssh23:24:283
24092996022,24cyclictest0-21swapper/320:55:173
24092996022,18cyclictest7950irq/56-dwc_otg_00:25:053
24092996022,18cyclictest7950irq/56-dwc_otg_00:25:053
2409199602,13cyclictest7750irq/56-dwc_otg22:05:012
2409199602,13cyclictest7750irq/56-dwc_otg22:05:012
2409099605,44cyclictest7950irq/56-dwc_otg_19:50:051
2409099601,48cyclictest0-21swapper/123:05:161
2409099601,47cyclictest16561-21chrt20:15:451
24089996029,12cyclictest7850irq/56-dwc_otg_21:20:040
24092995926,10cyclictest7850irq/56-dwc_otg_22:40:273
2409199597,3cyclictest0-21swapper/200:38:042
2409199597,10cyclictest0-21swapper/222:47:122
2409199595,4cyclictest26533-21fschecks_time20:45:242
2409199591,5cyclictest21979-21munin-run23:30:052
2409199591,5cyclictest21979-21munin-run23:30:052
2409099592,40cyclictest25626-21dhclient-script19:14:391
2409099591,47cyclictest7850irq/56-dwc_otg_19:22:121
2409099591,44cyclictest975-21ssh23:04:491
2409099591,43cyclictest9797-21ssh21:55:511
2409099591,41cyclictest4165-21chrt19:44:581
24089995923,17cyclictest7850irq/56-dwc_otg_19:10:330
24092995826,15cyclictest23245-21ssh22:51:303
24092995826,15cyclictest23245-21ssh22:51:303
2409199582,9cyclictest7950irq/56-dwc_otg_23:05:212
24091995819,4cyclictest11428-21cat20:05:042
2409199581,4cyclictest7850irq/56-dwc_otg_19:30:042
2409199581,11cyclictest7950irq/56-dwc_otg_21:30:232
2409199581,11cyclictest7950irq/56-dwc_otg_21:30:232
2409099582,37cyclictest2058-21chrt19:36:171
2409099582,32cyclictest0-21swapper/119:20:051
2409099581,43cyclictest31059-21ssh22:21:491
2408999583,27cyclictest0-21swapper/022:30:160
24089995829,16cyclictest0-21swapper/020:45:050
24092995729,11cyclictest14351-21ssh22:01:363
24092995729,11cyclictest14351-21ssh22:01:363
24092995726,16cyclictest0-21swapper/320:10:263
24092995726,12cyclictest7850irq/56-dwc_otg_23:30:053
24092995726,12cyclictest7850irq/56-dwc_otg_23:30:053
24092995722,17cyclictest7950irq/56-dwc_otg_20:25:293
2409199573,5cyclictest7850irq/56-dwc_otg_20:05:192
2409199572,5cyclictest7850irq/56-dwc_otg_22:36:442
2409199572,5cyclictest7850irq/56-dwc_otg_00:25:292
2409199571,4cyclictest6132-21/usr/sbin/munin23:10:242
2409199571,4cyclictest6132-21/usr/sbin/munin23:10:242
2409199571,4cyclictest0-21swapper/223:36:252
2409199571,3cyclictest7850irq/56-dwc_otg_23:33:162
2409199571,16cyclictest0-21swapper/222:10:252
2409099571,46cyclictest2415-21taskset21:07:181
2409099571,42cyclictest0-21swapper/119:55:501
2409099571,42cyclictest0-21swapper/119:55:501
24089995726,7cyclictest7850irq/56-dwc_otg_22:00:180
24089995726,7cyclictest7850irq/56-dwc_otg_22:00:180
2408999571,34cyclictest9-21ksoftirqd/022:10:040
24092995627,21cyclictest503-21taskset19:34:403
24092995626,11cyclictest26475-21ssh22:16:033
2409199562,4cyclictest7850irq/56-dwc_otg_21:15:542
2409199561,4cyclictest7850irq/56-dwc_otg_22:56:302
2409199561,3cyclictest7850irq/56-dwc_otg_23:19:212
2409099562,42cyclictest0-21swapper/120:53:191
2409099561,44cyclictest24406-21aten_rbpower_cu20:40:171
2409099561,43cyclictest19799-21ssh22:47:451
24089995613,23cyclictest3304-21fschecks_count21:10:230
24092995535,10cyclictest4417-21ssh23:47:043
24092995528,12cyclictest24398-21apt-get20:40:173
2409199554,12cyclictest7850irq/56-dwc_otg_21:41:322
2409099552,42cyclictest23945-21chrt20:37:351
2409099551,27cyclictest0-21swapper/119:50:251
2408999559,6cyclictest31469-21cron21:00:040
2408999558,24cyclictest0-21swapper/023:00:180
2408999557,21cyclictest0-21swapper/019:35:150
24089995519,6cyclictest7750irq/56-dwc_otg00:05:190
2409199549,4cyclictest0-21swapper/222:26:412
2409199549,3cyclictest0-21swapper/221:26:592
2409199545,5cyclictest7850irq/56-dwc_otg_23:55:322
2409199542,4cyclictest7750irq/56-dwc_otg23:05:002
2409199541,4cyclictest7750irq/56-dwc_otg21:47:222
2409099541,38cyclictest31182-21chrt19:29:571
24089995431,8cyclictest7850irq/56-dwc_otg_23:35:210
24089995416,20cyclictest1180-21runrttasks22:40:330
24092995321,12cyclictest27462-21chrt19:19:523
24092995318,11cyclictest0-21swapper/321:01:283
2409199535,7cyclictest7950irq/56-dwc_otg_20:40:042
2409199535,4cyclictest7750irq/56-dwc_otg21:50:372
2409199534,5cyclictest0-21swapper/221:21:142
2408999533,45cyclictest56232sleep023:10:170
2408999533,45cyclictest56232sleep023:10:170
24089995327,7cyclictest7389-21unixbench_singl19:50:320
24089995320,22cyclictest0-21swapper/023:50:150
2408999531,3cyclictest0-21swapper/023:55:210
2408999531,26cyclictest0-21swapper/021:50:280
24092995235,14cyclictest28120-21apt-get20:50:153
2409199522,6cyclictest24145-21grep00:10:322
2409099521,47cyclictest18970-21apt-get20:25:161
2409099521,46cyclictest32336-21sed21:00:231
2408999529,28cyclictest0-21swapper/021:58:550
2408999526,43cyclictest0-21swapper/020:00:180
24089995226,6cyclictest7850irq/56-dwc_otg_21:05:180
24089995225,4cyclictest21922-21grep20:30:330
24089995225,4cyclictest21922-21grep20:30:330
24089995223,5cyclictest7850irq/56-dwc_otg_22:15:040
2408999522,23cyclictest0-21swapper/020:25:050
2408999521,46cyclictest0-21swapper/019:20:240
24091995118,4cyclictest29299-21idleruntime-cro19:25:052
2409099512,37cyclictest7950irq/56-dwc_otg_19:35:001
2409099512,37cyclictest0-21swapper/120:59:011
2408999516,27cyclictest22870-21cut20:35:220
2408999511,28cyclictest0-21swapper/000:20:270
2408999511,28cyclictest0-21swapper/000:20:270
2408999511,22cyclictest18921-21ntp_kernel_pll_23:25:270
2408999511,22cyclictest18921-21ntp_kernel_pll_23:25:270
24092995026,11cyclictest25431-21seq19:12:093
24092995021,11cyclictest5935-21chrt19:49:393
2409199509,3cyclictest0-21swapper/222:19:372
2409199504,12cyclictest0-21swapper/223:24:072
2409199502,11cyclictest0-21swapper/222:20:552
2409199501,5cyclictest24676-21fschecks_count20:40:212
2409199501,5cyclictest14723-21users20:10:332
2409099502,35cyclictest0-21swapper/120:21:221
24089995023,4cyclictest24943-21sh22:15:180
2408999502,28cyclictest0-21swapper/022:55:190
24089995016,24cyclictest7850irq/56-dwc_otg_22:20:300
2408999501,27cyclictest22493-21cpuspeed23:30:190
24092994935,11cyclictest24308-21cut20:40:043
24092994934,12cyclictest4359-21cut19:45:053
24092994934,12cyclictest28563-21expr19:20:303
24092994934,12cyclictest21039-21fschecks_count20:30:213
24092994934,12cyclictest21039-21fschecks_count20:30:213
24092994933,13cyclictest6926-21ntpq19:50:283
2409199491,5cyclictest7019-21ssh22:32:022
24089994918,15cyclictest812-21cron21:05:050
2408999491,32cyclictest0-21swapper/023:40:210
2408999491,25cyclictest0-21swapper/019:30:160
24092994836,9cyclictest15356-21apt-get20:15:163
24092994831,14cyclictest17601-21if_wlan020:20:223
24092994831,13cyclictest1923-21grep19:35:333
2409199486,12cyclictest0-21swapper/222:40:092
2409199485,7cyclictest7850irq/56-dwc_otg_22:07:302
2409199482,4cyclictest7750irq/56-dwc_otg21:11:472
2409199481,5cyclictest25253-21ssh21:35:322
2409199481,5cyclictest22018-21latency22:50:262
2409199481,5cyclictest22018-21latency22:50:262
2408999484,27cyclictest0-21swapper/020:10:150
24089994820,5cyclictest7950irq/56-dwc_otg_21:45:180
24089994811,5cyclictest9361-21cut22:35:220
2408999481,15cyclictest0-21swapper/022:45:260
2408999481,15cyclictest0-21swapper/021:41:450
237682482,14sleep00-21swapper/019:09:240
24089994718,7cyclictest16477-21grep20:15:340
24089994714,29cyclictest26157-21fschecks_count19:15:230
2408999471,22cyclictest823-21aten_rbpower_po22:25:180
2408999442,7cyclictest11361-21tr00:35:190
24089994418,15cyclictest0-21swapper/021:26:230
2408999431,20cyclictest0-21swapper/020:25:180
2409199405,23cyclictest6405-21ssh23:50:172
2409199401,10cyclictest0-21swapper/200:20:542
2409199401,10cyclictest0-21swapper/200:20:542
228822400,2sleep20-21swapper/219:05:242
2409199372,10cyclictest7850irq/56-dwc_otg_20:25:152
2409199365,13cyclictest0-21swapper/200:05:262
226572360,5sleep30-21swapper/319:05:213
2409199357,5cyclictest7850irq/56-dwc_otg_21:00:302
24091993519,4cyclictest15431-21basename20:15:192
2409199351,21cyclictest17336-21cpuspeed20:20:182
24091993414,4cyclictest5987-21latency_hist19:50:052
2409199327,14cyclictest7950irq/56-dwc_otg_20:55:312
2409199322,13cyclictest7850irq/56-dwc_otg_19:55:312
2409199322,13cyclictest7850irq/56-dwc_otg_19:55:312
237132323,23sleep10-21swapper/119:08:481
2409199318,6cyclictest7850irq/56-dwc_otg_21:55:272
2409199301,13cyclictest7750irq/56-dwc_otg19:52:552
24091992921,5cyclictest20808-21wget20:30:182
24091992921,5cyclictest20808-21wget20:30:182
2409199291,21cyclictest373-21ssh23:42:192
2409199287,12cyclictest7950irq/56-dwc_otg_20:50:322
2409199283,16cyclictest0-21swapper/219:15:192
2409199282,11cyclictest7950irq/56-dwc_otg_21:05:302
24091992720,5cyclictest2383-21sh19:40:042
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional