You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 04:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Wed Jun 17, 2026 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
84522990,2sleep00-21swapper/022:20:310
300882980,5sleep0174999cyclictest21:30:150
300882980,5sleep0174999cyclictest21:30:150
197302970,5sleep3175299cyclictest22:35:163
6462940,8sleep0101ktimersoftd/019:05:260
174999882,7cyclictest28127-21grep20:20:310
174999872,3cyclictest0-21swapper/021:20:180
174999871,5cyclictest23535-21ssh22:40:030
174999861,4cyclictest1927-21aten_rbpower_en20:40:190
174999861,4cyclictest1927-21aten_rbpower_en20:40:190
1749998561,3cyclictest0-21swapper/021:15:170
174999852,4cyclictest0-21swapper/023:05:310
174999851,4cyclictest18840-21rm00:30:320
174999839,58cyclictest29951-21fschecks_count00:05:240
174999832,6cyclictest9500-21fschecks_time21:00:190
174999831,8cyclictest29457-21latency_hist00:05:040
174999831,7cyclictest29234-21fschecks_count23:25:210
174999831,7cyclictest29234-21fschecks_count23:25:210
174999831,5cyclictest0-21swapper/019:35:210
174999811,5cyclictest1893-21tr19:10:180
174999811,5cyclictest17790-21latency_hist19:55:030
193722790,5sleep1175099cyclictest00:30:481
174999781,4cyclictest13082-21basename23:45:170
174999772,54cyclictest0-21swapper/023:20:040
174999771,72cyclictest12880-21sh22:25:470
174999771,5cyclictest16776-21ssh21:15:010
174999771,4cyclictest750-21snmpd20:00:300
174999771,4cyclictest6425-21df21:40:180
174999762,54cyclictest0-21swapper/019:30:040
174999761,5cyclictest24336-21uniq22:40:230
174999761,5cyclictest24336-21uniq22:40:230
174999751,5cyclictest0-21swapper/020:15:140
174999742,2cyclictest0-21swapper/022:00:150
174999742,2cyclictest0-21swapper/022:00:150
174999741,59cyclictest18042-21ssh23:11:120
174999741,59cyclictest18042-21ssh23:11:120
1749997410,47cyclictest18966-21sh22:34:180
1749997410,47cyclictest18966-21sh22:34:180
174999738,49cyclictest24704-21apt-get23:20:090
174999736,55cyclictest9-21ksoftirqd/000:21:300
174999736,55cyclictest9-21ksoftirqd/000:21:300
174999736,47cyclictest9-21ksoftirqd/023:35:220
174999721,5cyclictest6654-21chrt19:21:220
155702720,3sleep20-21swapper/221:12:542
174999719,53cyclictest29547-21ssh22:45:460
174999712,7cyclictest0-21swapper/021:54:280
174999711,4cyclictest0-21swapper/000:38:570
174999702,4cyclictest0-21swapper/000:10:450
174999701,5cyclictest28205-21sensors22:05:320
174999701,53cyclictest0-21swapper/023:00:160
174999701,4cyclictest6073-21ssh22:56:590
174999701,4cyclictest12033-21ssh21:45:550
175099692,15cyclictest7850irq/56-dwc_otg23:35:151
174999691,6cyclictest27534-21chrt21:26:240
174999691,6cyclictest27534-21chrt21:26:240
174999691,5cyclictest0-21swapper/022:14:260
174999691,4cyclictest4311-21ssh21:37:220
174999691,4cyclictest17559-21ssh00:30:030
174999691,48cyclictest17334-21cpu23:50:180
175099689,23cyclictest8050irq/56-dwc_otg_19:50:141
174999681,5cyclictest21345-21ssh21:57:230
174999681,5cyclictest18597-21cat19:55:250
174999681,58cyclictest24722-21ssh23:59:180
174999681,58cyclictest24722-21ssh23:59:180
174999681,4cyclictest0-21swapper/000:16:240
174999672,7cyclictest0-21swapper/022:17:180
174999671,4cyclictest4895-21taskset20:46:050
174999671,4cyclictest3346-21ssh22:54:340
174999661,6cyclictest0-21swapper/023:42:230
175099659,4cyclictest0-21swapper/122:31:331
175099659,4cyclictest0-21swapper/122:31:331
175099653,5cyclictest0-21swapper/119:55:151
174999641,7cyclictest0-21swapper/020:28:590
174999641,5cyclictest0-21swapper/019:46:360
174999641,5cyclictest0-21swapper/019:46:360
174999641,50cyclictest7118-21cron20:55:030
174999641,4cyclictest0-21swapper/021:08:550
174999641,4cyclictest0-21swapper/020:32:040
174999631,5cyclictest0-21swapper/023:33:520
174999631,5cyclictest0-21swapper/020:12:230
174999631,5cyclictest0-21swapper/019:18:400
174999628,39cyclictest0-21swapper/019:32:380
174999621,5cyclictest0-21swapper/020:09:100
174999612,3cyclictest0-21swapper/019:40:180
80872600,2sleep30-21swapper/321:41:293
174999602,4cyclictest0-21swapper/020:57:280
174999581,5cyclictest0-21swapper/020:37:250
175099573,5cyclictest0-21swapper/123:20:161
14242564,44sleep10-21swapper/119:09:251
175299541,10cyclictest7850irq/56-dwc_otg22:10:133
175099542,6cyclictest0-21swapper/122:15:171
175299537,30cyclictest5578-21seq20:50:183
175099533,15cyclictest7850irq/56-dwc_otg22:40:161
175099533,15cyclictest7850irq/56-dwc_otg22:40:161
10282520,3sleep3381ktimersoftd/320:35:313
175099514,10cyclictest0-21swapper/123:10:161
175099514,10cyclictest0-21swapper/123:10:161
175099504,28cyclictest11432-21ssh22:25:161
175199498,28cyclictest23961-21ssh22:40:162
175199498,28cyclictest23961-21ssh22:40:162
173062490,2sleep217301-21ssh21:15:192
175099487,27cyclictest0-21swapper/119:10:171
175099487,26cyclictest0-21swapper/119:35:171
175099484,4cyclictest0-21swapper/100:35:141
1750994832,12cyclictest0-21swapper/100:05:181
175199475,32cyclictest8050irq/56-dwc_otg_00:25:152
175199473,19cyclictest7950irq/56-dwc_otg_00:20:322
175199473,19cyclictest7950irq/56-dwc_otg_00:20:322
175099477,26cyclictest0-21swapper/120:05:181
175099477,12cyclictest5958-21missed_timers19:20:221
175199461,14cyclictest7950irq/56-dwc_otg_23:55:172
175199461,14cyclictest7950irq/56-dwc_otg_23:55:172
175099467,24cyclictest0-21swapper/120:00:171
175099466,11cyclictest9460-21cut21:00:191
177202450,3sleep211-21rcu_preempt23:50:232
175299452,4cyclictest0-21swapper/321:50:153
175099457,23cyclictest0-21swapper/119:45:181
175099457,23cyclictest0-21swapper/119:45:181
175299448,23cyclictest0-21swapper/321:55:173
175299443,26cyclictest39-21ksoftirqd/322:45:433
175299443,10cyclictest8050irq/56-dwc_otg_00:25:153
175199447,24cyclictest0-21swapper/223:05:192
175199447,24cyclictest0-21swapper/221:05:172
1751994419,6cyclictest125-21systemd-journal19:25:032
175299437,20cyclictest37-21rcuc/319:55:043
1752994311,21cyclictest381ktimersoftd/320:40:153
1752994311,21cyclictest381ktimersoftd/320:40:153
175199437,23cyclictest0-21swapper/222:15:192
175299424,6cyclictest0-21swapper/323:30:163
175299422,7cyclictest7950irq/56-dwc_otg_19:45:163
175299422,7cyclictest7950irq/56-dwc_otg_19:45:163
1752994210,14cyclictest0-21swapper/323:25:183
1752994210,14cyclictest0-21swapper/323:25:183
175099427,25cyclictest0-21swapper/120:30:171
175099427,24cyclictest0-21swapper/120:35:171
175099427,23cyclictest0-21swapper/121:30:091
175099427,23cyclictest0-21swapper/121:30:091
175099427,23cyclictest0-21swapper/120:55:181
175099421,7cyclictest0-21swapper/121:10:151
175299419,19cyclictest37-21rcuc/321:00:213
175299418,17cyclictest39-21ksoftirqd/323:03:043
175299417,24cyclictest0-21swapper/323:20:103
175299416,21cyclictest37-21rcuc/300:19:153
175099415,21cyclictest0-21swapper/121:55:161
1750994121,7cyclictest335-21latency_hist23:30:041
1750994121,7cyclictest335-21latency_hist23:30:041
175299405,14cyclictest37-21rcuc/319:18:553
175299403,5cyclictest8050irq/56-dwc_otg_20:45:143
1752994017,14cyclictest381ktimersoftd/322:51:413
1752994011,14cyclictest381ktimersoftd/322:00:323
1752994011,14cyclictest381ktimersoftd/322:00:323
175199407,21cyclictest0-21swapper/220:40:182
175199407,21cyclictest0-21swapper/220:40:182
1750994025,5cyclictest31364-21/usr/sbin/munin22:10:201
175299399,20cyclictest37-21rcuc/319:24:083
175299399,18cyclictest37-21rcuc/323:56:523
175299399,18cyclictest37-21rcuc/323:56:523
175299399,16cyclictest37-21rcuc/323:39:533
175299398,19cyclictest37-21rcuc/300:38:583
175299398,15cyclictest39-21ksoftirqd/300:30:343
175299397,25cyclictest0-21swapper/300:00:163
175299395,21cyclictest39-21ksoftirqd/300:22:253
175299395,21cyclictest39-21ksoftirqd/300:22:253
175299394,8cyclictest7950irq/56-dwc_otg_22:05:183
175299391,27cyclictest13210-21ls19:40:243
175199397,23cyclictest0-21swapper/223:30:162
175199397,19cyclictest0-21swapper/219:30:172
175199391,26cyclictest557-21ls20:35:242
1750993918,5cyclictest630250wget21:40:171
1750993917,5cyclictest9143-21threads23:00:321
228752380,2sleep20-21swapper/222:00:042
175299389,18cyclictest37-21rcuc/319:29:473
175299388,9cyclictest7950irq/56-dwc_otg_23:48:293
175299384,22cyclictest37-21rcuc/300:07:553
175299383,17cyclictest8050irq/56-dwc_otg_23:10:043
175299382,11cyclictest8050irq/56-dwc_otg_21:34:533
175299382,11cyclictest8050irq/56-dwc_otg_21:34:533
1752993819,8cyclictest7850irq/56-dwc_otg22:57:263
175199387,20cyclictest25457-21kworker/u8:120:50:092
175199383,18cyclictest7950irq/56-dwc_otg_22:20:212
1751993818,16cyclictest31-21ksoftirqd/221:25:162
1751993818,16cyclictest31-21ksoftirqd/221:25:162
1751993817,7cyclictest7950irq/56-dwc_otg_23:45:152
175199381,28cyclictest0-21swapper/200:35:092
175099387,11cyclictest7850irq/56-dwc_otg00:30:031
175099383,7cyclictest7950irq/56-dwc_otg_23:30:141
175099381,3cyclictest7850irq/56-dwc_otg23:45:171
175299376,21cyclictest39-21ksoftirqd/323:20:043
175299376,19cyclictest39-21ksoftirqd/323:11:123
175299376,19cyclictest39-21ksoftirqd/323:11:123
175299374,15cyclictest7950irq/56-dwc_otg_21:45:203
175299372,18cyclictest0-21swapper/322:40:213
175299372,18cyclictest0-21swapper/322:40:213
1752993715,9cyclictest381ktimersoftd/322:28:393
175299371,23cyclictest21808-21cpuspeed20:05:203
175199377,4cyclictest0-21swapper/222:38:502
175199377,20cyclictest0-21swapper/220:15:162
175199371,4cyclictest7850irq/56-dwc_otg23:35:142
1751993713,4cyclictest7850irq/56-dwc_otg23:40:202
175099375,26cyclictest0-21swapper/121:15:171
175099372,24cyclictest8050irq/56-dwc_otg_22:20:201
175099371,19cyclictest3606-21ls20:45:051
175099371,19cyclictest3606-21ls20:45:051
175299369,7cyclictest8050irq/56-dwc_otg_22:23:043
175299368,18cyclictest39-21ksoftirqd/320:00:423
175299368,16cyclictest37-21rcuc/319:35:213
175299368,15cyclictest8050irq/56-dwc_otg_20:30:043
175299367,17cyclictest7850irq/56-dwc_otg19:10:213
175299364,19cyclictest7850irq/56-dwc_otg21:20:413
175299361,20cyclictest381ktimersoftd/322:31:513
175299361,20cyclictest381ktimersoftd/322:31:513
175199362,16cyclictest28247-21cat22:05:332
1751993620,14cyclictest14062-21ssh21:49:282
175199361,25cyclictest1881-21ls00:10:232
175199361,24cyclictest16544-21cut19:50:202
175099369,4cyclictest0-21swapper/123:15:241
1750993620,12cyclictest0-21swapper/100:20:221
1750993620,12cyclictest0-21swapper/100:20:221
175099361,8cyclictest2413450ssh23:58:131
175099361,8cyclictest2413450ssh23:58:131
84252350,2sleep28390-21ssh23:00:232
175299358,17cyclictest37-21rcuc/321:26:203
175299358,17cyclictest37-21rcuc/321:26:203
175299356,17cyclictest0-21swapper/300:10:283
175299354,17cyclictest37-21rcuc/319:30:063
175299352,3cyclictest8050irq/56-dwc_otg_20:20:153
175299352,16cyclictest7950irq/56-dwc_otg_21:10:263
175299351,19cyclictest30851-21ls20:30:183
175299351,17cyclictest39-21ksoftirqd/319:55:263
175299351,12cyclictest39-21ksoftirqd/321:08:553
175199358,11cyclictest8050irq/56-dwc_otg_20:25:252
175199357,15cyclictest0-21swapper/222:50:182
175199354,14cyclictest7950irq/56-dwc_otg_20:00:332
1751993529,4cyclictest15912-21fschecks_time22:30:222
1751993529,4cyclictest15912-21fschecks_time22:30:222
1751993515,4cyclictest12103-21/usr/sbin/munin22:25:262
175199351,4cyclictest7950irq/56-dwc_otg_19:15:302
175099359,4cyclictest0-21swapper/122:53:171
175099356,13cyclictest8050irq/56-dwc_otg_22:55:181
1750993524,4cyclictest221ktimersoftd/119:26:341
175099351,7cyclictest2807850ssh22:05:301
175099351,4cyclictest7850irq/56-dwc_otg21:25:331
175099351,4cyclictest7850irq/56-dwc_otg21:25:331
1750993510,7cyclictest7850irq/56-dwc_otg21:25:041
104602350,1sleep10-21swapper/123:40:561
9242344,16sleep31046-21unixbench_singl19:05:303
175299345,7cyclictest39-21ksoftirqd/322:20:043
175199349,11cyclictest8050irq/56-dwc_otg_21:35:322
175199348,5cyclictest0-21swapper/221:00:122
175199345,18cyclictest0-21swapper/223:13:542
175199345,18cyclictest0-21swapper/223:13:542
175199345,17cyclictest750-21snmpd20:10:312
175199341,6cyclictest7950irq/56-dwc_otg_19:40:152
175199341,18cyclictest7850irq/56-dwc_otg23:25:342
175199341,18cyclictest7850irq/56-dwc_otg23:25:342
175099347,5cyclictest27007-21latency_hist22:05:041
175099347,5cyclictest27007-21latency_hist22:05:041
175099343,12cyclictest8050irq/56-dwc_otg_20:30:041
175299333,21cyclictest37-21rcuc/320:12:023
1752993312,7cyclictest0-21swapper/320:15:153
175299331,15cyclictest39-21ksoftirqd/323:50:513
1752993310,12cyclictest7850irq/56-dwc_otg21:35:423
175199339,7cyclictest8050irq/56-dwc_otg_00:30:222
175199338,6cyclictest7950irq/56-dwc_otg_22:10:182
175199338,4cyclictest0-21swapper/200:08:102
175199334,14cyclictest7950irq/56-dwc_otg_22:49:502
175199334,14cyclictest7950irq/56-dwc_otg_21:30:252
175199334,14cyclictest7950irq/56-dwc_otg_21:30:252
175099337,4cyclictest7850irq/56-dwc_otg20:10:321
175099334,4cyclictest0-21swapper/122:35:301
175099333,19cyclictest0-21swapper/100:19:591
175099332,18cyclictest0-21swapper/123:55:031
1750993312,6cyclictest0-21swapper/121:45:291
1750993312,4cyclictest0-21swapper/100:10:251
1750993311,6cyclictest6663-21unixbench_multi20:50:321
1750993311,5cyclictest1481650wget21:50:171
175299327,9cyclictest11285-21ssh23:42:263
175299327,23cyclictest0-21swapper/320:55:183
175199327,5cyclictest7850irq/56-dwc_otg22:00:292
175199327,5cyclictest7850irq/56-dwc_otg22:00:292
175199324,3cyclictest7950irq/56-dwc_otg_21:20:392
175199323,5cyclictest21896-21rm23:15:392
1751993210,4cyclictest0-21swapper/200:00:172
175099327,5cyclictest13008-21ssh23:05:281
175099325,6cyclictest8050irq/56-dwc_otg_19:30:311
175099324,5cyclictest7850irq/56-dwc_otg00:00:331
175099324,15cyclictest11722-21ps21:05:281
175099323,6cyclictest7850irq/56-dwc_otg21:35:211
175099322,18cyclictest28236-21cut22:45:191
175099322,18cyclictest0-21swapper/119:40:231
175299311,9cyclictest8050irq/56-dwc_otg_21:16:233
175199318,6cyclictest0-21swapper/221:41:502
175199317,12cyclictest7850irq/56-dwc_otg23:20:192
175199316,10cyclictest7950irq/56-dwc_otg_20:20:202
175199313,5cyclictest0-21swapper/220:45:172
175199313,4cyclictest18827-21/usr/sbin/munin19:55:292
175099315,18cyclictest3637-21grep19:15:171
175199306,14cyclictest0-21swapper/222:55:182
175199303,19cyclictest727-21runrttasks00:17:542
175199303,12cyclictest8050irq/56-dwc_otg_20:55:242
1751993012,9cyclictest7850irq/56-dwc_otg21:50:262
175099301,13cyclictest7950irq/56-dwc_otg_20:20:301
175199292,17cyclictest22156-21latency20:05:252
175199291,6cyclictest0-21swapper/220:30:282
175199291,10cyclictest14476-21aten_rbpower_en19:45:182
175199291,10cyclictest14476-21aten_rbpower_en19:45:182
175099292,14cyclictest0-21swapper/120:15:241
1751992821,5cyclictest183650wget19:10:182
175199281,5cyclictest7850irq/56-dwc_otg19:35:182
1751992815,4cyclictest7191-21/usr/sbin/munin19:25:252
175099287,10cyclictest0-21swapper/120:48:331
12042263,14sleep20-21swapper/219:06:382
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional