You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-10 - 06:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Mon Aug 10, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
830022660,4sleep30-21swapper/319:10:033
8479991393,11cyclictest0-21swapper/023:45:300
84799912424,80cyclictest23428-21ssh00:35:190
84799912424,80cyclictest23428-21ssh00:35:190
84799911839,63cyclictest7850irq/56-dwc_otg_22:55:270
8479991172,98cyclictest5040-21kworker/u8:123:30:250
8479991153,89cyclictest22153-21kworker/u8:200:25:120
2733221140,2sleep00-21swapper/021:20:030
8479991023,12cyclictest0-21swapper/000:15:090
8479991003,78cyclictest0-21swapper/022:50:040
8479999814,67cyclictest19678-21grep23:50:320
308142980,2sleep30-21swapper/300:05:163
8479999731,51cyclictest8699-1kworker/u9:100:30:350
8481999614,17cyclictest7950irq/56-dwc_otg_00:25:082
847999969,17cyclictest0-21swapper/020:30:160
8479999325,45cyclictest31626-21grep22:05:330
8479999220,51cyclictest0-21swapper/021:05:130
847999921,73cyclictest17461-21cat19:35:020
8479999030,46cyclictest7750irq/56-dwc_otg22:00:290
8479999027,50cyclictest7750irq/56-dwc_otg21:40:150
8481998914,42cyclictest23367-21ssh00:35:182
8481998914,42cyclictest23367-21ssh00:35:182
30772890,7sleep2848199cyclictest21:30:212
222332890,3sleep322195-21ssh23:15:203
848199883,11cyclictest0-21swapper/223:30:262
8479998721,47cyclictest19730-21fschecks_time19:40:210
119662870,2sleep10-21swapper/122:22:141
847999851,63cyclictest6833-21ssh21:35:110
848199834,17cyclictest6252-21ssh22:55:292
8479998314,56cyclictest21413-21ssh21:11:330
847999823,75cyclictest0-21swapper/022:50:040
8479998221,41cyclictest7750irq/56-dwc_otg22:35:160
8479998220,42cyclictest0-21swapper/022:40:200
847999821,62cyclictest23309-21ntp_kernel_pll_21:55:240
848199813,26cyclictest0-21swapper/200:30:342
847999813,10cyclictest27022-21swap23:20:290
847999812,65cyclictest3163-21unixbench_multi22:10:330
8479998124,36cyclictest14758-21ssh21:45:180
8479998124,36cyclictest14758-21ssh21:45:180
8479998117,47cyclictest7750irq/56-dwc_otg21:20:020
161652800,2sleep00-21swapper/021:00:210
847999793,69cyclictest0-21swapper/000:21:530
847999791,60cyclictest520-21rs:main0
847999791,59cyclictest0-21swapper/021:50:200
8482997810,8cyclictest0-21swapper/300:25:083
847999785,50cyclictest0-21swapper/023:00:280
848199762,17cyclictest7750irq/56-dwc_otg22:50:032
847999762,59cyclictest17917-21fschecks_count19:35:220
847999761,5cyclictest31386-21rm21:25:150
847999752,55cyclictest0-21swapper/022:20:370
8479997518,4cyclictest7850irq/56-dwc_otg_21:30:300
8480997420,25cyclictest23-21ksoftirqd/123:45:321
847999742,57cyclictest0-21swapper/020:40:030
8479997418,42cyclictest0-21swapper/022:33:180
847999741,55cyclictest0-21swapper/022:15:350
847999741,18cyclictest0-21swapper/019:59:080
848199733,14cyclictest30182-21ssh23:25:132
8479997227,25cyclictest30465-21cron00:05:020
847999721,21cyclictest10218-21/usr/sbin/munin23:40:160
847999721,19cyclictest0-21swapper/020:01:270
8482997133,18cyclictest7750irq/56-dwc_otg23:45:323
8480997115,11cyclictest1041-21ssh22:50:031
848299709,28cyclictest7850irq/56-dwc_otg_00:30:303
8479997017,41cyclictest7850irq/56-dwc_otg_22:26:000
847999692,52cyclictest1180-21runrttasks19:45:350
8479996918,3cyclictest7750irq/56-dwc_otg23:14:030
847999691,52cyclictest0-21swapper/023:27:030
8479996912,44cyclictest2904-21idleruntime00:10:200
98332680,4sleep19834-21modprobe23:40:021
847999683,50cyclictest0-21swapper/019:51:120
8479996730,17cyclictest0-21swapper/020:05:300
8479996710,9cyclictest0-21swapper/019:27:130
847999664,5cyclictest7850irq/56-dwc_otg_00:10:020
847999662,39cyclictest8675-21chrt20:40:150
8479996618,35cyclictest0-21swapper/020:47:170
848199653,40cyclictest15392-21ssh23:45:302
848099658,9cyclictest0-21swapper/122:55:291
848099655,10cyclictest7850irq/56-dwc_otg_23:25:131
847999652,22cyclictest0-21swapper/019:15:200
848099643,14cyclictest17135-1kworker/u9:200:35:201
848099643,14cyclictest17135-1kworker/u9:200:35:201
848099642,24cyclictest0-21swapper/123:20:301
847999644,14cyclictest0-21swapper/023:06:090
847999642,30cyclictest0-21swapper/020:25:150
8479996413,41cyclictest0-21swapper/020:16:460
8479996413,41cyclictest0-21swapper/020:16:460
8479996411,9cyclictest13639-21chrt19:24:340
205432640,9sleep1848099cyclictest00:30:341
8482996310,32cyclictest37-21rcuc/323:20:283
848099635,28cyclictest21-21rcuc/100:15:091
8479996314,39cyclictest0-21swapper/020:21:530
8479996313,5cyclictest30246-21/usr/sbin/munin20:10:210
847999631,11cyclictest0-21swapper/023:19:080
848099624,36cyclictest0-21swapper/123:50:311
8480996216,9cyclictest15029-21ssh00:25:081
847999629,13cyclictest0-21swapper/023:57:240
847999622,18cyclictest0-21swapper/019:11:460
19152620,2sleep20-21swapper/221:28:522
8481996114,19cyclictest19257-21diskmemload00:21:532
848299607,46cyclictest1032-21ls22:50:033
848299606,4cyclictest21620-21ssh22:35:103
8481996011,13cyclictest7850irq/56-dwc_otg_23:50:312
848099593,21cyclictest2530-21ssh23:30:241
848299588,25cyclictest7950irq/56-dwc_otg_00:15:063
848299587,24cyclictest7850irq/56-dwc_otg_23:50:323
8481995818,12cyclictest6650-21ssh00:15:092
8481995723,8cyclictest7850irq/56-dwc_otg_22:15:122
847999561,16cyclictest12247-21chrt20:50:060
848299554,13cyclictest23387-21ssh00:35:183
848299554,13cyclictest23387-21ssh00:35:183
848099558,29cyclictest0-21swapper/119:20:161
848099556,12cyclictest140-21systemd-journal22:50:041
8480995513,21cyclictest12932-21ssh00:21:531
847999551,31cyclictest0-21swapper/020:55:180
326112550,3sleep132613-21unixbench_multi21:25:321
848199541,7cyclictest7850irq/56-dwc_otg_23:00:132
848299533,28cyclictest0-21swapper/323:30:243
8481995310,21cyclictest7750irq/56-dwc_otg23:20:282
848099538,28cyclictest0-21swapper/120:35:171
848299528,28cyclictest0-21swapper/321:00:163
242922520,2chrt24293-21diskmemload23:56:121
8480995117,15cyclictest0-21swapper/120:40:151
848099511,35cyclictest7750irq/56-dwc_otg20:50:181
848299508,29cyclictest0-21swapper/322:25:173
848299508,27cyclictest0-21swapper/322:00:183
848199509,28cyclictest0-21swapper/221:35:082
848299489,25cyclictest0-21swapper/321:35:093
848299487,20cyclictest6311-21/usr/sbin/munin22:55:303
8482994819,19cyclictest39-21ksoftirqd/322:40:133
848199483,29cyclictest0-21swapper/222:50:052
848199483,19cyclictest0-21swapper/219:55:152
848099488,26cyclictest0-21swapper/121:05:151
8480994822,8cyclictest21240-21idleruntime-cro22:35:031
8480994818,17cyclictest0-21swapper/119:45:161
8482994711,20cyclictest12950-21ssh00:21:553
848199472,9cyclictest7750irq/56-dwc_otg20:30:132
848199472,22cyclictest23303-21ssh21:15:032
848099478,27cyclictest7950irq/56-dwc_otg_21:20:161
848299469,17cyclictest0-21swapper/321:30:193
848299463,27cyclictest0-21swapper/322:50:053
848299462,34cyclictest0-21swapper/300:15:033
848299461,28cyclictest17643-21sh22:30:153
848199468,26cyclictest0-21swapper/221:15:182
848199468,26cyclictest0-21swapper/220:40:172
8480994615,7cyclictest0-21swapper/122:10:131
848299457,13cyclictest7850irq/56-dwc_otg_23:05:143
848299451,28cyclictest13827-21latency_hist20:55:033
848199454,12cyclictest26760-21sh00:00:182
8480994522,7cyclictest21-21rcuc/123:40:131
169932450,9sleep2301ktimersoftd/219:30:322
848299447,23cyclictest1933-21ssh22:10:163
848299441,6cyclictest7950irq/56-dwc_otg_19:45:153
848199442,9cyclictest7750irq/56-dwc_otg19:50:152
848299439,29cyclictest0-21swapper/319:30:163
848199432,2cyclictest0-21swapper/223:55:132
848099432,32cyclictest3478-21grep20:25:201
8480994317,12cyclictest2534150ssh21:16:331
8480994314,9cyclictest0-21swapper/121:35:101
848299421,25cyclictest25136-21uniq19:55:223
848199423,30cyclictest7950irq/56-dwc_otg_20:10:172
8481994211,16cyclictest7950irq/56-dwc_otg_21:55:302
848099428,29cyclictest0-21swapper/119:30:091
848099424,24cyclictest0-21swapper/122:40:141
848099421,25cyclictest16164-21uniq21:00:211
4252420,2sleep20-21swapper/222:07:482
8482994114,4cyclictest7750irq/56-dwc_otg21:25:303
74012410,3sleep03580-21kworker/0:219:05:270
8482994019,5cyclictest39-21ksoftirqd/320:16:333
8482994019,5cyclictest39-21ksoftirqd/320:16:333
848199407,7cyclictest7950irq/56-dwc_otg_21:40:222
848199402,7cyclictest7850irq/56-dwc_otg_20:50:122
848199401,26cyclictest17935-21cut22:30:192
848199401,11cyclictest13812-21kworker/u8:121:45:172
848199401,11cyclictest13812-21kworker/u8:121:45:172
848099408,13cyclictest7850irq/56-dwc_otg_21:46:011
848099408,13cyclictest7850irq/56-dwc_otg_21:46:011
848099407,14cyclictest7950irq/56-dwc_otg_21:58:401
8480994022,4cyclictest14179-21sh23:05:221
8480994018,5cyclictest20933-21sh21:10:371
8480994013,7cyclictest19510-21runrttasks19:40:181
848099401,25cyclictest31251-21ls20:10:351
848099401,16cyclictest7750irq/56-dwc_otg19:30:031
848299398,17cyclictest0-21swapper/322:20:173
848299398,17cyclictest0-21swapper/319:35:183
848299397,22cyclictest0-21swapper/321:20:203
8482993923,8cyclictest7950irq/56-dwc_otg_21:40:283
848299392,24cyclictest0-21swapper/322:15:283
8482993916,7cyclictest23130-21wget19:50:183
848299391,26cyclictest8862-21ls19:10:203
848299391,25cyclictest30808-21cut22:05:213
8482993910,8cyclictest39-21ksoftirqd/321:55:123
848199399,10cyclictest29362-21latency_hist22:45:022
848199398,16cyclictest0-21swapper/220:35:172
848199391,26cyclictest15021-21ls20:55:332
848099398,15cyclictest7950irq/56-dwc_otg_19:35:191
848099393,23cyclictest30080-21ls20:10:021
8480993918,5cyclictest2164350/usr/sbin/munin22:35:251
848099391,26cyclictest1950-21latency20:20:231
848199381,29cyclictest18674-21ls21:05:302
848099382,17cyclictest7750irq/56-dwc_otg20:30:201
8480993815,13cyclictest18906-21ssh21:50:201
848099381,29cyclictest0-21swapper/122:07:151
848299379,25cyclictest0-21swapper/320:25:163
848299375,24cyclictest37-21rcuc/323:25:143
848299372,23cyclictest0-21swapper/321:45:283
848299372,23cyclictest0-21swapper/321:45:283
848199378,15cyclictest7950irq/56-dwc_otg_22:00:232
848199377,5cyclictest7750irq/56-dwc_otg20:25:032
848199376,15cyclictest7950irq/56-dwc_otg_22:25:172
848199372,18cyclictest0-21swapper/219:20:162
848099372,22cyclictest0-21swapper/119:55:191
8480993714,12cyclictest10797-21acpi21:40:151
848299367,6cyclictest7957-21unixbench_multi20:35:333
8482993624,8cyclictest19727-21fschecks_time19:40:213
8482993613,6cyclictest14346-21if_eth019:25:213
848299361,24cyclictest8908-21uniq20:40:213
848299361,22cyclictest9935-21ls23:40:023
8482993611,11cyclictest39-21ksoftirqd/321:50:303
848199369,5cyclictest7950irq/56-dwc_otg_22:20:332
848199368,17cyclictest0-21swapper/219:40:172
848199362,10cyclictest16477-21missed_timers21:00:252
848099369,24cyclictest0-21swapper/119:15:181
848099362,17cyclictest7950irq/56-dwc_otg_20:15:301
848099362,17cyclictest7950irq/56-dwc_otg_20:15:301
8480993620,9cyclictest7950irq/56-dwc_otg_23:03:191
8480993617,6cyclictest2976-21sh21:30:201
8480993614,11cyclictest28219-21latency_hist20:05:031
848299356,20cyclictest17812-21ssh23:10:163
848299354,5cyclictest7950irq/56-dwc_otg_21:05:313
848299352,25cyclictest0-21swapper/321:16:353
8482993519,6cyclictest7750irq/56-dwc_otg00:00:223
848299351,25cyclictest3001-21latency_hist20:25:033
848299351,24cyclictest30042-21ls20:10:023
848199357,5cyclictest7950irq/56-dwc_otg_22:35:262
848199355,7cyclictest7950irq/56-dwc_otg_19:18:532
848199352,17cyclictest7750irq/56-dwc_otg21:50:282
8481993513,5cyclictest4802-21latency_hist20:30:022
848099359,21cyclictest0-21swapper/123:10:161
848099357,5cyclictest0-21swapper/122:25:181
848099357,16cyclictest0-21swapper/119:10:151
848099355,24cyclictest7950irq/56-dwc_otg_20:45:141
848099352,17cyclictest0-21swapper/120:57:501
8480993516,12cyclictest0-21swapper/100:09:581
848299348,9cyclictest37-21rcuc/321:15:033
848299348,17cyclictest37-21rcuc/323:40:243
848299347,6cyclictest7850irq/56-dwc_otg_20:35:023
848299344,6cyclictest37-21rcuc/320:45:433
8482993422,9cyclictest28280-21latency_hist20:05:033
848299341,7cyclictest7950irq/56-dwc_otg_20:10:353
848199342,8cyclictest32292-21cut20:15:202
848199342,8cyclictest32292-21cut20:15:202
848199341,15cyclictest7850irq/56-dwc_otg_20:06:302
848199341,14cyclictest7750irq/56-dwc_otg21:20:262
848199341,12cyclictest7950irq/56-dwc_otg_00:15:022
848099342,5cyclictest0-21swapper/122:00:321
848099341,23cyclictest0-21swapper/122:15:241
848299339,12cyclictest0-21swapper/323:55:293
848199338,5cyclictest7950irq/56-dwc_otg_23:10:232
848199335,13cyclictest7950irq/56-dwc_otg_22:11:052
848199333,7cyclictest7950irq/56-dwc_otg_20:45:222
848199333,4cyclictest7750irq/56-dwc_otg19:25:202
848199331,28cyclictest10074-21latency_hist19:15:032
848099335,20cyclictest2509-21ssh00:10:151
8480993323,7cyclictest24706-21latency_hist19:55:031
82072331,22sleep10-21swapper/119:10:021
848299329,4cyclictest0-21swapper/323:05:023
848299327,13cyclictest1191-21snmpd19:15:203
848299323,19cyclictest0-21swapper/319:20:293
848199328,15cyclictest3361-21kworker/2:123:35:152
848199326,10cyclictest7950irq/56-dwc_otg_20:00:302
848199324,12cyclictest7950irq/56-dwc_otg_19:35:302
848199322,17cyclictest7750irq/56-dwc_otg19:45:292
848199321,8cyclictest1457850ssh23:05:272
848299311,25cyclictest14234-21cpuspeed20:55:203
848199316,6cyclictest7950irq/56-dwc_otg_23:40:232
848199312,20cyclictest0-21swapper/223:15:092
848099314,5cyclictest22289-21grep23:15:211
848099312,4cyclictest0-21swapper/100:00:351
848199303,6cyclictest30919-21aten_rbpower_en00:05:212
66592263,14sleep20-21swapper/219:05:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional