You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 19:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Wed Mar 11, 2026 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16002991118,64cyclictest0-21swapper/008:10:150
160029910726,36cyclictest0-21swapper/008:00:150
160029910726,36cyclictest0-21swapper/008:00:150
52972930,5sleep31600599cyclictest12:35:243
5482890,2sleep00-21swapper/009:15:500
168022880,2sleep30-21swapper/312:10:203
263602850,2sleep30-21swapper/311:42:343
16004998211,18cyclictest7950irq/56-dwc_otg_10:25:072
1600299823,64cyclictest0-21swapper/007:10:040
16004998112,57cyclictest16537-21fschecks_time08:40:192
16002997814,61cyclictest15249-21sh10:50:180
16002997814,61cyclictest15249-21sh10:50:180
74782770,2sleep30-21swapper/309:25:023
48722770,2sleep20-21swapper/211:16:122
48722770,2sleep20-21swapper/211:16:122
1600299778,56cyclictest26891-21modprobe09:10:020
16002997717,38cyclictest24671-21/usr/sbin/munin11:40:240
1600399762,57cyclictest3628-21/usr/sbin/munin08:05:161
16002997615,48cyclictest3275-21aten_rbpower_en11:15:180
16002997615,48cyclictest3275-21aten_rbpower_en11:15:180
16002997614,49cyclictest21401-21sed09:40:250
248752750,2sleep10-21swapper/112:20:161
172882750,5sleep11600399cyclictest10:14:121
1600499753,11cyclictest0-21swapper/207:10:042
1600299753,46cyclictest12718-21/usr/sbin/munin12:05:200
8582730,3sleep337-21rcuc/310:32:583
8582730,3sleep337-21rcuc/310:32:583
1600299732,53cyclictest0-21swapper/011:50:160
16002997321,49cyclictest19761-21apt-get11:35:120
1600399721,39cyclictest19757-21awk11:35:121
154712720,2sleep10-21swapper/109:34:181
294882710,1sleep00-21swapper/010:28:320
1600299716,44cyclictest7413-21tr11:20:160
16002997116,11cyclictest10932-21grep10:05:300
16004997023,7cyclictest7850irq/56-dwc_otg_10:30:122
16004997023,7cyclictest7850irq/56-dwc_otg_10:30:122
16002997047,5cyclictest0-21swapper/010:45:140
16002997014,47cyclictest16580-21ssh09:35:170
1600399694,41cyclictest17995-21/usr/sbin/munin08:45:301
1600399694,41cyclictest17995-21/usr/sbin/munin08:45:301
1600299699,56cyclictest24449-21grep07:30:280
16002996910,23cyclictest14355-21ssh09:32:210
1600299688,47cyclictest0-21swapper/009:13:160
1600299688,43cyclictest0-21swapper/012:35:260
1600299686,59cyclictest26082-21http10:25:010
16002996817,37cyclictest4020-21sh10:36:090
16002996813,52cyclictest0-21swapper/010:03:000
1600499673,11cyclictest0-21swapper/207:15:122
1600299679,47cyclictest0-21swapper/012:17:100
1600299674,54cyclictest0-21swapper/012:00:020
16002996712,41cyclictest11225-21ssh09:29:200
16002996712,41cyclictest11225-21ssh09:29:200
16002996711,53cyclictest21550-21ssh10:19:230
1600399661,52cyclictest0-21swapper/112:08:471
1600399661,40cyclictest26863-21/usr/sbin/munin10:25:191
1600299668,43cyclictest0-21swapper/011:12:530
1600299667,51cyclictest0-21swapper/009:20:190
16002996612,36cyclictest0-21swapper/010:55:300
1600399653,56cyclictest0-21swapper/107:10:041
1600399651,55cyclictest6740-21ssh09:23:561
1600399651,48cyclictest16202-21apt-get08:40:121
1600399651,39cyclictest22127-21missed_timers07:25:251
1600399651,35cyclictest7750irq/56-dwc_otg12:25:181
1600299659,44cyclictest0-21swapper/010:11:200
1600299656,49cyclictest30253-21runrttasks07:49:120
1600299652,42cyclictest0-21swapper/011:30:130
16002996512,41cyclictest24963-21/usr/sbin/munin09:45:250
16002996512,41cyclictest24963-21/usr/sbin/munin09:45:250
20032640,1sleep10-21swapper/111:52:101
1600399641,43cyclictest7970-21ssh12:00:041
1600399641,42cyclictest19329-21ssh11:34:511
1600399641,39cyclictest16556-21ssh09:35:161
1600299647,22cyclictest0-21swapper/008:25:140
1600299645,46cyclictest0-21swapper/010:30:160
1600299645,46cyclictest0-21swapper/010:30:160
16002996418,39cyclictest8988-21ssh12:00:260
16002996417,28cyclictest17995-21/usr/sbin/munin08:45:310
16002996417,28cyclictest17995-21/usr/sbin/munin08:45:310
16002996411,32cyclictest28739-21apt-get12:25:120
16002996410,44cyclictest25610-21mii-tool07:35:210
16002996410,41cyclictest16182-21chrt08:40:070
1600499635,5cyclictest7950irq/56-dwc_otg_09:35:262
1600499633,10cyclictest7950irq/56-dwc_otg_09:10:212
1600399633,39cyclictest531-21ssh09:54:421
1600399631,53cyclictest29927-21ssh09:12:551
1600399631,36cyclictest2029-21ssh12:31:041
1600399631,34cyclictest11445-21ssh09:29:421
1600399631,34cyclictest11445-21ssh09:29:421
1600499624,10cyclictest0-21swapper/211:53:012
1600399621,46cyclictest22050-21/usr/sbin/munin09:40:321
1600399621,44cyclictest25160-21ssh11:01:451
1600299624,48cyclictest0-21swapper/009:50:250
16002996211,38cyclictest24714-21chrt09:01:530
16004996117,41cyclictest5031-21if_wlan012:35:202
1600399611,50cyclictest2276-21ssh09:18:471
1600399611,42cyclictest24058-21ntp_states07:30:241
1600399611,41cyclictest7942-21rm10:02:431
1600299619,36cyclictest0-21swapper/008:05:150
1600299616,44cyclictest0-21swapper/011:48:160
1600299616,44cyclictest0-21swapper/011:48:160
16002996112,38cyclictest4569-21ssh09:59:170
1600499605,10cyclictest0-21swapper/212:25:552
1600399602,39cyclictest5997-21ssh11:18:141
1600399602,39cyclictest5997-21ssh11:18:141
1600399601,49cyclictest11169-21ssh10:05:521
1600399601,41cyclictest14872-21ssh10:50:131
1600399601,41cyclictest14872-21ssh10:50:131
1600399601,38cyclictest28179-21ssh09:48:461
1600399601,38cyclictest28179-21ssh09:48:461
1600399601,36cyclictest6338-21chrt12:36:231
1600399601,34cyclictest1289-21chrt07:57:301
1600299607,39cyclictest0-21swapper/008:32:030
1600299606,51cyclictest0-21swapper/008:50:140
16002996013,44cyclictest1-21systemd10:43:210
240092590,4sleep31600599cyclictest12:19:303
1600499599,15cyclictest0-21swapper/212:00:132
1600499597,9cyclictest7850irq/56-dwc_otg_11:55:122
1600499592,6cyclictest0-21swapper/207:25:152
1600499592,3cyclictest0-21swapper/209:57:182
1600499591,4cyclictest149-21systemd-journal11:35:022
1600399591,48cyclictest14888-21ssh11:29:201
16003995914,30cyclictest908-21runrttasks08:51:171
1600399591,41cyclictest30886-21rm11:48:161
1600399591,41cyclictest30886-21rm11:48:161
1600399591,37cyclictest5895-21ssh10:39:351
1600299599,38cyclictest0-21swapper/012:22:210
1600299598,41cyclictest0-21swapper/011:29:150
1600299596,40cyclictest0-21swapper/008:18:330
1600299594,47cyclictest0-21swapper/011:05:140
1600499582,6cyclictest7850irq/56-dwc_otg_10:22:202
1600499581,5cyclictest27313-21/usr/sbin/munin11:05:192
1600499581,15cyclictest0-21swapper/211:49:012
1600499581,15cyclictest0-21swapper/211:49:012
1600499581,14cyclictest0-21swapper/210:00:292
1600399588,39cyclictest0-21swapper/111:41:341
1600399581,47cyclictest6404-21ssh11:57:391
1600399581,38cyclictest1743-21apt08:00:121
1600399581,38cyclictest1743-21apt08:00:121
1600399581,34cyclictest0-21swapper/110:55:271
1600299586,34cyclictest0-21swapper/012:14:190
1600599578,12cyclictest7850irq/56-dwc_otg_11:10:143
1600499572,14cyclictest0-21swapper/208:45:122
1600499572,14cyclictest0-21swapper/208:45:122
1600499571,4cyclictest0-21swapper/210:50:232
1600499571,4cyclictest0-21swapper/210:50:232
1600499571,15cyclictest3193-21latency_hist09:20:022
1600399573,42cyclictest7850irq/56-dwc_otg_08:32:321
1600399573,38cyclictest7750irq/56-dwc_otg11:10:131
1600399571,48cyclictest24471-21ssh10:22:091
1600399571,43cyclictest0-21swapper/108:35:131
1600399571,42cyclictest8892-21ssh11:20:571
1600399571,32cyclictest8814-21ssh10:42:101
1600399571,31cyclictest20056-21fschecks_time07:20:201
197152560,5sleep229-21rcuc/211:35:092
1600499565,10cyclictest7950irq/56-dwc_otg_09:43:242
1600499561,4cyclictest7850irq/56-dwc_otg_11:10:192
1600399562,36cyclictest18071-21ssh12:11:151
1600399561,41cyclictest22735-21ssh12:17:091
1600399561,39cyclictest32225-21ssh10:30:581
1600399561,39cyclictest32225-21ssh10:30:581
1600399561,37cyclictest0-21swapper/110:16:341
1600299569,35cyclictest0-21swapper/011:04:110
16002995612,37cyclictest26889-21diskmemload12:31:280
1600499556,9cyclictest7850irq/56-dwc_otg_10:41:592
1600499555,4cyclictest7750irq/56-dwc_otg11:20:222
1600499552,12cyclictest0-21swapper/212:10:562
1600499551,7cyclictest4076-21grep08:05:212
1600499551,3cyclictest0-21swapper/208:50:252
1600499551,11cyclictest20302-21grep10:55:322
1600399552,34cyclictest11532-21ssh10:45:261
1600399551,51cyclictest8139-21ls08:15:281
1600399551,33cyclictest1327-21ssh09:55:171
1600299557,34cyclictest0-21swapper/007:24:490
1600299552,50cyclictest0-21swapper/008:25:020
1600499545,8cyclictest7950irq/56-dwc_otg_11:04:212
1600499545,4cyclictest908-21runrttasks07:20:182
1600499542,4cyclictest7950irq/56-dwc_otg_09:51:432
1600499542,2cyclictest0-21swapper/207:40:212
1600499541,6cyclictest9535-21ssh09:26:232
1600499541,6cyclictest9535-21ssh09:26:232
1600499541,6cyclictest15463-21latency_hist11:30:022
16004995416,35cyclictest17907-21latency_hist10:15:032
1600499541,4cyclictest1497-21modprobe08:00:022
1600299546,38cyclictest0-21swapper/007:40:290
1600599535,9cyclictest7950irq/56-dwc_otg_07:20:143
1600499532,5cyclictest917-21snmpd12:05:482
1600499531,6cyclictest2414250ssh12:19:442
1600499531,3cyclictest0-21swapper/210:39:472
1600499531,3cyclictest0-21swapper/210:19:302
1600499531,10cyclictest25019-21latency_hist09:05:022
16004995310,5cyclictest0-21swapper/208:15:182
1600399531,41cyclictest24975-21apt-get09:05:031
1600399531,38cyclictest29661-21chrt11:07:221
16002995312,27cyclictest22318-21grep07:25:280
1600499521,3cyclictest0-21swapper/211:40:292
1600399521,31cyclictest0-21swapper/108:29:211
1600499515,4cyclictest7950irq/56-dwc_otg_12:20:272
1600499513,4cyclictest7850irq/56-dwc_otg_07:38:352
1600499512,4cyclictest7850irq/56-dwc_otg_09:48:562
1600499512,4cyclictest7850irq/56-dwc_otg_09:48:562
1600499512,4cyclictest15979-21latency_hist09:35:022
1600499512,13cyclictest7950irq/56-dwc_otg_07:52:192
1600499511,3cyclictest7950irq/56-dwc_otg_10:08:262
1600399511,46cyclictest29952-21/usr/sbin/munin07:45:281
1600299519,25cyclictest1471-21seq07:59:500
1600299519,11cyclictest19271-21taskset07:17:070
16002995110,32cyclictest0-21swapper/008:37:510
1600599502,7cyclictest0-21swapper/309:15:143
1600499502,5cyclictest7850irq/56-dwc_otg_08:00:232
1600499502,5cyclictest7850irq/56-dwc_otg_08:00:232
1600499501,4cyclictest7750irq/56-dwc_otg12:30:542
16004995014,4cyclictest12567-21/usr/sbin/munin08:30:162
16004995014,33cyclictest30358-21idleruntime-cro07:50:022
1600499501,3cyclictest0-21swapper/209:21:372
1600499501,10cyclictest10474-21seq08:24:262
1600399501,46cyclictest18634-21ntp_states07:15:251
1600399501,34cyclictest0-21swapper/108:59:341
1600299506,33cyclictest0-21swapper/007:54:490
1600499491,2cyclictest0-21swapper/210:45:312
1600499491,12cyclictest0-21swapper/208:15:022
1600399491,45cyclictest5357-21apt-get08:10:131
1600399491,45cyclictest25625-21irqstats07:35:221
1600599482,9cyclictest7750irq/56-dwc_otg08:55:133
1600599481,2cyclictest0-21swapper/311:15:163
1600599481,2cyclictest0-21swapper/311:15:163
1600499483,4cyclictest7950irq/56-dwc_otg_08:35:152
1600499482,8cyclictest7850irq/56-dwc_otg_09:05:102
1600499482,8cyclictest12072-21runrttasks08:26:472
1600499481,4cyclictest23365-21chrt07:30:142
1600399482,37cyclictest0-21swapper/109:04:451
1600399481,43cyclictest27917-21/usr/sbin/munin07:40:291
1600299485,30cyclictest0-21swapper/008:59:120
1600399471,43cyclictest31758-21/usr/sbin/munin07:50:311
1600399471,34cyclictest0-21swapper/108:20:121
1600599467,24cyclictest0-21swapper/311:45:153
1600599467,24cyclictest0-21swapper/311:45:153
1600599467,24cyclictest0-21swapper/308:35:153
1600599457,24cyclictest0-21swapper/307:35:163
1600599457,23cyclictest0-21swapper/308:05:153
155982453,35sleep00-21swapper/007:08:180
1600599445,23cyclictest20972-21kworker/u8:108:20:023
1600599443,25cyclictest24659-21rm12:20:143
1600499442,3cyclictest7950irq/56-dwc_otg_08:59:202
1600599437,22cyclictest0-21swapper/307:15:093
1600599429,4cyclictest7750irq/56-dwc_otg08:10:133
1600599425,18cyclictest7750irq/56-dwc_otg08:00:153
1600599425,18cyclictest7750irq/56-dwc_otg08:00:153
1600599423,5cyclictest0-21swapper/311:20:153
301052410,2sleep30-21swapper/310:29:403
1600599401,3cyclictest0-21swapper/312:25:123
16005994012,14cyclictest26889-21diskmemload10:00:183
16005993918,7cyclictest8194-21sshd09:25:213
16005993918,7cyclictest8194-21sshd09:25:213
1600599381,5cyclictest26893-21latency_hist09:10:023
1600599379,13cyclictest7850irq/56-dwc_otg_10:15:203
16005993712,6cyclictest7950irq/56-dwc_otg_10:40:023
16005993712,6cyclictest0-21swapper/311:51:483
1600599371,10cyclictest999-21ssh12:30:203
16005993710,12cyclictest7850irq/56-dwc_otg_09:50:193
1600599368,4cyclictest7950irq/56-dwc_otg_08:45:293
1600599368,4cyclictest7950irq/56-dwc_otg_08:45:293
1600599366,21cyclictest27253-21ssh09:10:153
16005993617,4cyclictest7750irq/56-dwc_otg08:25:263
16005993612,7cyclictest0-21swapper/312:00:113
16005993611,14cyclictest21887-21taskset11:36:583
1600599356,24cyclictest0-21swapper/308:20:153
1600599354,4cyclictest0-21swapper/310:44:023
1600599354,15cyclictest7750irq/56-dwc_otg10:10:203
16005993517,3cyclictest20511-21cat09:40:033
1600599351,3cyclictest7750irq/56-dwc_otg07:30:183
16005993513,4cyclictest0-21swapper/309:05:023
1600599351,17cyclictest7950irq/56-dwc_otg_09:40:093
1600599348,5cyclictest10885-21unixbench_multi10:05:303
1600599347,5cyclictest7750irq/56-dwc_otg11:25:153
1600599345,15cyclictest7950irq/56-dwc_otg_09:45:193
1600599345,15cyclictest7950irq/56-dwc_otg_09:45:193
1600599344,7cyclictest7750irq/56-dwc_otg09:30:213
1600599342,10cyclictest0-21swapper/311:03:593
16005993419,4cyclictest7950irq/56-dwc_otg_09:55:143
1600599341,3cyclictest0-21swapper/312:05:123
144132346,12sleep10-21swapper/107:05:191
1600599339,6cyclictest7750irq/56-dwc_otg11:55:253
1600599334,14cyclictest7850irq/56-dwc_otg_10:20:193
1600599332,5cyclictest7750irq/56-dwc_otg08:30:193
157292335,16sleep215765-21munin-run07:10:022
1600599328,11cyclictest0-21swapper/310:45:403
1600599327,5cyclictest7950irq/56-dwc_otg_07:25:313
1600599327,5cyclictest0-21swapper/311:07:313
1600599322,5cyclictest624-21ntp_states07:55:253
1600599322,14cyclictest7850irq/56-dwc_otg_11:32:303
16005993212,5cyclictest17636-21sh10:53:093
16005993212,5cyclictest17636-21sh10:53:093
16005993212,12cyclictest0-21swapper/310:55:323
1600599304,4cyclictest7750irq/56-dwc_otg07:54:543
1600599303,15cyclictest7750irq/56-dwc_otg07:10:043
1600599291,6cyclictest20057-21fschecks_count08:50:173
1600599284,3cyclictest7750irq/56-dwc_otg08:40:233
1600599282,22cyclictest29931-21head07:45:273
1600599281,19cyclictest0-21swapper/307:42:213
154792283,15sleep30-21swapper/307:06:473
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional