You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 23:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Wed Jun 17, 2026 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
270626090,6sleep20-21swapper/207:05:312
270626090,6sleep20-21swapper/207:05:312
2158921610,5sleep1368699cyclictest11:13:421
21832970,5sleep0368599cyclictest08:35:040
167582890,2sleep20-21swapper/210:28:462
218302880,2sleep00-21swapper/009:17:260
3685998420,44cyclictest2428-21aten_rbpower_en08:35:170
368599812,54cyclictest20031-21latency_hist07:55:050
368599811,63cyclictest22503-21if_wlan008:00:220
368599811,58cyclictest22292-21cut10:35:230
368599808,48cyclictest1020-21unixbench_multi09:30:340
232602800,5sleep1368699cyclictest11:54:361
232602800,5sleep1368699cyclictest11:54:361
3685997920,42cyclictest754-21wc12:05:300
3685997722,34cyclictest11298-21/usr/sbin/munin11:40:170
3685997713,51cyclictest14772-21diskmemload12:19:280
368599757,3cyclictest0-21swapper/010:55:050
368599757,3cyclictest0-21swapper/010:55:050
3685997517,3cyclictest0-21swapper/012:25:050
368899747,47cyclictest6841-21latency_hist11:35:043
3685997317,41cyclictest0-21swapper/009:50:140
368599731,55cyclictest22628-21ssh09:55:520
3685997312,45cyclictest24262-21ssh12:35:040
3688997214,38cyclictest18391-21sh09:13:563
368599724,52cyclictest0-21swapper/011:06:110
3685997215,41cyclictest8050irq/56-dwc_otg_10:10:030
368599712,57cyclictest0-21swapper/010:10:200
3685997119,35cyclictest8050irq/56-dwc_otg_10:43:510
368599711,56cyclictest0-21swapper/009:47:220
368599692,58cyclictest13954-21ps09:05:280
368599692,58cyclictest13954-21ps09:05:280
368599692,55cyclictest0-21swapper/010:21:370
368599691,6cyclictest16930-21ssh12:25:240
3685996914,40cyclictest0-21swapper/010:04:210
368599691,17cyclictest0-21swapper/007:55:230
368899682,53cyclictest4846-21ntp_states09:35:283
368899682,53cyclictest4846-21ntp_states09:35:283
368699682,17cyclictest7850irq/56-dwc_otg10:30:141
368599685,14cyclictest6889-21dpkg11:35:040
368599681,5cyclictest1916-21ssh11:29:010
368599681,55cyclictest0-21swapper/012:36:150
368599681,17cyclictest0-21swapper/009:25:200
368599672,17cyclictest0-21swapper/012:00:140
3685996714,42cyclictest0-21swapper/010:27:180
3685996712,7cyclictest0-21swapper/011:12:080
368899661,52cyclictest11609-21awk09:00:193
368899661,40cyclictest2828850ssh11:20:313
368599661,7cyclictest22922-21cut11:15:170
368599661,13cyclictest0-21swapper/011:55:180
3688996512,40cyclictest13908-1kworker/u9:209:50:533
3685996519,34cyclictest7950irq/56-dwc_otg_09:41:490
368599651,55cyclictest9-21ksoftirqd/009:10:250
368599651,51cyclictest0-21swapper/010:15:320
368899642,50cyclictest23053-21awk11:15:183
3685996414,5cyclictest25963-21ssh09:22:130
3685996412,39cyclictest0-21swapper/011:23:250
368599641,16cyclictest12945-21ssh11:03:020
368599641,12cyclictest0-21swapper/010:55:310
200972640,2sleep30-21swapper/310:32:173
151592640,5sleep0368599cyclictest07:40:220
368899634,38cyclictest8050irq/56-dwc_otg_09:05:303
368899634,38cyclictest8050irq/56-dwc_otg_09:05:303
368899631,49cyclictest14772-21diskmemload12:08:383
368699633,14cyclictest7850irq/56-dwc_otg07:40:151
368599632,49cyclictest0-21swapper/011:51:490
368599632,49cyclictest0-21swapper/011:51:490
368599631,50cyclictest0-21swapper/007:18:290
3685996312,41cyclictest0-21swapper/009:00:210
368599631,17cyclictest0-21swapper/010:47:000
3685996311,38cyclictest0-21swapper/010:31:020
368899621,50cyclictest2123-21ssh11:29:233
368599627,8cyclictest0-21swapper/012:11:020
368599621,14cyclictest0-21swapper/011:37:010
368599621,14cyclictest0-21swapper/011:37:010
368899611,46cyclictest54692sleep312:11:043
368599615,5cyclictest7950irq/56-dwc_otg_08:40:460
3685996112,27cyclictest0-21swapper/007:35:330
368599611,15cyclictest5756-21ssh09:36:130
368599611,15cyclictest5756-21ssh09:36:130
368599611,12cyclictest0-21swapper/011:46:460
368899603,40cyclictest7850irq/56-dwc_otg11:59:533
368899602,43cyclictest22382-21cut08:00:203
368899601,4cyclictest7950irq/56-dwc_otg_11:40:183
3685996030,15cyclictest0-21swapper/007:35:030
368899591,46cyclictest17264-21ssh11:46:133
368899591,46cyclictest15944-21ssh10:27:163
368599592,14cyclictest0-21swapper/007:21:020
368599591,16cyclictest18077-21taskset07:49:460
368899581,4cyclictest8050irq/56-dwc_otg_10:55:163
368899581,46cyclictest0-21swapper/307:18:483
3685995812,10cyclictest0-21swapper/008:19:090
368899579,30cyclictest0-21swapper/312:32:353
368899575,40cyclictest8050irq/56-dwc_otg_08:50:323
368899573,43cyclictest0-21swapper/311:10:173
368599576,13cyclictest0-21swapper/007:26:120
368599571,12cyclictest0-21swapper/008:50:320
368899566,39cyclictest8050irq/56-dwc_otg_09:20:033
368899561,4cyclictest0-21swapper/312:20:183
368899561,4cyclictest0-21swapper/310:50:223
368899561,4cyclictest0-21swapper/310:50:223
368899561,45cyclictest0-21swapper/310:37:203
368899561,43cyclictest19476-1kworker/u9:010:49:183
368899561,40cyclictest0-21swapper/309:58:413
368599561,15cyclictest0-21swapper/008:59:590
368899553,38cyclictest26094-1kworker/u9:112:03:223
368899551,49cyclictest12902-21ssh09:45:213
368899551,37cyclictest0-21swapper/309:30:343
368699552,6cyclictest7950irq/56-dwc_otg_10:45:151
368699552,12cyclictest7850irq/56-dwc_otg11:45:141
368599552,5cyclictest0-21swapper/008:27:310
368599551,38cyclictest3701-21/usr/sbin/munin07:10:210
368899543,41cyclictest8702-21ssh11:35:543
368899543,41cyclictest8702-21ssh11:35:543
368899541,4cyclictest25679-21apt-get08:10:163
368899541,44cyclictest10599-21seq07:26:293
368899541,44cyclictest0-21swapper/308:32:543
368899541,43cyclictest0-21swapper/307:23:553
368899541,41cyclictest0-21swapper/310:16:433
3685995429,6cyclictest26769-21grep08:10:320
368599541,6cyclictest7565-21munin-run08:50:040
368599541,16cyclictest0-21swapper/008:05:410
368899535,38cyclictest0-21swapper/307:55:233
368899535,36cyclictest0-21swapper/312:17:353
3688995326,24cyclictest30100-21latency_hist10:45:053
368899532,40cyclictest0-21swapper/309:26:303
368899531,4cyclictest3813-21ssh10:13:013
3688995314,36cyclictest26616-21sh10:00:333
368799536,29cyclictest22002-21ssh10:35:192
368699539,13cyclictest16542-21ssh12:25:191
368599531,14cyclictest0-21swapper/008:24:300
368899524,30cyclictest7950irq/56-dwc_otg_09:42:233
368899522,2cyclictest0-21swapper/308:15:153
368899521,8cyclictest2372-21apt-get08:35:143
368899521,4cyclictest8050irq/56-dwc_otg_09:00:043
368899521,40cyclictest27260-21ssh12:38:023
368899521,37cyclictest0-21swapper/310:20:533
368799525,5cyclictest7850irq/56-dwc_otg10:30:162
368799522,9cyclictest0-21swapper/208:50:142
368699521,9cyclictest21991-21ssh10:35:171
368899512,46cyclictest14471-21aten_rbpower_en11:05:173
368899511,40cyclictest0-21swapper/311:01:103
368899511,40cyclictest0-21swapper/308:49:023
3688995111,37cyclictest16757-21/usr/sbin/munin07:45:193
29212515,32sleep00-21swapper/007:05:340
29212515,32sleep00-21swapper/007:05:340
368899506,29cyclictest8050irq/56-dwc_otg_09:23:273
368899501,3cyclictest8050irq/56-dwc_otg_11:50:323
368899501,3cyclictest8050irq/56-dwc_otg_11:50:323
368899501,3cyclictest0-21swapper/310:05:163
368899501,3cyclictest0-21swapper/308:40:153
368899501,37cyclictest0-21swapper/308:29:503
368699508,27cyclictest0-21swapper/110:20:101
368699505,6cyclictest7850irq/56-dwc_otg11:05:151
3686995016,20cyclictest221ktimersoftd/111:26:041
3686995013,24cyclictest0-21swapper/109:20:171
368899492,39cyclictest8050irq/56-dwc_otg_07:50:083
368899491,45cyclictest14996-21fschecks_count07:40:203
368899491,3cyclictest7850irq/56-dwc_otg12:25:263
3686994928,9cyclictest8050irq/56-dwc_otg_09:15:121
368899481,44cyclictest25462-21latency_hist08:10:043
368899481,3cyclictest0-21swapper/308:24:503
368699487,5cyclictest7950irq/56-dwc_otg_12:15:161
368899471,4cyclictest11773-21ls07:30:253
368899471,2cyclictest0-21swapper/307:10:163
368699477,25cyclictest0-21swapper/109:05:171
368699477,25cyclictest0-21swapper/109:05:171
368699477,25cyclictest0-21swapper/107:35:181
368699477,25cyclictest0-21swapper/107:25:091
368699474,25cyclictest6073-21/usr/sbin/munin10:55:271
368699474,23cyclictest0-21swapper/112:11:201
368699473,5cyclictest0-21swapper/111:35:161
368699473,5cyclictest0-21swapper/111:35:161
3686994713,14cyclictest8050irq/56-dwc_otg_11:40:141
3686994712,10cyclictest8050irq/56-dwc_otg_10:30:031
368699466,24cyclictest17978-21/usr/sbin/munin09:50:311
368699460,8cyclictest8050irq/56-dwc_otg_11:15:151
368899451,35cyclictest0-21swapper/307:39:353
368799452,9cyclictest0-21swapper/210:50:142
368799452,9cyclictest0-21swapper/210:50:142
368699458,16cyclictest945-21ls09:30:331
368699457,25cyclictest0-21swapper/108:25:191
368699451,14cyclictest0-21swapper/108:15:171
368699446,24cyclictest0-21swapper/107:15:091
368699441,20cyclictest22352-21/usr/sbin/munin08:00:201
199172440,5sleep2368799cyclictest12:29:432
368699437,26cyclictest0-21swapper/107:50:161
368699437,24cyclictest0-21swapper/111:20:151
3686994325,7cyclictest7850irq/56-dwc_otg12:39:151
368699424,17cyclictest18413-21ssh09:13:581
368699423,22cyclictest874-21grep12:05:311
3686994220,4cyclictest3309-21fschecks_time11:30:211
3686994218,9cyclictest7850irq/56-dwc_otg11:03:361
3686994215,9cyclictest8050irq/56-dwc_otg_10:10:191
368699417,22cyclictest0-21swapper/108:30:181
368699416,11cyclictest0-21swapper/109:55:501
368699412,23cyclictest0-21swapper/107:10:171
3686994121,7cyclictest9105-21sh10:20:031
3686994110,12cyclictest221ktimersoftd/110:55:051
3686994110,12cyclictest221ktimersoftd/110:55:051
3686994110,11cyclictest4175-21/usr/sbin/munin08:40:591
324172410,1sleep10-21swapper/110:08:361
368699409,7cyclictest221ktimersoftd/108:35:311
368699406,23cyclictest0-21swapper/109:40:141
368699403,10cyclictest25303-21ssh10:00:161
3686994018,12cyclictest9550irq/48-DMA15:26:471
3686994015,9cyclictest20148-21/usr/sbin/munin07:55:221
3686994010,19cyclictest7950irq/56-dwc_otg_08:24:301
368799392,26cyclictest0-21swapper/212:30:302
368699399,20cyclictest221ktimersoftd/110:43:511
368699392,3cyclictest0-21swapper/107:45:171
3686993923,8cyclictest8050irq/56-dwc_otg_12:00:261
3686993922,4cyclictest7850irq/56-dwc_otg08:05:341
368799381,28cyclictest6307-21ssh10:55:162
3687993810,17cyclictest27987-21wget09:25:172
368699387,25cyclictest0-21swapper/107:20:171
3686993816,10cyclictest8050irq/56-dwc_otg_12:25:041
368799377,25cyclictest0-21swapper/211:55:172
368799377,24cyclictest0-21swapper/212:35:182
368799377,24cyclictest0-21swapper/208:15:092
368799377,24cyclictest0-21swapper/208:00:162
368799377,22cyclictest0-21swapper/207:20:172
3687993719,8cyclictest7950irq/56-dwc_otg_11:15:062
368799371,6cyclictest7850irq/56-dwc_otg11:05:322
368799371,26cyclictest26365-21grep10:40:182
368799371,11cyclictest0-21swapper/207:10:172
368699373,19cyclictest15129-21ssh09:47:391
3686993715,11cyclictest221ktimersoftd/112:30:521
368799367,23cyclictest0-21swapper/207:45:172
368799362,8cyclictest31-21ksoftirqd/211:25:282
3687993619,5cyclictest8050irq/56-dwc_otg_09:15:132
3687993612,5cyclictest23970-21aten_rbpower_vo08:05:202
3686993620,8cyclictest7950irq/56-dwc_otg_09:00:131
368799355,4cyclictest8050irq/56-dwc_otg_10:20:062
3687993525,5cyclictest32294-21wget09:30:202
368799352,18cyclictest12938-21/usr/sbin/munin07:35:312
3687993511,4cyclictest18466-21aten_rbpower_vo07:50:172
368799350,32cyclictest7597-21ls11:35:222
368799350,32cyclictest7597-21ls11:35:222
368699357,15cyclictest0-21swapper/108:10:181
368699353,7cyclictest7144-21grep08:45:341
368699352,6cyclictest7850irq/56-dwc_otg08:50:321
3686993519,8cyclictest7850irq/56-dwc_otg09:38:561
3686993519,8cyclictest7850irq/56-dwc_otg09:38:561
368699351,6cyclictest7850irq/56-dwc_otg08:55:301
368799348,13cyclictest0-21swapper/209:20:152
368799345,20cyclictest15508-21ssh11:45:102
368799344,8cyclictest7850irq/56-dwc_otg09:55:272
368799342,10cyclictest0-21swapper/210:08:562
3687993418,4cyclictest5750-21idleruntime-cro08:45:042
368799341,26cyclictest11467-21cut07:30:212
368799341,17cyclictest0-21swapper/211:13:412
3686993415,8cyclictest8050irq/56-dwc_otg_11:57:221
368799339,12cyclictest0-21swapper/212:16:562
368799338,5cyclictest13097-21irqstats09:45:232
368799335,5cyclictest8050irq/56-dwc_otg_11:50:322
368799335,5cyclictest8050irq/56-dwc_otg_11:50:322
368799335,14cyclictest8050irq/56-dwc_otg_11:00:252
368799335,11cyclictest7850irq/56-dwc_otg10:15:202
368799332,12cyclictest0-21swapper/209:03:292
3687993310,7cyclictest8050irq/56-dwc_otg_10:05:042
3686993312,8cyclictest7950irq/56-dwc_otg_07:31:371
368799329,6cyclictest0-21swapper/209:35:272
368799329,6cyclictest0-21swapper/209:35:272
368799329,5cyclictest7950irq/56-dwc_otg_12:10:312
368799329,4cyclictest0-21swapper/210:10:492
368799328,4cyclictest7950irq/56-dwc_otg_09:43:382
368799325,15cyclictest0-21swapper/209:50:042
368799323,21cyclictest8050irq/56-dwc_otg_08:20:152
368799322,22cyclictest15268-21ls07:40:232
368799321,22cyclictest27158-21cpuspeed11:20:172
368799321,20cyclictest1126-21missed_timers08:30:252
368799319,12cyclictest0-21swapper/212:24:092
368799317,14cyclictest0-21swapper/211:42:172
368799315,19cyclictest32138-21ssh12:05:142
368799315,11cyclictest8050irq/56-dwc_otg_12:00:232
368799312,20cyclictest0-21swapper/211:31:142
368799306,13cyclictest8050irq/56-dwc_otg_07:25:052
368799305,4cyclictest7850irq/56-dwc_otg08:30:032
368799302,3cyclictest0-21swapper/208:35:252
3687993011,5cyclictest0-21swapper/210:45:322
368799301,13cyclictest7950irq/56-dwc_otg_09:10:042
368799301,13cyclictest7950irq/56-dwc_otg_09:10:042
368799296,14cyclictest0-21swapper/208:45:202
368799291,6cyclictest15219-21wget09:10:172
24352298,10sleep10-21swapper/107:05:271
24352298,10sleep10-21swapper/107:05:271
368799284,11cyclictest8050irq/56-dwc_otg_08:10:292
368799277,10cyclictest7850irq/56-dwc_otg08:58:282
368799274,5cyclictest8050irq/56-dwc_otg_07:19:282
368799267,16cyclictest0-21swapper/207:55:162
31152263,15sleep30-21swapper/307:06:183
31152263,15sleep30-21swapper/307:06:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional