You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 20:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Tue Jun 23, 2026 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
819122360,2sleep20-21swapper/207:05:212
268521720,5sleep1992299cyclictest09:25:341
1501021050,2sleep315011-21/usr/sbin/munin08:50:343
56222930,5sleep0992199cyclictest10:45:410
171602880,3sleep30-21swapper/310:20:363
93472810,2sleep20-21swapper/210:11:292
13662800,5sleep1992299cyclictest11:20:241
13662800,5sleep1992299cyclictest11:20:241
9922997738,20cyclictest14126-21/usr/sbin/munin11:35:311
153212770,5sleep2992399cyclictest11:36:522
9922997533,26cyclictest20388-21ssh12:22:041
9922997441,9cyclictest14409-21apt-get09:40:201
57862740,1sleep10-21swapper/109:30:091
228642740,2sleep1992299cyclictest10:28:231
9922997334,11cyclictest24942-21sh09:14:451
9922997334,11cyclictest24942-21sh09:14:451
9922997236,20cyclictest4920-21ssh10:06:061
9922997236,20cyclictest4920-21ssh10:06:061
9922997231,17cyclictest16603-21rm11:00:081
992199726,44cyclictest0-21swapper/008:35:120
9922997137,19cyclictest408-21fschecks_time10:40:221
9922997131,19cyclictest32260-21/usr/sbin/munin10:00:301
9922997030,14cyclictest25539-21grep11:50:081
9922996938,18cyclictest16611-21ls08:55:311
9922996935,18cyclictest22385-21ssh11:05:581
9922996935,13cyclictest9190-21/usr/sbin/munin08:35:321
9922996929,25cyclictest1784-21ssh12:39:381
322892690,2sleep30-21swapper/309:22:393
9922996835,15cyclictest19184-21ssh11:41:221
9922996833,12cyclictest24885-21ssh09:51:391
9922996832,19cyclictest26110-21ssh10:31:451
9922996829,23cyclictest9583-21taskset12:10:041
9922996826,19cyclictest21417-21/usr/sbin/munin07:40:281
9921996822,25cyclictest11-21rcu_preempt12:30:180
9921996815,12cyclictest7850irq/56-dwc_otg10:35:180
9921996813,9cyclictest0-21swapper/010:40:150
9922996734,21cyclictest14983-21ssh10:57:351
9922996731,19cyclictest5174-21rm12:04:361
9922996731,12cyclictest10840-21sh10:14:121
9922996729,13cyclictest13055-21ssh11:35:071
9922996635,20cyclictest16087-21df10:20:221
9922996630,13cyclictest30997-21grep09:20:341
9922996535,13cyclictest12569-21ssh09:37:301
9922996533,18cyclictest20893-21diskmemload09:58:251
9922996533,18cyclictest18751-21awk07:35:061
9922996533,18cyclictest18751-21awk07:35:061
9922996529,21cyclictest6553-21acpi08:30:161
9922996432,20cyclictest27493-21/usr/sbin/munin12:30:331
9922996431,17cyclictest28222-21runrttasks09:18:011
9922996430,20cyclictest5819-21ssh10:46:031
9921996435,18cyclictest0-21swapper/007:25:200
992199642,57cyclictest0-21swapper/012:05:070
9922996333,19cyclictest20822-21sshd09:09:321
9922996332,14cyclictest15510-21date08:55:071
9922996326,17cyclictest31748-21/usr/sbin/munin08:10:371
9922996326,13cyclictest10316-21perl12:10:241
9922996325,14cyclictest20434-21ssh09:46:201
9922996232,13cyclictest379-21ssh11:58:271
9922996228,22cyclictest25046-21chrt12:28:001
9922996226,17cyclictest4240-21taskset08:21:481
992199621,26cyclictest21700-21aten_rbpower_po11:45:220
992499613,12cyclictest8050irq/56-dwc_otg_08:30:243
992499612,5cyclictest0-21swapper/312:07:363
9922996136,13cyclictest10650-21ntp_states07:10:301
9922996135,13cyclictest23505-21threads07:45:331
9922996130,13cyclictest29825-21cat08:05:071
9922996127,17cyclictest27587-21taskset07:56:471
9922996127,17cyclictest27587-21taskset07:56:471
9922996125,15cyclictest27165-21rm11:12:081
992199611,44cyclictest24980-21kworker/0:012:18:280
992499601,8cyclictest7950irq/56-dwc_otg_07:40:203
9922996036,11cyclictest30661-21ssh10:37:301
9922996035,17cyclictest15517-21ssh12:15:461
9922996032,18cyclictest8366-21ssh11:29:191
9922996028,18cyclictest31821-21ssh11:18:011
9922996026,17cyclictest2379-21taskset08:16:151
9922996019,15cyclictest6538-21date08:30:081
992199607,35cyclictest0-21swapper/007:35:200
992199607,22cyclictest0-21swapper/009:05:170
992199604,28cyclictest0-21swapper/011:00:180
992199602,5cyclictest0-21swapper/011:20:170
992199602,5cyclictest0-21swapper/011:20:170
992199601,37cyclictest11493-21latency_hist10:15:070
992499598,5cyclictest8050irq/56-dwc_otg_11:15:163
992499592,46cyclictest0-21swapper/309:15:213
992499591,5cyclictest17768-21grep11:40:243
992499591,49cyclictest0-21swapper/310:20:073
992499591,46cyclictest16755-21wget11:00:213
992499591,12cyclictest0-21swapper/310:38:373
992299596,24cyclictest0-21swapper/107:15:201
9922995931,12cyclictest25636-21chrt07:51:191
9922995929,10cyclictest27511-21ssh11:51:271
9922995927,14cyclictest11755-21ssh10:54:161
992199592,29cyclictest0-21swapper/009:10:200
992199592,29cyclictest0-21swapper/009:10:200
992499583,11cyclictest31512-21aten_rbpower_cu10:00:203
992499582,48cyclictest0-21swapper/311:14:543
9922995829,12cyclictest20893-21diskmemload10:19:571
9922995829,10cyclictest16891-21taskset07:29:391
9922995828,12cyclictest17732-21fschecks_count09:00:211
992199587,9cyclictest0-21swapper/012:20:200
9921995817,19cyclictest23634-21grep12:25:350
992199581,29cyclictest6464-21latency_hist08:30:070
9921995810,8cyclictest0-21swapper/007:50:180
992499579,4cyclictest0-21swapper/310:05:463
992499579,4cyclictest0-21swapper/310:05:463
992499572,3cyclictest0-21swapper/307:10:203
992499571,5cyclictest22249-21latency_hist12:25:083
992499571,47cyclictest0-21swapper/312:39:263
992499571,12cyclictest0-21swapper/310:45:233
9924995710,5cyclictest7850irq/56-dwc_otg09:40:303
9922995723,15cyclictest11762-21taskset08:44:151
992199575,32cyclictest0-21swapper/010:55:180
992199572,31cyclictest0-21swapper/010:20:180
992199572,25cyclictest5875-21ssh09:30:170
992499563,3cyclictest7950irq/56-dwc_otg_11:57:183
992499561,4cyclictest7950irq/56-dwc_otg_08:55:163
992499561,12cyclictest8050irq/56-dwc_otg_12:10:353
9921995648,5cyclictest8050irq/56-dwc_otg_12:05:200
9921995628,12cyclictest7950irq/56-dwc_otg_07:15:070
9921995623,25cyclictest24429-21grep10:30:240
992499557,4cyclictest0-21swapper/311:52:203
992499554,9cyclictest8050irq/56-dwc_otg_11:35:183
992499554,11cyclictest8050irq/56-dwc_otg_11:29:503
9924995514,38cyclictest28496-21unixbench_singl09:55:353
992199559,23cyclictest0-21swapper/008:20:070
992199555,23cyclictest0-21swapper/012:35:180
9921995530,5cyclictest7850irq/56-dwc_otg11:55:190
9921995523,16cyclictest1064-21grep08:15:070
992499545,5cyclictest7950irq/56-dwc_otg_08:30:073
992499541,6cyclictest15565-21ssh10:58:403
992499541,3cyclictest0-21swapper/309:45:253
992499541,14cyclictest0-21swapper/308:05:173
992499541,11cyclictest3727-21ssh12:01:573
9922995424,16cyclictest0-21swapper/107:21:341
9922995424,11cyclictest29882-21chrt08:05:081
992199545,16cyclictest0-21swapper/009:55:170
9921995429,3cyclictest0-21swapper/009:35:190
96282543,12sleep00-21swapper/007:09:490
992499533,11cyclictest32345-21missed_timers08:10:283
992499531,5cyclictest32554-21ssh10:40:183
992499531,5cyclictest21004-21latency_hist09:10:073
992499531,3cyclictest8050irq/56-dwc_otg_09:52:133
992199537,14cyclictest0-21swapper/011:50:200
992199532,29cyclictest0-21swapper/009:17:450
9921995320,19cyclictest0-21swapper/011:35:180
9921995313,6cyclictest0-21swapper/011:30:170
992199531,26cyclictest9440-21ssh10:50:340
992499524,8cyclictest7850irq/56-dwc_otg09:29:563
992499522,9cyclictest0-21swapper/309:00:503
992499521,9cyclictest0-21swapper/311:32:343
992499521,9cyclictest0-21swapper/308:44:043
992499521,3cyclictest0-21swapper/311:45:373
992499521,10cyclictest22312-21ssh12:25:093
992199526,18cyclictest21423-21ssh11:45:080
992199524,28cyclictest31492-21ssh10:00:200
992199522,30cyclictest0-21swapper/009:52:180
9921995221,14cyclictest13976-21wget08:50:200
992199521,28cyclictest6038-21grep11:25:330
992499518,4cyclictest0-21swapper/307:45:363
992499517,7cyclictest8050irq/56-dwc_otg_07:37:573
992499516,5cyclictest22276-21ls09:10:343
992499516,5cyclictest22276-21ls09:10:343
992499512,4cyclictest0-21swapper/312:17:173
992499511,4cyclictest0-21swapper/308:02:293
992499511,10cyclictest20013-21ssh10:25:193
9922995125,9cyclictest0-21swapper/107:37:281
992199512,7cyclictest4094-21ntp_states10:05:300
992199512,7cyclictest4094-21ntp_states10:05:300
992499503,10cyclictest7950irq/56-dwc_otg_09:32:023
992499502,10cyclictest26015-21ssh10:31:353
992499501,6cyclictest750-21snmpd10:13:583
992499501,41cyclictest0-21swapper/311:20:143
992499501,41cyclictest0-21swapper/311:20:143
992499501,3cyclictest8050irq/56-dwc_otg_10:54:513
992499501,13cyclictest0-21swapper/307:26:473
9924995010,4cyclictest26374-21aten_rbpower_po07:55:213
9924995010,4cyclictest26374-21aten_rbpower_po07:55:213
9922995022,10cyclictest0-21swapper/108:49:511
992199506,31cyclictest0-21swapper/009:45:200
992199501,26cyclictest26307-21unixbench_singl11:10:370
992499496,4cyclictest0-21swapper/309:36:013
992499492,10cyclictest0-21swapper/311:10:063
992499491,5cyclictest12978-21taskset07:16:013
992499491,3cyclictest0-21swapper/312:30:303
992499491,39cyclictest0-21swapper/307:21:213
9921994926,3cyclictest0-21swapper/008:10:060
9921994918,17cyclictest0-21swapper/007:40:300
992199491,31cyclictest29650-21cron08:05:060
992199491,30cyclictest0-21swapper/012:10:240
9921994834,8cyclictest0-21swapper/010:15:320
9921994819,5cyclictest1993-21/usr/sbin/munin09:25:250
992199481,31cyclictest0-21swapper/011:05:300
992199481,29cyclictest12199-21wget08:45:220
992199481,25cyclictest21038-21ssh10:25:340
992499471,3cyclictest0-21swapper/308:50:073
9924994710,3cyclictest0-21swapper/308:15:253
992399474,13cyclictest7850irq/56-dwc_otg09:55:182
992199476,6cyclictest0-21swapper/007:20:180
9921994718,20cyclictest0-21swapper/008:43:090
9921994715,22cyclictest0-21swapper/009:20:170
9921994711,19cyclictest16149-21/usr/sbin/munin08:55:240
9921994711,18cyclictest7950irq/56-dwc_otg_08:20:190
992499461,3cyclictest0-21swapper/308:38:483
9921994629,4cyclictest0-21swapper/009:41:170
992499459,4cyclictest3869-21timerandwakeup08:20:323
9923994519,4cyclictest7950irq/56-dwc_otg_09:15:202
9921994528,4cyclictest7950irq/56-dwc_otg_11:19:110
992199452,17cyclictest0-21swapper/008:30:230
9921994520,7cyclictest7850irq/56-dwc_otg07:35:060
9921994520,7cyclictest7850irq/56-dwc_otg07:35:060
9921994518,15cyclictest22582-21/usr/sbin/munin07:45:220
992199451,24cyclictest0-21swapper/007:15:250
992499432,6cyclictest0-21swapper/307:50:213
9921994317,3cyclictest0-21swapper/009:00:290
992399426,24cyclictest0-21swapper/209:20:202
992399422,4cyclictest7950irq/56-dwc_otg_09:10:182
992399422,4cyclictest7950irq/56-dwc_otg_09:10:182
992399416,22cyclictest0-21swapper/209:25:212
992199415,18cyclictest0-21swapper/007:55:270
992199415,18cyclictest0-21swapper/007:55:270
965024011,16sleep17752-21kworker/u8:007:10:071
992399391,7cyclictest8050irq/56-dwc_otg_11:55:162
208352390,3sleep220833-21ssh11:05:162
9923993811,5cyclictest17932-21idleruntime-cro12:20:072
992399376,21cyclictest0-21swapper/211:10:222
992399376,18cyclictest12267-21grep10:55:072
992399371,26cyclictest17105-21ls11:00:252
992499361,8cyclictest0-21swapper/307:31:293
992499361,8cyclictest0-21swapper/307:31:293
9923993621,5cyclictest3179150wget08:10:212
9923993616,5cyclictest32259-21apt-config10:40:082
992399347,6cyclictest8050irq/56-dwc_otg_12:40:062
992399347,6cyclictest7950irq/56-dwc_otg_07:55:352
992399347,6cyclictest7950irq/56-dwc_otg_07:55:352
992399343,6cyclictest7850irq/56-dwc_otg10:55:282
9923993425,7cyclictest26623-21rm09:54:432
9923993422,9cyclictest8050irq/56-dwc_otg_09:45:332
992399342,19cyclictest8050irq/56-dwc_otg_12:05:262
85602348,13sleep30-21swapper/307:05:273
992399338,12cyclictest0-21swapper/212:20:252
992399336,15cyclictest8050irq/56-dwc_otg_10:15:352
992399336,15cyclictest8050irq/56-dwc_otg_09:00:212
992399333,23cyclictest7950irq/56-dwc_otg_08:15:342
992399332,24cyclictest8050irq/56-dwc_otg_07:35:172
992399332,18cyclictest0-21swapper/211:25:352
992399332,15cyclictest8050irq/56-dwc_otg_11:15:342
9923993314,10cyclictest249552chrt07:50:282
9923993310,3cyclictest0-21swapper/211:20:282
9923993310,3cyclictest0-21swapper/211:20:282
992399328,5cyclictest7950irq/56-dwc_otg_07:20:202
992399327,7cyclictest7950irq/56-dwc_otg_07:13:242
992399327,16cyclictest31-21ksoftirqd/212:30:252
992399327,12cyclictest8050irq/56-dwc_otg_10:05:262
992399327,12cyclictest8050irq/56-dwc_otg_10:05:262
992399325,5cyclictest31-21ksoftirqd/209:30:132
992399325,12cyclictest8050irq/56-dwc_otg_12:30:082
992399323,15cyclictest8050irq/56-dwc_otg_08:05:212
9923993216,5cyclictest32711-21unixbench_multi10:00:352
9923993212,4cyclictest24705-21cut10:30:272
992399321,22cyclictest13650-21latency_hist08:50:072
992399321,18cyclictest21046-21cut07:40:232
9923993211,4cyclictest0-21swapper/210:43:432
992399317,5cyclictest8050irq/56-dwc_otg_08:30:072
992399316,5cyclictest7950irq/56-dwc_otg_09:40:352
992399316,13cyclictest8050irq/56-dwc_otg_08:50:182
9923993125,4cyclictest301ktimersoftd/209:05:172
992399312,3cyclictest0-21swapper/210:25:252
992399311,6cyclictest10890-21netstat09:35:292
992399311,5cyclictest15781-21wget08:55:192
992399311,16cyclictest7950irq/56-dwc_otg_11:54:002
9923993111,5cyclictest31-21ksoftirqd/212:10:322
992399311,14cyclictest23712-21grep07:45:352
9923993110,5cyclictest7950irq/56-dwc_otg_11:40:242
992399307,5cyclictest8050irq/56-dwc_otg_07:30:252
992399307,5cyclictest8050irq/56-dwc_otg_07:30:252
992399307,4cyclictest0-21swapper/210:49:302
992399303,6cyclictest7850irq/56-dwc_otg08:40:342
9923993016,4cyclictest7950irq/56-dwc_otg_11:45:252
992399297,4cyclictest0-21swapper/211:30:472
992399291,8cyclictest2067-21idleruntime12:00:252
992399291,7cyclictest15847-21apt-get10:20:182
992399291,5cyclictest7850irq/56-dwc_otg08:20:222
992399291,4cyclictest7950irq/56-dwc_otg_07:15:212
992399283,16cyclictest0-21swapper/208:00:212
992399272,18cyclictest0-21swapper/208:30:262
992399272,10cyclictest8050irq/56-dwc_otg_08:35:112
992399252,12cyclictest7950irq/56-dwc_otg_07:25:322
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional