You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-12 - 05:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot4s.osadl.org (updated Wed Aug 12, 2026 00:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20204996510,17cyclictest131rcu_preempt20:30:142
2020499631,47cyclictest6479-21ssh00:10:132
2020499596,8cyclictest131rcu_preempt00:05:152
2020499551,10cyclictest131rcu_preempt19:15:132
20204995325,16cyclictest131rcu_preempt19:45:132
20204995319,23cyclictest27-21ksoftirqd/200:35:152
2018199504,34cyclictest2682-21ssh22:20:140
2018199484,35cyclictest9976-21ssh00:30:130
2018199472,41cyclictest31432-21ssh22:00:160
20216994433,8cyclictest35966irq/58-eth022:10:133
2020499444,2cyclictest131rcu_preempt21:25:142
2019699424,35cyclictest11672-21ssh22:25:111
20216994131,6cyclictest35966irq/58-eth000:05:163
20216993821,13cyclictest35966irq/58-eth021:40:133
2020499382,17cyclictest844-21munin-node21:05:162
2021699374,29cyclictest0-21swapper/322:50:143
2020499372,22cyclictest22430-21ssh21:55:142
2020499364,10cyclictest31725-21ssh23:30:132
2020499362,22cyclictest27346irq/40-dwc2_hso19:25:132
2020499361,16cyclictest29718-21ssh22:35:142
2020499354,9cyclictest989-21sh00:25:132
20204993525,6cyclictest27-21ksoftirqd/219:10:112
2020499352,24cyclictest18827-21ssh21:35:142
2019699351,19cyclictest17435-21ssh23:40:151
2018199351,29cyclictest21002-21sh00:00:150
2020499343,10cyclictest0-21swapper/223:06:122
20196993411,6cyclictest131rcu_preempt20:45:261
2021699333,5cyclictest0-21swapper/321:15:133
2019699334,15cyclictest21004-21ssh00:00:141
2019699333,23cyclictest17009-21ssh22:10:131
2019699332,19cyclictest26422-21ssh23:45:151
2018199332,26cyclictest26107-21ssh22:15:150
2021699324,16cyclictest35966irq/58-eth021:35:133
2021699322,22cyclictest0-21swapper/322:45:133
2021699322,20cyclictest35966irq/58-eth019:40:133
2021699321,22cyclictest35966irq/58-eth021:10:133
2019699322,23cyclictest26108-21sshd22:15:151
2018199320,11cyclictest15502-21ssh23:01:220
2021699311,24cyclictest35966irq/58-eth021:25:143
2021699311,19cyclictest35966irq/58-eth020:30:143
2020499313,18cyclictest27346irq/40-dwc2_hso23:35:132
2019699316,9cyclictest21-21ksoftirqd/100:31:591
2019699314,7cyclictest21-21ksoftirqd/123:15:261
20181993119,8cyclictest12-21ksoftirqd/023:40:140
20181993110,6cyclictest12-21ksoftirqd/021:48:500
2021699304,16cyclictest35966irq/58-eth023:55:153
2021699303,16cyclictest35966irq/58-eth020:35:163
20216993010,11cyclictest35966irq/58-eth023:20:133
2020499303,15cyclictest27346irq/40-dwc2_hso21:15:132
2019699305,4cyclictest131rcu_preempt00:39:541
2018199302,22cyclictest21612-21ssh23:24:150
20216992913,11cyclictest35966irq/58-eth022:40:133
2020499293,13cyclictest27346irq/40-dwc2_hso20:15:142
2020499291,21cyclictest20771-21ssh23:23:152
20196992914,5cyclictest21-21ksoftirqd/122:06:411
2018199291,7cyclictest2352-21mailstats19:55:280
20181992916,10cyclictest15340-21apt-get22:45:110
2021699281,12cyclictest0-21swapper/322:10:013
2020499286,13cyclictest27346irq/40-dwc2_hso19:35:132
2020499283,8cyclictest20169-21cyclictest23:55:152
2020499283,8cyclictest0-21swapper/223:14:152
2020499283,8cyclictest0-21swapper/223:14:142
2020499282,20cyclictest0-21swapper/220:45:152
2020499282,19cyclictest0-21swapper/220:10:152
2019699286,3cyclictest131rcu_preempt21:20:281
2019699286,3cyclictest131rcu_preempt20:10:241
2019699285,12cyclictest21-21ksoftirqd/120:15:221
2019699285,10cyclictest21-21ksoftirqd/121:38:531
2019699284,6cyclictest21-21ksoftirqd/121:52:411
20181992820,4cyclictest32371-21apt-get20:30:140
2018199281,10cyclictest30384-21find23:45:300
2018199280,8cyclictest17869-21latency_hist20:15:010
2021699273,16cyclictest0-21swapper/323:06:133
2020499277,6cyclictest0-21swapper/222:05:142
2020499274,11cyclictest27346irq/40-dwc2_hso21:00:132
2020499273,14cyclictest27346irq/40-dwc2_hso20:00:172
2020499272,20cyclictest0-21swapper/219:40:142
2020499272,19cyclictest0-21swapper/223:50:142
2020499271,19cyclictest0-21swapper/220:40:112
2019699273,6cyclictest21-21ksoftirqd/100:20:191
2019699273,5cyclictest21-21ksoftirqd/100:10:161
2019699273,13cyclictest31430-21sshd22:00:161
20196992719,5cyclictest201rcuc/123:05:231
2018199274,4cyclictest12-21ksoftirqd/022:30:550
2018199273,5cyclictest12-21ksoftirqd/023:15:180
2018199272,5cyclictest12-21ksoftirqd/000:25:160
2018199271,10cyclictest12-21ksoftirqd/019:30:250
2021699268,6cyclictest0-21swapper/323:43:273
2021699266,9cyclictest35966irq/58-eth023:50:143
2021699265,15cyclictest0-21swapper/321:55:143
2021699263,8cyclictest0-21swapper/321:20:323
2021699263,20cyclictest35966irq/58-eth019:15:133
2021699263,14cyclictest0-21swapper/323:00:123
2021699263,13cyclictest35966irq/58-eth022:20:123
2021699262,7cyclictest0-21swapper/300:10:143
2021699262,17cyclictest0-21swapper/323:31:173
2020499263,11cyclictest27793-21ssh21:40:132
2020499262,9cyclictest10096-21ssh23:16:152
2020499262,14cyclictest0-21swapper/220:25:142
2019699266,11cyclictest6249-21kworker/u8:021:30:141
2019699265,8cyclictest21-21ksoftirqd/100:05:451
2019699265,7cyclictest21-21ksoftirqd/121:25:291
2019699265,5cyclictest21-21ksoftirqd/121:00:271
2019699264,8cyclictest131rcu_preempt23:55:241
2019699264,6cyclictest21-21ksoftirqd/121:40:311
2019699264,3cyclictest131rcu_preempt23:32:291
2019699263,5cyclictest21-21ksoftirqd/121:15:171
2019699263,4cyclictest131rcu_preempt23:20:241
2019699262,5cyclictest21-21ksoftirqd/120:35:201
20196992615,6cyclictest10785-21ssh23:54:051
20196992614,4cyclictest21-21ksoftirqd/121:05:261
20196992612,3cyclictest21-21ksoftirqd/123:10:301
20196992612,3cyclictest21-21ksoftirqd/123:10:291
2018199268,5cyclictest12-21ksoftirqd/000:05:230
2018199266,6cyclictest12-21ksoftirqd/021:25:230
2018199264,4cyclictest12-21ksoftirqd/020:30:010
2018199263,10cyclictest12-21ksoftirqd/022:40:060
2018199262,5cyclictest12-21ksoftirqd/023:40:010
2018199262,18cyclictest28177-21ssh23:26:140
20181992612,11cyclictest940-21apt-get22:55:140
2021699258,11cyclictest0-21swapper/322:35:153
2021699253,15cyclictest0-21swapper/323:14:153
2021699253,15cyclictest0-21swapper/323:14:153
2021699251,9cyclictest0-21swapper/300:00:213
2021699251,8cyclictest0-21swapper/321:35:023
2020499253,15cyclictest27346irq/40-dwc2_hso22:40:132
2020499251,6cyclictest13328-21ssh21:50:122
20204992513,9cyclictest24349-21ssh00:20:062
2020499251,18cyclictest22689-21sh23:25:152
2019699258,11cyclictest21-21ksoftirqd/122:45:201
2019699257,9cyclictest21-21ksoftirqd/120:25:211
2019699257,8cyclictest21-21ksoftirqd/122:55:321
2019699257,5cyclictest21-21ksoftirqd/121:45:311
2019699256,7cyclictest21-21ksoftirqd/122:35:071
2019699256,3cyclictest131rcu_preempt22:50:131
2019699256,3cyclictest131rcu_preempt21:55:531
2019699255,7cyclictest21-21ksoftirqd/120:05:371
2019699255,7cyclictest21-21ksoftirqd/120:05:361
2019699255,7cyclictest131rcu_preempt00:29:051
2019699254,3cyclictest131rcu_preempt23:25:231
2019699254,3cyclictest131rcu_preempt20:40:251
2019699254,3cyclictest131rcu_preempt20:20:151
2019699251,5cyclictest21-21ksoftirqd/120:50:131
2019699251,5cyclictest21-21ksoftirqd/120:50:131
20196992515,3cyclictest5734-21diskmemload23:35:231
20196992513,5cyclictest21-21ksoftirqd/122:20:221
20196992511,7cyclictest0-21swapper/123:01:581
2018199258,11cyclictest18001-21apt-get20:15:140
2018199257,5cyclictest12-21ksoftirqd/021:00:200
2018199257,4cyclictest151rcuc/021:54:590
2018199255,5cyclictest151rcuc/021:36:150
2018199255,4cyclictest151rcuc/023:13:370
2018199255,4cyclictest151rcuc/023:13:370
2018199254,6cyclictest12-21ksoftirqd/000:21:200
2018199254,5cyclictest12-21ksoftirqd/022:29:550
2018199253,5cyclictest12-21ksoftirqd/021:20:270
2018199253,4cyclictest12-21ksoftirqd/021:14:210
2018199253,10cyclictest12-21ksoftirqd/021:58:360
20181992519,3cyclictest21606-21apt-get19:45:120
2018199251,4cyclictest12-21ksoftirqd/019:25:310
20181992513,8cyclictest9556-21apt-get20:40:100
2021699249,3cyclictest0-21swapper/321:54:243
2021699246,11cyclictest35966irq/58-eth000:15:043
2021699242,8cyclictest0-21swapper/300:40:013
2021699242,15cyclictest0-21swapper/323:25:143
2020499248,11cyclictest0-21swapper/200:15:152
2020499241,18cyclictest29458-21ssh00:04:562
2020499241,16cyclictest27346irq/40-dwc2_hso20:20:132
2020499241,10cyclictest24413-21ssh22:50:142
2019699248,7cyclictest21-21ksoftirqd/122:31:131
2019699247,8cyclictest21-21ksoftirqd/100:16:291
2019699246,8cyclictest21-21ksoftirqd/121:14:031
2019699246,8cyclictest21-21ksoftirqd/119:40:031
2019699246,6cyclictest21-21ksoftirqd/119:20:181
2019699246,3cyclictest131rcu_preempt19:50:181
2019699246,10cyclictest21-21ksoftirqd/120:00:281
2019699245,3cyclictest131rcu_preempt19:55:301
2019699244,3cyclictest131rcu_preempt19:10:281
20196992418,4cyclictest201rcuc/119:40:211
2018199246,5cyclictest12-21ksoftirqd/021:35:010
2018199245,4cyclictest12-21ksoftirqd/020:45:310
2018199244,5cyclictest12-21ksoftirqd/023:33:120
2018199244,5cyclictest12-21ksoftirqd/022:50:200
2018199244,5cyclictest12-21ksoftirqd/000:15:540
2018199243,5cyclictest12-21ksoftirqd/022:06:170
2018199243,5cyclictest12-21ksoftirqd/000:10:140
2018199243,4cyclictest12-21ksoftirqd/023:55:170
2018199242,7cyclictest4763-21mailstats21:05:300
2018199242,5cyclictest12-21ksoftirqd/023:50:140
2018199242,10cyclictest12-21ksoftirqd/023:08:570
20181992410,4cyclictest12-21ksoftirqd/022:10:540
2018199240,12cyclictest12-21ksoftirqd/021:17:500
2021699239,3cyclictest0-21swapper/322:56:583
2021699232,7cyclictest0-21swapper/322:00:223
2020499233,16cyclictest27346irq/40-dwc2_hso21:20:152
2020499233,15cyclictest27346irq/40-dwc2_hso22:30:152
2020499232,17cyclictest26409-21apt-get23:45:162
2020499232,16cyclictest0-21swapper/221:10:152
20204992315,5cyclictest18028-21ssh23:40:202
2019699235,9cyclictest10222-21ssh22:40:261
2019699233,4cyclictest21-21ksoftirqd/119:25:201
20196992318,3cyclictest201rcuc/120:55:191
2019699231,4cyclictest21-21ksoftirqd/120:30:131
2018199237,7cyclictest12-21ksoftirqd/000:35:180
2018199237,2cyclictest131rcu_preempt19:10:300
2018199233,5cyclictest12-21ksoftirqd/020:55:200
2018199233,4cyclictest12-21ksoftirqd/022:35:020
2018199233,4cyclictest12-21ksoftirqd/020:20:180
2018199232,4cyclictest12-21ksoftirqd/019:20:020
2018199230,6cyclictest12-21ksoftirqd/020:35:300
2018199230,5cyclictest31013-21grep21:40:210
2018199230,5cyclictest30336-21cut19:20:180
2021699222,8cyclictest0-21swapper/300:30:053
2021699222,6cyclictest0-21swapper/323:45:163
2021699222,6cyclictest0-21swapper/300:29:043
2021699222,14cyclictest35966irq/58-eth020:20:133
2020499225,5cyclictest0-21swapper/222:15:142
2020499222,9cyclictest4349-21ssh21:45:132
2020499221,18cyclictest10344-21cut21:30:192
2019699225,3cyclictest131rcu_preempt19:30:271
2019699223,6cyclictest21-21ksoftirqd/119:10:021
20196992216,4cyclictest201rcuc/119:45:281
20196992210,5cyclictest21-21ksoftirqd/119:15:131
2018199225,5cyclictest12-21ksoftirqd/019:50:190
2018199223,4cyclictest12-21ksoftirqd/020:05:260
2018199223,4cyclictest12-21ksoftirqd/020:05:260
2018199222,4cyclictest12-21ksoftirqd/019:40:150
2020499215,7cyclictest27-21ksoftirqd/222:00:302
2020499214,14cyclictest2885-21fschecks_time22:20:152
2020499212,14cyclictest27346irq/40-dwc2_hso19:20:122
2020499212,13cyclictest27346irq/40-dwc2_hso19:50:122
2020499212,11cyclictest10691-21kthreadcore23:00:182
2020499212,10cyclictest1095-21fschecks_count22:55:152
2020499211,18cyclictest11948-21kthreadcore00:30:202
2020499211,15cyclictest0-21swapper/220:55:142
2020499211,11cyclictest12302-21cut22:25:172
2018199213,4cyclictest12-21ksoftirqd/020:50:180
2018199213,4cyclictest12-21ksoftirqd/020:50:180
2018199210,4cyclictest3697-21diskstats20:00:190
2021699202,11cyclictest0-21swapper/319:10:133
2021699201,13cyclictest35966irq/58-eth019:35:133
2020499202,15cyclictest27346irq/40-dwc2_hso20:35:162
2020499202,10cyclictest6315-1kworker/u9:122:45:142
2020499201,15cyclictest19679-21sed20:50:192
2020499201,15cyclictest19679-21sed20:50:182
2018199206,3cyclictest131rcu_preempt19:35:130
2021699199,7cyclictest0-21swapper/322:25:183
2021699199,6cyclictest0-21swapper/323:18:003
2021699192,10cyclictest0-21swapper/321:05:163
20216991912,4cyclictest0-21swapper/322:15:143
2021699191,13cyclictest0-21swapper/320:05:243
2021699191,13cyclictest0-21swapper/320:05:243
2021699191,13cyclictest0-21swapper/319:30:163
2021699191,12cyclictest0-21swapper/319:50:013
2021699191,11cyclictest0-21swapper/320:00:173
2020499192,9cyclictest8341-21kthreadcore19:30:202
2020499191,9cyclictest11377-21kthreadcore20:05:292
2020499191,9cyclictest11377-21kthreadcore20:05:282
2020499191,8cyclictest31376-21fschecks_time19:55:162
2020499191,8cyclictest17813-21tr22:10:182
2021699188,6cyclictest0-21swapper/320:40:113
2021699187,7cyclictest0-21swapper/323:35:213
2021699184,9cyclictest35966irq/58-eth019:20:133
2021699182,10cyclictest0-21swapper/320:50:143
2021699182,10cyclictest0-21swapper/320:50:133
2021699182,10cyclictest0-21swapper/320:15:153
2021699181,14cyclictest0-21swapper/321:45:233
2020499181,9cyclictest20169-21cyclictest19:10:012
2020499181,9cyclictest20169-21cyclictest19:10:002
2021699179,6cyclictest0-21swapper/322:32:023
2021699176,9cyclictest0-21swapper/300:20:453
2021699172,10cyclictest0-21swapper/319:25:133
2021699171,12cyclictest0-21swapper/320:25:243
2021699161,10cyclictest0-21swapper/320:10:253
2021699157,3cyclictest0-21swapper/321:00:153
2021699141,10cyclictest0-21swapper/320:55:193
2019699142,4cyclictest21-21ksoftirqd/119:10:011
2018199141,10cyclictest20264-21latency_hist19:10:020
2018199141,10cyclictest20264-21latency_hist19:10:020
2021699127,3cyclictest0-21swapper/319:52:043
2021699121,9cyclictest35966irq/58-eth020:45:153
2021699121,9cyclictest0-21swapper/319:55:233
2021699101,6cyclictest0-21swapper/319:10:023
2021699101,6cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional