You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-24 - 19:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot4s.osadl.org (updated Fri Jul 24, 2026 12:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1838699685,48cyclictest6753-21ssh10:05:120
1840499651,53cyclictest31834-21ssh09:25:122
1838699584,45cyclictest14217-21ssh12:15:120
1840499550,50cyclictest930-21snmpd07:40:142
1839499424,34cyclictest4537-21ssh09:10:131
1839499412,34cyclictest25064-21ssh11:45:141
1841299391,23cyclictest35966irq/58-eth012:35:143
1839499393,31cyclictest30168-21ssh10:00:151
1839499362,31cyclictest12414-21ssh11:20:131
1839499362,30cyclictest24860-21ssh10:15:121
1841299352,23cyclictest35966irq/58-eth009:40:143
18386993511,19cyclictest12-21ksoftirqd/011:05:120
1841299345,17cyclictest35966irq/58-eth010:05:123
18412993412,13cyclictest35966irq/58-eth011:35:113
1841299341,17cyclictest35966irq/58-eth011:55:143
1838699343,26cyclictest10442-21apt-get10:25:120
1838699343,24cyclictest26770-21ssh11:10:130
18404993324,6cyclictest877-21lldpd07:25:132
1839499333,24cyclictest10454-21ssh10:25:131
1839499333,19cyclictest21-21ksoftirqd/109:05:111
1839499332,25cyclictest19648-21ssh12:00:151
1839499326,20cyclictest7023-21ssh11:35:121
1839499313,24cyclictest8997-21ssh12:30:131
18394993125,3cyclictest0-21swapper/111:50:141
1838699313,21cyclictest31843-21ssh09:25:130
1839499305,22cyclictest21405-21ssh11:25:131
18386993020,3cyclictest0-21swapper/010:45:110
1840499296,13cyclictest261rcuc/209:55:162
1840499294,18cyclictest8430-21ssh09:30:132
1840499294,18cyclictest8430-21ssh09:30:122
18394992821,3cyclictest21-21ksoftirqd/110:35:121
18394992821,3cyclictest21-21ksoftirqd/110:35:111
1838699282,14cyclictest5218-21ssh12:10:150
1839499272,20cyclictest8732-21ssh10:40:241
1840499262,20cyclictest0-21swapper/208:55:162
18404992615,9cyclictest27-21ksoftirqd/211:40:122
1840499261,20cyclictest930-21snmpd12:10:152
1839499266,12cyclictest0-21swapper/108:45:121
1839499262,15cyclictest18375-21cyclictest08:35:121
1839499261,19cyclictest2979-21rm09:45:131
1838699262,18cyclictest15805-21ssh10:10:130
1838699261,20cyclictest1472-21ssh10:20:140
18412992512,9cyclictest35966irq/58-eth009:50:143
1840499252,7cyclictest3171-21fschecks_time09:45:152
18404992514,8cyclictest0-21swapper/211:00:122
1840499251,16cyclictest4541-21ssh09:10:132
1839499258,11cyclictest17862-1kworker/u9:110:55:151
1839499255,17cyclictest19455-21ssh10:30:141
1839499255,17cyclictest19455-21ssh10:30:131
1839499251,21cyclictest13568-21ssh09:15:121
1838699251,21cyclictest23087-21ssh10:50:130
1841299241,11cyclictest35966irq/58-eth008:40:143
1840499243,10cyclictest0-21swapper/210:15:112
1840499241,17cyclictest27346irq/40-dwc2_hso12:35:132
18404992411,5cyclictest22825-21ssh11:05:472
1840499241,13cyclictest27346irq/40-dwc2_hso09:20:142
18404992410,11cyclictest0-21swapper/207:10:162
18394992412,8cyclictest21-21ksoftirqd/109:20:131
1839499241,18cyclictest32359-21ssh12:25:151
18394992411,10cyclictest25686-21cron08:25:021
18394992410,9cyclictest21-21ksoftirqd/108:05:131
18386992412,9cyclictest1481-21cron08:00:010
1840499239,11cyclictest16534-21kthreadcore10:10:202
1840499235,8cyclictest2846-21cron08:35:012
1840499234,4cyclictest0-21swapper/209:20:012
1840499231,8cyclictest3264266ssh10:55:192
18404992312,7cyclictest0-21swapper/207:20:292
18404992311,5cyclictest3249-21ssh12:08:072
18404992311,5cyclictest2442-21ssh10:37:232
18404992311,5cyclictest2442-21ssh10:37:222
18404992311,4cyclictest0-21swapper/208:00:162
1840499231,12cyclictest25065-21sh11:45:152
18404992310,10cyclictest10042-21ssh11:17:422
1840499230,13cyclictest0-21swapper/211:10:142
1839499232,14cyclictest630-21Async09:36:311
1839499231,16cyclictest12400-21ssh11:00:271
1838699232,6cyclictest15420-21kthreadcore09:50:230
1838699231,13cyclictest23384-21diskmemload12:20:140
1841299222,13cyclictest35966irq/58-eth011:10:133
1840499229,10cyclictest32089-21kworker/u8:111:25:142
1840499228,4cyclictest6329-21kthreadcore10:40:202
1840499226,12cyclictest0-21swapper/209:50:242
1840499222,16cyclictest0-21swapper/212:30:132
18404992212,8cyclictest0-21swapper/208:15:152
18404992211,9cyclictest15365-21ssh10:25:362
18404992211,8cyclictest0-21swapper/209:35:132
1840499221,12cyclictest14233-21sh12:15:132
18404992210,9cyclictest3549-21grep12:25:262
1840499220,12cyclictest1881-21ls11:50:172
1839499222,16cyclictest16056-21sh10:45:201
1838699223,9cyclictest17990-21ssh12:35:120
18386992212,7cyclictest13299-21cat12:30:300
1841299212,12cyclictest35966irq/58-eth009:30:113
1841299212,12cyclictest35966irq/58-eth009:30:113
18412992111,8cyclictest0-21swapper/312:15:213
1840499211,9cyclictest17382-21kthreadcore10:45:212
1840499211,9cyclictest14877-21wc08:10:272
18404992113,5cyclictest0-21swapper/212:20:162
1840499211,17cyclictest20218-21kthreadcore10:30:202
1840499211,17cyclictest20218-21kthreadcore10:30:202
1840499211,15cyclictest26428-21ssh09:40:142
1840499211,15cyclictest0-21swapper/208:05:232
1840499211,12cyclictest9066-21timerwakeupswit07:30:292
1840499211,11cyclictest9757-21kthreadcore11:35:212
1840499211,10cyclictest27136-21grep07:15:312
1840499211,10cyclictest27136-21grep07:15:312
18404992110,7cyclictest0-21swapper/210:05:142
1839499215,13cyclictest630-21Async09:36:311
18394992114,4cyclictest26019-21idleruntime-cro09:40:001
18394992113,6cyclictest14669-21cron07:40:011
1839499210,9cyclictest20883-21munin-run08:20:001
1839499210,17cyclictest17968-21find12:35:121
1838699211,16cyclictest25044-21apt-get11:45:140
1838699211,11cyclictest9069-21kthreadcore11:35:210
1838699211,10cyclictest0-21swapper/010:00:310
1841299209,8cyclictest0-21swapper/310:38:093
1841299209,8cyclictest0-21swapper/310:38:093
1841299209,7cyclictest0-21swapper/312:10:153
1841299208,9cyclictest0-21swapper/310:56:073
1841299202,10cyclictest35966irq/58-eth009:20:133
18412992010,8cyclictest0-21swapper/311:27:233
18412992010,8cyclictest0-21swapper/310:50:053
18412992010,6cyclictest35966irq/58-eth009:10:143
1840499209,9cyclictest12358-21ssh11:20:112
1840499209,8cyclictest0-21swapper/207:50:302
1840499208,9cyclictest20491-21kthreadcore08:50:222
1840499201,9cyclictest732-21grep07:55:322
1840499201,9cyclictest3976-21kthreadcore10:20:222
1840499201,16cyclictest26889-21mailstats10:50:302
1840499201,15cyclictest901-21kthreadcore10:00:222
1840499201,10cyclictest28448-21latency_hist12:05:022
1840499201,10cyclictest12669-21cat08:45:012
18404992010,8cyclictest0-21swapper/208:35:162
18404992010,7cyclictest0-21swapper/208:20:242
1840499200,10cyclictest11367-21kthreadcore11:55:202
1839499209,8cyclictest25819-21cat09:55:351
1839499208,8cyclictest6151-21kthreadcore07:30:201
1839499204,10cyclictest24674-21ls10:15:031
1839499202,13cyclictest31184-21irqstats11:30:181
1839499202,13cyclictest18375-21cyclictest08:50:131
18394992013,5cyclictest0-21swapper/107:15:291
18394992013,5cyclictest0-21swapper/107:15:281
1839499201,16cyclictest31919-21ls09:25:141
18394992011,6cyclictest1-21systemd11:55:101
1839499201,15cyclictest11995-21ssh09:50:131
1839499200,13cyclictest23354-21find12:20:121
1838699209,8cyclictest19564-21df10:30:160
1838699209,8cyclictest19564-21df10:30:150
1838699204,10cyclictest0-21swapper/007:40:140
1838699201,6cyclictest31027-21irqcore08:30:170
1838699201,5cyclictest53646usb-storage08:15:050
18386992014,3cyclictest12590-21switchtime11:00:290
18386992013,4cyclictest0-21swapper/009:55:280
18386992012,6cyclictest20997-21cron11:25:010
1838699201,15cyclictest17387-21ssh09:35:130
1838699201,14cyclictest30482-21ssh11:30:130
1838699201,13cyclictest26427-21sh09:40:140
1838699200,16cyclictest10560-21find11:55:120
1841299199,6cyclictest0-21swapper/312:29:013
1841299199,6cyclictest0-21swapper/311:24:393
1841299199,6cyclictest0-21swapper/311:16:443
1841299198,9cyclictest0-21swapper/311:06:423
1841299194,9cyclictest0-21swapper/307:40:143
1841299192,12cyclictest0-21swapper/307:10:143
1841299192,10cyclictest0-21swapper/310:10:133
1841299192,10cyclictest0-21swapper/308:55:153
18412991911,6cyclictest0-21swapper/312:20:023
18412991911,5cyclictest0-21swapper/310:30:163
18412991911,5cyclictest0-21swapper/310:30:163
18412991910,6cyclictest0-21swapper/311:45:173
18412991910,4cyclictest0-21swapper/311:50:193
1840499195,11cyclictest19828-21df_inode07:45:152
1840499193,12cyclictest27346irq/40-dwc2_hso08:25:132
1840499192,9cyclictest10837-21kthreadcore07:35:222
1840499191,9cyclictest30450-21apt-get11:30:132
1840499191,8cyclictest16057-21missed_timers08:45:242
18404991911,5cyclictest0-21swapper/209:05:162
1840499190,15cyclictest27308-21fschecks_time09:00:152
1839499199,7cyclictest12775-21cat09:30:311
1839499199,7cyclictest12775-21cat09:30:301
1839499193,11cyclictest0-21swapper/107:55:151
1839499193,10cyclictest0-21swapper/107:50:151
18394991911,5cyclictest5183-21/usr/sbin/munin12:10:161
18394991911,5cyclictest26720-21/usr/sbin/munin11:10:291
1839499191,14cyclictest26401-21apt-get09:40:141
1839499191,10cyclictest854-21sshd10:09:271
1838699193,4cyclictest345-21kthreadcore10:55:210
1838699193,3cyclictest131rcu_preempt09:15:230
1838699192,8cyclictest0-21swapper/012:05:140
1838699192,10cyclictest12-21ksoftirqd/011:15:130
1838699191,9cyclictest4135-21grep09:10:010
1838699191,6cyclictest2148-21ssh11:50:180
18386991912,4cyclictest0-21swapper/008:55:000
18386991911,5cyclictest23392-21kthreadcore11:25:230
1838699191,14cyclictest22799-21ssh09:20:160
18386991910,7cyclictest9866-21cat10:40:300
1841299189,7cyclictest0-21swapper/311:33:453
1841299186,9cyclictest0-21swapper/310:01:313
1841299182,11cyclictest0-21swapper/310:45:143
1841299182,10cyclictest0-21swapper/312:05:153
1841299182,10cyclictest0-21swapper/307:15:153
1841299182,10cyclictest0-21swapper/307:15:153
18412991811,5cyclictest35966irq/58-eth012:00:153
1841299181,14cyclictest35966irq/58-eth011:40:123
18412991810,6cyclictest0-21swapper/311:01:413
18412991810,6cyclictest0-21swapper/310:40:083
18412991810,5cyclictest35966irq/58-eth009:38:233
18412991810,3cyclictest0-21swapper/310:25:583
1839499189,7cyclictest1-21systemd10:54:571
1839499183,11cyclictest1490-21apt-get08:00:031
1839499182,13cyclictest820-21kthreadcore08:30:221
1839499182,13cyclictest1468-21ssh10:20:131
18394991811,4cyclictest3497-21forks11:15:161
1839499181,13cyclictest19670-21latency_hist07:45:021
1839499181,12cyclictest0-21swapper/111:05:131
18394991810,5cyclictest16544-21kthreadcore12:15:221
1839499180,9cyclictest21462-21kthreadcore07:45:201
1839499180,15cyclictest11388-21find08:10:141
1838699189,6cyclictest23213-21missed_timers12:00:250
1838699188,7cyclictest7604-21cat09:45:310
1838699184,11cyclictest29234-21sh10:15:300
1838699183,12cyclictest24059-21kthreadcore07:15:220
1838699183,12cyclictest24059-21kthreadcore07:15:210
1838699182,12cyclictest20897-21users11:40:310
1838699181,3cyclictest0-21swapper/012:29:020
18386991812,4cyclictest8141-21ntp_192.168.11409:10:260
1841299179,6cyclictest0-21swapper/310:23:383
1841299179,6cyclictest0-21swapper/309:26:173
1841299178,6cyclictest0-21swapper/309:45:223
1841299172,10cyclictest0-21swapper/307:45:133
1841299171,13cyclictest0-21swapper/309:00:233
1841299171,10cyclictest0-21swapper/309:55:313
1841299171,10cyclictest0-21swapper/309:15:143
1839499172,13cyclictest21672-21kthreadcore07:10:221
1839499170,14cyclictest28696-21sh12:05:131
1838699178,6cyclictest8986-21timerandwakeup07:30:280
1838699178,6cyclictest31005-21grep09:00:280
1838699173,11cyclictest11090-21ssh09:30:210
1838699173,11cyclictest11090-21ssh09:30:210
1838699172,9cyclictest0-21swapper/008:00:130
1838699172,10cyclictest0-21swapper/010:35:120
1838699172,10cyclictest0-21swapper/010:35:120
1838699171,7cyclictest27365-21kthreadcore07:50:220
1838699171,5cyclictest53646usb-storage07:10:320
18386991712,3cyclictest28401-21hwlatdetect07:20:170
18386991711,4cyclictest0-21swapper/008:40:220
1838699171,13cyclictest2707-21tr07:25:220
1838699171,11cyclictest12815-21cpuspeed08:45:140
1838699170,15cyclictest21622-21irqrtprio08:20:180
1841299169,3cyclictest0-21swapper/310:15:443
1841299168,6cyclictest0-21swapper/312:31:433
1841299162,9cyclictest0-21swapper/307:35:153
1839499169,5cyclictest0-21swapper/108:40:281
1839499169,4cyclictest30414-21wc09:00:211
1839499162,9cyclictest0-21swapper/108:25:141
1839499162,10cyclictest0-21swapper/107:20:141
18394991611,3cyclictest22358-21cpu08:55:151
1838699162,11cyclictest20441-21kthreadcore07:45:190
1838699161,12cyclictest2847-21apt-get08:35:020
1838699161,12cyclictest12983-21kthreadcore07:35:240
1838699161,11cyclictest8075-21kthreadcore08:05:190
1838699161,11cyclictest26067-21fschecks_count08:25:170
1838699161,11cyclictest11906-21grep08:10:190
18386991610,4cyclictest22591-21idleruntime08:55:180
1841299151,11cyclictest0-21swapper/308:25:203
1838699151,10cyclictest18496-21cat07:10:010
1841299149,3cyclictest0-21swapper/307:55:163
1841299141,6cyclictest0-21swapper/308:50:183
1841299141,10cyclictest0-21swapper/309:05:203
1841299138,3cyclictest0-21swapper/308:15:103
1841299131,5cyclictest0-21swapper/307:35:013
1841299131,10cyclictest0-21swapper/308:30:183
1841299131,10cyclictest0-21swapper/308:20:303
1841299131,10cyclictest0-21swapper/308:10:313
1839499132,9cyclictest18375-21cyclictest07:10:011
1841299127,3cyclictest0-21swapper/307:24:373
1841299123,7cyclictest0-21swapper/308:05:153
1841299121,8cyclictest0-21swapper/307:54:203
1840499121,8cyclictest18414-21latency_hist07:10:022
1841299112,5cyclictest0-21swapper/308:00:133
1841299111,7cyclictest0-21swapper/308:45:143
1841299111,7cyclictest0-21swapper/308:35:153
1841299111,7cyclictest0-21swapper/307:25:163
1841299111,7cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional