You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-15 - 00:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Sun Jun 14, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2771029077,9sleep20-21swapper/207:07:162
2787528774,9sleep00-21swapper/007:09:230
2769428468,12sleep10-21swapper/107:07:031
2760428371,8sleep30-21swapper/307:05:533
281692740,0sleep10-21swapper/111:10:141
93542590,0sleep00-21swapper/011:56:370
158032570,0sleep00-21swapper/007:50:180
2801799290,1cyclictest0-21swapper/309:14:333
2801499291,27cyclictest13086-21sort07:45:162
2801799270,0cyclictest0-21swapper/309:21:373
2801499268,17cyclictest32-21ksoftirqd/210:36:482
2801799252,23cyclictest0-21swapper/310:46:433
28014992524,1cyclictest0-21swapper/210:12:182
28014992522,2cyclictest0-21swapper/210:25:162
2801799240,1cyclictest0-21swapper/311:06:033
2801499240,24cyclictest0-21swapper/211:35:352
2801499240,24cyclictest0-21swapper/209:26:162
2801799231,1cyclictest0-21swapper/310:15:573
2801799231,1cyclictest0-21swapper/309:37:433
2801799230,2cyclictest0-21swapper/311:28:553
2801799230,23cyclictest0-21swapper/310:29:233
28012992320,2cyclictest537-21snmpd10:25:121
28017992219,2cyclictest537-21snmpd12:11:423
28017992219,2cyclictest537-21snmpd11:30:273
2801799220,2cyclictest0-21swapper/310:01:313
2801499228,1cyclictest0-21swapper/212:10:052
28014992220,1cyclictest537-21snmpd12:35:192
2800799221,20cyclictest0-21swapper/010:50:130
2800799221,20cyclictest0-21swapper/010:50:130
28017992119,1cyclictest537-21snmpd11:16:263
28014992116,1cyclictest32-21ksoftirqd/210:00:262
2801499211,19cyclictest22766-21df_abs09:30:152
28012992118,2cyclictest537-21snmpd12:27:401
28017992018,1cyclictest537-21snmpd09:50:193
2801799201,17cyclictest0-21swapper/310:36:313
2801799200,0cyclictest0-21swapper/312:19:403
2801499204,15cyclictest11527-21sensors10:40:242
28014992017,2cyclictest537-21snmpd12:31:412
28014992017,2cyclictest32-21ksoftirqd/209:23:022
28012992017,2cyclictest537-21snmpd12:19:491
28012992017,2cyclictest537-21snmpd11:46:241
2801299200,20cyclictest0-21swapper/112:11:091
28007992017,2cyclictest7276-21cron12:39:560
2801799190,1cyclictest0-21swapper/311:36:093
2801799190,0cyclictest0-21swapper/311:10:373
2801499192,5cyclictest24579-21load12:25:162
28014991918,1cyclictest20925-21kworker/u8:011:13:362
2801499191,1cyclictest311rcuc/209:47:122
28012991917,2cyclictest25-21ksoftirqd/109:39:371
28012991916,2cyclictest537-21snmpd09:25:461
28007991917,1cyclictest537-21snmpd09:37:410
2801799182,0cyclictest0-21swapper/312:09:263
2801799180,1cyclictest0-21swapper/310:50:213
2801799180,1cyclictest0-21swapper/310:50:203
2801499189,2cyclictest32-21ksoftirqd/211:26:592
28014991816,1cyclictest537-21snmpd12:00:482
2801499181,3cyclictest141rcu_preempt09:15:182
2801499181,11cyclictest0-21swapper/207:30:132
2801499180,18cyclictest0-21swapper/209:11:542
2801299186,10cyclictest0-21swapper/108:25:141
2801299180,17cyclictest0-21swapper/110:33:011
28007991815,2cyclictest537-21snmpd10:01:090
2800799181,4cyclictest1557-21ssh10:35:120
2800799180,15cyclictest0-21swapper/007:20:140
2800799180,0cyclictest0-21swapper/010:05:160
260922180,1sleep30-21swapper/311:47:213
2801799173,5cyclictest4136-21apt-get08:35:143
28017991714,2cyclictest537-21snmpd11:20:173
2801799170,1cyclictest0-21swapper/312:00:503
28014991715,1cyclictest32-21ksoftirqd/211:45:042
28012991714,2cyclictest537-21snmpd10:10:511
2801299170,16cyclictest0-21swapper/109:42:071
28007991715,1cyclictest553-21sshd11:07:340
28007991715,1cyclictest553-21sshd09:24:320
2800799171,2cyclictest0-21swapper/010:44:530
2801799160,0cyclictest0-21swapper/309:16:423
28014991615,1cyclictest311rcuc/212:15:582
28014991613,2cyclictest537-21snmpd11:00:152
2801499161,2cyclictest141rcu_preempt10:05:162
2801499161,13cyclictest32-21ksoftirqd/211:24:392
28014991610,2cyclictest32-21ksoftirqd/207:50:522
2801299163,9cyclictest1086-21sensors09:55:241
28012991616,0cyclictest0-21swapper/111:35:311
2801299160,15cyclictest0-21swapper/111:01:111
28007991614,1cyclictest21387-21ssh10:27:080
2801799153,6cyclictest31596-21apt-get08:25:143
2801799151,1cyclictest0-21swapper/312:36:093
2801799150,2cyclictest0-21swapper/309:59:163
2801799150,1cyclictest0-21swapper/311:42:273
2801799150,1cyclictest0-21swapper/310:42:033
2801799150,0cyclictest0-21swapper/311:51:433
2801499150,13cyclictest0-21swapper/210:50:132
2801499150,13cyclictest0-21swapper/210:50:122
2801499150,12cyclictest0-21swapper/210:55:092
2801499150,0cyclictest141rcu_preempt09:52:302
28012991512,2cyclictest14331-21apt-get09:45:011
2801299150,15cyclictest0-21swapper/112:20:191
2801299150,13cyclictest0-21swapper/112:00:131
28007991513,1cyclictest537-21snmpd12:28:190
2800799150,8cyclictest7972-21ntpq12:15:180
2800799150,1cyclictest0-21swapper/009:10:350
2800799150,15cyclictest0-21swapper/010:49:110
28017991412,1cyclictest13804-21apache212:23:093
28017991411,2cyclictest19400-21ls07:59:593
2801799140,1cyclictest0-21swapper/310:55:193
2801799140,0cyclictest0-21swapper/309:31:313
2801499149,4cyclictest32-21ksoftirqd/212:06:152
2801499142,2cyclictest141rcu_preempt08:05:222
28014991413,1cyclictest311rcuc/209:43:492
2801499141,1cyclictest141rcu_preempt10:46:122
28014991411,2cyclictest29597-21cut11:30:142
2801499140,3cyclictest0-21swapper/209:39:172
2801299149,4cyclictest10694-21wc10:20:261
2801299145,8cyclictest30523-21ssh09:15:181
2801299141,3cyclictest20595-21diskmemload10:39:231
28012991413,1cyclictest20595-21diskmemload11:27:211
28012991412,1cyclictest537-21snmpd11:30:391
28012991412,1cyclictest38150irq/131-snd_hda09:50:141
28012991411,2cyclictest5424-21wc11:15:251
28012991411,2cyclictest537-21snmpd10:06:361
28012991410,3cyclictest23138-21sort12:05:161
2801299140,13cyclictest3356-21ssh12:31:561
2801299140,13cyclictest0-21swapper/111:05:431
2800799149,4cyclictest13-21ksoftirqd/008:55:110
2800799145,6cyclictest24593-21ssh10:10:140
2800799142,6cyclictest21161-21idleruntime-cro11:45:000
2800799141,7cyclictest20586-21apt-get09:10:010
2800799140,14cyclictest0-21swapper/011:26:570
2801799132,3cyclictest0-21swapper/310:34:103
28017991311,1cyclictest537-21snmpd10:07:303
28017991310,2cyclictest9430-21sed10:20:153
28017991310,2cyclictest5092-21basename07:30:013
28017991310,2cyclictest24256-21sed12:25:153
28017991310,2cyclictest16171-21wc07:50:213
28017991310,2cyclictest15801-21cron09:00:003
28017991310,2cyclictest13373-21sh08:55:003
2801799130,12cyclictest22891-21cat09:50:003
2801499139,3cyclictest32-21ksoftirqd/211:40:062
2801499139,3cyclictest12491-21tr08:50:222
2801499137,2cyclictest32-21ksoftirqd/210:23:152
2801499135,4cyclictest32-21ksoftirqd/211:53:162
2801499132,5cyclictest341-21sed08:25:232
28014991310,2cyclictest30442-21tr08:20:212
28014991310,2cyclictest29845-21sed07:10:242
28014991310,2cyclictest18697-21chrt12:21:402
28014991310,2cyclictest1059-21grep10:35:002
2801299139,2cyclictest18277-21cat07:55:201
2801299139,2cyclictest12525-21wc08:50:221
28012991311,1cyclictest537-21snmpd10:52:521
28012991311,1cyclictest537-21snmpd10:52:521
28012991310,2cyclictest28309-21cut07:10:131
28012991310,2cyclictest25537-21grep08:10:201
28012991310,2cyclictest23309-21wc09:30:191
28012991310,2cyclictest22170-21cut08:05:161
28012991310,2cyclictest19233-21head09:05:161
28012991310,2cyclictest12623-21grep07:45:141
2801299130,13cyclictest0-21swapper/111:50:131
2801299130,12cyclictest8455-21grep07:35:161
2800799139,3cyclictest28998-21head07:10:160
2800799132,7cyclictest0-21swapper/009:30:430
28007991310,2cyclictest32717-21grep12:10:250
28007991310,2cyclictest32705-21head12:30:160
28007991310,2cyclictest31702-21cat11:50:240
28007991310,2cyclictest31167-21df07:15:160
28007991310,2cyclictest21786-21cron08:04:590
28007991310,2cyclictest15062-21grep12:00:170
28007991310,2cyclictest12007-21grep08:50:170
78332120,2sleep3381rcuc/307:35:143
290252120,0sleep00-21swapper/012:08:590
2801799129,2cyclictest6193-21tr11:55:143
2801799129,2cyclictest32160-21cat12:30:133
2801799129,2cyclictest24894-21tr10:10:153
2801799120,0cyclictest0-21swapper/309:25:423
2801499129,2cyclictest20165-21grep11:05:182
2801499129,2cyclictest17958-21grep07:55:172
2801499129,2cyclictest1188-21wc09:55:262
2801499128,3cyclictest5552-21grep11:15:262
2801499120,11cyclictest4607-21tail07:25:262
2801299129,2cyclictest9011-21cut08:45:141
2801299129,2cyclictest30861-21tr07:15:151
2801299129,2cyclictest17714-21grep09:00:251
2801299129,2cyclictest12065-21chrt11:20:081
2801299129,2cyclictest11830-21sed07:40:261
2801299128,3cyclictest20028-21awk10:45:261
28012991211,1cyclictest0-21swapper/111:41:551
28012991210,1cyclictest8220-21sed08:40:261
2801299120,1cyclictest0-21swapper/111:55:191
2800799129,2cyclictest5477-21grep11:15:240
2800799129,2cyclictest31053-21head09:15:220
2800799129,2cyclictest28387-21cat08:15:250
2800799129,2cyclictest13301-21grep11:20:190
2800799129,2cyclictest11756-21head11:00:150
2800799121,5cyclictest7476-21perf07:35:010
2801799118,2cyclictest7484-21wc08:40:173
2801799118,2cyclictest7304-21cut09:40:163
2801799118,2cyclictest22143-21aten2_r7power_p08:05:153
2801799118,2cyclictest20584-21latency_hist09:09:593
2801799118,2cyclictest10358-21grep07:40:153
2801799113,4cyclictest225-21systemd-journal09:05:003
2801799113,3cyclictest225-21systemd-journal07:19:233
2801799111,2cyclictest0-21swapper/308:00:143
2801499118,2cyclictest9179-21sh11:56:292
2801499118,2cyclictest748-21wc10:15:142
2801499118,2cyclictest6244-21dump-pmu-power08:40:002
2801499118,2cyclictest25060-21cut08:10:172
2801499118,2cyclictest2242-21tail07:20:272
2801499118,2cyclictest19702-21tr09:05:212
2801499118,2cyclictest16802-21grep09:00:162
2801499117,3cyclictest32-21ksoftirqd/207:35:192
2801499115,2cyclictest225-21systemd-journal08:59:422
2801499113,4cyclictest225-21systemd-journal08:49:552
2801299118,2cyclictest6568-21head07:30:231
2801299118,2cyclictest6402-21ssh09:20:171
2801299118,2cyclictest6112-21ssh10:56:371
2801299118,2cyclictest6102-21taskset08:38:261
2801299118,2cyclictest30822-21sed08:20:261
2801299118,2cyclictest27745-21grep08:15:181
2801299118,2cyclictest21063-21ssh09:10:031
2801299118,2cyclictest17009-21chrt07:54:551
2801299118,2cyclictest15395-21head08:55:231
2801299118,2cyclictest13556-21ssh12:38:231
2801299118,2cyclictest1316-21tail07:20:171
2800799118,2cyclictest8784-21ssh10:58:430
2800799118,2cyclictest6238-21grep11:35:210
2800799118,2cyclictest30411-21sed08:20:200
2800799118,2cyclictest29912-21ssh11:10:380
2800799118,2cyclictest25845-21expr10:30:110
2800799118,2cyclictest24893-21rm11:46:250
2800799118,2cyclictest24818-21expr08:10:150
2800799118,2cyclictest18429-21tr07:55:210
2800799118,2cyclictest15898-21cut09:45:170
2800799118,2cyclictest14645-21sh07:50:000
2800799118,2cyclictest11098-21cat07:40:190
2800799118,2cyclictest11008-21taskset09:42:260
28007991110,1cyclictest4228-21ssh09:57:350
2800799110,9cyclictest0-21swapper/010:20:130
2801799108,1cyclictest7620-21cat07:35:003
2801799108,1cyclictest2423-21tune2fs08:30:173
2801799108,1cyclictest12961-21expr07:45:163
2801799107,2cyclictest29321-21needreboot07:10:183
2801799107,2cyclictest29285-21wget08:20:143
2801799107,2cyclictest27261-21expr08:15:143
2801799107,2cyclictest24400-21chrt08:10:083
2801799107,2cyclictest10803-21ssh11:00:073
2801799107,2cyclictest1077-21df07:20:153
2801799100,9cyclictest10734-21taskset08:46:393
2801499108,1cyclictest8250-21users08:40:252
2801499108,1cyclictest18512sleep208:30:132
2801499107,2cyclictest27544-21tail08:15:172
2801499107,2cyclictest10852-21head07:40:172
2801499102,5cyclictest32-21ksoftirqd/207:20:012
2801299109,1cyclictest12766-21ssh10:41:061
2801299108,1cyclictest8760-21basename10:00:181
2801299108,1cyclictest4964-21chrt07:28:431
2801299107,2cyclictest19811-21grep08:00:151
2801299107,2cyclictest1868-21awk08:30:131
2801299107,2cyclictest1346-21tail10:15:161
2800799108,1cyclictest6859-21ls08:40:140
2800799108,1cyclictest29716-21grep11:30:150
2800799108,1cyclictest25923-21rm09:50:520
2800799108,1cyclictest2132-21ssh10:15:250
2800799108,1cyclictest16741-21fschecks_time09:00:160
2800799108,1cyclictest16303-21sed12:20:200
2800799107,2cyclictest9801-21taskset07:39:490
2800799107,2cyclictest3697-21head07:25:160
2800799107,2cyclictest16306-21ssh09:25:460
2800799105,2cyclictest225-21systemd-journal08:35:000
2800799100,9cyclictest8920-21basename08:45:130
2800799100,4cyclictest225-21systemd-journal08:10:000
2800799100,10cyclictest0-21swapper/008:25:140
280149997,1cyclictest19660-21cat08:00:122
280079998,1cyclictest2720-21expr08:30:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional